Title,Citation,Topic_area,Study_type,Study_evidence_rating,Outcome_effectiveness,Findings,Intervention_program,Topics,Target_population,Firm_characteristics,Geographic_setting,Original_publication_date,Original_publication_link "Synthesis Report: Evidence on the Effects of OSHA Activities",,"OSHA Enforcement",,,,"Findings: According to the research, there is some evidence that OSHA inspections reduce injury rates, on average. Some recent research has strong current relevance and provides valuable descriptive information, but low causal evidence on the impact of inspections. There is little information on the characteristics of OSHA inspections and other OSHA activities.","OSHA Enforcement Activities",Inspections,,,,, "Synthesis Report: Evidence on the Effectiveness of the National Guard Youth ChalleNGe Program",,"Opportunities for Youth",,,,"Findings: Research provides strong evidence that NGYCP improves the educational outcomes of at-risk youth. There is also strong evidence that NGYCP improves the labor market outcomes of at-risk youth. A cost-benefit analysis found NGYCP produced large positive benefits. NGYCP is a multi-component intervention, with little evidence on the effectiveness of specific components.","the National Guard Youth ChalleNGe Program",,,,,, "Synthesis Report: Evidence on the Effectiveness of Career Academies for High School Students",,"Career Academies",,,,"Findings: Career Academies produced strong and sustained increases in students’ post-high school earnings. These impacts were concentrated among young men. Career Academies did not increase educational attainment. Implementing all three program components proved somewhat challenging.","Career Academies",,"Youth, Adult",,,, "Synthesis Report: Research Synthesis: Employment Programs and Demonstrations for SSI and SSDI Beneficiaries",,"Disability Employment Policy",,,,"Findings: Evidence echoes previous literature reviews on the challenges of generating substantive impacts, though customized supports to well-targeted populations show some potential. The most effective interventions provided intensive, customized supports and services focused on job training, placement, and retention to narrowly defined target populations. Interventions that provided support services or incentives to help beneficiaries keep more of their benefits when working had small or no impacts on employment, even if spending on services was high. There is no evidence of SSI or SSDI caseload reductions, even among interventions that improved employment and/or earnings. Little is known about interventions for improving earnings of people with TBI and PTSD. Recruiting beneficiaries to participate in demonstrations was difficult, which limited the generalizability of study findings. Fidelity to the demonstration model is important. Work incentives and supports can be difficult to implement in the context of SSA’s existing work incentives, creating potential confusion for beneficiaries and program staff. A strong technical assistance component, with incentives for service providers to accept the assistance, is important to successful implementation. Demonstrations should be pilot tested before being implemented on a national scale.",,,Disability,,,, "Synthesis Report: Research Synthesis: Opportunities for Youth",,"Opportunities for Youth",,,,"Findings: Successful programs often involved a substantial time commitment from participating youth. Many successful programs involved a job placement component or job search assistance. Positive impacts tended to be realized in the short term and fade over time. More information is needed on the replicability of some programs.",,"Youth programs","Youth, Disconnected youth",,,, "Synthesis Report: Reemployment Synthesis",,Reemployment,,,,"Findings: The majority of reemployment interventions reduced weeks of benefit receipt and amount of benefits paid. The reemployment interventions had varying degrees of effectiveness. The Reemployment and Eligibility Assistance (REA) program boosted short-and long-term employment and earnings. Job search assistance (JSA) services had favorable impacts on all outcomes examined, but employment and earnings impacts varied over time. Reemployment bonuses appear to work in the short term, but their long-term effects are not known. Lighter-touch interventions, such as profiling and changing employer contact requirements,yield more limited benefits.",,"Job search assistance and supportive services Other employment and reemployment Unemployment Insurance",Unemployed,,"United States",, "Synthesis Report: Behavioral Finance Synthesis: Findings",,"Behavioral Finance: Retirement",,,,"Findings: People have relatively limited knowledge about saving for retirement and can be induced to save more when provided with additional information. Making retirement more salient, by having people think of themselves in retirement or providing a target retirement date, can increase intentions to save and alter investment choices. People can become overwhelmed by the number of investment options they face; when this occurs, they tend to use simple rules to make decisions.",,"Employer provided retirement benefits","Adult, Older worker",,"United States",, "Synthesis Report: Behavioral Finance Synthesis: Gaps",,"Behavioral Finance: Retirement",,,,"Findings: Many studies have demonstrated a relationship between default options and behavior. Taken together, these studies suggest that default options can affect investment behavior. But no study produces strong causal evidence on the impacts of defaults on its own. There is little evidence available on how the impacts of behavioral interventions designed to influence retirement savings vary by employee age, gender, income, or race. There is little evidence available on how the impacts of behavioral interventions designed to influence retirement affect total savings.",,,,,,, "Encouraging evidence on a sector-focused advancement strategy","Hendra, R., Greenberg, D. H., Hamilton, G., Oppenheim, A. Pennington, A. Schaberg, K., and Tessler, B. L. (2016). Encouraging evidence on a sector-focused advancement strategy. New York: MDRC. [Towards Employment]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine the impact of the WorkAdvance sectoral training program at the Towards Employment site on employment, earnings, education, and training from 2011 to 2015. The authors investigated similar research questions with three other sites, the profiles of which are available here. The study used a randomized controlled trial design to compare the treatment group, which was able to access the WorkAdvance program at the Towards Employment site, and the control group, which was not eligible for WorkAdvance services but could access other services in the community. The authors collected data from two sources: a follow-up survey and unemployment insurance (UI) wage and employment data. Using survey data, the authors found that those in the treatment group were significantly more likely to complete education or training compared with those in the control group. The authors found no statistically significant impacts of the program on employment or earnings from either the UI data or survey data. The quality of the causal evidence is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the WorkAdvance program at the Towards Employment site and not to other factors.","the WorkAdvance sectoral training program","Work based and other occupational training","Low income",,"Urban, United States",2020,https://files.eric.ed.gov/fulltext/ED568395.pdf "Oregon Credentials, Acceleration and Support for Employment (CASE) evaluation report: Results, key issues and implications for policy, practice and systems","Watrus, B., & Fercho, H. (2015). Oregon Credentials, Acceleration and Support for Employment (CASE) evaluation report: Results, key issues and implications for policy, practice and systems. Retrieved from https://www.roguecc.edu/Programs/CareerPathways/pdf/CASE%20final%20evaluation%20report_Final.pdf","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the Credentials, Acceleration and Support for Employment (CASE) program on education and employment outcomes. The authors used a nonexperimental design to compare the outcomes of students who were in the CASE program to a matched comparison group. The study found a positive relationship between participation in the CASE program and program completion and employment; however, the study did not include tests of statistical significance. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar or use sufficient. This means we are not confident that the estimated effects are attributable to the CASE program; other factors are likely to have contributed.","the Credentials, Acceleration and Support for Employment (CASE) Program","Capacity building programs Community college education and other classroom training","Adult, Dislocated or displaced worker, Unemployed, Other",,"United States",2020,https://www.roguecc.edu/Programs/CareerPathways/pdf/CASE%20final%20evaluation%2… "Evaluation of impacts of the Reemployment and Eligibility Assessment (REA) Program: Final report","Klerman, J. A., Saunders, C., Dastrup, E., Epstein, Z., Walton, D., Adam, T., & Barnow, B. S. (2019). Evaluation of impacts of the Reemployment and Eligibility Assessment (REA) Program: Final report. Cambridge, MA: Abt Associates. [Comparison between existing REA services group and control group]",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Reemployment and Eligibility Assessment (REA) program in four states on people’s public benefit receipt, employment, and earnings. The authors investigated similar research questions for three other contrasts, the profiles of which are available using the study search. The authors used a randomized controlled trial to compare the public benefit, earnings, and employment outcomes among unemployment insurance (UI) claimants randomly assigned to each state’s existing REA program or a control group. The authors drew on state administrative records from the UI benefit and case management systems for 28 weeks after random assignment and National Directory of New Hires data for two years after random assignment. The study found that, across the states, the existing REA treatment group received significantly fewer weeks and dollars of UI benefits than the control group did, and the existing REA treatment group had higher employment, longer job tenure, and higher earnings than the control group in the first or second year after random assignment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the REA program and not to other factors.","the Reemployment and Eligibility (REA) Program","RESEA Unemployment Insurance",Unemployed,,"United States",2019,https://www.dol.gov/sites/dolgov/files/OASP/evaluation/pdf/REA%20Impact%20Study… "Evaluation of impacts of the Reemployment and Eligibility Assessment (REA) Program: Final report","Klerman, J. A., Saunders, C., Dastrup, E., Epstein, Z., Walton, D., Adam, T., & Barnow, B. S. (2019). Evaluation of impacts of the Reemployment and Eligibility Assessment (REA) Program: Final report. Cambridge, MA: Abt Associates. [Comparison between partial REA treatment group and control group]",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Reemployment and Eligibility Assessment (REA) program in four states (Indiana, New York, Washington, and Wisconsin) on people’s public benefit receipt, employment, and earnings. The authors investigated similar research questions for three other contrasts, the profiles of which are available using the study search. The authors used a randomized controlled trial to compare public benefit receipt and employment outcomes among unemployment insurance (UI) claimants randomly assigned to a partial REA treatment group or a control group. The authors drew on state administrative records from the UI benefit and case management systems for 28 weeks after random assignment and National Directory of New Hires data for two years after random assignment. The study found that, across the four states, the partial REA treatment group received significantly fewer weeks of UI benefits. The study found no statistically significant differences between the groups in the number of quarters employed or longest job tenure one or two years after random assignment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the REA program and not to other factors.","the Reemployment and Eligibility (REA) Program","RESEA Unemployment Insurance",Unemployed,,"United States",2019,https://www.dol.gov/sites/dolgov/files/OASP/evaluation/pdf/REA%20Impact%20Study… "Evaluation of impacts of the Reemployment and Eligibility Assessment (REA) Program: Final report","Klerman, J. A., Saunders, C., Dastrup, E., Epstein, Z., Walton, D., Adam, T., & Barnow, B. S. (2019). Evaluation of impacts of the Reemployment and Eligibility Assessment (REA) Program: Final report. Cambridge, MA: Abt Associates. [Comparison between existing REA group and partial REA group]",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Reemployment and Eligibility Assessment (REA) program in four states (Indiana, New York, Washington, and Wisconsin) on people’s public benefit receipt, employment, and earnings. The authors investigated similar research questions for three other contrasts, the profiles of which are available using the study search. The authors used a randomized controlled trial to compare public benefit receipt and employment outcomes among unemployment insurance (UI) claimants randomly assigned to each state’s existing REA program as well as with a partial REA condition. The authors drew on state administrative records from the UI benefit and case management systems for 28 weeks after random assignment and National Directory of New Hires data for two years after random assignment. The study found that the existing REA treatment group received significantly fewer weeks of UI benefits and worked significantly more quarters than the partial REA treatment group. These findings were consistent in some of the individual states. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the REA program and not to other factors.","the Reemployment and Eligibility (REA) Program","RESEA Unemployment Insurance",Unemployed,,"United States",2019,https://www.dol.gov/sites/dolgov/files/OASP/evaluation/pdf/REA%20Impact%20Study… "Evaluation of impacts of the Reemployment and Eligibility Assessment (REA) Program: Final report","Klerman, J. A., Saunders, C., Dastrup, E., Epstein, Z., Walton, D., Adam, T., & Barnow, B. S. (2019). Evaluation of impacts of the Reemployment and Eligibility Assessment (REA) Program: Final report. Cambridge, MA: Abt Associates. [Comparison between multiple REA treatment group and single REA treatment group]",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Reemployment and Eligibility Assessment (REA) program in four states (Indiana, New York, Washington, and Wisconsin) on people’s public benefit receipt, employment, and earnings. The authors investigated similar research questions for three other contrasts, the profiles of which are available using the study search. The authors used a randomized controlled trial to compare public benefit receipt outcomes among unemployment insurance (UI) claimants randomly assigned to states’ multiple REA treatment group as well as with the single REA treatment group. The authors drew on state administrative records from the UI benefit and case management systems for 28 weeks after random assignment. For this contrast, the study used data from New York and Washington. The study found that weeks of UI benefits were significantly lower for the multiple REA treatment group than the single REA treatment group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the REA program and not to other factors.","the Reemployment and Eligibility (REA) Program","RESEA Unemployment Insurance",Unemployed,,"United States",2019,https://www.dol.gov/sites/dolgov/files/OASP/evaluation/pdf/REA%20Impact%20Study… "The effect of participation in a Title V program on Latinx student success at a community college","Lacagnino, S. N. (2019). The effect of participation in a Title V program on Latinx student success at a community college. (Unpublished doctoral dissertation). Seton Hall University, South Orange, NJ.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to determine the impact of participation in the Project Accel program on education outcomes for community college students. The study used a nonexperimental design to compare the outcomes of students who participated in the Project Accel program with those who did not, based on administrative data from the community college. Using several demographic characteristics, the author created a matched comparison group of students who were not in the program to assess the effectiveness of the program on course completion, program persistence, and fall-to-fall retention. For the accelerated English as a Second Language (ESL) program, the study found that program participation was significantly related to higher completion, persistence, and retention rates. For the accelerated developmental English program, the study found that program participation was significantly related to higher completion and persistence rates. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Project Accel program; other factors are likely to have contributed.","the Project Accel program","Community college education and other classroom training","Adult, Hispanic of any race",,"United States",2019,https://scholarship.shu.edu/dissertations/2642/ "Reflections on Accelerating CTE: Final evaluation report","Smith, T. (2019). Reflections on Accelerating CTE: Final evaluation report. Washington, DC: JFF.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Accelerating Career & Technical Education (CTE) program on community college students’ credential completion. The author compared outcomes before the implementation of the Accelerating CTE program and during the program using an interrupted time-series (ITS) design based on aggregate college data. The study participants were enrolled in Accelerating CTE programs, including health career and applied technologies pathways. The study found that participating in the Accelerated CTE program was associated with an increase in credential completion. However, the study did not include tests of statistical significance. The quality of causal evidence presented in this report is low because the author did not account for trends in outcomes before the intervention. This means we are not confident that the effects are attributable to the Accelerating CTE program; other factors are likely to have contributed.","Accelerating Career & Technical Education (CTE) Program","Community college education and other classroom training","Adult, Other barriers",,"Rural, United States",2019,https://files.eric.ed.gov/fulltext/ED598367.pdf "Effects of a two-generation human capital program on low-income parents' education, employment, and psychological wellbeing.","Chase-Lansdale, P. L., Sabol, T. J., Eckrich Sommer, T., Chor, E., Cooperman, A. W., Brooks-Gunn, J., Yoshikawa, H., King, C., & Morris, A. (2019). Effects of a two-generation human capital program on low-income parents’ education, employment, and psychological wellbeing. Journal of Family Psychology, 33(4), 433-443.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-Mixed impacts Employment","Summary: The study’s objective was to examine the impact of CareerAdvance on education, employment, and earnings outcomes. The study used a nonexperimental design to compare the outcomes of parents who participated in CareerAdvance to outcomes of parents who did not participate. The study found that parents in the treatment group had significantly higher rates of certification, more years of education, and higher rates of enrollment in education and training programs than parents in the comparison group. The treatment group also had significantly higher rates of employment in the healthcare sector, higher rates of part-time employment, and worked more irregular hours than the comparison group. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the CareerAdvance program, but other factors might also have contributed.","CareerAdvance Program","Capacity building programs Community college education and other classroom training","Adult, Parent, Low income",,"United States",2019,https://www.semanticscholar.org/paper/Effects-of-a-two-generation-human-capital… "WIOA impacts on community college student success (Doctoral dissertation).","Crumpton, J. A. (2019). WIOA impacts on community college student success (Doctoral dissertation). Retrieved from ProQuest Dissertations and Theses database. (UMI No. 13861007).","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of a workforce development program administered by a community college under the Workforce Innovation and Opportunity Act (WIOA) on education outcomes. This summary focuses on the comparison between WIOA program participants and non-participants. The author used a nonexperimental design to compare WIOA program student education outcomes (measured by degree or certificate attainment) to the outcomes of students with similar backgrounds (Pell Grant recipients) who were not enrolled in WIOA. Data from the community college were used to examine education success rates over the course of three years (2014-2017). The study found that WIOA program participants were significantly more likely to attain a degree or certificate than students who were not enrolled in the WIOA program. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention.This means we are not confident that the estimated effects are attributable to the WIOA Program; other factors are likely to have contributed","Workforce Innovation and Opportunity Act (WIOA) program","Basic skills Capacity building programs Community college education and other classroom training Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) training programs","Adult, Low income",,"Rural, United States",2019,https://search.proquest.com/openview/f270d29734cd670349c3aed2866ce41a/1?pq-orig… "WIOA impacts on community college student success (Doctoral dissertation).","Crumpton, J. A. (2019). WIOA impacts on community college student success (Doctoral dissertation). Retrieved from ProQuest Dissertations and Theses database. (UMI No. 13861007).","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of a workforce development program administered by a community college under the Workforce Innovation and Opportunity Act (WIOA) on education outcomes. This summary focuses on the comparison between the community college WIOA program participants and the state workforce WIOA program participants. The author used a nonexperimental design to compare WIOA program student education outcomes (measured by degree or certificate attainment) to the outcomes of participants in WIOA programs administered by entities other than community colleges (throughout the state). Data from the community college and the State Board for Workforce Development were used to examine education success rates over the course of three years (2014-2017). The study found that WIOA program participants were significantly more likely to attain a degree or certificate than participants who entered the WIOA program through a state workforce development board. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention.This means we are not confident that the estimated effects are attributable to the WIOA program; other factors are likely to have contributed","Workforce Innovation and Opportunity Act (WIOA) program","Basic skills Capacity building programs Community college education and other classroom training Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) training programs","Adult, Low income",,"Rural, United States",2019,https://search.proquest.com/openview/f270d29734cd670349c3aed2866ce41a/1?pq-orig… "Information technology career preparation for rural areas.","Hahs-Vaughn, D. L., Swan, B., & Clark, M. H. (2019). Information technology career preparation for rural areas. Community College Journal of Research and Practice, 1-13.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the Florida Information Technology Careers for Rural Areas (XCEL-IT) program on education, employment, and earnings outcomes. The authors used a nonexperimental design to compare the differences in outcomes between XCEL-IT program participants and a comparison group. The study found that XCEL-IT program participation was significantly related to program completion. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the XCEL-IT program; other factors are likely to have contributed.","the Florida Information Technology Careers for Rural Areas (XCEL-IT)","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Unemployed, Veteran or military",,"Rural, United States",2019, "An analysis of the Veterans Employment Initiative","Moses-Stanton, S. (2018). An analysis of the Veterans Employment Initiative. (Doctoral dissertation). Retrieved from ProQuest. Accession No. 10745075.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact Presidential Executive Order 13518 (EO13518) had on the employment of veterans who served in the military starting in September 2001 (Gulf War II-era veterans). The author used graphical analysis to examine employment outcomes for veterans and non-veterans after the implementation of EO13518. The study used Integrated Public Use Microdata Series (IPUMS USA) data for the years 2008, 2009, 2014, and 2015. The study did not show evidence of a relationship between the implementation of EO13518 and employment of Gulf War II-era veterans. The study did not statistically compare the employment of the veterans and non-veterans following implementation of the Executive Order. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we would not be confident that any estimated effects would be attributable to the implementation of EO13518; other factors would be likely to have contributed to the findings. However, the study did not find statistically significant effects.","Executive Order 13518","Job search assistance and supportive services Veterans' reemployment","Veteran or military",,"United States",2018,https://search.proquest.com/openview/c2ddd5b8502115f80bf2a7352fe1e281/1?cbl=187… "Heroes for Hire (H4H) program evaluation final report","Horwood, T., Campbell, J., McKinney, M., & Bishop, M. (2018). Heroes for Hire (H4H) program evaluation final report. Fairfax, VA: ICF.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Heroes for Hire (H4H) program on education and earnings outcomes. The authors used a nonexperimental design to compare the education outcomes of H4H program participants to a matched comparison group of students enrolled at the same college, at the same point of entry. and in similar programs of study. The authors also compared the earnings outcomes of students before and after participating in the H4H program. The study found that H4H participants were significantly more likely to complete the program and attain credit hours than the comparison group. In addition, participation in the H4H program was significantly associated with higher post-enrollment salaries compared to initial enrollment salaries. The quality of causal evidence presented in this study is low for the education outcomes because the authors did not ensure that the groups being compared were similar before the intervention nor include sufficient control variables. The quality of causal evidence is also low for the earnings outcomes because the authors did not account for trends in outcomes before the intervention. This means we are not confident that the estimated effects are attributable to the H4H program; other factors are likely to have contributed.","the Heroes for Hire (H4H) Program","Capacity building programs Community college education and other classroom training","Adult, Veteran or military",,"United States",2018, "University of the District of Columbia - Final annual evaluation report TAACCCT grant program, round 4","Hendricks, A., Mitran, A., & Ferroggiaro, E. (2018). University of the District of Columbia - Final annual evaluation report TAACCCT grant program, round 4 (Contract #: PO-GF-2015-C-0134-DJ). Fairfax, VA: ICF.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the University of the District of Columbia Community College (UDC-CC) grant-funded healthcare and hospitality programs on education, earnings, and employment outcomes. This summary focuses on the healthcare program. The authors used a randomized controlled trial to compare the education, employment, and earnings outcomes of participants enrolled in healthcare pathway courses and received the contextualized learning program, compared to participants enrolled in the same program, who received the traditional curriculum. The study found that program participation was significantly related to increased credential attainment. The quality of causal evidence presented in this report is low because it was based on a randomized controlled trial with unknown attrition and the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the UDC-CC grant-funded healthcare program; other factors are likely to have contributed.","the University of the District of Columbia Community College (UDC-CC) TAACCCT Healthcare program","Basic skills Capacity building programs Community college education and other classroom training","Adult, Low-skilled",,"United States",2018, "University of the District of Columbia - Final annual evaluation report TAACCCT grant program, round 4 ","Hendricks, A., Mitran, A., & Ferroggiaro, E. (2018). University of the District of Columbia - Final annual evaluation report TAACCCT grant program, round 4 (Contract #: PO-GF-2015-C-0134-DJ). Fairfax, VA: ICF.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the University of the District of Columbia Community College (UDC-CC) grant-funded healthcare and hospitality programs on earnings and employment outcomes. This summary focuses on the hospitality program. The authors used a nonexperimental design to compare the earnings and employment outcomes of participants before and after they participated in the grant-funded hospitality program. The study found that program participation was significantly related to increased earnings. The quality of causal evidence presented in this study is low because the authors did not observe outcomes for multiple time points before the intervention nor account for selection into the intervention. This means we are not confident that the estimated effects are attributable to the UDC-CC grant-funded hospitality program; other factors are likely to have contributed.","the University of the District of Columbia Community College (UDC-CC) TAACCCT Hospitality program","Basic skills Capacity building programs Community college education and other classroom training","Adult, Low-skilled",,"United States",2018, "Evaluation of commercially available seat suspensions to reduce whole body vibration exposures in mining heavy equipment vehicle operators","Kim, J. H., Marin, L. S., & Dennerlein, J. T. (2018). Evaluation of commercially available seat suspensions to reduce whole body vibration exposures in mining heavy equipment vehicle operators. Applied Ergonomics, 71, 78-86. https://doi.org/10.1016/j.apergo.2018.04.003","Mine Workers and Mine Health and Safety","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Health and safety-Mod/high-Mixed impacts Health and safety","Summary: The study’s objective was to examine the impact of seat suspension systems on mine worker health and safety outcomes. The study was a randomized controlled trial conducted in a laboratory setting. The authors examined differences in whole body vibration (WBV) exposure between different seat suspension systems for three mining heavy equipment vehicles. The study found that seats with active vertical suspension were significantly more effective in reducing WBV exposure compared to the passive suspension seats. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the different seat suspension systems, and not to other factors.",,"Mine safety and health Workplace injury",Adult,,"United States",2018,https://doi.org/10.1016/j.apergo.2018.04.003 "Improving the labor market outcomes of U.S. veterans: The long-run effect of the Transition Assistance Program","Li, X. (2018). Improving the labor market outcomes of U.S. veterans: The long-run effect of the Transition Assistance Program. New York: Syracuse University.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact the Transitional Assistance Program (TAP) had on outcomes related to employment, earnings, and education. The study used statistical models to compare veterans who had been offered and received TAP to veterans who were not offered TAP. Data came from the veterans supplement of the Current Population Survey for survey years 1995 to 2010. The study found positive associations between participation in TAP and employment, earnings, and education. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to TAP; other factors are likely to have contributed to the findings.","the Transitional Assistance Program","Job search assistance and supportive services Veterans' reemployment Other training and education","Dislocated or displaced worker, Veteran or military",,"United States",2018, "Long-term effects of job-search assistance: Experimental evidence using administrative tax data","Manoli, D. S., Michaelides, M., & Patel, A. (2018). Long-term effects of job-search assistance: Experimental evidence using administrative tax data. (Report no. w24422). Cambridge, MA: National Bureau of Economic Research.",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study examined the impact of the Nevada Reemployment and Eligibility Assessment (REA) program on long-term employment, earnings, and Unemployment Insurance (UI) benefit receipt. This study was a randomized controlled trial that took place in the state of Nevada and involved new UI claimants from July to December 2009. The authors used program administrative and Internal Revenue Service (IRS) tax return data to compare outcomes of participants with outcomes of the control group for six years following the intervention. The study found that participants of the Nevada REA program experienced greater increases in employment and earnings relative to the control group for each of the six years following the intervention. Additionally, the study found that participants of the Nevada REA program experienced greater decreases in UI benefit receipt relative to the control group and lower benefit amounts in the first year after program entry. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Nevada REA program, and not to other factors. See more CLEAR profiles related to The Reemployment and Eligibility Assessment.","Reemployment Eligibility Assessment","RESEA Job search assistance and supportive services","Dislocated or displaced worker, Unemployed",,"Urban, United States",2018,http://www.daymanoli.com/wp-content/uploads/2018/03/Manoli_Michaelides_Patel-nv… "Integrating economic strengthening and family coaching to reduce work-related health hazards among children of poor households: Burkina Faso","Karimli, L., Rost, L., & Ismayilova, L. (2018). Integrating economic strengthening and family coaching to reduce work-related health hazards among children of poor households: Burkina Faso. Journal of Adolescent Health, 62, S6-S14.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Health and safety-Low-No impacts Health and safety","Summary: The study’s objective was to examine the impact of the Trickle Up and Trickle Up Plus programs on children’s exposure to work-related hazards and abuse, and children’s work-related health outcomes. This summary focuses on the comparison between the Trickle Up Plus intervention group and the control group. The study was a randomized controlled trial in the Nord Region of Burkina Faso, West Africa. Using three waves of survey data administered to children and adults separately, the authors conducted statistical models to compare the outcomes of treatment and control group members. The study found that Trickle Up Plus program participation was significantly related to a reduction of hazardous work and abuse, compared with the control group. However, the study found no statistically significant relationship between the Trickle Up program and work-related health outcomes. The quality of causal evidence presented in this report is low because it was a randomized controlled trial with unknown attrition and the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Trickle Up Plus program; other factors are likely to have contributed.","Trickle Up Plus Program","Child labor Health","Female, Other, Low income",,International,2018,https://www.researchgate.net/publication/322086777_Integrating_Economic_Strengt… "Integrating economic strengthening and family coaching to reduce work-related health hazards among children of poor households: Burkina Faso","Karimli, L., Rost, L., & Ismayilova, L. (2018). Integrating economic strengthening and family coaching to reduce work-related health hazards among children of poor households: Burkina Faso. Journal of Adolescent Health, 62, S6-S14.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Health and safety-Low-No impacts Health and safety","Summary: The study’s objective was to examine the impact of the Trickle Up and Trickle Up Plus programs on children’s exposure to work-related hazards and abuse, and children’s work-related health outcomes. This summary focuses on the comparison between the Trickle Up intervention group and the control group. The study was a randomized controlled trial in the Nord Region of Burkina Faso, West Africa. Using three waves of survey data administered to children and adults separately, the authors conducted statistical models to compare the outcomes of treatment and control group members. The study found that Trickle Up program participation was significantly related to a reduction of hazardous work and abuse, compared with the control group. However, the study found no statistically significant relationship between the Trickle Up program and work-related health outcomes. The quality of causal evidence presented in this report is low because it was a randomized controlled trial with unknown attrition and the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Trickle Up program; other factors are likely to have contributed.","Trickle Up Program","Child labor Health","Female, Other, Low income",,International,2018,https://www.researchgate.net/publication/322086777_Integrating_Economic_Strengt… "Developmental students' persistence towards graduation in paired coursework programs among African American and Latino males in community colleges","Davis, E. (2018). Developmental students' persistence towards graduation in paired coursework programs among African American and Latino males in community colleges. (Doctoral dissertation). Retrieved from ProQuest Dissertations and Theses database.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of accelerated paired courses on male African American and Latino students’ academic persistence. The study used a nonexperimental design to compare the outcomes of students who completed paired coursework to students who did not. The author examined enrollment and course completion using college administrative records. The study found that students who completed paired coursework were significantly more likely to enroll in college the following semester than students in the comparison group. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the paired coursework; other factors are likely to have contributed.","Accelerated paired courses","Community college education and other classroom training","Adult, Male, Black or African American, Hispanic of any race",,"United States",2018,https://jscholarship.library.jhu.edu/handle/1774.2/59950 "The impact of developmental English learning communities on the academic performance of diverse freshmen at an urban community college","Elabid, H. (2018). The impact of developmental English learning communities on the academic performance of diverse freshmen at an urban community college (Doctoral dissertation). Retrieved from ProQuest Dissertations and Theses. (UMI No. 10826529).","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Opening Doors Learning Communities on community college students’ credit accumulation and persistence. The study used a nonexperimental design to compare the outcomes of students who participated in the Opening Doors Learning Communities (ODLC) to students who did not participate in the program. Using administrative data from the community college, the author tested for group differences in credit accumulation and persistence. When compared to non-participating students, the study did not find a significant relationship between participation in OLDC and student persistence or credit accumulation. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Opening Doors Learning Communities; other factors are likely to have contributed.","the Opening Doors Learning Communities","Community college education and other classroom training",Adult,,"United States",2018,https://search.proquest.com/openview/af06e2baf83811d1fc06d8ad9827b853/1?pq-orig… "Accelerating developmental math students in California community colleges: A comparative assessment of two acceleration models","Martinez, A. F. (2018). Accelerating developmental math students in California community colleges: A comparative assessment of two acceleration models. (Unpublished doctoral dissertation). California State University, Long Beach, CA.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of two accelerated pathway models (course redesign and compression) on completion rates for community college students. This summary focuses on the compression accelerated model. This study used a nonexperimental design to compare accelerated and non-accelerated pathways to college-level math by tracking the progress of students placed in developmental math courses. The study found that participation in the compression accelerated program was significantly related to higher college-level and developmental math completion rates for students placed in mid-level remediation. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the accelerated pathway programs; other factors are likely to have contributed.","the Compression Accelerated Model","Community college education and other classroom training","Adult, Other barriers",,"United States",2018,https://search.proquest.com/openview/adffc87f79e0373131993e9c4e2f5070/1?pq-orig… "Accelerating developmental math students in California community colleges: A comparative assessment of two acceleration models","Martinez, A. F. (2018). Accelerating developmental math students in California community colleges: A comparative assessment of two acceleration models. (Unpublished doctoral dissertation). California State University, Long Beach, CA.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to compare the impact of two accelerated pathway models (course redesign and compression) on completion rates for community college students. This summary focuses on the course redesign accelerated model. This study used a nonexperimental design to compare accelerated and non-accelerated pathways to college-level math by tracking the progress of students placed in developmental math courses. The study found that participation in the course redesign accelerated program was significantly related to higher college-level and developmental math completion rates for first-generation students and students placed in both low-level and mid-level remediation. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the course redesign accelerated model; other factors are likely to have contributed.","the course redesign accelerated model","Community college education and other classroom training","Adult, Other barriers",,"United States",2018,https://search.proquest.com/openview/adffc87f79e0373131993e9c4e2f5070/1?pq-orig… "Does AVID Higher Education (AVID HE) increase student term-to-term progression, persistence toward credited classes and social capital for first-generation college students placing into developmental education: A mixed methods study","Plinski, C. M. (2018). Does AVID Higher Education (AVID HE) increase student term-to-term progression, persistence toward credited classes and social capital for first-generation college students placing into developmental education: A mixed methods study. (Doctoral dissertation). Retrieved from ProQuest Dissertations and Theses database. (UMI No. 10825692) doi: 10.15760/etd.6311","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to assess the impact of the Advancement via Individual Determination Higher Education (AVID HE), a developmental education program, on first generation college students’ educational persistence. The study used a nonexperimental design to compare the outcomes of students who participated in AVID HE and those who did not. Using data from college institutional records, the author tested for group differences in educational persistence. The study found that AVID HE participation was significantly related to higher cumulative credits and higher enrollment rates in a credit-earning writing course. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to AVID HE; other factors are likely to have contributed.","the Advancement via Individual Determination Higher Education (AVID HE)","Community college education and other classroom training","Adult, Other barriers",,"United States",2018,http://dx.doi.org/10.15760/etd.6311 "Becoming college-ready: Early findings from a CUNY Start evaluation","Scrivener, S., Gupta, H., Weiss, M. J., Cohen, B., Cormier, M. S., & Brathwaite, J. (2018). Becoming college-ready: Early findings from a CUNY Start evaluation. New York: MDRC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Mixed impacts Education and skills gains","Summary: The study’s objective is to examine the impact of the CUNY Start program on community college students’ enrollment rates, college readiness, and credits attempted and earned. The study used a randomized controlled trial that examined data obtained from CUNY student transcripts, the CUNY Administrative Data Warehouse, and Start applications. The study found that CUNY Start participants were significantly more likely to enroll in college and become college-ready by the end of the program than students in the control group. The quality of causal evidence presented in this report is high because it is a well-implemented randomized controlled trial with low attrition. This means we are confident that the estimated effects are attributable to CUNY Start, and not to other factors.","the CUNY Start Program","Community college education and other classroom training","Adult, Other barriers",,"United States",2018,https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3269901 "Doubling graduation rates in a new state: Two-year findings from the ASAP Ohio demonstration","Sommo, C., Cullinan, D., Manno, M., Blake, S., & Alonzo, E. (2018). Doubling graduation rates in a new state: Two-year findings from the ASAP Ohio demonstration. New York: MDRC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of Ohio’s Accelerated Study in Associate Programs (ASAP) on community college students’ persistence, credit accumulation, and degree completion rates. The study was a randomized controlled trial conducted at three community colleges in Ohio. Eligible students were randomly assigned to either the treatment or control groups. The authors conducted statistical tests to examine differences in outcomes between the groups over four semesters. The study found that when compared to the control group, ASAP students had significantly higher enrollment rates and credit accumulation over the two-year period, and also had significantly higher degree completion rates. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial with low attrition. This means we are confident that the estimated effects are attributable to the Ohio Accelerated Study in Associate Programs, and not to other factors.","the Ohio Accelerated Study in Associate Programs (ASAP)","Community college education and other classroom training","Adult, Low income",,"United States",2018,https://files.eric.ed.gov/fulltext/ED592008.pdf "Starting to succeed: The impact of CUNY Start on academic momentum","Webber (2018). Starting to succeed: The impact of CUNY Start on academic momentum. Retrieved from http://www1.cuny.edu/sites/cunystart/wp-content/uploads/sites/51/2018/08/gateway_brief_final.pdf","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the CUNY Start program on community college students’ gateway course completion. The study used a nonexperimental design to compare the outcomes of students who participated in the CUNY Start program to a matched comparison group who did not participate in the program. Using program and institutional research data, the author conducted statistical models to examine differences between the groups. The study found that students participating in CUNY Start were significantly more likely to complete gateway courses than nonparticipating students. The quality of causal evidence presented in this study is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to CUNY Start, but other factors might also have contributed.","the CUNY Start Program","Community college education and other classroom training","Age, Other barriers",,"United States",2018,http://www1.cuny.edu/sites/cunystart/wp-content/uploads/sites/51/2018/08/gatewa… "Assessing the effectiveness of Quantway®: A multilevel model with propensity score matching","Yamada, H., Bohannon, A. X., Grunow, A., & Thorn, C. A. (2018). Assessing the effectiveness of Quantway®: A multilevel model with propensity score matching. Community College Review, 46(3), 257-287. doi: 10.1177/0091552118771754","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Quantway® 1 math program on community college students’ developmental math completion rates. The authors used a nonexperimental design to compare the outcomes of students who were in the Quantway® 1 program to a matched comparison group. When compared to non-participating students, the study found that Quantway® 1 program participation was associated with a significantly higher likelihood of successfully completing the developmental math course. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Quantway® 1 program; other factors are likely to have contributed.",Quantway®,"Community college education and other classroom training","Adult, Other barriers",,"United States",2018,https://doi.org/10.1177%2F0091552118771754 "Evaluation of Ivy Tech’s pathways to information technology: Implementation and outcomes, final report","Edwards, R., Douglas, D., Van Noy, M., Javed, S., Hubbard-Mattix, L., & Pardalis, N. (2018). Evaluation of Ivy Tech’s pathways to information technology: Implementation and outcomes, final report. Piscataway, NJ: Rutgers Education and Employment Research Center.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to examine the effects of Ivy Tech Community College’s Trade Adjustment Assistance Community College and Career Training (TAACCCT) grant for enhanced Information Technology (IT) curriculum on education outcomes of community college students. The study used a nonexperimental design to compare the outcomes of students who were in enhanced IT courses to a comparison group of students in Advanced Manufacturing courses. Using Ivy Tech College’s administrative records, the authors conducted statistical models to examine differences between the groups. The study found no statistically significant relationships between participating in the TAACCCT IT program and the number of terms enrolled or number of credits earned. The quality of causal evidence presented in this report is low because the authors used a comparison group from a different academic program presenting a confounding factor. This means we are not confident that the estimated effects are attributable to Ivy Tech’s TAACCCT IT program; other factors are likely to have contributed.","Ivy Tech’s TAACCCT IT program","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs",Adult,,"United States",2018,https://smlr.rutgers.edu/sites/default/files/ivy_tech_report_1.pdf "Kansas Technical Re/training Among Industry-targeted Networks (KanTRAIN) TAACCCT IV evaluation final report","Foster, L. R., Staklis, S., Ott, N. R., & Moyer, R. (2018). Kansas Technical Re/training Among Industry-targeted Networks (KanTRAIN) TAACCCT IV evaluation final report. Raleigh, NC: RTI International.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the Kansas Technical Re/training Among Industry-targeted Networks (KanTRAIN) program on education, earnings, and employment outcomes. The authors used a nonexperimental design to compare education, earnings, and employment outcomes of KanTRAIN participants to a matched comparison group. The study found KanTRAIN participants were significantly more likely to earn more credits per semester, pass a higher percentage of the credits attempted, attain more credentials, and earn a nondegree credential or a college degree, and receive a wage increase than the comparison group. The quality of causal evidence presented in this study is low because the authors used a comparison group from previous enrollment years presenting a confounding factor. This means we are not confident that the estimated effects are attributable to the KanTRAIN program; other factors are likely to have contributed.","Kansas Technical Re/training Among Industry-targeted Networks (KanTRAIN)","Capacity building programs Community college education and other classroom training","Adult, Veteran or military",,"United States",2018,https://www.skillscommons.org/bitstream/handle/taaccct/18334/KanTRAIN_TAACCCT_I… "Washington State’s Integrated Basic Education and Skills Training (I-BEST) program in three colleges: Implementation and early impact report (Report No. 2018-87)","Glosser, A., Martinson, K., Cho, S.W., & K. Gardiner. (2018). Washington State’s Integrated Basic Education and Skills Training (I-BEST) program in three colleges: Implementation and early impact report (Report No. 2018-87). Washington, DC: Office of Planning, Research, and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Washington State Integrated Basic Education and Skills Training (I-BEST) program on education outcomes. The study was a randomized controlled trial conducted at three community and technical colleges in Washington State. Eligible students were randomly assigned to either the treatment or control groups. The authors used statistical models to examine differences in outcomes between the groups up to 24 months after the study began. The study found that I-BEST participants were significantly more likely to enroll in and complete courses, earn credits, and earn credentials than control group participants. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the I-BEST program, and not to other factors.","the Washington State Integrated Basic Education and Skills Training (I-BEST) Program","Basic skills Capacity building programs Community college education and other classroom training",Adult,,"United States",2018,https://mefassociates.com/wordpress/wp-content/uploads/2018/10/i_best_implement… "Preparing Alaskans for mining careers through short, industry-informed training programs: University of Alaska round IV TAACCCT grant","Hanson, H., Stevens, D., Vazquez, M., & Roberts, B. (2018). Preparing Alaskans for mining careers through short, industry-informed training programs: University of Alaska round IV TAACCCT grant. Portland, OR: Education Northwest.","Community College",,,"Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the University of Alaska's Trade Adjustment Assistance Community College and Career Training (TAACCCT) grant program on the employment and earnings of community college students. The study used a nonexperimental design to compare the outcomes of students in the TAACCCT-enhanced Surface Mining and Underground Mining programs to similar individuals who did not attend community college and instead entered the labor market in mining occupations. The study found that the TAACCCT-enhanced program participation was significantly associated with a higher likelihood of employment retention and increased quarterly wages. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the University of Alaska's TAACCCT grant program; other factors are likely to have contributed.","the University of Alaska's TAACCCT Grant Program","Employer partnerships Capacity building programs Community college education and other classroom training","Adult, Dislocated or displaced worker, American Indian or Alaska Native, Veteran or military",,"United States",2018,http://www.skillscommons.org/bitstream/handle/taaccct/18578/AK_TAACCCT_Report_0… "Evaluation of Richland College's Veterans-Focused Engineering Technology Project: Final Report","Haviland, S., Van Noy, M., Kuang, L., Vinton, J., & Pardalis, N. (2018). Evaluation of Richland College's Veterans-Focused Engineering Technology Project: Final Report. New Brunswick, NJ: Rutgers University Education and Employment Research Center.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Unfavorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of Richland College’s Veterans-Focused Engineering Technology Project on education outcomes. The authors used a nonexperimental design to compare education outcomes of program participants to a matched comparison group one and two years after enrollment. The study found that program participation was significantly associated with fewer credit hours earned one year after enrollment. The quality of causal evidence presented in this report is low because the authors did not use sufficient controls in their analysis. This means we are not confident that the estimated effects are attributable to the Veterans-Focused Engineering Technology Project; other factors are likely to have contributed program.","the Veterans-Focused Engineering Technology Project","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Veteran or military",,"United States",2018,https://smlr.rutgers.edu/sites/default/files/evaluation_of_richland_colleges_ve… "Evaluation of Clark State Community College’s Advanced Manufacturing to Compete in a Global Economy (AMCGE) training program final report","Haviland, S. B., Van Noy, M., Kuang, L., Vinton, J., & Pardalis, N. (2018). Evaluation of Clark State Community College’s Advanced Manufacturing to Compete in a Global Economy (AMCGE) training program final report.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Advanced Manufacturing to Compete in a Global Economy (AMCGE) workforce training program on education outcomes. The authors used a nonexperimental design to compare the outcomes of students participating in the AMCGE program to a matched comparison group using data from college administrative records. The study found a significant relationship between AMCGE program participation and increased number of credits earned and increased program completion rates in the first year. The quality of causal evidence presented in this report is low because the authors used a comparison group from a different academic program presenting a confounding factor. This means we are not confident that the estimated effects are attributable to the AMCGE program; other factors are likely to have contributed.","the Advanced Manufacturing to Compete in a Global Economy (AMCGE) program","Capacity building programs Community college education and other classroom training",Adult,,"United States",2018,http://www.skillscommons.org/bitstream/handle/taaccct/17927/Clark%20State_Final… "KCTCS Enhancing Programs for IT Certification (EPIC): Independent evaluation contracted by the Kentucky Community and Technical College System","Hughes, K., Belfield, C., Ran, F., & Jenkins, D. (2018). KCTCS Enhancing Programs for IT Certification (EPIC): Independent evaluation contracted by the Kentucky Community and Technical College System. New York, NY: Community College Research Center, Teacher's College, Columbia University.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to assess the impact of the Enhancing Programs for IT Certification’s (EPIC) Learn on Demand (LoD) courses on community college students’ education outcomes. This summary focuses on the comparison between students who enrolled in EPIC LoD courses and students who enrolled in non-EPIC LoD courses. The authors used a nonexperimental design to compare the outcomes of students enrolled in EPIC LoD courses with those enrolled in non-EPIC LoD courses. The study found that EPIC LoD course participation was significantly associated with increased course completion and certificate completion. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the EPIC LoD courses, but other factors might also have contributed.","the Enhancing Programs for IT Certification (EPIC) Project","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Dislocated or displaced worker, Veteran or military",,"United States",2018,https://ccrc.tc.columbia.edu/media/k2/attachments/CCRC_KCTCS_EPIC_Report_09-26-… "KCTCS Enhancing Programs for IT Certification (EPIC): Independent evaluation contracted by the Kentucky Community and Technical College System","Hughes, K., Belfield, C., Ran, F., & Jenkins, D. (2018). KCTCS Enhancing Programs for IT Certification (EPIC): Independent evaluation contracted by the Kentucky Community and Technical College System. New York, NY: Community College Research Center, Teacher's College, Columbia University.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to assess the impact of the Enhancing Programs for IT Certification’s (EPIC) Learn on Demand (LoD) courses on community college students’ education outcomes. This summary focuses on the comparison between students who enrolled in EPIC LoD courses and students who enrolled in the traditional format courses. The authors used a nonexperimental design to compare the outcomes of students enrolled in EPIC LoD courses with those enrolled in traditional formats of courses where an EPIC LoD version was available. The study found that EPIC LoD course participation was significantly associated with increased course completion and certificate completion. The quality of causal evidence presented in this report is moderate for the course completion outcome because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the EPIC LoD courses, but other factors might also have contributed. For the certificate completion outcome, the quality of causal evidence presented in this report is low because the authors did not use sufficient controls in their analysis. This means we are not confident that the estimated effects are attributable to the EPIC LoD courses; other factors are likely to have contributed.","the Enhancing Programs for IT Certification (EPIC) Project","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Dislocated or displaced worker, Veteran or military",,"United States",2018,https://ccrc.tc.columbia.edu/media/k2/attachments/CCRC_KCTCS_EPIC_Report_09-26-… "USDOL TAACCCT: Final evaluation report","Kelly-Smith, A., Smith, E., Bellville, J., & Hicks, B. (2018). USDOL TAACCCT: Final evaluation report. Indianapolis, IN: Thomas P. Miller & Associates.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Unfavorable impacts Earnings and wages","Summary: The study’s objective was to examine the impact of the Accelerated Career and Education Pathway Program (ACEPP) on earnings outcomes. The authors used a nonexperimental design to compare earnings outcomes of students in ACEPP with a matched comparison group. The study found that students participating in ACEPP had significantly lower wages than students in the comparison group. MThe quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the Accelerated Career and Education Pathway Program (ACEPP), but other factors might also have contributed.","the Accelerated Career and Education Pathway Program (ACEPP)","Capacity building programs Community college education and other classroom training",Adult,,"United States",2018, "Does stacking work? The academic value of short-term, stackable certificates (Unpublished doctoral dissertation)","Bowers, J. M. (2018). Does stacking work? The academic value of short-term, stackable certificates (Unpublished doctoral dissertation). University of Washington, Seattle, WA.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-No impacts Education and skills gains","Summary: The study’s objective was to evaluate the benefits of stackable certificates on education and earnings outcomes for full-time students with no prior post-secondary education. The author used a nonexperimental design to compare the effects of participating in stackable short-term certificate programs on outcomes for those in the treatment group versus those in the comparison group. The study found that students who attained a single short-term stackable certificate had a sufficiently lower likelihood of earning a two-year degree, whereas attaining two or more short-term, stackable certificates more than doubled a student’s likelihood of earning a degree. The quality of causal evidence presented in this study is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to short-term stackable certificates, but other factors might also have contributed.","Short-Term Stackable Certificates","Capacity building programs Community college education and other classroom training","Adult, Other barriers",,"United States",2018,https://digital.lib.washington.edu/researchworks/bitstream/handle/1773/43361/Bo… "STEM education for workforce development through online contextualized training","Mohammadi, A. (2018). STEM education for workforce development through online contextualized training. (Unpublished doctoral dissertation). University of Nebraska, Lincoln, Nebraska.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of contextualized teaching and learning (CTL) on education outcomes. Using institutional data, the author conducted a nonexperimental design to compare education outcomes of CTL participants to non-CTL participants. The study found no statistically significant relationships between participation in the contextualized teaching and learning training and credit hours completed, length of program enrollment, or credentials attained. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention and did not include sufficient controls. This means we are not confident that the estimated effects are attributable to CTL; other factors are likely to have contributed.","the Contextualized Teaching and Learning (CTL) Training","Basic skills Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Other barriers, Dislocated or displaced worker",,"United States",2018,https://search.proquest.com/openview/2185911e68616901d0e3cf2e958e11d6/1?cbl=187… "Final evaluation of the ACED grant at Salt Lake Community College","Bragg, D., Cosgrove, J., Cosgrove, M. & Blume, G. (2018). Final evaluation of the ACED grant at Salt Lake Community College. Salt Lake City, UT: Bragg & Associates, Inc.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Education and skills gains-Low-No impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study’s objective was to evaluate the impact of a competency-based education (CBE) program offered by Salt Lake Community College on educational, employment, and earnings outcomes. The study used a nonexperimental design to compare outcomes among students enrolled in the CBE-based program and students who were not enrolled in CBE. The study found CBE program participation was associated with a statistically significant increase in post-program wages. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to Salt Lake Community College’s CBE Program; other factors are likely to have contributed.","Salt Lake Community College's CBE Program","Capacity building programs Community college education and other classroom training",Adult,,"United States",2018,http://www.skillscommons.org/bitstream/handle/taaccct/18574/Final-SATTS-TAA-Rep… "Minnesota advanced manufacturing project: Final external evaluation report","Bucci, P., Evans, W.D., Friesenborg, L., Fox, D.A., Bishop, K., Balraj, N., & Jang, B. (2018). Minnesota advanced manufacturing project: Final external evaluation report. Retrieved from https://www.skillscommons.org/bitstream/handle/taaccct/18521/MnAMP%20Final%20Evaluation%20Report.pdf?sequence=1&isAllowed=y","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Mixed impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Minnesota Advanced Manufacturing Partnership (MnAMP) program on education outcomes. The authors used a nonexperimental design to compare education outcomes of MnAMP participants to a matched comparison group using institutional data. The study found that MnAMP program participation was significantly associated with earning fewer credits and fewer credentials relative to the comparison group. However, among students who attained credentials, participating in the MnAMP program was significantly associated with completing a one-year certificate in less time than comparison group students. The quality of causal evidence presented in this study is low because the authors used a comparison group from previous enrollment years, presenting a confounding factor. This means we are not confident that the estimated effects are attributable to the MnAMP program; other factors are likely to have contributed.","Minnesota Advanced Manufacturing Partnership (MnAMP) Program","Capacity building programs Community college education and other classroom training","Adult, Unemployed, Veteran or military",,"United States",2018,https://www.skillscommons.org/bitstream/handle/taaccct/18521/MnAMP%20Final%20Ev… "Third-party evaluation of DOL Round 4 TAACCCT grant Mechatronics Re-envisioned: Final evaluation report","North Carolina State University. (2018). Third-party evaluation of DOL Round 4 TAACCCT grant Mechatronics Re-envisioned: Final evaluation report. Raleigh, NC: North Carolina State University Industry Expansion Solutions.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to assess the impact of the Mechatronics Re-envisioned (MRE) program on education outcomes. Using college administrative data, the authors conducted a nonexperimental study to compare the differences in outcomes between students in the MRE program and a matched comparison group. The study found a significant relationship between MRE program participation and higher rates of program retention and completion, relative to the comparison group. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the MRE program; other factors are likely to have contributed.","the Mechatronics Re-envisioned (MRE) Program","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs",Adult,,"United States",2018, "Evaluation of the Idaho Center of Excellence Healthcare Partnership (ICE): Final report","Negoita, M., Paprocki, A., & Gutierrez, I. (2018). Evaluation of the Idaho Center of Excellence Healthcare Partnership (ICE): Final report. Oakland, CA: Social Policy Research Associates.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Idaho Center of Excellence Healthcare Partnership (ICE) on education outcomes. The authors used a nonexperimental design to compare outcomes of students who enrolled in ICE-enhanced courses to a matched comparison group. The study found a significant positive association between enrollment in ICE-enhanced courses and prerequisite course completion. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the ICE enhancements; other factors are likely to have contributed.","the Idaho Center of Excellence Healthcare Partnership (ICE)","Capacity building programs Community college education and other classroom training",Adult,,"United States",2018,http://www.skillscommons.org/bitstream/handle/taaccct/18548/ICE%20Final%20Evalu… "Third-party evaluation of MoSTEMWINs: Implementation, outcomes, and impact","Cosgrove, J., & Cosgrove, M. (2018). Third-party evaluation of MoSTEMWINs: Implementation, outcomes, and impact. St. Louis, MO: Cosgrove & Associates, LLC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Missouri STEM Workforce Innovation Networks (MoSTEMWINs) program on education and employment outcomes. The authors used a nonexperimental design to compare education and employment outcomes of MoSTEMWINs participants to a historical comparison group. The study found that MoSTEMWINs participants were significantly more likely to complete the program and attain employment than the comparison group. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the MoSTEMWINs program; other factors are likely to have contributed.",MoSTEMWINs,"Basic skills Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Dislocated or displaced worker, Unemployed, Veteran or military",,"United States",2018,http://www.skillscommons.org/bitstream/handle/taaccct/10845/MoSTEMWINs%20Mid-Po… "TAACCCT building Illinois' bio-economy (BIB) consortium final evaluation report","The New Growth Group. (2018). TAACCCT building Illinois' bio-economy (BIB) consortium final evaluation report. Cleveland, OH: New Growth Group.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Building Illinois’ Bio-economy (BIB) consortium on education outcomes. The authors used a nonexperimental design to compare the outcomes of students in BIB grant-affected programs to a matched comparison group of students in non-BIB grant-affected programs. The study found a significant positive relationship between BIB program participation and program completion rates at two of the five colleges. The quality of causal evidence presented in this report is low because the authors did not use sufficient controls in their analysis. This means we are not confident that the estimated effects are attributable to participation in BIB grant-affected programs; other factors are likely to have contributed.","the Building Illinois’ Bio-economy (BIB) Consortium","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Veteran or military",,"United States",2018, "The Ohio Technical Skills Innovation Network (Ohio TechNet) Trade Adjustment Assistance Community College Career Training Grant (TAACCCT) Final Evaluation Report","The New Growth Group, LLC & The Ohio Education Research Center at The Ohio State University. (2018). The Ohio Technical Skills Innovation Network (Ohio TechNet) Trade Adjustment Assistance Community College Career Training Grant (TAACCCT) Final Evaluation Report. Retrieved from https://oerc.osu.edu/sites/oerc/themes/oerc/publications/LCCC%20OTN%20Lead%20Team%20Evaluation%20Final%20Report.pdf","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Education and skills gains-Low-Mixed impacts Education and skills gains Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to evaluate the impact of advanced manufacturing programs offered through the Ohio Technical Skills Innovation Network (OTN) initiative on education, earnings, and employment outcomes. The study used a nonexperimental design to compare outcomes of students enrolled in OTN-affected programs/core courses to a matched comparison group. The study found that OTN participation was associated with a significant increase in program completion, program retention, credit hour completion, continuing further education, credential attainment, immediate employment, and job retention. Program participation was also associated with a significant decrease in retention in other programs and earning a degree. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the OTN grant programs; other factors are likely to have contributed.","The Ohio Technical Skills Innovation Network Initiative","Capacity building programs Community college education and other classroom training",Adult,,"United States",2018,https://oerc.osu.edu/sites/oerc/themes/oerc/publications/LCCC%20OTN%20Lead%20Te… "SUN PATH comparison group study","Dauphinee, T., & Bishwakarma, R. (2018). SUN PATH comparison group study. Albuquerque, NM: University of New Mexico, Career to Cradle Policy Institute.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Skill‐UP Network Pathways Acceleration in Technology and Healthcare (SUN PATH) program on education, earnings, and employment outcomes. The authors used a nonexperimental design to compare the outcomes of students who were in the SUN PATH program to a matched comparison group of students. The study found that SUN PATH students had higher rates of program completion, certificates/degree attainment, program retention, employment, and earnings than students in the comparison group. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the SUN PATH program, but other factors might also have contributed.","the Skill‐UP Network Pathways Acceleration in Technology and Healthcare (SUN PATH) Program","Capacity building programs Community college education and other classroom training","Adult, Dislocated or displaced worker, Other, Low-skilled, Veteran or military",,"United States",2018,https://www.skillscommons.org/bitstream/handle/taaccct/18108/SUN%20PATH%20Compa… "Evaluation of the Pennsylvania’s Advanced Training and Hiring Program: Final report","Davis, S., & Bill, N. (2018). Evaluation of the Pennsylvania’s Advanced Training and Hiring Program: Final report. Washington, DC: Impaq International.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to assess the impact of the Pennsylvania’s Advanced Training and Hiring (PATH) initiative on education outcomes. Using college administrative data, the authors conducted a nonexperimental study to compare education outcomes of students in the PATH program to a matched comparison group. The study found that PATH participation was significantly associated with higher rates of program completion and academic progress. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention.This means we are not confident that the estimated effects are attributable to the PATH initiative; other factors are likely to have contributed.","Pennsylvania’s Advanced Training and Hiring (PATH) Initiative","Capacity building programs Community college education and other classroom training",Adult,,"United States",2018,https://www.impaqint.com/work/case-studies/evaluation-pennsylvania%E2%80%99s-ad… "Iowa’s Information Technology, Healthcare, Utilities, and Manufacturing Network Statewide Consortium (IHUM) final evaluation report","de la Mora, A., Abraham, W., & Callen, E. (2018). Iowa’s Information Technology, Healthcare, Utilities, and Manufacturing Network Statewide Consortium (IHUM) final evaluation report. Ames, IA: Iowa State University, Research Institute for Studies in Education.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Mixed impacts Education and skills gains","Summary: The study’s objective was to evaluate the effects of the Iowa’s Information Technology, Healthcare, Utilities, and Manufacturing (IHUM) Network Consortium project on education outcomes. The authors used a nonexperimental design to compare the education outcomes of the IHUM treatment group to a comparison group comprised of both historical and concurrent cohorts of students. The study found that IHUM participation was significantly related to higher rates of program diplomas earned and lower rates of earning an Associate’s degree. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention and did not include sufficient controls. This means we are not confident that the estimated effects are attributable to IHUM; other factors are likely to have contributed.","Iowa’s Information Technology, Healthcare, Utilities, and Manufacturing (IHUM) Network Consortium","Capacity building programs Community college education and other classroom training",Adult,,"United States",2018, "Summative evaluation report: Training for Regional Energy in North Dakota (TREND)","Dervarics, C., Evans, W. D., Bucci, P. T., Fox, D. A., Bishop, K., & Balraj, N. (2018). Summative evaluation report: Training for Regional Energy in North Dakota (TREND). Washington, DC: PTB and Associates","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Training for Regional Energy in North Dakota (TREND) program on education outcomes. The authors used a nonexperimental design to compare students enrolled in the TREND program to a matched comparison group of students at a community college in North Dakota. Using secondary data, the authors conducted statistical models to examine differences between the groups. The study found that TREND program participation was significantly related to higher credential attainment and higher rates of retention. The quality of causal evidence presented in this study is low because the authors used a comparison group from previous enrollment years presenting a confounding factor. This means we are not confident that the estimated effects are attributable to the TREND program; other factors are likely to have contributed.","the Training for Regional Energy in North Dakota (TREND) program","Capacity building programs Community college education and other classroom training",Adult,,"United States",2018,https://www.skillscommons.org/bitstream/handle/taaccct/18122/FINAL%20TREND%20Ro… "Northwest State Community College of Ohio Industrial Automation Manufacturing innovative Strategic Training Achieving Results (IAM iSTAR) Initiative (TAACCCT Grant TC-26481-14-60-A-39)","Dockery, J., Bottomley, M., Murray, C., Tichnell, T., Stover, S., Schroeder, N., Hance, D., Fruchey, K., & Franco, S. (2018). Northwest State Community College of Ohio Industrial Automation Manufacturing innovative Strategic Training Achieving Results (IAM iSTAR) Initiative (TAACCCT Grant TC-26481-14-60-A-39). Dayton, OH: Wright State University, Applied Policy Research Institute.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Industrial Automation Manufacturing innovative Strategic Training Achieving Results (IAM iSTAR) initiative on education outcomes. The authors used a nonexperimental design to compare education outcomes of students enrolled in the IAM iSTAR program to a historic cohort of students enrolled in the same programs of study prior to the implementation of the IAM iSTAR program. The study found that IAM iSTAR program participation was significantly associated with higher numbers of credit hours attempted and completed per semester. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the IAM iSTAR initiative; other factors are likely to have contributed.","Industrial Automation Manufacturing innovative Strategic Training Achieving Results (IAM iSTAR) Initiative","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs",Adult,,"United States",2018,https://www.skillscommons.org/bitstream/handle/taaccct/18570/2018%20IAM%20iSTAR… "Final evaluation report: Trade Adjustment Assistance Community – round 4: Nevada Community College Consortium","Pacific Research and Evaluation. (2018). Final evaluation report: Trade Adjustment Assistance Community – round 4: Nevada Community College Consortium. Retrieved from https://www.skillscommons.org/bitstream/handle/taaccct/18580/NCCC%20TAACCCT%20Final%20Evaluation%20Report-Pacific%20Research%20and%20Evaluation.pdf?sequence=1&isAllowed=y","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Education and skills gains-Low-No impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the Nevada Community College Consortium (NCCC) Trade Adjustment Assistance Community College and Career Training (TAACCCT) grant program on education, earnings, and employment. Using community college data, the authors used a nonexperimental design to compare the outcomes of students in the program to a comparison group comprised of both concurrent and historical cohorts of students. The study found no statistically significant relationships between NCCC and education, earnings, and employment outcomes. The quality of causal evidence presented in this report is low because the authors did not include sufficient control variables. This means we are not confident that the estimated effects are attributable to NCCC; other factors are likely to have contributed.","Nevada Community College Consortium (NCCC)","Capacity building programs Community college education and other classroom training",Adult,,"United States",2018,https://www.skillscommons.org/bitstream/handle/taaccct/18580/NCCC%20TAACCCT%20F… "Greater Memphis Alliance for a Competitive Workforce: TAACCCT round 4 grant, impact evaluation final report","Patnaik, A. (2018). Greater Memphis Alliance for a Competitive Workforce: TAACCCT round 4 grant, impact evaluation final report. Austin, TX: Ray Marshall Center for the Study of Human Resources, The University of Texas at Austin, Lyndon B. Johnson School of Public Affairs.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Greater Memphis Alliance for a Competitive Workforce (GMACW) Trade Adjustment Assistance Community College and Career Training (TAACCCT) grant program on credential attainment. Using a nonexperimental design, the study author compared students in the program to a matched historical comparison group. The study found that students in the GMACW TAACCCT program were significantly more likely to achieve a credential than students in the comparison group. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the GMACW TAACCCT; other factors are likely to have contributed.","the Greater Memphis Alliance for a Competitive Workforce (GMACW) Trade Adjustment Assistance Community College and Career Training (TAACCCT) grant program","Capacity building programs Community college education and other classroom training",Adult,,"United States",2018,https://raymarshallcenter.org/files/2018/10/FINAL-GMACW-TAACCCT-Impact-Evaluati… "Health Profession Opportunity Grants (HPOG 1.0) impact study interim report: Program implementation and short-term impacts. (Report No. 2018-16a)","Peck, L. R., Werner, A., Harvill, E., Litwok, D., Moulton, S., Fountain, A. R., & Locke, G. (2018). Health Profession Opportunity Grants (HPOG 1.0) impact study interim report: Program implementation and short-term impacts. (Report No. 2018-16a). Washington, DC: Office of Planning. Research, and Evaluation, Administration for Children and Families, US Department of Health and Human Services.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Health Profession Opportunity Grant (HPOG) program on educational progress, earnings, and employment. The authors used a randomized controlled trial to analyze the effects of the program between a treatment group, an enhanced treatment group, and a control group. The study found that HPOG participants had significantly higher rates of educational progress, significantly higher earnings in the fifth quarter, and a significantly higher likelihood to be employed in healthcare than the control group. The quality of causal evidence presented in the study is high for the employment and earnings outcomes because they are based on a well-implemented randomized controlled trial with low attrition. However, the quality of causal evidence is moderate for the educational progress and employment in healthcare outcomes because sample attrition for these outcomes was high, but the authors controlled for key differences between the treatment and control groups at baseline. This means we are somewhat confident that estimated effects on these outcomes would be attributable to HPOG, but other factors might have also contributed.","the Health Profession Opportunity Grant (HPOG)","Capacity building programs Community college education and other classroom training","Adult, Low income",,"United States",2018,https://www.acf.hhs.gov/sites/default/files/opre/hpog_interim_appendices_final_… "Advancing Careers and Training (ACT) for Healthcare in Wisconsin","Price, D., Valentine, J., Sedlak, W., & Roberts, B. (2018). Advancing Careers and Training (ACT) for Healthcare in Wisconsin. Retrieved from: http://support.skillscommons.org/showcases/outcomes/healthcare/act/","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to assess the impact of the Advancing Careers and Training for Healthcare (ACT for Healthcare) program on education, earnings, and employment outcomes. Using college administrative data and state unemployment insurance data, the authors conducted a nonexperimental study to compare the outcomes of students who were in the ACT for Healthcare program to a matched comparison group. The study found that a significantly larger proportion of students in the ACT for Healthcare treatment group earned a credential, stayed in their institution after one semester, and stayed in their institution after one year, relative to the comparison group. In addition, a significantly larger proportion of students in the treatment group gained employment and increased their wages, relative to the comparison group. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the ACT for Healthcare program, but other factors might also have contributed.","the Advancing Careers and Training for Healthcare (ACT for Healthcare)","Capacity building programs Community college education and other classroom training",Adult,,"United States",2018,http://support.skillscommons.org/showcases/outcomes/healthcare/act/ "Northwest State Community College of Ohio Industrial Automation Manufacturing innovative Strategic Training Achieving Results (IAM iSTAR) Initiative (TAACCCT Grant TC-26481-14-60-A-39)","Dockery, J., Bottomley, M., Murray, C., Tichnell, T., Stover, S., Schroeder, N., Hance, D., Fruchey, K., & Franco, S. (2018). Northwest State Community College of Ohio Industrial Automation Manufacturing innovative Strategic Training Achieving Results (IAM iSTAR) Initiative (TAACCCT Grant TC-26481-14-60-A-39). Dayton, OH: Wright State University, Applied Policy Research Institute.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Industrial Automation Manufacturing innovative Strategic Training Achieving Results (IAM iSTAR) initiative on earnings and employment outcomes. The authors used a nonexperimental design to compare employment and earnings outcomes of students enrolled in the IAM iSTAR program to a matched cohort of students from other local community colleges enrolled in the same or similar programs of study. The study found that IAM iSTAR program participation was significantly associated with a higher likelihood of finding and retaining employment for non-incumbent workers. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the IAM iSTAR program; other factors are likely to have contributed","Industrial Automation Manufacturing innovative Strategic Training Achieving Results (IAM iSTAR) Initiative","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs",Adult,,"United States",2018,https://www.skillscommons.org/bitstream/handle/taaccct/18570/2018%20IAM%20iSTAR… "Trade Adjustment Assistance Community College Career Training Grant (TAACCCT): Final evaluation report","The Greater Cincinnati Supply Chain Career Development Center (SCCDC). (2018). Trade Adjustment Assistance Community College Career Training Grant (TAACCCT): Final evaluation report. Cincinnati, OH: Author.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of The Greater Cincinnati Supply Chain Career and Development Center’s (SCCDC) Supply Chain Management and Materials Handling & Logistics programs on education outcomes. The study used a nonexperimental design to compare the program completion of students enrolled in SCCDC programs to students in a matched comparison group. The study found that participation in the Supply Chain Management program, one of the SCCDC programs, was associated with a significant increase in the likelihood of program completion. The quality of causal evidence presented in this report is low because the authors used a comparison group from different academic programs presenting a confounding factor. This means we are not confident that the estimated effects are attributable to the SCCDC programs; other factors are likely to have contributed.","the SCCDC’s Supply Chain Management and Materials Handling & Logistics Technologies Programs","Capacity building programs Community college education and other classroom training","Adult, Dislocated or displaced worker, Veteran or military",,"United States",2018,https://www.skillscommons.org/handle/taaccct/17943 "Get IT project evaluation: Final report","Singer, S. (2018). Get IT project evaluation: Final report. Syracuse, NY: Hezel Associates.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the enhanced Growing the Economy through Information Technology (Get IT) curricula on student education outcomes. The study used a nonexperimental design to compare the outcomes of students in enhanced Get IT courses to a comparison group of students not taking enhanced IT courses. Using administrative records, the author conducted statistical tests to examine the differences between groups. The study found that students in enhanced Get IT courses were significantly more likely to remain in school than students who were not in enhanced Get IT courses. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention or include sufficient control variables. This means we are not confident that the estimated effects are attributable to NHTI’s enhanced Get IT program; other factors are likely to have contributed.","NHTI’s Get IT Program","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs",Adult,,"United States",2018,http://www.skillscommons.org/bitstream/handle/taaccct/18125/HezelAssoc_GetITEva… "PluggedIn and WorkREADY! at Southwest Virginia Community College: 2018 final report","Styers, M., Haden, C., Cosby, A., & Peery, E. (2018). PluggedIn and WorkREADY! at Southwest Virginia Community College: 2018 final report. Charlottesville, VA: Magnolia Consulting, LLC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the PluggedIn and WorkREADY! advanced manufacturing training program on education, employment, and earnings outcomes. The study used a nonexperimental design to compare the outcomes of students enrolled in the PluggedIn and WorkREADY! program with students enrolled at Southwest Virginia Community College (SWCC) in comparable majors. The study found a significant positive relationship between PluggedIn and WorkREADY! program participation and program completion, credential attainment, number of credentials attained, and employment and a significant negative relationship with program dropout. The quality of causal evidence presented in this report is low because the authors did not use sufficient controls in their analysis. This means we are not confident that the estimated effects are attributable to the PluggedIn and WorkREADY! program; other factors are likely to have contributed.","the PluggedIn and WorkREADY! Program","Capacity building programs Community college education and other classroom training",Adult,,"United States",2018, "M-PATH: Advanced manufacturing final evaluation report. (Rep. No. 33VCDOLTACT2014.Y4S)","Swan, B., Clarke, M. H., Serpa, A., DeStefano, C., & Hahs-Vaughn (2018). M-PATH: Advanced manufacturing final evaluation report. (Rep. No. 33VCDOLTACT2014.Y4S). Orlando, FL: University of Central Florida, Program Evaluation and Educational Research Group (PEER).","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the M-PATH: Advanced Manufacturing Trade Adjustment Assistance Community College and Career Training (TAACCCT) grant program on education, earnings, and employment outcomes. Using a nonexperimental design, the authors compared students in the M-PATH TAACCCT program to a matched comparison group. The study found that participation in the M-PATH TAACCCT program was significantly related to increased program completion and decreased continued education in another certificate program. The study also found that non-incumbent workers who completed the program were significantly more likely to enter employment than the comparison group. The quality of causal evidence presented in this report is low because the authors did not include sufficient control variables. This means we are not confident that the estimated effects are attributable to the M-PATH TAACCCT program; other factors are likely to have contributed.","the M-PATH: Advanced Manufacturing Trade Adjustment Assistance Community College and Career Training (TAACCCT) Grant Program","Capacity building programs Community college education and other classroom training",Adult,,"United States",2018,http://www.skillscommons.org/bitstream/handle/taaccct/18579/TC-26475-14-60-A-12… "New Jersey Health Professions Pathways to Regional Excellence project TAACCCT evaluation: Final report: Implementation and impact","Van Noy, M., Edwards, R., Haviland, S. B, McKay, H., Douglas, D., Mabe, W., Coty, V., Javed, S., Pardalis, N., Hubbard-Mattix, L., & Seith, D. (2018). New Jersey Health Professions Pathways to Regional Excellence project TAACCCT evaluation: Final report: Implementation and impact. Piscataway, NJ: Rutgers Education and Employment Research Center.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine the impact of the New Jersey Health Professions Pathways to Regional Excellence Project (NJ-PREP) on earnings and employment outcomes. The study used a nonexperimental design to compare the outcomes of students who participated in the Nj-PREP program to those that did not. The authors examined data from Unemployment Insurance records, state higher education records, and the New Jersey Consumer Report Card of Training Providers. The study did not find any statistically significant effects on employment or earnings. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the NJ-PREP, but other factors might also have contributed.","New Jersey Health Professions Pathways to Regional Excellence Project (NJ-PREP)","Capacity building programs Community college education and other classroom training","Adult, Low income",,"United States",2018,https://smlr.rutgers.edu/sites/default/files/nj_prep_taaccct_evaluation_finalre… "Knowledge to work summative evaluation: Lord Fairfax Community College.","Voorhees, R. A. (2018). Knowledge to work summative evaluation: Lord Fairfax Community College. Voorhees, NJ: Voorhees Group LLC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to assess the impact of the Knowledge to Work (K2W) program on education outcomes. The study used a non-experimental design to compare participants in the K2W program with participants from a comparison group. The study found no statistically significant relationships between K2W program participation and education outcomes. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the K2W program; other factors are likely to have contributed.","the Knowledge to Work (K2W) Program","Capacity building programs Community college education and other classroom training","Adult, Dislocated or displaced worker, Low-skilled",,"United States",2018,http://www.skillscommons.org/bitstream/handle/taaccct/17589/K2W%20Summative%20R… "Southern Regional Technical College TAACCCT: Healthcare Career Works! (HCW) program third-party evaluation final report","WorkED Consulting. (2018). Southern Regional Technical College TAACCCT: Healthcare Career Works! (HCW) program third-party evaluation final report. Burke, VA: WorkED Consulting.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Healthcare Career Works! (HCW) program on education outcomes. The authors used a nonexperimental design to compare differences in education outcomes between HCW participants and a matched comparison group. The study found no statistically significant relationships between the HCW program and program completion. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the HCW program; other factors are likely to have contributed.","Healthcare Career Works! (HCW)","Capacity building programs Community college education and other classroom training","Adult, Dislocated or displaced worker, Unemployed, Veteran or military",,"United States",2018, "Oklahoma City Community College TAACCCT: Commercial Food Equipment Service Technician (CFEST) program third-party evaluation final report","WorkED Consulting. (2018). Oklahoma City Community College TAACCCT: Commercial Food Equipment Service Technician (CFEST) program third-party evaluation final report. Burke, VA: WorkED Consulting, LLC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Education and skills gains-Low-No impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the Commercial Food Equipment Service Technician (CFEST) program on education, earnings, and employment outcomes. The study used a nonexperimental design to compare the outcomes of CFEST program participants to a matched comparison group at the same community college. The study did not find a significant association between participation in the CFEST program and earned credentials, program completion, attainment of employment, or hourly wage. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the CFEST program; other factors are likely to have contributed.","the Commercial Food Equipment Service Technician (CFEST) Program","Capacity building programs Community college education and other classroom training",Adult,,"United States",2018, "Johnson County Community College (JCCC) TAACCCT final evaluation report","York, V. (2018). Johnson County Community College (JCCC) TAACCCT final evaluation report. Office of Educational Innovation and Evaluation. Manhattan, KS: Kansas State University.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to evaluate the effects of Johnson County Community College’s (JCCC) Accelerated, Collaborative Technology Training Services (ACTTS) project on education outcomes. The author used a nonexperimental design to compare cohorts of students enrolled in ACTTS and comparison programs on five educational outcomes of interest. The study found that ACTTS students were significantly more likely than comparison group participants to complete their program of study, be retained in their program of study, complete credit hours, and earn credentials. The quality of causal evidence presented in this study is low because the authors did not ensure that the groups being compared were similar before the intervention or include sufficient controls. This means we are not confident that the estimated effects are attributable to ACTTS; other factors are likely to have contributed.","JCCC’s Accelerated, Collaborative Technology Training Services (ACTTS) project","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Dislocated or displaced worker, Veteran or military",,"United States",2018,https://www.skillscommons.org/bitstream/handle/taaccct/17872/JCCC%20TAACCCT%20F… "Providing Public Workforce Services to Job Seekers: 30-Month Impact Findings on the WIA Adult and Dislocated Worker Programs [Comparison between Core-and-Intensive Services versus Core Services].","Fortson, K., Rotz, D., Burkander, P., Mastri, A., Schochet, P., Rosenberg, L., McConnell, S., & D'Amico, R. (2017). Providing Public Workforce Services to Job Seekers: 30-Month Impact Findings on the WIA Adult and Dislocated Worker Programs (No. 42e8b3550e40408f854b966d0229c3b5). Washington, DC: Mathematica Policy Research. [Comparison between Core-and-Intensive Services versus Core Services]",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Adult and Dislocated Worker programs on training, employment, earnings, and service receipt after 30 months. This summary focuses on the comparison between the group who received core-and-intensive services versus the group who received core services. The study was a randomized controlled trial, where customers in each local area were randomly assigned to one of three groups: full-WIA, core-and-intensive, or core. The authors compared the outcomes between the groups from baseline to 30 months after study enrollment. The study found that compared to core customers, core-and-intensive customers were significantly more likely to receive a credential through a training program and have higher earnings. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects are attributable to the Adult and Dislocated Worker programs and not to other factors.","Adult and Dislocated Worker programs","Adult and Dislocated Worker programs Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA)","Adult, Unemployed",,"United States",2017,https://www.mathematica-mpr.com/our-publications-and-findings/publications/prov… "Providing Public Workforce Services to Job Seekers: 30-Month Impact Findings on the WIA Adult and Dislocated Worker Programs [Comparison Between Full-WIA Services versus Core Services].","Fortson, K., Rotz, D., Burkander, P., Mastri, A., Schochet, P., Rosenberg, L., McConnell, S., & D'Amico, R. (2017). Providing Public Workforce Services to Job Seekers: 30-Month Impact Findings on the WIA Adult and Dislocated Worker Programs (No. 42e8b3550e40408f854b966d0229c3b5). Washington, DC: Mathematica Policy Research. [Comparison Between Full-WIA Services versus Core Services]",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Adult and Dislocated Worker programs on training, employment, earnings, and service receipt after 30 months. This summary focuses on the comparison between the group who received the full-WIA services versus the group who received core services. The study was a randomized controlled trial, where customers in each local area were randomly assigned to one of three groups: full-WIA, core-and-intensive, or core. The authors compared the outcomes between the groups from baseline to 30 months after study enrollment. The study found that compared to core customers, full-WIA customers reported a higher number of hours worked, an increased likelihood to receive a credential and complete a training program, and a decreased likelihood to receive public assistance. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects are attributable to the Adult and Dislocated Worker programs and not to other factors.","Adult and Dislocated Worker programs","Adult and Dislocated Worker programs Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA)","Adult, Unemployed",,"United States",2017,https://www.mathematica-mpr.com/our-publications-and-findings/publications/prov… "Providing Public Workforce Services to Job Seekers: 30-Month Impact Findings on the WIA Adult and Dislocated Worker Programs [Comparison Between Full-WIA Services versus Core-and-Intensive Services].","Fortson, K., Rotz, D., Burkander, P., Mastri, A., Schochet, P., Rosenberg, L., McConnell, S., & D'Amico, R. (2017). Providing Public Workforce Services to Job Seekers: 30-Month Impact Findings on the WIA Adult and Dislocated Worker Programs (No. 42e8b3550e40408f854b966d0229c3b5). Washington, DC: Mathematica Policy Research. [Comparison Between Full-WIA Services versus Core-and-Intensive Services]",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Adult and Dislocated Worker programs on training, employment, earnings, and service receipt after 30 months. This summary focuses on the comparison between the group who received the full-WIA services versus the group who received core-and-intensive services. The study was a randomized controlled trial, where customers in each local area were randomly assigned to one of three groups: full-WIA, core-and-intensive, or core. The authors compared the outcomes between the groups from baseline to 30 months after study enrollment. The study found that full-WIA customers were significantly more likely than core-and-intensive customers to complete a training program. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects are attributable to the Adult and Dislocated Worker programs and not to other factors.","Adult and Dislocated Worker programs","Adult and Dislocated Worker programs Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA)","Adult, Unemployed",,"United States",2017,https://www.mathematica-mpr.com/our-publications-and-findings/publications/prov… "Evaluating recidivism and job quality outcomes for participants in the Hoosier Initiative for Reentry Employment (HIRE) program","Northcutt Bohmert, M., Hood, B. J., & Meckes, J. (2017). Evaluating recidivism and job quality outcomes for participants in the Hoosier Initiative for Reentry Employment (HIRE) program. Corrections: Policy, Practice and Research, 2(2), 110-129.",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of job placement through the Hoosier Initiative for Reentry Employment (HIRE) program on recidivism among people released from Indiana prisons in 2014. The authors used HIRE program data and Indiana Department of Corrections data on the prison population to compare the recidivism outcomes of previously incarcerated people who were placed in a job through HIRE with the outcomes of those who were not placed in a job by the HIRE program. The authors used a statistical model to compare rates of recidivism between these two groups. The study found a statistically significant relationship between the intervention and recidivism. People obtaining a job placement were less likely to be reincarcerated between one to two years after release than nonparticipants who did not use intervention program services. The study also examined employment outcomes but these were not eligible for review. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to job placement through HIRE; other factors are likely to have contributed.","the Hoosier Initiative for Reentry Employment (HIRE) program","Other employment and reemployment Reentry",Justice-involved,,"United States",2017,https://doi.org/10.1080/23774657.2016.1277378 "The effect of changing employers’ access to criminal histories on ex-offenders’ labor market outcomes: Evidence from the 2010-2012 Massachusetts CORI Reform","Jackson, O., & Zhao, B. (2017). The effect of changing employers’ access to criminal histories on ex-offenders’ labor market outcomes: Evidence from the 2010-2012 Massachusetts CORI Reform. Boston, MA: Federal Reserve Bank of Boston. [Study 1: Ban the Box reform]",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Unfavorable impacts Earnings and wages Employment-Low-Unfavorable impacts Employment","Summary: The state of Massachusetts, as part of the Criminal Offender Record Information (CORI) Reform, implemented a policy change known as Ban the Box, which refers to a box job seekers would check to report their criminal histories in job applications. The study’s objective was to examine the impact of Ban the Box on employment and earnings among people with a criminal record. The authors investigated similar research questions for another contrast, which is available here. The authors used a nonexperimental design to compare people with a criminal record who were impacted by the Ban the Box reform with a group of people with a criminal record who were not impacted (that is, those who did not have a criminal record until after the Ban the Box reform). The authors compared impacts on employment and earnings using Unemployment Insurance wage records and CORI from the state Department of Criminal Justice Information Services for six quarters after the reform was implemented. For each of the six quarters after the start of the reform, the Ban the Box reform was significantly associated with an employment rate that was 1.0 to 3.8 percentage points lower among the treatment group compared with the comparison group. The reform was also significantly associated with relatively lower earnings among the treatment group in two of the six quarters after the reform but was not associated with a difference in earnings in the other four quarters. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Ban the Box reform; other factors are likely to have contributed.","Criminal Offender Record Information (CORI) Reform",Reentry,Justice-involved,,"United States",2017,https://papers.ssrn.com/sol3/papers.cfm?abstract_id=2942005 "The effect of changing employers’ access to criminal histories on ex-offenders’ labor market outcomes: Evidence from the 2010-2012 Massachusetts CORI Reform","Jackson, O., & Zhao, B. (2017). The effect of changing employers’ access to criminal histories on ex-offenders’ labor market outcomes: Evidence from the 2010-2012 Massachusetts CORI Reform. Boston, MA: Federal Reserve Bank of Boston. [Study 2: Record access reform]",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Mixed impacts Employment","Summary: The state of Massachusetts, as part of the Criminal Offender Record Information (CORI) Reform, implemented a policy change to reduce access to job applicants’ criminal histories. The study’s objective was to examine the impact of the record access reform on employment and earnings among people with a criminal record. The authors investigated similar research questions for another contrast, which is available here. The authors used a nonexperimental design to compare people with a criminal record who were impacted by the record access reform with a similar group of people who were not impacted by the reform. The authors compared impacts on employment and earnings using Unemployment Insurance wage records and CORI from the state Department of Criminal Justice Information Services for 14 quarters after the reform was implemented. The study found a mixed relationship between record access reform and the employment rate of people. In quarters 1 to 5, there was either no impact on employment or a small positive impact. In quarters 6 to 14, this relationship was significant and negative, which means that record access reform was associated with a lower employment rate among the treatment group compared with the comparison group. The record access reform was associated, however, with significantly increased earnings in 5 of the 14 quarters after implementation, but it showed no impact in the rest of the 14 quarters. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the record access reform; other factors are likely to have contributed.","Criminal Offender Record Information (CORI) Reform",Reentry,Justice-involved,,"United States",2017,https://papers.ssrn.com/sol3/papers.cfm?abstract_id=2942005 "Testing rapid connections to subsidized private sector jobs for low-income individuals in San Francisco: Implementation and early impacts of the STEP Forward program","Walter, J, Navarro, D, Anderson, C., & Tso, A. (2017). Testing rapid connections to subsidized private sector jobs for low-income individuals in San Francisco: Implementation and early impacts of the STEP Forward program. OPRE Report 2017-103. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-No impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of STEP Forward on employment, earnings, and education outcomes. The authors used a randomized controlled trial to estimate impacts of enrollment in STEP Forward, using administrative data on enrollees and enrollees’ self-reported data. The study found that people enrolled in STEP Forward were more likely to become employed and earned more after random assignment than people in the control group. There were no significant differences between the groups in their education outcomes. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to STEP Forward, and not to other factors.","STEP Forward","Adult and Dislocated Worker programs Job search assistance and supportive services","Other barriers",,"Urban, United States",2017,https://www.acf.hhs.gov/opre/resource/testing-rapid-connections-subsidized-priv… "North Dakota State College of Science TAACCCT Project: North Dakota Advanced Manufacturing Skills Training Initiative (NDAMSTI) final evaluation report","WorkED Consulting. (2017). North Dakota State College of Science TAACCCT Project: North Dakota Advanced Manufacturing Skills Training Initiative (NDAMSTI) final evaluation report. Burke, VA: WorkED Consulting","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the North Dakota Advanced Manufacturing Skills Training Initiative (NDAMSTI) on earnings and employment outcomes. The authors used an interrupted time series design to examine employment and earnings outcomes associated with the completion of the NDAMSTI program. The study found that participation in the NDAMSTI program was associated with higher hourly wages, on average. However, the study did not include tests of statistical significance. The quality of causal evidence presented in this report is low because the authors did not account for trends in outcomes before the intervention. This means we are not confident that the estimated effects are attributable to the NDAMSTI program; other factors are likely to have contributed.","the North Dakota Advanced Manufacturing Skills Training Initiative (NDAMSTI)","Basic skills Capacity building programs Community college education and other classroom training",Adult,,"United States",2017, "North Dakota State College of Science TAACCCT Project: North Dakota Advanced Manufacturing Skills Training Initiative (NDAMSTI) final evaluation report","WorkED Consulting. (2017). North Dakota State College of Science TAACCCT Project: North Dakota Advanced Manufacturing Skills Training Initiative (NDAMSTI) final evaluation report. Burke, VA: WorkED Consulting.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Education and skills gains-Low-No impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the North Dakota Advanced Manufacturing Skills Training Initiative (NDAMSTI) on education, earnings, and employment outcomes. The authors used a nonexperimental design to compare the outcomes of the NDAMSTI program participants to a historic cohort of students enrolled in the same welding program five years prior to the grant funding. The study found that NDAMSTI participation was positively related to program completion and negatively related to rates of continuing education, employment, and wage increases. However, the study did not include tests of statistical significance. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the NDAMSTI program; other factors are likely to have contributed.","the North Dakota Advanced Manufacturing Skills Training Initiative (NDAMSTI)","Basic skills Capacity building programs Community college education and other classroom training",Adult,,"United States",2017, "Southeastern Economic and Education Leadership Consortium (SEELC) final report","Takyi-Laryea, A., Gall, A., Chamberlin, M., Naughton, L., & Spychala, B. G. (2017). Southeastern Economic and Education Leadership Consortium (SEELC) final report. Fairfax, VA: ICF.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Education and skills gains-Low-No impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the WorkKeys® assessment, a component of the TAACCCT-funded programming at Southeastern Economic and Education Leadership Consortium (SEELC) colleges, on education, earnings outcomes, and employment. The authors used a nonexperimental design to compare the education, earnings outcomes, and employment of SEELC program participants that took the WorkKeys® assessment to a matched comparison group of SEELC participants enrolled at the same colleges who did not take the assessment. The study found a significant relationship between taking the WorkKeys® assessment and earnings, with SEELC participants who took the assessment receiving higher post-program hourly wages than the comparison group of students who did not take the assessment. The quality of causal evidence presented in this study is low because the authors did not ensure that the groups being compared were similar before the intervention nor include sufficient control variables. This means we are not confident that the estimated effects are attributable to the SEELC consortium WorkKeys® assessment; other factors are likely to have contributed.","the Southeastern Economic and Education Leadership Consortium (SEELC)","Capacity building programs Community college education and other classroom training","Adult, Veteran or military",,"United States",2017,http://www.skillscommons.org/handle/taaccct/13986 "University of the District of Columbia Community College TAACCCT round 3 final evaluation report.","Takyi-Laryea, A., Passa, K., & Gall, A. (2017). University of the District of Columbia Community College TAACCCT round 3 final evaluation report. Fairfax, VA: ICF.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the grant-funded DC Construction Academy (DCCA) program on education outcomes. The study used a nonexperimental design to compare the education outcomes of DCCA program participants to a matched historical comparison group of students enrolled in the same construction programs prior to TAACCCT funding. The study found that DCCA program participants were significantly more likely to attain a credential than the comparison group. The quality of causal evidence presented in this study is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the DCCA program; other factors are likely to have contributed.","the DC Construction Academy (DCCA)","Capacity building programs Community college education and other classroom training",Adult,,"United States",2017,https://www.skillscommons.org/bitstream/handle/taaccct/15691/UDC-CC%20TAACCCT%2… "Accelerating Connections to Employment volume I final evaluation report","Modicamore, D., Lamb, Y., Taylor, J., Takyi-Laryea, A., Karageorge, K., & Ferroggiaro, E. (2017). Accelerating Connections to Employment volume I final evaluation report. Fairfax, VA: ICF.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-Mixed impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Accelerating Connections to Employment (ACE) program on education, earnings, and employment outcomes. The authors used a randomized controlled trial. Eligible participants were randomly assigned to either the treatment group, which received ACE training services, or the control group, which received business-as-usual services. The primary data sources were administrative enrollment and tracking records, one- and two-year follow-up surveys, and state unemployment insurance (UI) records. The study found that the ACE program had a significant, positive impact on employment rates, earnings, and rates of occupational credential attainment when compared to the control group. However, individuals in the control group were significantly more likely to enroll in other training or education programs than ACE participants. The quality of causal evidence presented in this report is high for the education outcome measure ""enrolled in additional training or education program"" because it was based on a randomized controlled trial with low attrition. This means we are confident that the estimated effects are attributable to the ACE program, and not to other factors. However, the quality of causal evidence is moderate for the remaining education, earnings, and employment outcomes because sample attrition for these outcomes was high, but the authors controlled for key differences between the treatment and control groups at baseline. This means we are somewhat confident that estimated effects on these outcomes would be attributable to the ACE program, but other factors might have also contributed.","the Accelerating Connections to Employment (ACE) Program","Basic skills Capacity building programs Community college education and other classroom training","Adult, Low-skilled",,"United States",2017, "Maine is IT! program evaluation final report","Horwood, T., Usher, K.., McKinney, M., & Passa, K. (2017). Maine is IT! program evaluation final report. Fairfax, VA: ICF.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to evaluate the effects of the Maine is IT! program on education outcomes. The authors used a nonexperimental design to compare the outcomes of students enrolled in the Maine is IT! program to a matched comparison group of students enrolled at the same college and at the same point of entry in business administration programs of study. Using student tracking data, the authors conducted statistical models to examine differences between the groups. The study found that compared to non-participating students, students enrolled in the Maine is IT! program were significantly more likely to complete credit hours, be retained in their program of study, and earn a degree. The quality of causal evidence presented in this study is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Maine is IT! program; other factors are likely to have contributed.","Maine is IT! Program","and Math (STEM) programs Engineering Science Technology Capacity building programs Community college education and other classroom training",Adult,,"United States",2017,https://www.skillscommons.org/handle/taaccct/13794 "The real effects of mandated information on social responsibility in financial reports: Evidence from mine-safety records","Christensen, H. B., Floyd, E., Liu, L. Y., & Maffett, M. (2017). The real effects of mandated information on social responsibility in financial reports: Evidence from mine-safety records. Journal of Accounting and Economics, 64(2-3), 284-304. https://doi.org/10.1016/j.jacceco.2017.08.001","Mine Workers and Mine Health and Safety","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Health and safety-Mod/high-Favorable impacts Health and safety","Summary: The study’s objective was to examine the impact of mine safety disclosures (MSD) on health and safety outcomes. The authors used a difference-in-differences model to compare the changes in safety citations and injury rates for mines that are required to include MSD records in financial reports with mines that are not. The study found that including safety records in financial reports is associated with a significant reduction in mining-related citations and worker injuries. The quality of causal evidence presented in this report is moderate because it is based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the mandatory inclusion of mine safety disclosures (MSD), but other factors might also have contributed.",,"Mine safety and health Workplace injury",,"Mining, quarrying, and oil and gas extraction","United States",2017,https://doi.org/10.1016/j.jacceco.2017.08.001 "Child schooling and child work in the presence of a partial education subsidy","de Hoop, J., Friedman, J., Kandpal, E., & Rosati, F. (2017). Child schooling and child work in the presence of a partial education subsidy. Retrieved from http://documents.worldbank.org/curated/en/501961504719564270/pdf/WPS8182.pdf","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Unfavorable impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The purpose of the study was to assess the impact of a conditional cash transfer program, the Pantawid Pamilya Pilipino Program, on children’s school attendance and participation and their participation in work inside and outside of their households. The study was a randomized controlled trial. The researchers used household surveys, administered at baseline and two and half years after the intervention began, to assess program impact on schooling and child labor outcomes between the treatment and control groups. The study found that, two and a half years after the program began, a significantly higher proportion of children participating in the program worked for pay outside of their household than children not participating in the program. However, there was a significantly greater proportion of children in the treatment group than the control group who attended school and attended school regularly. Similarly, children in the treatment group attended a significantly greater number of days of school than those in the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the the Pantawid Pamilya Pilipino Program, and not to other factors.","Pantawid Pamilya Pilipino Program","Child labor","Other, Low income",,International,2017,http://documents.worldbank.org/curated/en/501961504719564270/pdf/WPS8182.pdf "The influence of Bolsa Familia conditional cash transfer program on child labor in Brazil","Pais, P. S. M., Silva, F. D. F., & Teixeira, E. C. (2017). The influence of Bolsa Familia conditional cash transfer program on child labor in Brazil. International Journal of Social Economics, 44(2), 206-221.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Unfavorable impacts Child labor","Summary: The objective of the study was to examine the impact of the Bolsa Familia conditional cash transfer program on child labor in Brazil. The study used a nonexperimental design to compare labor outcomes of children who received the conditional cash transfer with a matched comparison group of children who did not, based on data from a national household survey. The study found that the program was significantly related to an increase in child labor, with a 52.5 percent increase in hours spent on child labor for those receiving Bolsa Familia. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to Bolsa Familia; other factors are likely to have contributed.","Bolsa Familia","Child labor","Other, Low income",,International,2017, "The impact of Medicare Part D on self-employment.","Moulton, J. G., Diebold, J. C., & Scott, J. C. (2017). The impact of Medicare Part D on self-employment. Research on Aging, 39(1), 64-85.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The study examined the effect of the introduction of Medicare Part D on self-employment. The authors used a nonexperimental approach and data from the American Community Survey to estimate the impact. The authors found that self-employment significantly increased by 0.5 percentage points after the program began. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects on self-employment are attributable to the introduction of Medicare Part D, although other factors might also have contributed.","Medicare Part D","Federal retirement benefits Older workers' programs","Adult, Older worker",,"United States",2017, "The effect of the Affordable Care Act on labor transitions among older workers.","Camilleri, S. E. (2017). The effect of the Affordable Care Act on labor transitions among older workers. In Three papers on the Affordable Care Act (Doctoral dissertation). North Carolina State University, Raleigh, NC.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-No impacts Employment","Summary: The study examined the impact of the Affordable Care Act (ACA) on the employment outcomes of older workers. The author used data from the Current Population Survey for 2011–2016 and regression analyses to estimate impacts. The study found that the ACA was not associated with employment outcomes among older workers. The quality of causal evidence presented in this report is moderate because the study is based on a well-implemented nonexperimental design. This means we are somewhat confident that any estimated effects are attributable to the ACA, but other factors might also have contributed.","Affordable Care Act (ACA)","Older workers' programs Health insurance","Adult, Older worker",,"United States",2017, "Does protecting older workers from discrimination make it harder to get hired? Evidence from disability discrimination laws.","Neumark, D., Song, J., & Button, P. (2017). Does protecting older workers from discrimination make it harder to get hired? Evidence from disability discrimination laws. Research on Aging, 39(1), 29-63.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Mixed impacts Employment","Summary: The study examined the impact of the strength of state disability discrimination laws on hiring rates of older men. The study used statistical models and data from the Health and Retirement Study and the Survey of Income and Program Participation to estimate the impacts. The study found no relationship between the strength of disability discrimination laws and the hiring rate for older unemployed disabled and nondisabled men. The quality of casual evidence presented in this report is low because the study is a nonexperimental analysis that did not demonstrate that the groups being compared were similar and did not account for possible differences in the analysis. This means we are not confident that the estimated effects are attributable to state disability discrimination laws; other factors are likely to have contributed.","Disability discrimination laws","Health Older workers' programs","Adult, Older worker, Male",,"United States",2017,https://journals.sagepub.com/doi/full/10.1177/0164027516656142 "Assessing the statewide impact of the Specter Vocational Program on reentry outcomes: A propensity score matching analysis.","Hill, L., Scaggs, S., & Bales, W. D. (2017). Assessing the statewide impact of the Specter Vocational Program on reentry outcomes: A propensity score matching analysis. Journal of Offender Rehabilitation, 56(1), 61-86.",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine the impact of completing the Workplace and Community Transition Training for Incarcerated Individuals (WCTTII) program on the employment and recidivism outcomes of young people released from prison in Florida. The authors used a nonexperimental matching design to create a comparison group of former prisoners who were similar to WCTTII program graduates but who did not participate in the WCTTII program or who started the program but did not complete it. The authors estimated the program’s impact by comparing employment and recidivism outcomes for program graduates with those for the matched comparison group using administrative data from the Florida Department of Corrections Offender Based Information System, law enforcement, and the Department of Revenues. The study found that the WCTTII program decreased the proportion of former prisoners who were reconvicted or re-incarcerated within three years of their release. The study found no statistically significant relationships between the program and employment within three months of release. The quality of causal evidence on recidivism outcomes presented in this report is moderate because they were based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the WCTTII program, but other factors might also have contributed. The quality of causal evidence on employment is low because the authors did not adequately account for differences in employment history before the intervention.","Workplace and Community Transition Training for Incarcerated Individuals","Other employment and reemployment Reentry",Justice-involved,,"United States",2017, "The differences in first-year retention rates for adult and traditional community college students enrolled and not enrolled in learning communities","Budd, L. B. (2017). The differences in first-year retention rates for adult and traditional community college students enrolled and not enrolled in learning communities. (Doctoral dissertation). Retrieved from ProQuest Dissertations and Theses database. (UMI No. 10639485)","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to determine the impact of participation in the learning communities on retention rates for community college students. The author used a nonexperimental design to compare the enrollment rates of first-time community college students who enrolled in learning communities to those who did not, including one semester and one year after initial enrollment. The study found that students who participated in learning communities were significantly more likely to enroll in college one year later. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the learning communities; other factors are likely to have contributed.","the learning communities","Community college education and other classroom training",Adult,,"United States",2017,https://search.proquest.com/docview/2007545357 "Quantitative analysis of an urban community college S-STEM program","Chapman, A. (2017). Quantitative analysis of an urban community college S-STEM program. (Unpublished doctoral dissertation). University of Phoenix, Phoenix, AZ.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Scholarships in Science, Technology, Engineering, and Mathematics (S-STEM) program on community college students’ success and progress. The study used a nonexperimental design to compare the outcomes of S-STEM program participants to a matched comparison group. Using administrative data from the community college, the author tested for group differences in student success and progress rate. The study found that participation in the S-STEM program was associated with significantly higher rates of student success and progress. The quality of causal evidence presented in this study is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the S-STEM program, but other factors might also have contributed.","the Scholarships in Science, Technology, Engineering, and Mathematics (S-STEM) program","Community college education and other classroom training Mentoring Science, Technology, Engineering, and Math (STEM) programs","Adult, Low income",,"United States",2017,https://search.proquest.com/openview/0549b8ce7f3331a8abe04827df253116/1?pq-orig… "Impact of the Accelerate You! instructional model on student success","Henderson, T. F. (2017). Impact of the Accelerate You! instructional model on student success. (Unpublished doctoral dissertation). Murray State University, Murray, KY.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to examine the effects of the Accelerate You! (AY!) program on academic persistence. The study used a nonexperimental design to compare the outcomes of AY! program participants to a comparison group. Using academic records, the author tested for group differences in semester-to-semester persistence. The study found no significant relationships between AY! program participation and academic persistence. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to Accelerate You!; other factors are likely to have contributed.","the Accelerate You! (AY!) program","Community college education and other classroom training","Adult, Other barriers",,"United States",2017,https://digitalcommons.murraystate.edu/cgi/viewcontent.cgi?referer=https%3A//sc… "Maintaining success rates: Does Statway® sustain its impact as it scales to new classrooms and institutions?","Huang, M., & Yamada, H. (2017). Maintaining success rates: Does Statway® sustain its impact as it scales to new classrooms and institutions? Carnegie Foundation for the Advancement of Teaching: Stanford, CA.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Statway® math program on community college students’ earning of math credits. The authors used a nonexperimental design to compare the outcomes of students who were in the Statway® program to a matched comparison group. When compared to non-participating students, the study found that Statway® program participation was associated with a significantly higher likelihood of earning college math credit. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Statway® program; other factors are likely to have contributed.","the Statway® math program","Community college education and other classroom training",Adult,,"United States",2017,https://eric.ed.gov/?id=ED582441 "Essays on the economics of higher education: The academic and labor market outcomes to four to two-year transfer, summer enrollment, and year-round Pell","Liu, Y. T. (2017). Essays on the economics of higher education: The academic and labor market outcomes to four to two-year transfer, summer enrollment, and year-round Pell (Unpublished doctoral dissertation). Columbia University, New York, NY. doi: 10.7916/D8M90N11","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine the impact of receiving year-round Pell (YRP) funding on community college students’ enrollment, credit accumulation, degree completion, employment, and earnings. The study used a nonexperimental design to compare the effects of receiving the YRP funding on outcomes for those in the treatment group versus those in the comparison group. The study found that students who received YRP were significantly more likely to enroll in summer courses that year, earn more credits during the semester, and earn more money three years later. The quality of causal evidence presented in this study is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the YRP, but other factors might also have contributed.","Year-Round Pell (YRP) funding","Community college education and other classroom training","Adult, Low income",,"United States",2017,https://academiccommons.columbia.edu/doi/10.7916/D8M90N11 "Innovative pathways through developmental education and postsecondary success: An examination of developmental math interventions across Texas","Weisburst, E., Daughetry, L., Miller, T., Martorell, P., & Coisairt, J. (2017). Innovative pathways through developmental education and postsecondary success: An examination of developmental math interventions across Texas. The Journal of Higher Education, 88(2), 183-209. doi: 10.1080/00221546.2016.1243956","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of two developmental math courses on community college students’ rates of passing, enrollment, completion, persistence, transfer, and graduation. This summary focuses on the accelerated developmental courses. This study used a nonexperimental design to compare the outcomes of students who participated in the accelerated developmental courses to those who did not. The study reported outcomes one semester, one year, and two years after students first enrolled in the courses. The study found that enrollment in the accelerated developmental courses was associated with a significant increase in passing rates in the developmental math course after one semester and a significant increased likelihood of enrolling and passing the college-level math course after one semester and each subsequent year. Accelerated course enrollment was also significantly associated with an increased likelihood of graduating after two years. The quality of causal evidence presented in this study is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the accelerated developmental courses, but other factors might also have contributed.","Accelerated Developmental Education","Community college education and other classroom training",Adult,,"United States",2017,https://doi.org/10.1080/00221546.2016.1243956 "Innovative pathways through developmental education and postsecondary success: An examination of developmental math interventions across Texas","Weisburst, E., Daughetry, L., Miller, T., Martorell, P., & Coisairt, J. (2017). Innovative pathways through developmental education and postsecondary success: An examination of developmental math interventions across Texas. The Journal of Higher Education, 88(2), 183-209. doi: 10.1080/00221546.2016.1243956","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of two developmental math courses on community college students’ rates of passing, enrollment, completion, persistence, transfer, and graduation. This summary focuses on the developmental math paired with student success course. This study used a nonexperimental design to compare the outcomes of students who participated in the developmental math paired with student success course to those who did not. The study reported outcomes one semester, one year, and two years after students first enrolled in the courses. The study found that enrollment in the developmental math paired with student success course was associated with an increase in passing rates in the developmental math course after one semester, an increased likelihood of enrolling and passing the college-level math course after one semester and one year later, and an increased likelihood of persistence one and two years after initial enrollment. These outcomes were all statistically significant. The quality of causal evidence presented in this study is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the developmental math paired with student success course, but other factors might also have contributed.","Accelerated Developmental Education","Community college education and other classroom training",Adult,,"United States",2017,https://doi.org/10.1080/00221546.2016.1243956 "STEM-Connect at the University of Vermont, College of Engineering and Mathematical Sciences: Program evaluation final report","Farrell, R., Harris, D., Meyers, H., & Ratmeyer, S. (2017). STEM-Connect at the University of Vermont, College of Engineering and Mathematical Sciences: Program evaluation final report. Swanton, VT: Core Research and Evaluation.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the effects of the University of Vermont’s (UVM) Science, Technology, Engineering and Math (STEM) Connect program on earnings and employment outcomes. The study used a nonexperimental design to compare the outcomes of students who were enrolled in the UVM STEM-Connect program to a matched comparison group of students who took a STEM-Connect course but were not enrolled in the STEM-Connect program. The study found no statistically significant relationships between STEM-Connect program participation and average quarterly wages or employment rates. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the UVM STEM-Connect program; other factors are likely to have contributed.","the UVM STEM-Connect Program","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Dislocated or displaced worker, Unemployed, Veteran or military",,"United States",2017,http://www.skillscommons.org/bitstream/handle/taaccct/13127/STEM-Connect%20Fina… "Pima Community College Pathways to Healthcare Program: Implementation and early impact report (Report No. 2017-10)","Gardiner, K., Rolston, H., Fein, D., & Cho, S-W. (2017). Pima Community College Pathways to Healthcare Program: Implementation and early impact report (Report No. 2017-10). Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to assess the impact of the Pathways to Healthcare program on students’ education and employment outcomes. The study used a randomized controlled trial to compare outcomes of students enrolled in the Pathways to Healthcare program with non-participants. The study found that Pathways to Healthcare program participants had significantly higher average total hours of college occupational training, higher rates of certification receipt, and higher rates of credential receipt from a college than the control group. The quality of causal evidence presented in this study is high because it is based on a well-implemented randomized controlled trial with low attrition. This means we are confident that the estimated effects are attributable to the Pathways to Healthcare program and not to other factors.","the Pathways to Healthcare Program","Basic skills Capacity building programs Community college education and other classroom training","Adult, Low-skilled, Low income","Health care and social assistance","United States",2017,https://www.acf.hhs.gov/sites/default/files/opre/pathways_to_healthcare_impleme… "Final evaluation Golden Triangle Modern Manufacturing Project","Harpole, S. (2017). Final evaluation Golden Triangle Modern Manufacturing Project. SHH Consulting, LLC","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the Golden Triangle Modern Manufacturing Project on education, earnings, and employment outcomes. The author used a nonexperimental design to compare outcomes of Golden Triangle Modern Manufacturing Project participants to a matched comparison group. The study found that program participation was significantly associated with increases in program retention, credential attainment, and earnings. The quality of causal evidence presented in this study is low because the author used a comparison group from previous enrollment years presenting a confounding factor. This means we are not confident that the estimated effects are attributable to Golden Triangle Modern Manufacturing Project; other factors are likely to have contributed.","the Golden Triangle Modern Manufacturing Project","Capacity building programs Community college education and other classroom training","Adult, Dislocated or displaced worker, Unemployed, Low-skilled, Veteran or military",,"United States",2017,https://www.skillscommons.org/handle/taaccct/15669 "RevUp: Empowering Montana's workforce student impact analysis","Hong, Y., Boyette, J., & Staklis, S. (2017). RevUp: Empowering Montana's workforce student impact analysis study report. Berkeley, CA: RTI International.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Mixed impacts Education and skills gains","Summary: The study’s objective was to examine the impact of Montana’s RevUp program on education outcomes. The authors used a nonexperimental design to compare education outcomes of RevUp participants to a matched comparison group. The study found that RevUp participation was significantly associated with lower college credit accumulation, higher RevUp course credit accumulation, lower program persistence, and higher dropout. The quality of causal evidence presented in this report is low because the authors did not use sufficient controls in their analysis. This means we are not confident that the estimated effects are attributable to the RevUp program; other factors are likely to have contributed.","the RevUp Program","Capacity building programs Community college education and other classroom training",Adult,,"United States",2017,http://www.gfcmsu.edu/revup/documents/RevUp_DevMathStudy_09302017.pdf "Orthotics, Prosthetics, and Pedorthics (HOPE) careers consortium: Final evaluation report","Good, K., & Yeh-Ho, H. (2017). Orthotics, Prosthetics, and Pedorthics (HOPE) careers consortium: Final evaluation report. Denver, CO: McREL International.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Orthotics, Prosthetics & Pedorthics (HOPE) careers consortium program on education outcomes. The authors used a nonexperimental design to compare education outcomes of HOPE participants to a matched comparison group with institutional research data. The study found no significant associations between HOPE participation and program completion rates, completion of more than one certificate or degree, or furthering education status. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the HOPE program; other factors are likely to have contributed.","the Orthotics, Prosthetics & Pedorthics (HOPE) Careers Consortium Program","Capacity building programs Community college education and other classroom training","Adult, Other barriers, Dislocated or displaced worker, Unemployed, Veteran or military",,"United States",2017,https://www.skillscommons.org/bitstream/handle/taaccct/13872/hope-consortium-tc… "RITA consortium final evaluation report","The Improve Group. (2017). RITA consortium final evaluation report. Saint Paul, MN: The Improve Group.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Education and skills gains-Low-Mixed impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of enhancements to the Rural Information Technology Alliance (RITA) program on education, earnings, and employment outcomes. The authors used a nonexperimental design to compare the outcomes of RITA participants to a matched comparison group at four community colleges. The study found that RITA program students were significantly more likely to complete an associate’s degree at two of the four colleges; however, RITA students were significantly less likely to complete an associate’s degree at the other two colleges. RITA participation was also positively associated with completing any degree (associate, diploma, or certificate) at one school, and negatively associated with completing any degree at another school. These findings were significant. The quality of causal evidence presented in this study is low because the authors used a comparison group from previous enrollment years presenting a confounding factor. This means we are not confident that the estimated effects are attributable to the RITA program; other factors are likely to have contributed.","the Rural Information Technology Alliance (RITA)","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs",Adult,,"Rural, United States",2017,http://www.skillscommons.org/bitstream/handle/taaccct/13172/RITA%20Final%20Summ… "Evaluation of the Community College Consortium for Bioscience Credentials (c3bc): Final report.","Alamprese, J. A., Costelloe, S., Price, C., & Zeidenberg, M. (2017). Evaluation of the Community College Consortium for Bioscience Credentials (c3bc): Final report. Cambridge, MA: Abt Associates.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Unfavorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Community College Consortium for Bioscience Credentials (c3bc) redesigned courses on course completion rates. The authors used a nonexperimental design to compare course completion outcomes of c3bc participants to a matched comparison group. The study found that enrollment in c3bc courses was significantly associated with lower course completion rates. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the c3bc redesigned courses; other factors are likely to have contributed.","the Community College Consortium for Bioscience Credentials (c3bc) Course Redesigns","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Dislocated or displaced worker",,"United States",2017,https://www.abtassociates.com/insights/publications/report/evaluation-of-the-co… "New evidence on integrated  career pathways: Final impact report for Accelerating Opportunity","Anderson, T., Kuehn, D., Eyster, L., Barnow, B., & Lerman, R. I. (2017). New evidence on integrated career pathways: Final impact report for Accelerating Opportunity. Washington, D.C.:  Urban Institute.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Mixed impacts Earnings and wages Education and skills gains-Mod/high-Mixed impacts Education and skills gains Employment-Mod/high-Mixed impacts Employment","Summary: The study’s objective was to examine the impact of the Accelerating Opportunity (AO) program on education, earnings, and employment outcomes in four states. This summary contains the findings from Illinois. The authors used a nonexperimental design to compare education, earnings, and employment outcomes of AO participants to a matched comparison group. The study found that AO participants were significantly more likely to earn a credential, earn more credentials, and earn more than 12 credits than the comparison group. AO participants also had a significantly higher employment rate and medium-term earning gains compared to the comparison group. However, AO participants earned fewer college credits than the comparison group. The quality of causal evidence presented in this study is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the Accelerating Opportunity program, but other factors might also have contributed.","Accelerating Opportunity (AO) program","Basic skills Capacity building programs Community college education and other classroom training","Adult, Other barriers",,"United States",2017,http://tawb.org/wp-content/uploads/2017/06/ao_final_impacts.pdf "New evidence on integrated career pathways: Final impact report for Accelerating Opportunity","Anderson, T., Kuehn, D., Eyster, L., Barnow, B., & Lerman, R. I. (2017). New evidence on integrated career pathways: Final impact report for Accelerating Opportunity. Washington, D.C.: Urban Institute.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-Mixed impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Accelerating Opportunity (AO) program on education, earnings, and employment outcomes in four states. This summary contains the findings from Kansas. The authors used a nonexperimental design to compare education, earnings, and employment outcomes of AO participants to a matched comparison group.  The study found AO participants were significantly more likely to earn a credential and earn more credentials than the comparison group. AO participants also had a significantly higher employment rate and earning gains compared to the comparison group. However, AO participants earned significantly fewer college credits than the comparison group. The quality of causal evidence presented in this study is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the Accelerating Opportunity program, but other factors might also have contributed.  ","Accelerating Opportunity (AO) program","Basic skills Capacity building programs Community college education and other classroom training","Adult, Other barriers",,"United States",2017,http://tawb.org/wp-content/uploads/2017/06/ao_final_impacts.pdf "Project IMPACT: Innovative multi-industry partnership and career training project final evaluation report. Gateway Community Technical College","Jensen, J., Horohov, J., & Waddington, J. (2017). Project IMPACT: Innovative multi-industry partnership and career training project final evaluation report. Gateway Community Technical College. Lexington, KY: University of Kentucky, College of Education, Educational Policy Studies & Evaluation.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study’s objective was to assess the impact of Project IMPACT on education, earnings, and employment outcomes. Using academic records from the college as well as data obtained from the Kentucky Center for Workforce Statistics, the authors used a nonexperimental design to compare outcomes of Project IMPACT participants to outcomes of historical cohort students who were enrolled in the Project IMPACT programs of study prior to grant implementation. The study found that participating in Project IMPACT was significantly associated with a higher likelihood to take courses, pass courses, earn credits, and receive credentials. The study also found that participating in Project IMPACT was significantly associated with higher earnings in the quarter following enrollment. The quality of causal evidence presented in this study is low for the education and employment outcomes because the authors used a comparison group from previous enrollment years presenting a confounding factor and because the authors did not ensure the groups being compared were similar before the intervention, respectively. This means we are not confident that the estimated effects are attributable to Project IMPACT; other factors are likely to have contributed.","Project IMPACT","Employer partnerships Capacity building programs Community college education and other classroom training","Adult, Other barriers, Veteran or military",,"United States",2017,https://www.skillscommons.org/bitstream/handle/taaccct/15674/IMPACT%20Final%20E… "New evidence on integrated  career pathways: Final impact report for Accelerating Opportunity"," Anderson, T., Kuehn, D., Eyster, L., Barnow, B., & Lerman, R. I. (2017). New evidence on integrated career pathways: Final impact report for Accelerating Opportunity. Washington, D.C.: Urban Institute.  ","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Unfavorable impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Accelerating Opportunity (AO) program on education, earnings, and employment outcomes in four states. This summary contains the findings from Kentucky. The authors used a nonexperimental design to compare education, earnings, and employment outcomes of AO participants to a matched comparison group.  The study found AO participants were significantly more likely to earn a credential, earn more credentials, earn more college credits, and were likely to earn more than 12 credits than the comparison group. AO participants also had a significantly higher employment rate, but also lower earnings compared to the comparison group.  The quality of causal evidence presented in this study is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the Accelerating Opportunity program, but other factors might also have contributed.","Accelerating Opportunity (AO) program","Basic skills Capacity building programs Community college education and other classroom training","Adult, Other barriers",,"United States",2017,http://tawb.org/wp-content/uploads/2017/06/ao_final_impacts.pdf "Final evaluation report: Linn-Benton Community College","Kelley-Smith, A., Schoeph, K., Hamai, T., & Bishop, M. (2017). Final evaluation report: Linn-Benton Community College. Albany, OR: LB iLearn Campus.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study’s objective was to assess the impact of degree and certificate programming offered at Linn-Benton Community College’s (LBCC) iLearn campus compared to traditional programming offered at the community college on various educational, employment, and earnings outcomes. The study used a nonexperimental design to compare the outcomes of students enrolled in the Linn-Benton (LB) iLearn campus to students enrolled in traditional programming. The study found that program participation was significantly associated with increased rates of program completion. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the LB iLearn campus program; other factors are likely to have contributed.","the LB iLearn Campus Program","Capacity building programs Community college education and other classroom training","Adult, Other barriers, Dislocated or displaced worker, Veteran or military",,"United States",2017,https://www.skillscommons.org/handle/taaccct/15675 "New evidence on integrated career pathways: Final impact report for Accelerating Opportunity. ","Anderson, T., Kuehn, D., Eyster, L., Barnow, B., & Lerman, R. I. (2017). New evidence on integrated career pathways: Final impact report for Accelerating Opportunity. Washington, D.C.:  Urban Institute.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Mixed impacts Earnings and wages Education and skills gains-Mod/high-Mixed impacts Education and skills gains Employment-Mod/high-Mixed impacts Employment","Summary: The study’s objective was to examine the impact of the Accelerating Opportunity (AO) program on education, earnings, and employment outcomes in four states. This summary contains the findings from Louisiana. The authors used a nonexperimental design to compare education, earnings, and employment outcomes of AO participants to a matched comparison group.  The study found AO participants were significantly more likely to earn a credential and earn more credentials than the comparison group. AO participants also had a significantly higher short-term employment rate and earning gains compared to the comparison group.  However, AO participants earned significantly fewer college credits than the comparison group. The quality of causal evidence presented in this study is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the Accelerating Opportunity program, but other factors might also have contributed.","Accelerating Opportunity (AO) program","Basic skills Capacity building programs Community college education and other classroom training","Adult, Other barriers",,"United States",2017,http://tawb.org/wp-content/uploads/2017/06/ao_final_impacts.pdf "Butler Community College TAACCCT final evaluation report","Kansas State University Office of Educational Innovation and Evaluation. (2017). Butler Community College TAACCCT final evaluation report. Manhattan, KS: Kansas State University.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the Butler Community College Trade Adjustment Assistance Community College and Career Training (TAACCCT) grant on education, earnings, and employment outcomes. The study used a nonexperimental design to compare the outcomes of students who were in the Butler TAACCCT Information Technology (IT) program to a comparison group. The study found that students in the Butler TAACCCT IT program were significantly more likely to complete their program, be retained in their program, and earn credentials than their counterparts in other selected Career and Technical Education (CTE) courses. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention or include sufficient controls. This means we are not confident that the estimated effects are attributable to the Butler TAACCCT IT program; other factors are likely to have contributed.","the Butler Community College TAACCCT Project","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Dislocated or displaced worker, Veteran or military",,"United States",2017,https://www.skillscommons.org/handle/taaccct/15664 "Final evaluation report: Cincinnati State Technical and Community College: Greater Cincinnati Manufacturing Careers Accelerator (GCMCA)","Belville, J., Romano, G., Frisby, M., Chamberlin, M., & Strem, L. (2017). Final evaluation report: Cincinnati State Technical and Community College: Greater Cincinnati Manufacturing Careers Accelerator (GCMCA).","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Unfavorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Greater Cincinnati Manufacturing Careers Accelerator (GCMCA) program on education outcomes. The author used a nonexperimental design to compare the education persistence of students in the treatment group to students in a matched comparison group. The study found that students in the comparison group were significantly more likely to complete the program than students in the treatment group for both the Welding or Mechanical Engineering Technology Manufacturing and Design programs. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention.This means we are not confident that the estimated effects are attributable to the Greater Cincinnati Manufacturing Careers Accelerator (GCMCA) program; other factors are likely to have contributed.    ","Greater Cincinnati Manufacturing Careers Accelerator (GCMCA) Program","Basic skills Capacity building programs Community college education and other classroom training","Adult, Dislocated or displaced worker, Veteran or military",,"United States",2017, "Thaddeus Stevens College of Technology TAACCCT final evaluation report","Lawrence, M. (2017). Thaddeus Stevens College of Technology TAACCCT final evaluation report. Denton, MD: Community Workforce Advancements, LLC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Mixed impacts Earnings and wages","Summary: The study’s objective was to examine the impact of TAACCCT-funded programs at Thaddeus Stevens College of Technology (TSCT) on earnings outcomes. The study used a nonexperimental design to compare the earnings outcomes of students enrolled in TAACCCT-funded programs at TSCT to two comparison groups: TSCT students who were not enrolled in TAACCCT-funded programs and a group of dislocated workers from surrounding counties. When compared to students who were not enrolled in TAACCCT-funded programs at TSCT, the study found a significant relationship between participating in a TAACCCT-funded program and wages with the treatment group having higher or lower wages than the comparison group depending on the TAACCCT-funded program. When compared to dislocated workers, the study found a significant relationship between program participation and higher wages. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the TAACCCT-funded programs implemented at Thaddeus Stevens College of Technology; other factors are likely to have contributed.","the TAACCCT-funded Programs at Thaddeus Stevens College of Technology","Capacity building programs Community college education and other classroom training",Adult,,"United States",2017, "Evaluation of the Michigan Coalition for Advanced Manufacturing (M-CAM) final report","Lewis-Charp, H., Khemani, D., D’Amico, R., Goger, A., Gutierrez, I., Clark, M., Mack, M., Sarver, M., & van Docto, C. (2017). Evaluation of the Michigan Coalition for Advanced Manufacturing (M-CAM) final report. Oakland, CA: Social Policy Research Associates.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Mixed impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Michigan Coalition for Advanced Manufacturing (M-CAM) program on earnings and employment outcomes. The study used a nonexperimental design to compare students in the treatment group to two different comparison groups of students: students who were not enrolled in M-CAM programs while the program was in operation (contemporary comparison group) and students who were enrolled in the same manufacturing program prior to M-CAM implementation (historical comparison group). The study found that M-CAM participation was significantly associated with higher employment rates and earnings than the contemporary comparison group. However, when compared to the historical comparison group, the study found that M-CAM participation was significantly associated with higher employment rates and lower earnings. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Michigan Coalition for Advanced Manufacturing (M-CAM) program; other factors are likely to have contributed.","the Michigan Coalition for Advanced Manufacturing (M-CAM) Program","Capacity building programs Community college education and other classroom training",Adult,,"United States",2017,https://strategies.workforcegps.org/resources/2019/12/10/15/58/Evaluation-of-th… "Transitioning students from adult education to postsecondary education through co-enrollment career pathways model","Maisak, N. (2017). Transitioning students from adult education to postsecondary education through co-enrollment career pathways model. (Unpublished doctoral dissertation). Charlotte, NC: Wingate University.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to evaluate the impact of the Pathways to Careers program on community college students’ education outcomes. The author used a nonexperimental design to compare the outcomes of students enrolled in the Pathways to Careers program to students enrolled in a traditional Adult Secondary Education (ASE) program. The study found that participation in the Pathways to Careers program was significantly related to increased retention rates and a higher likelihood of transition to postsecondary education. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Pathways to Careers program; other factors are likely to have contributed.","the Pathways to Careers Program","Basic skills Capacity building programs Community college education and other classroom training",Adult,,"Urban, United States",2017,https://eric.ed.gov/?id=ED580629 "WV Bridging the gap TAACCCT round 3: Final evaluation report.","Bellville et al. (2017). WV Bridging the gap TAACCCT round 3: Final evaluation report. Indianapolis, IN: Thomas P. Miller & Associates.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Mod/high-Mixed impacts Education and skills gains Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine the impact of the Bridging the Gap (BTG) program on education, employment, and earnings outcomes. The authors used a nonexperimental design to compare the outcomes of BTG participants to a matched comparison group.  The study found that BTG participation was significantly associated with fewer credits earned and higher dropout rates, but significantly associated with higher credential attainment relative to the comparison group. The quality of causal evidence presented in this study is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the Bridging the Gap program, but other factors might also have contributed.","Accelerated Study in the West Virginia Bridging the Gap (BTG) Program","Capacity building programs Community college education and other classroom training",Adult,,"United States",2017,https://www.skillscommons.org/bitstream/handle/taaccct/16343/WVBTG%20Evaluation… "Outcomes from a certification program for early career professionals in supply chain management","Maxwell, N., Dolfin, S., Bruch, J., & Luca, D. L. (2017). Outcomes from a certification program for early career professionals in supply chain management. Princeton, NJ: Mathematica Policy Research.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine the impact of the Leveraging, Integrating, Networking, and Coordinating Supplies (LINCS) program on employment and earnings. Using a nonexperimental design, the study authors compared students in the LINCS program to a historical comparison group who had not participated in the LINCS program. The study found no statistically significant relationships between LINCS program participation and employment or earnings. The quality of causal evidence provided in this study is moderate because it is based on a well-implemented nonexperimental design. This means we would be somewhat confident that any estimated effects would be attributable to LINCS, but other factors might also have contributed. However, the study did not find statistically significant effects.","the Leveraging, Integrating, Networking, and Coordinating Supplies (LINCS) program","Capacity building programs Community college education and other classroom training",Adult,,"United States",2017,https://www.mathematica.org/our-publications-and-findings/publications/outcomes… "Evaluation of Accelerated Training or Illinois Manufacturing (ATIM): Impact report.","Betesh, H., Kim, H., Kogan, D., Lindy, R., Paprocki, A. (2017). Evaluation of Accelerated Training for Illinois Manufacturing (ATIM): Impact report. Retrieved from https://www.spra.com/wordpress2/wp-content/uploads/2017/05/ATIM-Impact-Report_Final.pdf","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Mixed impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to assess the impact of Accelerated Training for Illinois Manufacturing (ATIM) Program, a workforce training intervention, on education, employment, and earnings outcomes. The authors used a randomized controlled trial to assess the program’s impact and compared education, employment, and earnings outcomes between the treatment and control group. Data on participant characteristics and outcomes was gathered from grant data systems, the Illinois Workforce Development System, and Illinois State Unemployment Insurance. The study found that significantly higher percentages of people in the treatment group than the control group enrolled in education training, completed training, and earned a certificate. In addition, those who were in the treatment group earned a significantly higher number of certificates than participants in the control group, and had significantly higher wages in the second year after beginning study participation. The quality of causal evidence presented in this report is high for the education outcomes because it was based on a randomized controlled trial with low attrition. This means we are confident that the estimated effects are attributable to the ATIM program, and not to other factors. The quality of causal evidence is moderate for the employment and earnings outcomes because these outcomes had high attrition but the authors included sufficient controls in their analysis. This means we are somewhat confident that the estimated effects are attributable to the ATIM program, but other factors might also have contributed.","Accelerated Training for Illinois Manufacturing (ATIM) Program","Capacity building programs Community college education and other classroom training","Adult, Dislocated or displaced worker, Low-skilled",,"United States",2017,https://www.spra.com/wordpress2/wp-content/uploads/2017/05/ATIM-Impact-Report_F… "Ozarks Technical Community College Technology-Enabled Pathways to Healthcare (TEPH): Department of Labor TAACCCCT Round III grant final evaluation report","Mittapalli, K., Keyes, D., Banerjee, A. & de las Alas, N. (2017). Ozarks Technical Community College Technology-Enabled Pathways to Healthcare (TEPH): Department of Labor TAACCCCT Round III grant final evaluation report. MN Associates.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Ozarks Technical Community College (OTC) Trade Adjustment Assistance Community College and Career Training (TAACCCT) grant on student’s education and earnings outcomes. The study used a nonexperimental design to compare the outcomes of students who were in the TAACCCT-enhanced Technology-Enabled Pathways to Healthcare (TEPH) to a comparison group of Biology students. Using the OTC database of administrative and student records, the authors conducted statistical models to examine differences between the groups. The study did not report statistical significance on the education and earnings outcomes of treatment versus comparison group students. The quality of causal evidence presented in this report is low because the authors did not use sufficient controls in their analysis. This means we are not confident that the estimated effects are attributable to the OTC TEPH TAACCCT program; other factors are likely to have contributed.","Technology-Enabled Pathways to Healthcare (TEPH) TAACCCT grant","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs",Adult,,"United States",2017,https://www.skillscommons.org/bitstream/handle/taaccct/9755/OTC%20TEPH%20final%… "Final evaluation report Round 3 TAACCCT grant: Mission critical operations","NC State Industry Expansion Solutions. (2017). Final evaluation report Round 3 TAACCCT grant: Mission critical operations. Raleigh, NC: NC State Industry Expansion Solutions.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Mixed impacts Education and skills gains","Summary: The study’s objective was to evaluate the effects of the National Consortium for Mission Critical Operations (MCO) program on educational outcomes. This summary contains the findings from Cleveland Community College. The authors used a nonexperimental design to compare the outcomes of students enrolled in the MCO program to a matched comparison group of students enrolled in the same courses of study prior to the implementation of the MCO program. The study found that participation in the MCO program was significantly associated with a higher retention rate, but lower rates of program progress. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the MCO program; other factors are likely to have contributed.","the Mission Critical Operations (MCO) Program","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs",Adult,,"United States",2017,http://www.skillscommons.org/handle/taaccct/13778 "Midlands Technical College TAACCCT Better Occupational Outcomes with Simulation Training: Program evaluation final report.","Center for Applied Research. (2017). Midlands Technical College TAACCCT Better Occupational Outcomes with Simulation Training: Program evaluation final report. Charlotte, NC: Center for Applied Research.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Mixed impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Better Occupational Outcomes with Simulation Training (BOOST) program on education outcomes. The authors used a nonexperimental design to compare the outcomes of students participating in BOOST to a matched comparison group using data from the colleges’ student information systems and the National Student Clearinghouse. The study found a significant relationship between BOOST participation and increased semester enrollment, increased certificate program completion, lower transfer rates, and faster rates of school completion. The quality of causal evidence presented in this report is low because the authors did not use sufficient controls in their analysis. This means we are not confident that the estimated effects are attributable to the BOOST program; other factors are likely to have contributed.","Better Occupational Outcomes with Simulation Training (BOOST) Program","Basic skills Capacity building programs Community college education and other classroom training","Adult, Other barriers",,"United States",2017,https://www.skillscommons.org/bitstream/handle/taaccct/15679/BOOST%20Final%20Ev… "Final evaluation report Round 3 TAACCCT grant: Mission critical operations","NC State Industry Expansion Solutions. (2017). Final evaluation report Round 3 TAACCCT grant: Mission critical operations. Raleigh, NC: NC State Industry Expansion Solutions.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to evaluate the effects of the National Consortium for Mission Critical Operations (MCO) program on educational outcomes. This summary contains the findings from Nash Community College. The authors used a nonexperimental design to compare the outcomes of students enrolled in the MCO program to a matched comparison group of students enrolled in the same courses of study prior to the implementation of the MCO program. The study found that participation in the MCO program was significantly associated with higher rates of retention and program progress. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the MCO program; other factors are likely to have contributed.","the Mission Critical Operations (MCO) Program","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs",Adult,,"United States",2017,http://www.skillscommons.org/handle/taaccct/13778 "Final evaluation report Round 3 TAACCCT grant: Mission critical operations","NC State Industry Expansion Solutions. (2017). Final evaluation report Round 3 TAACCCT grant: Mission critical operations. Raleigh, NC: NC State Industry Expansion Solutions.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to evaluate the effects of the National Consortium for Mission Critical Operations (MCO) program on educational outcomes. This summary contains the findings from Wake Tech Community College. The authors used a nonexperimental design to compare the outcomes of students enrolled in the MCO program to a matched comparison group of students enrolled in the same courses of study prior to the implementation of the MCO program. The study found that participation in the MCO program was significantly associated with higher rates of retention and program progress. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the MCO program; other factors are likely to have contributed.","the Mission Critical Operations (MCO) Program","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs",Adult,,"United States",2017,http://www.skillscommons.org/handle/taaccct/13778 "Central Georgia Technical College, TAACCCT","Center for Applied Research. (2017). Central Georgia Technical College, TAACCCT. Charlotte, NC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Education and skills gains-Mod/high-Mixed impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the BlendFlex program on community college students’ education outcomes. The study used a nonexperimental design to compare outcomes of students who completed at least one BlendFlex course to a matched comparison group using student records and data from the National Student Clearinghouse. The study found that when compared to non-participating students, BlendFlex program participation was associated with higher credit accumulation, a higher overall transfer rate, a higher transfer rate to a 4-year college, and a higher rate of earning a certificate or diploma. The quality of causal evidence presented in this study is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the BlendFlex programming, but other factors might also have contributed.",BlendFlex,"Capacity building programs Community college education and other classroom training",Adult,,"Rural, United States",2017, "Southwest Arkansas Community College Consortium: Trade Adjustment Assistance Community College Training grant final report","TAACCCT enhanced training. (2017). Southwest Arkansas Community College Consortium: Trade Adjustment Assistance Community College Training grant final report. Retrieved from https://www.skillscommons.org/bitstream/handle/taaccct/15686/SWACCC_Final_Report_9_27_2017.pdf?sequence=1&isAllowed=y","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to evaluate the impact of the South West Arkansas Community College Consortium’s (SWACCC) grant-enhanced programs on education outcomes. This summary contains the findings from Cossatot Community College of the University of Arkansas. The author used a nonexperimental design to compare the outcomes of students enrolled in the grant-enhanced Industrial Technology program to those enrolled in the Automotive Service Technology program at the same community college. The study found that participation in the grant-enhanced Industrial Technology treatment group was significantly associated with a higher likelihood of program completion relative to the Automotive Service Technology comparison group. The quality of causal evidence presented in this study is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to SWACCC’s grant-enhanced program; other factors are likely to have contributed.","the South West Arkansas Community College Consortium (SWACCC)","Capacity building programs Community college education and other classroom training",Adult,,"United States",2017,https://www.skillscommons.org/bitstream/handle/taaccct/15686/SWACCC_Final_Repor… "Southwest Arkansas Community College Consortium: Trade Adjustment Assistance Community College Training grant final report","TAACCCT enhanced training. (2017). Southwest Arkansas Community College Consortium: Trade Adjustment Assistance Community College Training grant final report. Retrieved from https://www.skillscommons.org/bitstream/handle/taaccct/15686/SWACCC_Final_Report_9_27_2017.pdf?sequence=1&isAllowed=y","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to evaluate the impact of the South West Arkansas Community College Consortium’s (SWACCC) grant-enhanced programs on education outcomes. This summary contains the findings from National Park College. The author used a nonexperimental design to compare the outcomes of students enrolled in the grant-enhanced Aerospace Fabrication and Assembly, Industrial Technology, and Welding Technology programs to those enrolled in the Marine Repair Technology, HVAC, and Automotive Service Technology programs at the same community college. The study found that participation in the grant-enhanced program treatment group was significantly associated with a higher likelihood of program completion relative to the comparison group. The quality of causal evidence presented in this study is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to SWACCC’s grant-enhanced program; other factors are likely to have contributed.","the South West Arkansas Community College Consortium (SWACCC)","Capacity building programs Community college education and other classroom training",Adult,,"United States",2017,https://www.skillscommons.org/bitstream/handle/taaccct/15686/SWACCC_Final_Repor… "New Mexico Junior College TAACCCT evaluation report","Dauphinee, T., Davis, M., & Carr, S. (2017). New Mexico Junior College TAACCCT evaluation report. Albuquerque, NM: University of New Mexico, Center for Education Policy and Research.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of New Mexico Junior College’s (NMJC) TAACCCT program on employment and earnings outcomes. The authors used a nonexperimental design to compare employment and earning outcomes of NMJC TAACCCT program participants to a matched comparison group using NMJC administrative data and data from New Mexico’s Department of Workforce Solutions. The study did not find a significant relationship between program participation and employment or earnings outcomes. The quality of causal evidence presented in this report is low because the authors did not use sufficient controls in their analysis. This means we are not confident that the estimated effects are attributable to the NMJC TAACCCT program; other factors are likely to have contributed program.","New Mexico Junior College’s (NMJC) TAACCCT Program","Capacity building programs Community college education and other classroom training",Adult,,"United States",2017,http://www.skillscommons.org/bitstream/handle/taaccct/13866/2017%20NMJC%20Evalu… "Southwest Arkansas Community College Consortium: Trade Adjustment Assistance Community College Training grant final report","TAACCCT enhanced training. (2017). Southwest Arkansas Community College Consortium: Trade Adjustment Assistance Community College Training grant final report. Retrieved from https://www.skillscommons.org/bitstream/handle/taaccct/15686/SWACCC_Final_Report_9_27_2017.pdf?sequence=1&isAllowed=y","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to evaluate the impact of the South West Arkansas Community College Consortium’s (SWACCC) grant-enhanced programs on education outcomes. This summary contains the findings from College of the Ouachitas. The author used a nonexperimental design to compare the outcomes of students enrolled in the grant-enhanced Mechatronic and Truck Driving program to those enrolled in the Criminal Justice programs at the same community college. The study found that there was no statistically significant relationship between participation in the grant-enhanced program and program completion. The quality of causal evidence presented in this study is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to SWACCC’s grant-enhanced program; other factors are likely to have contributed.","the South West Arkansas Community College Consortium (SWACCC)","Capacity building programs Community college education and other classroom training",Adult,,"United States",2017,https://www.skillscommons.org/bitstream/handle/taaccct/15686/SWACCC_Final_Repor… "Southwest Arkansas Community College Consortium: Trade Adjustment Assistance Community College Training grant final report","TAACCCT enhanced training. (2017). Southwest Arkansas Community College Consortium: Trade Adjustment Assistance Community College Training grant final report. Retrieved from https://www.skillscommons.org/bitstream/handle/taaccct/15686/SWACCC_Final_Report_9_27_2017.pdf?sequence=1&isAllowed=y","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to evaluate the impact of the South West Arkansas Community College Consortium’s (SWACCC) grant-enhanced programs on education outcomes. This summary contains the findings from South Arkansas Community College. The author used a nonexperimental design to compare the outcomes of students enrolled in the grant-enhanced Industrial Technology/Mechatronics or Process Technology programs to those enrolled in the Automotive Service Technology program at the same community college. The study found that participation in the grant-enhanced Industrial Technology/Mechatronics or Process Technology treatment group was significantly associated with a higher likelihood of program completion relative to the Automotive Service Technology comparison group. The quality of causal evidence presented in this study is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to SWACCC’s grant-enhanced program; other factors are likely to have contributed.","the South West Arkansas Community College Consortium (SWACCC)","Capacity building programs Community college education and other classroom training",Adult,,"United States",2017,https://www.skillscommons.org/bitstream/handle/taaccct/15686/SWACCC_Final_Repor… "Southwest Arkansas Community College Consortium: Trade Adjustment Assistance Community College Training grant final report","TAACCCT enhanced training. (2017). Southwest Arkansas Community College Consortium: Trade Adjustment Assistance Community College Training grant final report. Retrieved from https://www.skillscommons.org/bitstream/handle/taaccct/15686/SWACCC_Final_Report_9_27_2017.pdf?sequence=1&isAllowed=y","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Unfavorable impacts Education and skills gains","Summary: The study’s objective was to evaluate the impact of the South West Arkansas Community College Consortium’s (SWACCC) grant-enhanced programs on education outcomes. This summary contains the findings from Rich Mountain Community College. The author used a nonexperimental design to compare the outcomes of students enrolled in the grant-enhanced General Technology program to those enrolled in the Machine Tool Technology program at the same community college. The study found that participation in the grant-enhanced General Technology treatment group was significantly associated with a lower likelihood of program completion relative to the Machine Tool Technology comparison group. The quality of causal evidence presented in this study is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to SWACCC’s grant-enhanced program; other factors are likely to have contributed.","the South West Arkansas Community College Consortium (SWACCC)","Capacity building programs Community college education and other classroom training",Adult,,"United States",2017,https://www.skillscommons.org/bitstream/handle/taaccct/15686/SWACCC_Final_Repor… "Southwest Arkansas Community College Consortium: Trade Adjustment Assistance Community College Training grant final report","TAACCCT enhanced training. (2017). Southwest Arkansas Community College Consortium: Trade Adjustment Assistance Community College Training grant final report. Retrieved from https://www.skillscommons.org/bitstream/handle/taaccct/15686/SWACCC_Final_Report_9_27_2017.pdf?sequence=1&isAllowed=y","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to evaluate the impact of the South West Arkansas Community College Consortium’s (SWACCC) grant-enhanced programs on education outcomes. This summary contains the findings from Southern Arkansas University Tech. The author used a nonexperimental design to compare the outcomes of students enrolled in the grant-enhanced Supply Chain Management program to those enrolled in the General Technology/Engineering Technology program at the same community college. The study found that there was no statistically significant relationship between participation in the grant-enhanced programming and program completion. The quality of causal evidence presented in this study is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to SWACCC’s grant-enhanced program; other factors are likely to have contributed.","the South West Arkansas Community College Consortium (SWACCC)","Capacity building programs Community college education and other classroom training",Adult,,"United States",2017,https://www.skillscommons.org/bitstream/handle/taaccct/15686/SWACCC_Final_Repor… "Southwest Arkansas Community College Consortium: Trade Adjustment Assistance Community College Training grant final report","TAACCCT enhanced training. (2017). Southwest Arkansas Community College Consortium: Trade Adjustment Assistance Community College Training grant final report. Retrieved from https://www.skillscommons.org/bitstream/handle/taaccct/15686/SWACCC_Final_Report_9_27_2017.pdf?sequence=1&isAllowed=y","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to evaluate the impact of the South West Arkansas Community College Consortium’s (SWACCC) grant-enhanced programs on education outcomes. This summary contains the findings from University of Arkansas Community College at Hope. The author used a nonexperimental design to compare the outcomes of students enrolled in the grant-enhanced Supply Chain Management and Electric/General Technology programs to those enrolled in the Medical Office Management and Information Systems programs at the same community college. The study found that there was no statistically significant relationship between participation in the grant-enhanced programming and program completion. The quality of causal evidence presented in this study is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to SWACCC’s grant-enhanced program; other factors are likely to have contributed.","the South West Arkansas Community College Consortium (SWACCC)","Capacity building programs Community college education and other classroom training",Adult,,"United States",2017,https://www.skillscommons.org/bitstream/handle/taaccct/15686/SWACCC_Final_Repor… "2016 PETC annual evaluation report, Eastern Iowa Community Colleges","de la Mora, A., Callen, E., Kemis, M., & Abraham, W. (2017). 2016 PETC annual evaluation report, Eastern Iowa Community Colleges. Ames, IA: RISE.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the Pathways to Engineering Technology Careers (PETC) program on earnings and employment outcomes. Using student surveys and wage data, the study used a nonexperimental design to compare the outcomes of students in the PETC program to a comparison group. The study found that students in the PETC program were more likely to have higher wages than students in the comparison group. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the PETC program; other factors are likely to have contributed.","the Pathways to Engineering Technology Careers (PETC) Program","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs",Adult,,"United States",2017, "Iowa Western 2017 ITC2 annual evaluation report: Information technology - Credentials to Careers (ITC2), Iowa Western Community College","de la Mora, A., Callen, E., Kemis, M., & Abraham, W. (2017). Iowa Western 2017 ITC2 annual evaluation report: Information technology - Credentials to Careers (ITC2), Iowa Western Community College. Arnes, IA: Research Institute for Studies in Education.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the Information Technology – Credentials to Careers (ITC2) program on education, earnings, and employment outcomes. The authors used a nonexperimental design to compare the outcomes of students who were enrolled in Computer Information Technology (CIT) programs after the initiation of ITC2 programming to those who were enrolled in CIT programs prior to the start of the ITC2 program. The study found that ITC2 program participation was associated with a significant increase in certificate attainment. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention and did not include sufficient controls. This means we are not confident that the estimated effects are attributable to the ITC2 program; other factors are likely to have contributed.","Information Technology – Credentials to Careers (ITC2) Program","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs",Adult,,"United States",2017, "The impact of a cohort-based learning model on student success within vocational technical certificates at a community college (Doctoral dissertation, Northeastern University)","Oldham, T. M. (2017). The impact of a cohort-based learning model on student success within vocational technical certificates at a community college (Doctoral dissertation, Northeastern University). Retrieved from https://repository.library.northeastern.edu/files/neu:cj82pw09w/fulltext.pdf","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of a cohort-based learning model within a certificate program at a community college on the students’ education completion rate. Using community college data, the study used a nonexperimental design to compare students in the cohort-based learning model with those in the traditional program. The author found a statistically significant association between the cohort-learning model and education completion rates where students in the cohort model were more likely to complete the program than students in the traditional model. The quality of causal evidence presented in this report is low because the authors did not include sufficient control variables. This means we are not confident that the estimated effects are attributable to the cohort-based learning model; other factors are likely to have contributed.","the Cohort-Based Learning Model","Capacity building programs Community college education and other classroom training",Adult,,"United States",2017,https://repository.library.northeastern.edu/files/neu:cj82pw09w/fulltext.pdf "Final evaluation report Trade Adjustment Assistance Community College and Career Training (TAACCCT) grant: Round 3 Kapiʻolani Community College","Pacific Research & Evaluation, LLC. (2017). Final evaluation report Trade Adjustment Assistance Community College and Career Training (TAACCCT) grant: Round 3 Kapiʻolani Community College. Portland, OR: Pacific Research & Evaluation, LLC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to assess the impact of the grant-funded Implementing an Island-wide Strategy for Industry Cluster Formation and Community Revitalization in Hawai'i (C3T) project on education outcomes. The authors used a nonexperimental design to compare the outcomes of students enrolled in C3T programs and courses with students enrolled in comparable programs offered at the same community college. When compared to nonparticipating students, the study found that C3T participation was significantly associated with higher program completion and retention rates for students enrolled in the hospitality program. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the C3T project; other factors are likely to have contributed.","the Implementing an Island-wide Strategy for Industry Cluster Formation and Community Revitalization in Hawai'i (C3T) Project","Capacity building programs Community college education and other classroom training",Adult,,"United States",2017, "Saddleback College TAACCCT grant final evaluation report.","Pacific Research and Evaluation, LLC. (2017). Saddleback College TAACCCT grant final evaluation report. Portland, OR: Pacific Research and Evaluation, LLC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of Saddleback College’s Fast Track to Success program on student education outcomes. The study used a nonexperimental design to compare the outcomes of students who were in the Medical Assistant (MA) and Registered Nurse (RN) tracks of the Fast Track to Success program to a comparison group. The study found that MA and RN students in Fast Track to Success programming were significantly more likely to earn certificates, degrees, and credentials in the MA and RN areas. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention or include sufficient control variables. This means we are not confident that the estimated effects are attributable to the Fast Track to Success program; other factors are likely to have contributed.","the Fast Track to Success Program","Capacity building programs Community college education and other classroom training","Adult, Dislocated or displaced worker",,"United States",2017,https://www.skillscommons.org/bitstream/handle/taaccct/13850/Saddleback%20Colle… "Northeast Resiliency Consortium final evaluation report","Price, D., Childress, L., Sedlak, W., & Roach, R. (2017). Northeast Resiliency Consortium final evaluation report. Indianapolis, IN: DVP-PRAXIS LTD.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Northeast Resiliency Consortium (NRC) on education, earnings, and employment outcomes. This summary focuses on the continuing education to credit-based educational pathways strategy. The authors used a nonexperimental design to compare the outcomes of NRC students who enrolled in continuing education to credit pathways to a matched comparison group. The study found a significant association between NRC program participation and increased credit accumulation, matriculation, and employment attainment and retention. The quality of causal evidence presented in this study is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the NRC program; other factors are likely to have contributed.","the Northeast Resiliency Consortium (NRC)","Capacity building programs Community college education and other classroom training",Adult,,"United States",2017,https://www.dvp-praxis.org/wp-content/uploads/2015/05/Northeast-Resiliency-Cons… "Northeast Resiliency Consortium final evaluation report","Price, D., Childress, L., Sedlak, W., & Roach, R. (2017). Northeast Resiliency Consortium final evaluation report. Indianapolis, IN: DVP-PRAXIS LTD.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Northeast Resiliency Consortium (NRC) on education, earnings, and employment outcomes. This summary focuses on the comprehensive support services strategy. The authors used a nonexperimental design to compare the outcomes of NRC students who received comprehensive support services to a matched comparison group. The study found a significant association between receipt of support services and increased program completion, credential attainment, credit accumulation, earnings for incumbent workers, and employment attainment and retention. The quality of causal evidence presented in this study is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the NRC program; other factors are likely to have contributed.","the Northeast Resiliency Consortium (NRC)","Capacity building programs Community college education and other classroom training",Adult,,"United States",2017,https://www.dvp-praxis.org/wp-content/uploads/2015/05/Northeast-Resiliency-Cons… "Trade Adjustment Assistance Community College Career Training grant final report.","Mississippi River Transportation, Distribution & Logistics Consortium. (2017). Trade Adjustment Assistance Community College Career Training grant final report. Retrieved from https://www.skillscommons.org/bitstream/handle/taaccct/14261/MRTDL%20Final%20Report_9_30_2017.pdf?sequence=1&isAllowed=y","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Mississippi River Transportation, Distribution and Logistics (MRTDL) Consortium’s grant-funded programs on education outcomes. This summary contains the findings from Delgado Community College. The authors used a nonexperimental design to compare the outcomes of students enrolled in programs enhanced through grant funding to those enrolled in a similar program at the same community college. The study found that the odds of program completion were significantly higher for participants in the grant-funded programs compared to participants in the comparison group. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the MRTDL Consortium’s grant-funded programs; other factors are likely to have contributed.","the Mississippi River Transportation, Distribution and Logistics (MRTDL) TAACCCT Program","Capacity building programs Community college education and other classroom training","Adult, Dislocated or displaced worker",,"United States",2017,https://www.skillscommons.org/bitstream/handle/taaccct/14261/MRTDL%20Final%20Re… "Trade Adjustment Assistance Community College Career Training grant final report. (Mississippi River Transportation, Distribution & Logistics Consortium, 2017)","Mississippi River Transportation, Distribution & Logistics Consortium. (2017). Trade Adjustment Assistance Community College Career Training grant final report. Retrieved from https://www.skillscommons.org/bitstream/handle/taaccct/14261/MRTDL%20Final%20Report_9_30_2017.pdf?sequence=1&isAllowed=y","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Mississippi River Transportation, Distribution and Logistics (MRTDL) Consortium’s grant-funded programs on education outcomes. This summary contains the findings from Hinds Community College. The authors used a nonexperimental design to compare the outcomes of students enrolled in programs enhanced through grant funding to those enrolled in a similar program at the same community college. The study found that the odds of program completion were significantly higher for participants in the grant-funded programs compared to participants in the comparison group. The quality of causal evidence presented in this report is low because the authors used a comparison group from different academic programs presenting a confounding factor. This means we are not confident that the estimated effects are attributable to the MRTDL Consortium’s grant-funded programs; other factors are likely to have contributed.","the Mississippi River Transportation, Distribution and Logistics (MRTDL) TAACCCT Program","Capacity building programs Community college education and other classroom training","Adult, Dislocated or displaced worker",,"United States",2017,https://www.skillscommons.org/bitstream/handle/taaccct/14261/MRTDL%20Final%20Re… "Trade Adjustment Assistance Community College Career Training grant final report.","Mississippi River Transportation, Distribution & Logistics Consortium. (2017). Trade Adjustment Assistance Community College Career Training grant final report. Retrieved from https://www.skillscommons.org/bitstream/handle/taaccct/14261/MRTDL%20Final%20Report_9_30_2017.pdf?sequence=1&isAllowed=y","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Unfavorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Mississippi River Transportation, Distribution and Logistics (MRTDL) Consortium’s grant-funded programs on education outcomes. This summary contains the findings from John Wood Community College. The authors used a nonexperimental design to compare the outcomes of students enrolled in programs enhanced through grant funding to those enrolled in a similar program at the same community college. The study found that the odds of program completion were significantly lower for participants in the grant-funded programs compared to participants in the comparison group. The quality of causal evidence presented in this report is low because the authors used a comparison group from different academic programs and also used a comparison group from previous enrollment years presenting a confounding factor. This means we are not confident that the estimated effects are attributable to the MRTDL Consortium’s grant-funded programs; other factors are likely to have contributed.","the Mississippi River Transportation, Distribution and Logistics (MRTDL) TAACCCT Program","Capacity building programs Community college education and other classroom training","Adult, Dislocated or displaced worker",,"United States",2017,https://www.skillscommons.org/bitstream/handle/taaccct/14261/MRTDL%20Final%20Re… "Trade Adjustment Assistance Community College Career Training grant final report.","Mississippi River Transportation, Distribution & Logistics Consortium. (2017). Trade Adjustment Assistance Community College Career Training grant final report. Retrieved from https://www.skillscommons.org/bitstream/handle/taaccct/14261/MRTDL%20Final%20Report_9_30_2017.pdf?sequence=1&isAllowed=y","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Mississippi River Transportation, Distribution and Logistics (MRTDL) Consortium’s grant-funded programs on education outcomes. This summary contains the findings from Lewis & Clark Community College. The authors used a nonexperimental design to compare the outcomes of students enrolled in programs enhanced through grant funding to those enrolled in a similar program at the same community college. The study found that the odds of program completion were significantly higher for participants in the grant-funded programs compared to participants in the comparison group. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the MRTDL Consortium’s grant-funded programs; other factors are likely to have contributed.","the Mississippi River Transportation, Distribution and Logistics (MRTDL) TAACCCT Program","Capacity building programs Community college education and other classroom training","Adult, Dislocated or displaced worker",,"United States",2017,https://www.skillscommons.org/bitstream/handle/taaccct/14261/MRTDL%20Final%20Re… "Trade Adjustment Assistance Community College Career Training grant final report.","Mississippi River Transportation, Distribution & Logistics Consortium. (2017). Trade Adjustment Assistance Community College Career Training grant final report. Retrieved from https://www.skillscommons.org/bitstream/handle/taaccct/14261/MRTDL%20Final%20Report_9_30_2017.pdf?sequence=1&isAllowed=y","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Mississippi River Transportation, Distribution and Logistics (MRTDL) Consortium’s grant-funded programs on education outcomes. This summary contains the findings from Arkansas State University Mid-South. The authors used a nonexperimental design to compare the outcomes of students enrolled in programs enhanced through grant funding to those enrolled in a similar program at the same community college. The study found that there was no statistically significant relationship between enrollment in grant-funded programming and program completion. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the MRTDL Consortium’s grant-funded programs; other factors are likely to have contributed.","the Mississippi River Transportation, Distribution and Logistics (MRTDL) TAACCCT Program","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Dislocated or displaced worker",,"United States",2017,https://www.skillscommons.org/bitstream/handle/taaccct/14261/MRTDL%20Final%20Re… "Trade Adjustment Assistance Community College Career Training grant final report.","Mississippi River Transportation, Distribution & Logistics Consortium. (2017). Trade Adjustment Assistance Community College Career Training grant final report. Retrieved from https://www.skillscommons.org/bitstream/handle/taaccct/14261/MRTDL%20Final%20Report_9_30_2017.pdf?sequence=1&isAllowed=y","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Mississippi River Transportation, Distribution and Logistics (MRTDL) Consortium’s grant-funded programs on education outcomes. This summary contains the findings from Minnesota State College – Southeast Technical. The authors used a nonexperimental design to compare the outcomes of students enrolled in programs enhanced through grant funding to those enrolled in a similar program at the same community college. The study found that there was no statistically significant relationship between enrollment in grant-funded programming and program completion. The quality of causal evidence presented in this report is low because the authors used a comparison group from different academic programs presenting a confounding factor. This means we are not confident that the estimated effects are attributable to the MRTDL Consortium’s grant-funded programs; other factors are likely to have contributed.","the Mississippi River Transportation, Distribution and Logistics (MRTDL) TAACCCT Program","Capacity building programs Community college education and other classroom training","Adult, Dislocated or displaced worker",,"United States",2017,https://www.skillscommons.org/bitstream/handle/taaccct/14261/MRTDL%20Final%20Re… "Trade Adjustment Assistance Community College Career Training grant final report","Mississippi River Transportation, Distribution & Logistics Consortium. (2017). Trade Adjustment Assistance Community College Career Training grant final report. Retrieved from https://www.skillscommons.org/bitstream/handle/taaccct/14261/MRTDL%20Final%20Report_9_30_2017.pdf?sequence=1&isAllowed=y","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Mississippi River Transportation, Distribution and Logistics (MRTDL) Consortium’s grant-funded programs on education outcomes. This summary contains the findings from Southwest Tennessee Community College. The authors used a nonexperimental design to compare the outcomes of students enrolled in programs enhanced through grant funding to those enrolled in a similar program at the same community college. The study found that the odds of program completion were significantly higher for participants in the grant-funded programs compared to participants in the comparison group. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the MRTDL Consortium’s grant-funded programs; other factors are likely to have contributed.","the Mississippi River Transportation, Distribution and Logistics (MRTDL) TAACCCT Program","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Dislocated or displaced worker",,"United States",2017,https://www.skillscommons.org/bitstream/handle/taaccct/14261/MRTDL%20Final%20Re… "Trade Adjustment Assistance Community College Career Training grant final report","Mississippi River Transportation, Distribution & Logistics Consortium. (2017). Trade Adjustment Assistance Community College Career Training grant final report. Retrieved from https://www.skillscommons.org/bitstream/handle/taaccct/14261/MRTDL%20Final%20Report_9_30_2017.pdf?sequence=1&isAllowed=y","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Mississippi River Transportation, Distribution and Logistics (MRTDL) Consortium’s grant-funded programs on education outcomes. This summary contains the findings from St. Louis Community College. The authors used a nonexperimental design to compare the outcomes of students enrolled in programs enhanced through grant funding to those enrolled in a similar program at the same community college. The study found that the odds of program completion were significantly higher for participants in the grant-funded programs compared to participants in the comparison group. The quality of causal evidence presented in this report is low because the authors used a comparison group from different academic programs presenting a confounding factor. This means we are not confident that the estimated effects are attributable to the MRTDL Consortium’s grant-funded programs; other factors are likely to have contributed.","the Mississippi River Transportation, Distribution and Logistics (MRTDL) TAACCCT Program","Capacity building programs Community college education and other classroom training","Adult, Dislocated or displaced worker",,"United States",2017,https://www.skillscommons.org/bitstream/handle/taaccct/14261/MRTDL%20Final%20Re… "Trade Adjustment Assistance Community College Career Training grant final report","Mississippi River Transportation, Distribution & Logistics Consortium. (2017). Trade Adjustment Assistance Community College Career Training grant final report. Retrieved from https://www.skillscommons.org/bitstream/handle/taaccct/14261/MRTDL%20Final%20Report_9_30_2017.pdf?sequence=1&isAllowed=y","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Mississippi River Transportation, Distribution and Logistics (MRTDL) Consortium’s grant-funded programs on education outcomes. This summary contains the findings from West Kentucky Community and Technical College. The authors used a nonexperimental design to compare the outcomes of students enrolled in programs enhanced through grant funding to those enrolled in a similar program at the same community college. The study found that the odds of program completion were significantly higher for participants in the grant-funded programs compared to participants in the comparison group. The quality of causal evidence presented in this report is low because the authors used a comparison group from different academic programs presenting a confounding factor. This means we are not confident that the estimated effects are attributable to the MRTDL Consortium’s grant-funded programs; other factors are likely to have contributed.","the Mississippi River Transportation, Distribution and Logistics (MRTDL) TAACCCT Program","Capacity building programs Community college education and other classroom training","Adult, Dislocated or displaced worker",,"United States",2017,https://www.skillscommons.org/bitstream/handle/taaccct/14261/MRTDL%20Final%20Re… "TAACCCT3 INTERFACE project: Final evaluation report","Smith, L., Gregg, A., Roth, L., Stoeklen, P., Krueger, B., Lawton, G., & Knaeble, B. (2017). TAACCCT3 INTERFACE project: Final evaluation report. Menomonie, WI: University of Wisconsin-Stout, Applied Research Center, Wisconsin’s Polytechnic University.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Intentional Networks Transforming Effective and Rigorous Facilitation of Assessment, Collaboration, and Education (INTERFACE) project on education, earnings, and employment outcomes. The authors used a nonexperimental design to compare education, earnings, and employment outcomes of students in the INTERFACE program to a matched comparison group. The study found that INTERFACE students had significantly higher pass rates, graduation rates, and employment rates than students in the comparison group. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the INTERFACE program, but other factors might also have contributed.","the Intentional Networks Transforming Effective and Rigorous Facilitation of Assessment, Collaboration, and Education (INTERFACE) Program","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Veteran or military",,"United States",2017,https://www.skillscommons.org/bitstream/handle/taaccct/14262/INTERFACE%20Projec… "Developing pathways for careers in health: The Los Angeles Healthcare Competencies to Careers Consortium","Tan, C., & Moore, C. (2017). Developing pathways for careers in health: The Los Angeles Healthcare Competencies to Careers Consortium. Sacramento, CA: Education Insights Center, California State University, Sacramento.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Education and skills gains-Low-Mixed impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the Los Angeles Healthcare Competencies to Careers Consortium (LAH3C) on education, earnings, and employment outcomes. The authors used a nonexperimental design to compare outcomes between students in the LAH3C with a matched comparison group. The study found that LAH3C program participation was significantly related to improvements in retention, credit completion, and program completion. The quality of causal evidence presented in this study is low because the authors used a comparison group from previous enrollment years presenting a confounding factor. This means we are not confident that the estimated effects are attributable to the LAH3C; other factors are likely to have contributed.","the Los Angeles Healthcare Competencies to Careers Consortium (LAH3C)","Capacity building programs Community college education and other classroom training",Adult,,"United States",2017, "Weber State University Trade Adjustment Assistance Community College and Career Training (TAACCCT) grant-round 3: Final third party evaluation report","Wixom, G. (2017). Weber State University Trade Adjustment Assistance Community College and Career Training (TAACCCT) grant-round 3: Final third party evaluation report. Orem, UT: Education Matters.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the enhanced Health Information Technology Career Mobility (HITCM) program on education outcomes. The author used a nonexperimental design to compare the outcomes of students who were in the enhanced HITCM program to a matched comparison group of students in the non-enhanced HITCM program. The study found that enhanced HITCM program participation was significantly associated with more credits earned and higher graduation rates. The quality of causal evidence presented in this study is low because the author used a comparison group from previous enrollment years presenting a confounding factor. This means we are not confident that the estimated effects are attributable to the enhanced HITCM program; other factors are likely to have contributed.","the Health Information Technology Career Mobility (HITCM) program","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs",Adult,,"United States",2017, "Framing and claiming: How information-framing affects expected social security claiming behavior","Brown, J. R., Kapteyn, A., & Mitchell, O. S. (2016). Framing and claiming: How information-framing affects expected social security claiming behavior. Journal of Risk and Insurance, 83(1), 139-162.","Behavioral Finance: Retirement, Behavioral Insights","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of different ways of framing retirement information on the age at which individuals intended to claim Social Security benefits. The authors randomly assigned people who had been employed for at least 10 years and had yet to claim Social Security benefits to receive different messages about claiming the benefits. Each message contained the same financial information, but the information was presented—or framed—in different ways. There were 10 different messages—9 treatment conditions and one control condition that presented neutral information. Each study participant received 6 of the 10 messages. The study found that, on average, those presented with the break-even treatment were more likely to indicate a younger intended age to receive benefits compared with those presented with the control condition, whereas those who received 4 of the other treatment conditions expressed an older intended age compared with the control condition. The quality of causal evidence presented in this report is low because it was based on a randomized controlled trial with unknown attrition and the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the framing of information about the age at which Social Security is collected; other factors are likely to have contributed.",,"Federal retirement benefits Behavioral interventions",Employed,,"United States",2016, "The labor market effects of U.S. reemployment programs during the Great Recession","Michaelides, M., & Mueser, P. (2016). The labor market effects of U.S. reemployment programs during the Great Recession. (Working paper 08-2015). Nicosia, Cyprus: University of Cyprus, Department of Economics.",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of Florida’s Priority Reemployment Services (PREP) program on Unemployment Insurance (UI) claimants’ reemployment rates, earnings, and receipt of UI benefits. The study was a randomized controlled trial. UI claimants were randomly assigned to either a treatment group that could receive PREP services, another treatment group that could receive Reemployment Eligibility and Assessment (REA) services, or a control group that had access to neither. The authors examined administrative data from Florida’s UI claims and wage records. The study found that the PREP group had significantly higher reemployment rates and lower UI benefit receipt but had similar earnings as the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the PREP program, and not to other factors. The study also examined the impact of Florida’s REA program compared with the control group. CLEAR’s profile of that study is available here.","Profiling, Reemployment Eligibility Assessment","RESEA Job search assistance and supportive services Unemployment Insurance","Dislocated or displaced worker, Unemployed",,"United States",2016,http://papers.econ.ucy.ac.cy/RePEc/papers/08-15.pdf "Effects of the unemployment insurance work test on long-term employment outcomes.","Lachowska, M., Meral, M., & Woodbury, S.A. (2016). Effects of the unemployment insurance work test on long-term employment outcomes. Labour Economics, 41, 246–265.",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of more-stringent work search requirements for unemployment insurance (UI) claimants on earnings, employment, and UI benefit receipt outcomes over a nine-year follow-up period. This study extended the work of Johnson and Klepinger (1991), the CLEAR profile of which is available here. The CLEAR profile of a related study, Lachowska et al. (2015), is available here. The study examined data from a randomized controlled trial conducted in the 1980s in Washington State. UI claimants were randomly assigned to one of four groups, each with different work search requirements and/or verification of that work search. The authors used administrative data to compare the outcomes of the groups up to nine years after the initial UI claims. The study found that the groups with more-stringent work search requirements were more likely to be employed than the group with less-stringent requirements in the first year following their claims. They also received UI benefits payments for fewer weeks, exhausted UI benefits at a lower rate, and received fewer conditional payments in the year following their initial UI claims. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the more stringent work search requirements, and not to other factors.","More stringent work search requirements","RESEA Unemployment Insurance","Dislocated or displaced worker, Unemployed",,"United States",2016, "Providing public workforce services to job seekers: 15-month impact findings on the WIA Adult and Dislocated Worker programs [Comparison between Core-and-Intensive Services versus Core Services].","McConnell, S., Fortson, K., Rotz, D., Schochet, P., Burkander, P., Rosenberg, L., Mastri, A., & D’Amico, R. (2016). Providing public workforce services to job seekers: 15-month impact findings on the WIA Adult and Dislocated Worker programs.  Washington, DC: Mathematica Policy Research. [Comparison between Core-and-Intensive Services versus Core Services]",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Workforce Investment Act (WIA) Adult and Dislocated Worker programs on training, employment, earnings, and service receipt after 15 months. This summary focuses on the comparison between the group who received core-and-intensive services versus the group who received core services. The study was a randomized controlled trial, where customers in each local area were randomly assigned to one of three groups: full-WIA, core-and-intensive, or core. The authors compared the outcomes between the groups from baseline to 15 months after random assignment. The study found that core-and-intensive customers were significantly more likely than core customers to complete a training program, receive a training credential, and have higher earnings. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects are attributable to the Adult and Dislocated Worker programs and not to other factors.","Adult and Dislocated Worker programs","Adult and Dislocated Worker programs Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA)","Adult, Unemployed",,"United States",2016,https://www.mathematica-mpr.com/our-publications-and-findings/publications/prov… "Providing public workforce services to job seekers: 15-month impact findings on the WIA Adult and Dislocated Worker programs [Comparison betwwen Full-WIA Services versus Core Services].","McConnell, S., Fortson, K., Rotz, D., Schochet, P., Burkander, P., Rosenberg, L., Mastri, A., & D’Amico, R. (2016). Providing public workforce services to job seekers: 15-month impact findings on the WIA Adult and Dislocated Worker programs. Washington, DC: Mathematica Policy Research. [Comparison betwwen Full-WIA Services versus Core Services]",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Workforce Investment Act (WIA) Adult and Dislocated Worker programs on training, employment, earnings, and service receipt after 15 months. This summary focuses on the comparison between the group who received the full-WIA services versus the group who received core services. The study was a randomized controlled trial, where customers in each local area were randomly assigned to one of three groups: full-WIA, core-and-intensive, or core. The authors compared the outcomes between the groups from baseline to 15 months after random assignment. The study found that full-WIA customers were significantly more likely than core customers to complete a training program and receive a training credential. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects are attributable to the Adult and Dislocated Worker programs and not to other factors.","Adult and Dislocated Worker programs","Adult and Dislocated Worker programs Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA)","Adult, Unemployed",,"United States",2016,https://www.mathematica-mpr.com/our-publications-and-findings/publications/prov… "Providing public workforce services to job seekers: 15-month impact findings on the WIA Adult and Dislocated Worker programs [Comparison between Full-WIA Services versus Core-and-Intensive Services].","McConnell, S., Fortson, K., Rotz, D., Schochet, P., Burkander, P., Rosenberg, L., Mastri, A., & D’Amico, R. (2016). Providing public workforce services to job seekers: 15-month impact findings on the WIA Adult and Dislocated Worker programs. Washington, DC: Mathematica Policy Research.",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Workforce Investment Act (WIA) Adult and Dislocated Worker programs on training, employment, earnings, and service receipt after 15 months. This summary focuses on the comparison between the group who received the full-WIA services versus the group who received core-and-intensive services. The study was a randomized controlled trial, where customers in each local area were randomly assigned to one of three groups: full-WIA, core-and-intensive, or core. The authors compared the outcomes between the groups from baseline to 15 months after random assignment. The study found that full-WIA customers were significantly more likely than core-and-intensive customers to complete a training program and receive a training credential. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects are attributable to the Adult and Dislocated Worker programs and not to other factors.","Adult and Dislocated Worker programs","Adult and Dislocated Worker programs Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA)","Adult, Unemployed",,"United States",2016,https://www.mathematica-mpr.com/our-publications-and-findings/publications/prov… "The effect of private sector work opportunities in prison on labor market outcomes of the formerly incarcerated","Cox, R. (2016). The effect of private sector work opportunities in prison on labor market outcomes of the formerly incarcerated. Journal of Labor Research, 37, 412-440.",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study examines the effectiveness of a prison work program, Prison Industry Enhancement Certification Program (PIECP), on employment, earnings, and recidivism. The author used a nonexperimental design to compare employment, earnings, and recidivism outcomes among PIECP participants with those of a group of nonparticipants with similar demographic and criminal-justice backgrounds. They used data from state departments of corrections merged with data on reported earnings. The study found that PIECP participation was associated with a shorter time to employment after release from prison and with higher subsequent earnings. The study found PIECP had no impact on the risk of reconviction or the risk of reincarceration. The quality of causal evidence for recidivism outcomes is moderate because they were based on a well-implemented nonexperimental design. This means we are somewhat confident that any estimated effects would have been attributable to PIECP if the study had found statistically significant effects on recidivism. The quality of causal evidence on employment and earnings outcomes is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects on employment and earnings are attributable to PIECP; other factors are likely to have contributed.","Prison Industry Enhancement Certification Program (PIECP)","Other employment and reemployment Reentry",Justice-involved,,"United States",2016,https://doi.org/10.1007/s12122-016-9229-0 "Encouraging evidence on a sector-focused advancement strategy","Hendra, R., Greenberg, D. H., Hamilton, G., Oppenheim, A. Pennington, A. Schaberg, K., and Tessler, B. L. (2016). Encouraging evidence on a sector-focused advancement strategy. New York: MDRC. [St. Nicks Alliance]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the WorkAdvance sectoral training program at the St. Nicks Alliance site on employment, earnings, education, and training from 2011 to 2015. The authors investigated similar research questions with three other sites, the profiles of which are available here. The study used a randomized controlled trial design to compare the treatment group, which was able to access the WorkAdvance program at the St. Nicks Alliance site, and the control group, which was not eligible for WorkAdvance services but could access other services in the community. The authors collected data from two sources: a follow-up survey and unemployment insurance (UI) wage and employment data. Using UI data, the authors found that those assigned to the treatment group were significantly more likely to be ever employed in Quarters 2 to 5 after random assignment than those in the control group. Using survey data, the authors also found that those in the treatment group were significantly more likely to complete education or training than the control group. The quality of the causal evidence is high for employment and earnings outcomes based on UI data because those outcomes were based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects for those outcomes are attributable to the WorkAdvance program at the St. Nicks Alliance site and not to other factors. For education and training outcomes from the follow-up survey, the quality of the causal evidence is moderate because those outcomes were based on a randomized controlled trial in which many people did not complete the follow-up survey, but the authors did account for existing differences between the treatment and control groups. This means we are somewhat confident that the estimated effects for those outcomes are attributable to the WorkAdvance program at the St. Nicks Alliance site, but other factors might also have contributed.","the WorkAdvance sectoral training program","Work based and other occupational training","Low income",,"Urban, United States",2016,https://files.eric.ed.gov/fulltext/ED568395.pdf "Does “ban-the-box” help or hurt low-skilled workers? Statistical discrimination and employment outcomes when criminal histories are hidden","Doleac, J. L., & Hansen, B. (2016). Does “ban-the-box” help or hurt low-skilled workers? Statistical discrimination and employment outcomes when criminal histories are hidden. (NBER Working Paper No. 22469). Cambridge, MA: National Bureau of Economic Research.",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Unfavorable impacts Employment","Summary: The study’s objective was to examine how preventing employers from asking about an applicant’s criminal record in the early stage of the hiring process (ban-the-box) affected employment outcomes for low-skilled African American and Hispanic men ages 25 to 34. The authors use a nonexperimental difference-in-differences design to compare the employment probability of White non-Hispanic, African American non-Hispanic, and Hispanic men in areas that adopted ban-the-box policies with the employment probability of their counterparts in areas that did not adopt ban-the-box policies. The authors use a linear probability model to estimate employment outcomes. Information on study participant characteristics were from the Current Population Survey in 2004 to 2014. The study found that the probability of African American men obtaining employment was 3.4 percentage points lower among those who lived in areas with ban-the-box policies than among those who did not. In addition, the authors found that ban-the-box policies reduced the probability of African American men obtaining employment by 5.1 percentage points between one and two years after the policy went into effect, by 8.3 percentage points between three and four years afterward, and by 2.3 percentage points four or more years afterward. The study found no statistically significant relationships between ban-the-box policies and employment outcomes for Hispanic men. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the ban-the-box policies, but other factors might also have contributed.",Ban-the-Box,Reentry,"Male, Black or African American, Hispanic of any race",,"United States",2016,https://www.nber.org/papers/w22469.pdf "Evaluation of the Re-Integration of Ex-Offenders (RExO) program: Final impact reports","Wiegand, A., & Sussell, J. (2016). Evaluation of the Re-Integration of Ex-Offenders (RExO) program: Final impact reports. Retrieved from the Department of Labor website: https://wdr.doleta.gov/research/FullText_Documents/ETAOP-2015-10_The-Evaluation-of-the-Re-Integration-of-Ex-Offenders-%28RExO%29-Program-Final-Impact-Report_Acc.pdf",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of Reintegration of Ex-Offenders (RExO) programs on employment, earnings, public benefits receipt, and recidivism outcomes. The study was a randomized controlled trial whose authors employed a statistical method to estimate the impact of RExO using data from four sources, including qualitative data generated from an implementation study, administrative data on criminal justice outcomes, administrative data on employment and earnings from the National Directory of New Hires, and a follow-up survey of participants. The study found that the RExO program did not increase the long-term employment, earnings, public benefit receipt, or recidivism. The quality of causal evidence on employment, earnings, public benefit receipt, and recidivism outcomes presented in this report is high because the evidence is based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects would have been attributable to the RExO program and not to other factors had the study found statistically significant effects.","Reintegration of Ex-Offenders (RExO) programs","Job search assistance and supportive services Reentry Mentoring",Justice-involved,,"Urban, United States",2016,https://wdr.doleta.gov/research/FullText_Documents/ETAOP-2015-10_The-Evaluation… "Encouraging evidence on a sector-focused advancement strategy","Hendra, R., Greenberg, D. H., Hamilton, G., Oppenheim, A. Pennington, A. Schaberg, K., and Tessler, B. L. (2016). Encouraging evidence on a sector-focused advancement strategy. New York: MDRC. [Per Scholas]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the WorkAdvance sectoral training program at the Per Scholas site on employment, earnings, and education and training from 2011 to 2015. The authors investigated similar research questions with three other sites, the profiles of which are available here. The study used a randomized controlled trial design to compare the treatment group, which was able to access the WorkAdvance program at the Per Scholas site, and the control group, which was not eligible for WorkAdvance services but could access other services in the community. The authors collected data from two sources: a follow-up survey and unemployment insurance (UI) wage and employment data. The study found that the program had a statistically significant impact on quarterly earnings in the second and third years after random assignment (based on UI data) and average weekly earnings in the second year after random assignment (based on survey data). The study also found that the program did not have a significant impact on most employment outcomes. Using survey data, the authors found that members of the WorkAdvance group were significantly more likely to have obtained a degree or credential and to have completed a skills training program two years after random assignment. The quality of the causal evidence is moderate for employment and earnings outcomes based on UI data because those outcomes were based on a randomized controlled trial in which the authors did not demonstrate that they accounted for change in the probability of random assignment, but the authors did account for existing differences between the treatment and control groups. The quality of the causal evidence is moderate for education and training outcomes from the follow-up survey because those outcomes were based on a randomized controlled trial in which many people did not complete the follow-up survey, but the authors did account for existing differences between the treatment and control groups. This means we are somewhat confident that the estimated effects are attributable to the WorkAdvance program at the Per Scholas site, but other factors might also have contributed.","the WorkAdvance sectoral training program","Work based and other occupational training","STEM professional, Low income",,"Urban, United States",2016,https://files.eric.ed.gov/fulltext/ED568395.pdf "Encouraging evidence on a sector-focused advancement strategy","Hendra, R., Greenberg, D. H., Hamilton, G., Oppenheim, A. Pennington, A. Schaberg, K., and Tessler, B. L. (2016). Encouraging evidence on a sector-focused advancement strategy. New York: MDRC. [Madison Strategies Group]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine the impact of the WorkAdvance sectoral training program at the Madison Strategies Group site on employment, earnings, education, and training from 2011 to 2015. The authors investigated similar research questions with three other sites, the profiles of which are available here. The study used a randomized controlled trial design to compare the treatment group, which was able to access the WorkAdvance program at the Madison Strategies Group site, and the control group, which was not eligible for WorkAdvance services but could access other services in the community. The authors collected data from two sources: a follow-up survey and unemployment insurance (UI) wage and employment data. Using survey data, the authors found that those in the treatment group were significantly more likely to complete education or training compared with those in the control group. The authors found no statistically significant impacts of the program on employment or earnings from either the UI data or survey data. The quality of the causal evidence is high for employment and earnings outcomes based on UI data because those outcomes were based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects for those outcomes are attributable to the WorkAdvance program at the Madison Strategies Group site and not to other factors. For education and training outcomes from the follow-up survey, the quality of the causal evidence is moderate because those outcomes were based on a randomized controlled trial in which many people did not complete the follow-up survey, but the authors did account for existing differences between the treatment and control groups. This means we are somewhat confident that the estimated effects for those outcomes are attributable to the WorkAdvance program at the Madison Strategies Group site, but other factors might also have contributed.","the WorkAdvance sectoral training program","Work based and other occupational training","Low income",,"United States",2016,https://files.eric.ed.gov/fulltext/ED568395.pdf "Testing two subsidized employment approaches for recipients of Temporary Assistance for Needy Families: Implementation and early impacts of the Los Angeles County Transitional Subsidized Employment Program","Glosser, A., Barden, B., Williams, S., & Anderson, C. (2016). Testing two subsidized employment approaches for recipients of Temporary Assistance for Needy Families: Implementation and early impacts of the Los Angeles County Transitional Subsidized Employment Program. (OPRE Report 2016-77). Washington, DC: Office of Planning, Research, and Evaluation. [Contrast 1: Paid work experience versus comparison]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-No impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of a paid work experience program, part of Los Angeles’ Subsidized and Transitional Employment Demonstration, on employment, earnings, education, training, and public benefit receipt relative to no subsidized job opportunities. The authors also investigated related impacts, the profiles of which are available [here]. The authors used regression methods in a randomized controlled trial study to examine the impacts of participating in paid work experience. The data sources included administrative wage records, subsidized employment payroll records, Temporary Assistance for Needy Families (TANF) benefit payment records, and survey data. The study found that the paid work experience program had positive, statistically significant impacts on employment, earnings, and benefit receipt compared with the control condition of no subsidized job opportunities. Paid work experience had no impacts on education and training outcomes. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the paid work experience program and not to other factors.","Los Angeles’ Subsidized and Transitional Employment Demonstration","Adult and Dislocated Worker programs Job search assistance and supportive services Other training and education","Low income",,"United States",2016,https://www.mdrc.org/publication/testing-two-subsidized-employment-approaches-r… "Testing two subsidized employment approaches for recipients of Temporary Assistance for Needy Families: Implementation and early impacts of the Los Angeles County Transitional Subsidized Employment Program","Glosser, A., Barden, B., Williams, S., & Anderson, C. (2016). Testing two subsidized employment approaches for recipients of Temporary Assistance for Needy Families: Implementation and early impacts of the Los Angeles County Transitional Subsidized Employment Program. (OPRE Report 2016-77). Washington, DC: Office of Planning, Research, and Evaluation. [Contrast 2: On-the-job training versus comparison]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-Unfavorable impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of on-the-job training, part of Los Angeles’ Subsidized and Transitional Employment Demonstration, on employment, earnings, education, training, and public benefit receipt relative to no subsidized job opportunities. The authors also investigated related impacts, the profiles of which are available [here]. The authors used regression methods in a randomized controlled trial study to examine the impacts of participating in on-the-job training. The data sources included administrative wage records, subsidized employment payroll records, Temporary Assistance for Needy Families (TANF) benefit payment records, and survey data. The study found that on-the-job training had positive, statistically significant impacts on employment and earnings compared with the control condition of no subsidized job opportunities. There were mixed impacts on benefit receipt and negative impacts on earning a professional license or certification. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the on-the-job training program and not to other factors.","Los Angeles’ Subsidized and Transitional Employment Demonstration","Adult and Dislocated Worker programs Job search assistance and supportive services Other training and education","Low income",,"United States",2016,https://www.mdrc.org/publication/testing-two-subsidized-employment-approaches-r… "Testing two subsidized employment approaches for recipients of Temporary Assistance for Needy Families: Implementation and early impacts of the Los Angeles County Transitional Subsidized Employment Program","Glosser, A., Barden, B., Williams, S., Anderson, C. (2016). Testing two subsidized employment approaches for recipients of Temporary Assistance for Needy Families: Implementation and early impacts of the Los Angeles County Transitional Subsidized Employment Program. (OPRE Report 2016-77). Washington, DC: Office of Planning, Research, and Evaluation. [Contrast 3: Paid work experience versus on-the-job training]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-No impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of paid work experience, part of Los Angeles’ Subsidized and Transitional Employment Demonstration, on employment, earnings, and public benefit receipt relative to on-the-job training. The authors also investigated related impacts, the profiles of which are available [here]. The authors used regression methods in a randomized controlled trial study to examine the impacts of participating in paid work experience. The data sources included administrative wage records, subsidized employment payroll records, Temporary Assistance for Needy Families (TANF) benefit payment records, and survey data. The study found that paid work experience had positive, statistically significant impacts on employment, earnings, and benefit receipt compared with on-the-job training. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the paid work experience program and not to other factors.","Los Angeles’ Subsidized and Transitional Employment Demonstration","Adult and Dislocated Worker programs Job search assistance and supportive services Other training and education","Low income",,"Urban, United States",2016,https://www.mdrc.org/publication/testing-two-subsidized-employment-approaches-r… "Life after service for post-9/11 veterans: Data, methods, and policy impacts","Gardner, J. S. (2016). Life after service for post-9/11 veterans: Data, methods, and policy impacts (Doctoral dissertation). Retrieved from https://digitalscholarship.unlv.edu/cgi/viewcontent.cgi?article=3867&context=thesesdissertations",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Unfavorable impacts Employment","Summary: The study’s objective was to examine the effects of the 2008 GI Bill on post-9/11 veterans’ employment and educational attainment. The study used a statistical model to compare outcomes between veterans from before and after the passing of the 2008 GI Bill using data from the American Community Survey. The study found statistically significant relationships between the 2008 GI Bill and the education or employment of veterans. The quality of causal evidence presented in this report is low because the author did not observe outcomes for multiple demonstrations of the intervention. This means we are not confident that the estimated effects are attributable to the post-9/11 GI Bill; other factors are likely to have contributed.","the 2008 GI Bill","Veterans' reemployment Other training and education","Veteran or military",,"United States",2016,https://digitalscholarship.unlv.edu/cgi/viewcontent.cgi?article=3867&context=th… "Incorporating individualized placement and support principles into vocational rehabilitation for formerly incarcerated veterans","LePage, J. P., Lewis, A. A., Crawford, A. M., Parish, J. A., Ottomanelli, L., Washington, E. L., & Cipher, D. J. (2016). Incorporating individualized placement and support principles into vocational rehabilitation for formerly incarcerated veterans. Psychiatric Services, 67(7), 735-742.","Reentry, Veterans","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study examined the effect of the Individual Placement and Support (IPS) program on employment and earnings outcomes for justice-involved veterans with a prior felony conviction and a mental illness or substance abuse disorder. The study team used a randomized controlled trial and statistical tests to examine differences between justice-involved veterans who were offered the IPS program and veterans who were not offered this program. Justice-involved veterans self-reported their outcomes, which were verified based on a review of paystubs or contact with employers. The study showed that the IPS program increased employment, wages, number of days employed, and number of hours worked. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the IPS program, not to other factors.","Individual Placement and Support (IPS)","Job search assistance and supportive services Supported employment or other employment supports Veterans' reemployment","Veteran or military",,"United States",2016,https://ps.psychiatryonline.org/doi/full/10.1176/appi.ps.201500058 "Evaluating the effectiveness of mine safety enforcement actions in forecasting the lost-days rate at specific worksites","Gernand, J. M. (2016). Evaluating the effectiveness of mine safety enforcement actions in forecasting the lost-days rate at specific worksites. Journal of Risk and Uncertainty in Engineering Systems, 2(4). https://doi.org/10.1115/1.4032929","Mine Workers and Mine Health and Safety","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Health and safety-Mod/high-Favorable impacts Health and safety","Summary: The study’s objective was to examine the impact of Mine Safety and Health Administration (MSHA) inspection violations on future accidents and injuries in underground coal mines. The author used statistical models and publicly available MSHA data to predict whether a non-fatal or severe disabling injury would occur in the 12 months following an infraction. The study found that the rate of lost-time injuries could be significantly predicted by total worker time at the mine and the average penalty assessed by MSHA, with a lower likelihood of injury with increased number of worker days at the mine and higher penalties per violation. The quality of causal evidence presented in this report is moderate because it is based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to MSHA inspection violations, but other factors might also have contributed.",,"Mine safety and health Workplace injury",,"Mining, quarrying, and oil and gas extraction","United States",2016,https://doi.org/10.1115/1.4032929 "The Mining Healthy Worksite Program","Cherniack, M. (2016). The Mining Healthy Worksite Program. (Grant No. AFC113-9). Philadelphia, PA: Alpha Foundation for the Improvement of Mine Safety and Health, Inc.","Mine Workers and Mine Health and Safety","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Health and safety-Low-Favorable impacts Health and safety","Summary: The study’s objective was to examine the impact of the Mining Healthy Worksite Program (MHWP) on mine worker health and safety outcomes. The study used a nonexperimental design to assess self-reported health and safety knowledge after mining apprentices completed underground mining or surface mining MHWP courses. Using survey data, the author conducted statistical models to examine differences in outcomes between the groups. The study found a significant positive relationship between knowledge and transfer of training in the Hearing Loss and Prevention module for both surface and underground mining apprentices. The study also found that participation in the surface mining course was significantly associated with higher knowledge scores than the underground mining course. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Mining Healthy Worksite Program (MHWP); other factors are likely to have contributed.","Mining Healthy Worksite Program (MHWP)","Mine safety and health Workplace injury",,"Mining, quarrying, and oil and gas extraction","United States",2016,https://www.alpha-foundation.org/wp-content/uploads/2016/11/AFC113-9_Connecticu… "Implementation of risk management programs: Identification of best practices to reduce injuries and maximize economic benefits","Burgess, J. L. (2016). Implementation of risk management programs: Identification of best practices to reduce injuries and maximize economic benefits. (Report No. AFC113-07). Tucson, Arizona: University of Arizona.","Mine Workers and Mine Health and Safety","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Health and safety-Low-Favorable impacts Health and safety","Summary: The study’s objective was to examine the impact of risk management practices on mine worker health and safety outcomes. The study used a nonexperimental design to compare the differences in 25-year injury rates and lost time injury rates between four mines that implemented risk management practices and a matched comparison group of mines that did not. The study found that implementation of risk management practices in one mine was significantly associated with a lower lost time injury rate than the comparison group of mines. The quality of causal evidence presented in this report is low because the author did not account for preexisting differences between the groups before the intervention or include sufficient control variables. This means we are not confident that the estimated effects are attributable to the risk management practices; other factors are likely to have contributed.","Risk Management","Mine safety and health Workplace injury",,"Mining, quarrying, and oil and gas extraction","United States",2016, "The impact of disability benefits on labor supply: Evidence from the VA’s disability compensation program","Autor, D. H., Duggan, M., Greenberg, K., & Lyle, D. S. (2016). The impact of disability benefits on labor supply: Evidence from the VA’s disability compensation program. American Economic Journal: Applied Economics, 8(3), 31-68. http://www.aeaweb.org/aej-applied/ [Impact of DC enrollment and benefit amount]",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Unfavorable impacts Employment","Summary: The study examined the impact of Disability Compensation (DC) enrollment and benefit amount on labor force participation and earnings. The authors also examined the impact of the expansion of eligibility for DC benefits on labor force participation and earnings; see profile here . The authors estimated statistical models to compare outcomes for Vietnam-era Army veterans who served with “boots on the ground” (BOG) with those who served “not on the ground” (NOG) who did not fight directly in the conflict, before and after the implementation of the Type 2 diabetes policy change in 2001. The authors used administrative data from the U.S. Army Office of Economic and Manpower Analysis, the U.S. Department of Veterans Affairs (VA), and the Social Security Administration (SSA). The increases in DC enrollment due to the expansion in eligibility for DC in 2001 were associated with reductions in labor force participation and earnings. Increases in DC benefit amounts due to the expansion in eligibility were also associated with reductions in labor force participation. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to DC enrollment and benefit amounts, but other factors might also have contributed to the findings.",DC,"Disability insurance Veterans' reemployment","Disability, Male, Veteran or military",,"United States",2016,https://pubs.aeaweb.org/doi/pdf/10.1257/app.20150158 "The impact of disability benefits on labor supply: Evidence from the VA’s disability compensation program","Autor, D. H., Duggan, M., Greenberg, K., & Lyle, D. S. (2016). The impact of disability benefits on labor supply: Evidence from the VA’s disability compensation program. American Economic Journal: Applied Economics, 8(3), 31-68. http://www.aeaweb.org/aej-applied/ [Impact of eligibility expansion]",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Unfavorable impacts Earnings and wages Employment-Low-Unfavorable impacts Employment Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study examined the impact of a 2001 expansion in eligibility for Disability Compensation (DC) to type 2 diabetes for Vietnam-era veterans on labor force participation, earnings, and receipt of public benefits. The authors also examined the impact of receiving DC benefits and amount on labor force participation and earnings; see profile here . The authors estimated statistical models to compare outcomes for Vietnam-era Army veterans who served with “boots on the ground” (BOG) with those who served “not on the ground” (NOG) Veterans who did not fight directly in the conflict, from before and after the implementation of the type 2 diabetes policy change in 2001. The authors used administrative data from the U.S. Army Office of Economic and Manpower Analysis, the U.S. Department of Veterans Affairs (VA), and the Social Security Administration. The implementation of expanded DC coverage and benefits in 2001 resulted in reductions in labor force participation and earnings among impacted veterans as well as increases in the receipt of disability benefits. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the expansion in eligibility for Disability Compensation (DC); other factors are likely to have contributed to the findings.",DC,"Disability insurance Veterans' reemployment","Disability, Male, Veteran or military",,"United States",2016,https://pubs.aeaweb.org/doi/pdf/10.1257/app.20150158 "To work for yourself, for others, or not at all? How disability benefits affect the employment decisions of older veterans","Coile, C., Duggan, M., & Guo, A. (2016). To work for yourself, for others, or not at all? How disability benefits affect the employment decisions of older veterans. Unpublished manuscript.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study examined the impact of a 2001 expansion in eligibility for Disability Compensation (DC) to cover type 2 diabetes for Vietnam-era veterans on their employment, earnings, and public benefit receipt. The authors estimated statistical models to compare outcomes among male Vietnam-era veterans who did and did not serve with on the ground using data from the Veterans Supplement to the Current Population Survey from 1995 to 2015. The study found that the expansion of eligibility for DC was associated with greater receipt of DC, a lower likelihood of working for others, and a greater likelihood of self-employment by on-the-ground veterans compared with those veterans who did not serve on the ground. The study did not find a relationship between the expansion and earnings. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to changes in eligibility for DC and not to other factors.",DC,"Other wages and benefits Veterans' reemployment","Disability, Male, Veteran or military",,"United States",2016,https://www.nber.org/papers/w23006 "Growing Regional Opportunity for the Workforce (Project GROW): Final evaluation report.","Patnaik, A., O'Shea, D., & Prince, H. (2016). Growing Regional Opportunity for the Workforce (Project GROW): Final evaluation report. The University of Texas, Austin Ray Marshall Center for the Study of Human Resources.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Mod/high-No impacts Education and skills gains Employment-Mod/high-No impacts Employment","Summary: The study's objective was to examine the impact of Project GROW (Growing Regional Opportunities for the Workforce) on education, earnings, and employment outcomes. The study used a nonexperimental design comparing the outcomes of students in Project GROW to a matched comparison group. Using data from the Workforce Investment Boards’ Administrative System for Program Partners and administrative data from the Texas Workforce Commission and the Texas Health and Human Services Commission, the authors conducted statistical models to examine differences between the groups. The study found no statistically significant differences between the treatment and the comparison group on education, earnings, or employment outcomes. The quality of causal evidence presented in this study is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to Project GROW, but other factors might also have contributed.","Project Growing Regional Opportunities for the Workforce (GROW)","Employment and Training Services Employer Services Employer partnerships Training and Education Basic skills Capacity building programs Community college education and other classroom training","Adult, Low-skilled",,"United States",2016,https://repositories.lib.utexas.edu/handle/2152/74399 "Labor intensive public works and children's activities: The case of Malawi","de Hoop, J., & Rosati, F. C. (2016). Labor intensive public works and children's activities: The case of Malawi. Retrieved from http://ucw-project.org/attachment/11052017285Public_work_malawi_dehoop_rosati.pdf","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Unfavorable impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to assess the impact of Malawai’s Labour Intensive Public Works program (LIPW) on children’s school participation and involvement in paid work and household chores. The study was a randomized controlled trial where eligible villages were randomly assigned to a control group that would not receive any benefits, or to one of four treatment groups that differed by agricultural season (lean vs. post-harvest) and payment schedule (lump sum vs. installments). Using household survey data, the authors analyzed the impact of the treatment conditions on school attendance and work 3-months, 6-months, and 12-months after implementation. The study found that post-harvest program participation was significantly related to higher rates of paid work 6 months after participation for boys, whereas lean harvest program participation was significantly related to higher rates of household chores for girls one year after treatment. Lean program participation was also significantly related to school attendance 6 months after participation for all children. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to Malawi’s LIPW program, and not to other factors.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2016,http://ucw-project.org/attachment/11052017285Public_work_malawi_dehoop_rosati.p… "Multi-State Advanced Manufacturing Consortium (M-SAMC) TAACCCT Round II grant final evaluation report.","Corporation for a Skilled Workforce & The New Growth Group. (2016). Multi-State Advanced Manufacturing Consortium (M-SAMC) TAACCCT Round II grant final evaluation report. Ann Arbor, MI: Corporation for a Skilled Workforce (CSW); Cleveland, OH: The New Growth Group, LLC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Multi-State Advanced Manufacturing Consortium (M-SAMC) program participation on education outcomes. This summary focuses on the findings at Rhodes State College in Ohio.  The authors used a nonexperimental design to compare outcomes of M-SAMC program participants with a matched comparison group. The study found that the odds of program completion were significantly higher for participants in the M-SAMC programs compared to participants in the comparison group. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the M-SAMC; other factors are likely to have contributed.","Multi-State Advanced Manufacturing Consortium (M-SAMC)","Employment and Training Services Training and Education Community college education and other classroom training",Adult,,"United States",2016,https://www.skillscommons.org/bitstream/handle/taaccct/9692/MSAMC%20Final%20Eva… "The effects of youth employment: Evidence from New York City lotteries.","Gelber, A., Isen, A., & Kessler, J. B. (2016). The effects of youth employment: Evidence from New York City lotteries. The Quarterly Journal of Economics, 131(1), 423-460.",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Mixed impacts Earnings and wages Education and skills gains-Mod/high-No impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Summer Youth Employment Program (SYEP) on the employment rate, earnings, and college enrollment of New York City youth 14 to 21 years old. The authors compared the employment rate, earnings, and college enrollment of the treatment group, youth who won a random lottery for the SYEP program and chose to participate in it, with those of the control group, youth who applied to the program but were not randomly selected to participate. The study used data from the Internal Revenue Service to measure outcomes over a five-year period. The study found that, compared with earnings of the control group, the treatment group had significantly higher earnings in the year of participation in SYEP, but significantly lower earnings in the following three years. The treatment group also had a significantly higher probability of being employed in any job during the year of participation in SYEP and the first follow-up year compared with the employment probability of the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the SYEP program, and not to other factors.","Summer Youth Employment Program (SYEP)","Youth programs","Youth, Disconnected youth",,"United States",2016, "Do education and health conditions matter in a large cash transfer? Evidence from a Honduran experiment","Benedetti, F., Ibarrarán, P., & McEwan, P. J. (2016). Do education and health conditions matter in a large cash transfer? Evidence from a Honduran experiment. Economic Development and Cultural Change, 64(4), 759-793. doi:10.1086/686583","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-No impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of a conditional cash transfer on school enrollment and child labor. The study was a randomized controlled trial conducted in in low-income villages in Honduras. Villages were randomly assigned to the treatment and control groups. Baseline and follow-up survey data were collected from randomly selected households and analyzed using regression. The Bono 10,000 program significantly increased school enrollment but did not significantly reduce child labor. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Bono 10,000 program and not to other factors.","Bono 10,000","Child labor","Other, Low income",,International,2016,http://academics.wellesley.edu/Economics/mcewan/PDF/bono.pdf "The influence of conditional cash transfers on eligible children and their siblings","Lincove, J. A., & Parker, A. (2016). The influence of conditional cash transfers on eligible children and their siblings. Education Economics, 24(4), 352-373.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The purpose of the study was to examine the impact of Nicaragua’s Red de Proteccion Social (RPS) conditional cash transfer (CCT) program on attending school, working, and hours worked for children ages 6 to 16. The authors used data from an experimental design where communities were randomly assigned to participate in the program. The authors used difference-in-differences to estimate the effects of the program, controlling for child and family demographics separately by child gender and child age groups. The CCT was not associated with the probability of attending school and working for boys, but was associated with a statistically significant decrease in hours worked for boys ages 6-11 (2.8 hours) and for boys as 12-13 (8.7 hours). The program was also associated with a statistically significant 15.8 percent increase in the probability of school enrollment for girls ages 6-11. The quality of the causal evidence presented in this study is moderate because, although it was based on a randomized controlled trial with high attrition, the authors demonstrated that the treatment and control groups were similar before the intervention. This means we have confidence that the estimated effects are attributable at least in part to the RPS conditional cash transfer program, although other factors could also have contributed.","Red de Protección Social (RPS)","Child labor","Other, Low income",,International,2016,http://www.janelincove.com/uploads/3/7/2/0/37205101/educaton_economics_2015.pdf "The impact of conditional cash transfers on the amount and type of child labor","Del Carpio, X. V., Loayza, N. V., & Wada T. (2016). The impact of conditional cash transfers on the amount and type of child labor. World Development, 80, 33-47. doi:10.1016/j.worlddev.2015.11.013","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor","Summary: The study’s objective was to examine the impact of a conditional cash transfer (CCT) program on the amount and type of child labor conducted by children ages 8 to15. Types of child labor included household chores, farm labor (both at home and outside the home), and skill-forming activities defined as work in commerce, sales, or manufacturing activities outside the home. The study was a randomized controlled trial conducted in six municipalities in Nicaragua. Households from each community were randomly assigned into treatment and control groups. Treatment households received either the basic CCT or the basic CCT plus an additional a household grant for the creation of a micro business. Survey data were collected and child labor outcomes were analyzed using two statistical models. The study found that the program significantly reduced overall child labor, household chore labor, and farm labor for both treatment groups compared to the control group. The program had no effect on skill-forming labor for the treatment group that received the basic CCT but increased skill-forming labor for the children in the households that received the basic CCT plus the business grant. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial with low attrition. This means we are confident that the estimated effects are attributable to the Atención a Crisis program and not to other factors.","Atención a Crisis (“Attention to the Crisis”)","Child labor","Other, Low income",,International,2016,https://www.sciencedirect.com/science/article/pii/S0305750X15002934 "Wealth differentials in the impact of conditional and unconditional cash transfers on education: Findings from a community-randomised controlled trial in Zimbabwe","Fenton, R., Nyamukapa, C., Gregson, S., Robertson, L., Mushati, P., Thomas, R., & Eaton, J. W. (2016) Wealth differentials in the impact of conditional and unconditional cash transfers on education: Findings from a community-randomized controlled trial in Zimbabwe. Psychology, Health & Medicine, 21(8), 909-917","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the effects of conditional cash transfers (CCT) and unconditional cash transfers (UCT) on child labor and schooling outcomes. This summary focuses on the comparison between the CCT group and the control group. The study was a randomized controlled trial in which households were randomly assigned to receive one of two cash transfers (conditional or unconditional) or to participate in the control group that did not receive a cash transfer. Using household survey data, the authors analyzed the impact of the treatment conditions on child labor and schooling outcomes a year after the intervention began. The study found that receipt of a conditional cash transfer was significantly associated with a reduction in child work and increases in school attendance for the poorest households. The quality of causal evidence presented in this report is low because it based on a randomized controlled trial with unknown attrition and the authors did not ensure that the groups being compared were similar before receiving the cash transfer. This means we are not confident that the estimated effects are attributable to the conditional cash transfer; other factors are likely to have contributed.","Cash Transfer Program","Child labor","Other barriers, Other, Low income",,International,2016,https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5044770/ "Wealth differentials in the impact of conditional and unconditional cash transfers on education: Findings from a community-randomised controlled trial in Zimbabwe","Fenton, R, Nyamukapa, C., Gregson, S., Robertson, L., Mushati, P., Thomas, R., & Eaton, J.W. (2016). Wealth differentials in the impact of conditional and unconditional cash transfers on education: Findings from a community-randomised controlled trial in Zimbabwe. Psychology, Health & Medicine, 21(8), 909-917","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-No impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the effects of conditional cash transfers (CCT) and unconditional cash transfers (UCT) on child labor and schooling outcomes. This summary focuses on the comparison between the UCT group and the control group. The study was a randomized controlled trial in which households were randomly assigned to receive one of two cash transfers (conditional or unconditional) or to participate in the control group that did not receive a cash transfer. Using household survey data, the authors analyzed the impact of the treatment conditions on child labor and schooling outcomes a year after the intervention began. The study found that receipt of an unconditional cash transfer was significantly associated with an increases in school attendance for the poorest households, but not significantly related to child labor outcomes. The quality of causal evidence presented in this report is low because it based on a randomized controlled trial with unknown attrition and the authors did not ensure that the groups being compared were similar before receiving the cash transfers. This means we are not confident that the estimated effects are attributable to the unconditional cash transfers; other factors are likely to have contributed.","Cash Transfer Program","Child labor","Other barriers, Other, Low income",,International,2016,https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5044770/ "Wealth differentials in the impact of conditional and unconditional cash transfers on education: Findings from a community-randomised controlled trial in Zimbabwe","Fenton, R., Nyamukapa, C., Gregson, S., Robertson, L., Mushati, P., Thomas, R., & Eaton, J.W. (2016). Wealth differentials in the impact of conditional and unconditional cash transfers on education: Findings from a community-randomised controlled trial in Zimbabwe. Psychology, Health & Medicine, 21(8), 909-917.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-No impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the effects of conditional cash transfers (CCT) and unconditional cash transfers (UCT) on child labor and schooling outcomes. This summary focuses on the comparison between the CCT group and the UCT group. The study was a randomized controlled trial in which households were randomly assigned to receive one of two cash transfers (conditional or unconditional) or to participate in the control group that did not receive a cash transfer. Using household survey data, the authors analyzed the impact of the treatment conditions on child labor and schooling outcomes a year after the intervention began. The study found that the CCT group had significantly higher levels of school attendance than the UCT group for the least poor households. However, the study found no statistically significant difference in the number of hours worked between the two groups. The quality of causal evidence presented in this report is low because it based on a randomized controlled trial with unknown attrition and the authors did not ensure that the groups being compared were similar before receiving the cash transfers. This means we are not confident that the estimated effects are attributable to the cash transfers; other factors are likely to have contributed.","Cash Transfer Program","Child labor","Other barriers, Other, Low income",,International,2016,https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5044770/ "Do conditional cash transfers reduce child labor?: Evidence from the Philippines","Galang, I. M. (2016). Do conditional cash transfers reduce child labor?: Evidence from the Philippines (Unpublished Master's thesis). Tokyo, Japan: The University of Tokyo.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-No impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The objective of the study was to examine the impact of the Philippines conditional cash transfer program, Pantawid Pamilyang Pilipino Program (4Ps), on child labor and school attendance. The authors used a nonexperimental design to compare the outcomes of children ages 12-14 that received the conditional cash transfers with those who did not, based on data from the 2011 Annual Poverty Indicator Survey. Using several demographic characteristics, they created a matched comparison group of families who did not receive the benefit to assess the effectiveness of the cash transfer program. The study found that receipt of the cash transfer was significantly associated with increased school attendance but not significantly associated with child labor. The quality of causal evidence presented in this report is low because the authors did not account for the outcomes of schooling and work at baseline. This means we are not confident that the estimated effects are attributable to the 4Ps program; other factors are likely to have contributed.","Pantawid Pamilya Pilipino Program","Child labor","Other, Low income",,International,2016,http://www.pp.u-tokyo.ac.jp/wp-content/uploads/2016/02/1.31-MB-1.pdf "Do conditional cash transfers reduce child labor?: Evidence from the Philippines","Galang, I. M. (2016). Do conditional cash transfers reduce child labor?: Evidence from the Philippines (Unpublished Master's thesis). Tokyo, Japan: The University of Tokyo.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-No impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The objective of the study was to examine the impact of the Philippines conditional cash transfer program, Pantawid Pamilyang Pilipino Program (4Ps), on child labor and school attendance. The authors used a nonexperimental design to compare the outcomes of children ages 12-14 that received the conditional cash transfers with those who did not, based on data from the 2011 Annual Poverty Indicator Survey. Using several demographic characteristics, they created a matched comparison group of families who did not receive the benefit to assess the effectiveness of the cash transfer program. The study found that receipt of the cash transfer was significantly associated with increased school attendance but not significantly associated with child labor. The quality of causal evidence presented in this report is low because the authors did not account for the outcomes of schooling and work at baseline. This means we are not confident that the estimated effects are attributable to the 4Ps program; other factors are likely to have contributed.","Pantawid Pamilyang Pilipino Program (4Ps)","Child labor","Other, Low income",,International,2016,http://www.pp.u-tokyo.ac.jp/wp-content/uploads/2016/02/1.31-MB-1.pdf "Nursing interventions to help prevent children from working on the streets","Mert, K., & Kadioglu, H. (2016). Nursing interventions to help prevent children from working on the streets. International Nursing Review 63, 429–436. doi:10.1111/inr.12301","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-No impacts Child labor","Summary: The study’s objective was to assess the impact of a program developed to prevent children under 18 years of age from working on the street. The study was an interrupted time series design conducted in one neighborhood in the city of Izmit, Turkey. The authors compared the outcomes for mothers and their children before, immediately after, and three months after participating in The Streets are Not the Solution program. The study found that participating in the program was associated with a 44 percentage point decrease from pretest to posttest in the percentage of children who worked on the streets. However, the study did not include tests of statistical significance. The quality of causal evidence presented in this report is low because the authors did not account for trends in outcomes before the intervention. This means we are not confident that the effects are attributable to the Streets are Not the Solution program; other factors are likely to have contributed.","The Streets are Not the Solution","Child labor","Female, Other, Parent",,International,2016, "Eliminating child labour in El Salvador through economic empowerment and social inclusion: Impact report","de Hoop, J., Kovrova, I., & Rosati, F. C. (2016). Eliminating child labour in El Salvador through economic empowerment and social inclusion: Impact report. Retrieved from http://www.ucw-project.org/attachment/07032017224El_Salvador_IE_07042016_web.pdf","Child Labor","Study Type: Descriptive Analysis",,,"Summary: The study’s objective was to assess the effects of a women’s entrepreneurship training program on children’s participation in school and work. The study was a regression discontinuity design, using baseline and follow-up household surveys to measure program outcomes. Households were selected into the program if they had a wealth score below a cut-off point. The authors compared the outcomes of children in households above and below the cut-off score to understand the program’s effects. The study found that selection and participation in the program was significantly associated with a decrease in the percent of children working-only and not attending school, and the number of hours that children worked per week. Selection and participation in the program was also significantly related to an increase in school attendance. This study used a regression discontinuity design and therefore was reviewed using CLEAR’s descriptive study evidence review guidelines. As such, it does not receive a causal rating.","Eliminating Child Labour in El Salvador through Economic Empowerment and Social Inclusion","Child labor","Female, Parent, Low income",,International,2016,http://www.ucw-project.org/attachment/07032017224El_Salvador_IE_07042016_web.pdf "Men and women expecting to work longer: Do changing work conditions matter?","Moen, P., Kojola, E., Kelly, E.L., & Karakaya, Y. (2016). Men and women expecting to work longer: Do changing work conditions matter? Work, Aging and Retirement, 2(3), 321-344.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of a work flexibility intervention called STAR (Support. Transform. Achieve. Results) on workers’ expectations of retirement age and bridge jobs. The study is a randomized controlled trial that uses surveys of workers before the intervention and five years post-intervention. The study found that receiving STAR was associated with higher expectations of working at age 65 and retiring at age 67 or older. The quality of causal evidence presented in this report is low because, although it was based on a randomized controlled trial, it had unknown attrition and the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to STAR; other factors are likely to have contributed.","STAR (Support. Transform. Achieve. Results.)","Work based and other occupational training Other employer services","Adult, Older worker",,"United States",2016,https://experts.umn.edu/en/publications/men-and-women-expecting-to-work-longer-… "Job insecurity, unemployment insurance and on-the-job search. Evidence from older American workers.","Gutierrez, I. A. (2016). Job insecurity, unemployment insurance and on-the-job search. Evidence from older American workers. Labour Economics, 41, 228-245. doi:10.1016/j.labeco.2016.05.011","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-No impacts Employment","Summary: The study examined the impact of the potential wage replacement rate through Unemployment Insurance (UI) on the probability of transitioning to non-employment. The study used a nonexperimental design and data from the Health and Retirement Study (HRS) from 1996–2006 and 2010–2012 to identify workers who expected job loss during the baseline survey and who experienced job transitions by the follow-up survey two years later. The study found no statistically significant relationships between potential wage replacement rates and transitions to non-employment. The quality of causal evidence presented in this report is low because the analyses do not sufficiently account for other factors that might contribute to the estimated effects. This means we are not confident that the estimated effects are attributable to the potential wage replacement rate through UI; other factors are likely to have contributed.","Unemployment Insurance (UI)","Older workers' programs Unemployment Insurance","Adult, Older worker, Employed",,"United States",2016, "The effect of Social Security information on the labor supply and savings of older Americans.","Armour, P., & Lovenheim, M. F. (2016). The effect of Social Security information on the labor supply and savings of older Americans. (Working paper no. 361). Ann Arbor, MI: University of Michigan, Michigan Retirement Research Center.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Mixed impacts Employment","Summary: The study examined the impact of the Social Security statements issued by the Social Security Administration (SSA) on older men’s annual hours worked. The authors used a nonexperimental design and data from Health and Retirement Study surveys and Social Security administrative records to estimate the impacts. The study found that receiving the first Social Security Statement is associated with a decrease in self-reported annual hours worked and receiving the second Social Security Statement is associated with an increase in self-reported annual hours worked. The quality of casual evidence presented in this report is moderate because that the study was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to Social Security statements, but other factors might also have contributed.","Social Security statements","Older workers' programs Other disparities or discrimination in employment and earnings","Adult, Older worker, Male",,"United States",2016, "Spousal labor market effects from government health insurance: Evidence from a veterans affairs expansion.","Boyle, M. A. & Lahey, J. N. (2016). Spousal labor market effects from government health insurance: Evidence from a veterans affairs expansion. Journal of Health Economics, Elsevier, 45(C), 63-76.","Older Workers, Veterans","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Mod/high-No impacts Employment","Summary: The study examined the impact of the expansion of health insurance for veterans through the U.S. Department of Veterans Affairs (VA) in the mid-1990s (as a result of the implementation of the Veteran’s Health Care Eligibility Reform Act) on the employment and earnings of non-covered spouses. The authors used a statistical model and data from the Census Bureau’s March Current Population Survey and the Health and Retirement Study to compare the employment and earnings of wives of male veterans with wives of non-veterans of the same ages before and after the expansion of health insurance for veterans through the VA. The study found no statistically significant associations between the expansion of health insurance for veterans and the employment of their wives and mixed evidence on associations between the expansion of health insurance for veterans and the earnings of their wives. The quality of causal evidence presented in this report is moderate for the employment outcomes because it was based on a well-implemented nonexperimental design. This means we would be somewhat confident that any estimated effects would be attributable to the expansion of health insurance for veterans through the VA, but other factors might also have contributed. The quality of causal evidence presented in this report is low for earnings outcomes because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the expansion of health insurance for veterans through the VA; other factors are likely to have contributed.","Veteran Health Insurance Expansion","Health Older workers' programs Veterans' reemployment","Adult, Older worker, Veteran or military",,"United States",2016, "Enhanced vocational rehabilitation for veterans with mild traumatic brain injury and mental illness: Pilot study","O’Connor, M. K., Mueller, L., Kwon, E., Drebing, C. E., O’Connor, A. A., Semiatin, A., & Daley, R. (2016). Enhanced vocational rehabilitation for veterans with mild traumatic brain injury and mental illness: Pilot study. Journal of Rehabilitation Research & Development, 53(3), 307-319.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of an embedded cognitive rehabilitation intervention on employment and earnings. The study was a randomized controlled trial with the authors using administrative data. The study found no statistically significant relationships between an embedded cognitive rehabilitation intervention and employment and earnings after one year. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to an embedded cognitive rehabilitation intervention; other factors are likely to have contributed.","the cognitive rehabilitation intervention","Substance abuse recovery Vocational rehabilitation","Other barriers, Male, Veteran or military",,"United States",2016,http://search.proquest.com/openview/ee479834dd8beedff02771b00bc95e0a/1?pq-origs… "Delivery of remedial community college mathematics instruction in an emporium learning environment: Predicting academic success, persistence, retention, and completion","Little, M. D. (2016). Delivery of remedial community college mathematics instruction in an emporium learning environment: Predicting academic success, persistence, retention, and completion. (Unpublished doctoral dissertation). University of North Carolina at Charlotte, Charlotte, NC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Education and skills gains-Mod/high-No impacts Education and skills gains","Summary: The study’s objective was to determine the impact of an accelerated emporium developmental math course on community college students’ course completion, persistence, retention, and academic success. The study used a nonexperimental design to compare the outcomes of students who enrolled in an accelerated emporium developmental math course with those who enrolled in a traditional developmental math course. The study did not find any statistically significant effects of the emporium delivery format on course completion, course persistence, retention, or student success. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the accelerated emporium math course and not to other factors.","the Accelerated Emporium Developmental Math Course","Community college education and other classroom training",Adult,,"Urban, United States",2016,https://ninercommons.uncc.edu/islandora/object/etd%3A476/datastream/PDF/downloa… "Four-year degree and employment findings from a randomized controlled trial of a one-year performance-based scholarship program in Ohio","Mayer, A. K., Patel, R., & Gutierrez, M. (2016). Four-year degree and employment findings from a randomized controlled trial of a one-year performance-based scholarship program in Ohio. Journal of Research on Educational Effectiveness, 9(3), 283-306. doi: 10.1080/19345747.2015.1086914","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine the impact of a performance-based scholarship program on community college students’ credit accumulation, degree/certificate completion, employment, and earnings. The study was a randomized controlled trial conducted at three community colleges in Ohio. Eligible students were randomly assigned to either the treatment or control groups. The authors conducted statistical models to examine differences in outcomes between the groups four years post-random assignment. The study found that when compared to the control group, students in the performance-based scholarship program had significantly higher credit accumulation and rates of degree/ certificate completion. The quality of causal evidence presented in this study is high because it is based on a well-implemented randomized controlled trial with low attrition. This means we are confident that the estimated effects are attributable to the one-year performance-based scholarship program and not to other factors.","the performance-based scholarship program","Community college education and other classroom training","Adult, Low income",,"United States",2016,https://doi.org/10.1080/19345747.2015.1086914 "Assessing the First Two Years’ Effectiveness of Statway®","Yamada, H., & Bryk, A. S. (2016). Assessing the First Two Years’ Effectiveness of Statway®. Community College Review, 44(3), 179–204. doi: 10.1177/0091552116643162","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to evaluate the impact of Statway® on community college students’ earning of math course credits. The study used a nonexperimental design to compare the outcomes of students who were in the Statway® program to a matched comparison group. Using institutional research data from the community colleges, the authors conducted statistical models to examine differences between the groups. When compared to non-participating students, the study found that Statway® program participation was associated with a significantly higher likelihood of earning college math credit. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to Statway®; other factors are likely to have contributed.",Statway®,"Community college education and other classroom training","Adult, Other barriers",,"United States",2016,https://doi.org/10.1177%2F0091552116643162 "Consortium for Healthcare Education Online: Final evaluation report","Edwards, R., McKay, H., Mattoon, A., & Yang, S. (2016). Consortium for Healthcare Education Online: Final evaluation report. Piscataway, NJ: Rutgers Education and Employment Research Center.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Unfavorable impacts Earnings and wages Education and skills gains-Low-Mixed impacts Education and skills gains Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Consortium for Healthcare Education Online (CHEO) on education, earnings, and employment outcomes. This summary contains the findings from Flathead Valley Community College. Using institutional, employment, and wage data, the authors conducted a nonexperimental design to compare the outcomes of students who were enrolled in the CHEO program to a historic comparison group of students from previous enrollment years. The study found that CHEO program participation was significantly associated with earning more course credits, lower pass rates, a greater likelihood of pursuing further education, and higher rates of employment after program completion for incumbent workers. The quality of causal evidence presented in this study is low because the authors used a comparison group from previous enrollment years presenting a confounding factor. This means we are not confident that the estimated effects are attributable to the CHEO program; other factors are likely to have contributed.","the Consortium for Healthcare Education Online (CHEO) Program","Capacity building programs Community college education and other classroom training",Adult,,"United States",2016,https://epe.rutgers.edu/sites/default/files/images/Research_Documents/cheo_fina… "Consortium for Healthcare Education Online: Final Evaluation Report","Edwards, R., McKay, H., Mattoon, A., & Yang, S. (2016). Consortium for Healthcare Education Online: Final evaluation report. Piscataway, NJ: Rutgers Education and Employment Research Center.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Consortium for Healthcare Education Online (CHEO) on education, earnings, and employment outcomes. This summary contains the findings from Pueblo Community College. Using institutional, employment, and wage data, the authors conducted a nonexperimental design to compare the outcomes of students who were enrolled in the CHEO program to a historic comparison group of students from previous enrollment years. The study found that CHEO program participation was significantly associated with earning more course credits, a higher probability of passing courses and receiving a credential, greater likelihood of pursuing further education, and higher rates of employment after program completion. The quality of causal evidence presented in this study is low because the authors used a comparison group from previous enrollment years presenting a confounding factor. This means we are not confident that the estimated effects are attributable to the CHEO program; other factors are likely to have contributed.","the Consortium for Healthcare Education Online (CHEO) Program","Capacity building programs Community college education and other classroom training",Adult,,"United States",2016,https://epe.rutgers.edu/sites/default/files/images/Research_Documents/cheo_fina… "Evaluation report of the Amplifying Montana's Advanced Manufacturing and Innovation Industry (AMAMII) project: Final report","Feldman, J., Staklis, S., Hong, Y., & Elrahman, J. (2016). Evaluation report of the Amplifying Montana's Advanced Manufacturing and Innovation Industry (AMAMII) project: Final report. Berkeley, CA: RTI International.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Unfavorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Amplifying Montana’s Advanced Manufacturing and Innovation and Industry (AMAMII) program on education outcomes. The authors used a nonexperimental design to compare the outcomes of students participating in AMAMII to a matched comparison group using institutional research data. The study found a significant negative relationship between program participation and credit accumulation, with AMAMII students accumulating fewer credits than comparison students. The quality of causal evidence presented in this report is low because the authors did not use sufficient controls in their analyses. This means we are not confident that the estimated effects are attributable to the AMAMII program; other factors are likely to have contributed.","the Amplifying Montana’s Advanced Manufacturing and Innovation and Industry (AMAMII) Program","Basic skills Capacity building programs Community college education and other classroom training","Adult, Low-skilled",,"United States",2016,http://www.skillscommons.org/bitstream/handle/taaccct/15588/Flathead%20Valley%2… "Impact evaluation of the New England Institute of Technology's Shipbuilding/Marine Advanced Manufacturing Institute (SAMI) Program TAACCCT II grant","Fogg, N. P., Harrington, P. E., & Khatiwada, I. (2016). Impact evaluation of the New England Institute of Technology's Shipbuilding/Marine Advanced Manufacturing Institute (SAMI) Program TAACCCT II grant. Philadelphia, PA: Center for Labor Markets and Policy, Drexel University.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Shipbuilding/Marine Advanced Manufacturing Institute (SAMI) program on earnings and employment outcomes. Using data from the SAMI program student database and unemployment insurance data from the Rhode Island Department of Labor and Training, the authors conducted a nonexperimental study to compare the outcomes of SAMI participants to a matched comparison group. The study found that participating in the SAMI program was significantly associated with higher rates of employment and higher earnings. The quality of casual evidence provided in this study is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the SAMI program; other factors are likely to have contributed.","the Shipbuilding/Marine Advanced Manufacturing Institute (SAMI)","Capacity building programs Community college education and other classroom training",Adult,,"United States",2016,https://www.skillscommons.org/handle/taaccct/9764 "Final evaluation report: Summative evaluation TAACCCT round 2 accelerated, blended – online, 2 + 2 TAACCCT training project","Franco, E. O. (2016). Final evaluation report: Summative evaluation TAACCCT round 2 accelerated, blended – online, 2 + 2 TAACCCT training project. Cayey, PR: Colegio Universitario de San Juan.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Colegio Universitario de San Juan’s (CUSJ) modified electronics, engineering, and technology programs on education outcomes. The study used a nonexperimental design to compare education outcomes of CUSJ participants to a comparison group. Using CUSJ’s embedded course assessments, the author conducted statistical tests to examine differences between the groups. The study found that CUSJ participation was significantly associated with higher approval rates (defined as passing a course). The quality of causal evidence presented in this report is low because the author did not use sufficient controls in their analysis. This means we are not confident that the estimated effects are attributable to the CUSJ course modifications; other factors are likely to have contributed.","the Colegio Universitario de San Juan’s (CUSJ) Modified Courses","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Unemployed",,"United States",2016,https://www.skillscommons.org/handle/taaccct/15668 "Alliance evaluation: Final evaluation report","Ho, H. Y. (2016). Advanced Manufacturing Education (AME) Alliance evaluation: Final evaluation report (Grant Number TC-23753-12-60-A-27). Denver, CO: McREL International.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-No impacts Employment","Summary: This study’s objective was to examine the impact of the Advanced Manufacturing Education (AME) Alliance on education, earnings, and employment outcomes. The author used a nonexperimental design to compare education, employment, and earnings outcomes of AME participants to a matched comparison group. The study found that AME participants were significantly more likely to complete a program of study relative to the comparison group. The quality of casual evidence provided in this study is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the enhanced AME program; other factors are likely to have contributed.","the Advanced Manufacturing Education (AME) Alliance","Capacity building programs Community college education and other classroom training",Adult,,"United States",2016,https://www.skillscommons.org/bitstream/handle/taaccct/10174/DOLAME_Y4_FinalEva… "Online2Workforce (O2W) Elizabethtown Community & Technical College TAACCCT Round II Grant Final Evaluation Report","Jensen, J., Horohov, J., & Wright, C. (2016). Online2Workforce (O2W) Elizabethtown Community & Technical College TAACCCT Round II Grant Final Evaluation Report. Lexington, KY: University of Kentucky College of Education Evaluation Center.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-Unfavorable impacts Employment","Summary: The study’s objective was to assess the impact of the Online2Workforce (O2W) program on education, earnings, and employment outcomes. The authors used a nonexperimental design to compare the outcomes of students who were in the O2W program to a matched comparison group. The study found that O2W program participants had significantly higher rates of credentials earned and awarded, and lower rates of employment after program completion than the comparison group. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the Online2Workforce program, but other factors might also have contributed.","the Online-2-Workforce (O2W) Program","Capacity building programs Community college education and other classroom training",Adult,,"United States",2016,https://www.skillscommons.org/bitstream/handle/taaccct/15586/Elizabethtown%20CT… "An evaluation of the manufacturing advancement and assessment center (MAAC) program, final report","Kundin, D.M., & Dretzke, B.J. (2016). An evaluation of the manufacturing advancement and assessment center (MAAC) program, final report. St. Paul, MN: University of Minnesota, Center for Applied Research and Educational Improvement, College of Education and Human Development.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Manufacturing Assessment and Advancement Centers (MAAC) program on educational outcomes. The authors used a nonexperimental design to compare the outcomes of students who were enrolled in the MAAC program to a historic comparison group of students from previous enrollment years. The study found a significant relationship between program participation and increased credential attainment. The quality of causal evidence presented in this study is low because the authors used a comparison group from previous enrollment years presenting a confounding factor. This means we are not confident that the estimated effects are attributable to the MAAC program; other factors are likely to have contributed.","the Manufacturing Assessment and Advancement Centers (MAAC) Program","Capacity building programs Community college education and other classroom training",Adult,,"United States",2016, "Camden County College’s Trade Adjustment Assistance for Community College Career","Mabe, W. (2016). Camden County College’s Trade Adjustment Assistance for Community College Career Training grant: Training outcomes final evaluation report. New Brunswick, NJ: Edward J. Bloustein School of Planning and Public Policy at Rutgers University.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the Camden County College (CCC) workforce development program on earnings and employment outcomes. Using the New Jersey Unemployment Insurance (UI) wage record data system., the author conducted a nonexperimental design to compare earnings and employment outcomes of students enrolled in the workforce development program to a matched comparison group. The study found that participation in the workforce development program was associated with higher levels of employment and higher wages in the first two quarters after graduation. However, the study did not include tests of significance. The quality of the causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the CCC workforce development program; other factors are likely to have contributed.","the Camden County College Workforce Development Program","Capacity building programs Community college education and other classroom training",Adult,,"United States",2016,https://strategies.workforcegps.org/resources/2017/06/07/15/35/Camden-County-Co… "Coconino County Community College TAACCCT grant: Final report","Magnolia Consulting. (2016). Coconino County Community College TAACCCT grant: Final report. Retrieved from: https://www.skillscommons.org/handle/taaccct/15564","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to assess the impact of the CCC2NAU program on students’ education outcomes. Using college administrative data, the authors conducted a nonexperimental study to compare education outcomes of CCC2NAU participants to a matched comparison group. The study found that a significantly larger proportion of participants in the treatment group transferred to a 4-year college, were retained in the program, earned a two-year degree, and earned an Arizona General Education Curriculum (AGEC) certificate, relative to the comparison group. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to CCC2NAU, but other factors might also have contributed.",CCC2NAU,"Capacity building programs Community college education and other classroom training",Adult,,"United States",2016,https://www.skillscommons.org/handle/taaccct/15564 "Kansas City Kansas Community College: Training for Employment (T4E) program","Martin, G., & Melzer, B. A. (2016). Kansas City Kansas Community College: Training for Employment (T4E) program. Kansas City, MO: Evalytics, LLC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the Kansas City Kansas Community College’s Training for Employment (T4E) program on student education, earnings, and employment outcomes. The study used a nonexperimental design to compare the education, earnings, and employment outcomes of T4E students to a comparison group. Using data from the college’s student database and the American Job Link Alliance, the authors conducted statistical models to examine differences in outcomes between the groups. The study found that participation in the T4E program was significantly associated with a higher likelihood of certificate completion. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the T4E program; other factors are likely to have contributed.","the Kansas City Kansas Community College’s Training for Employment (T4E) Program","Basic skills Capacity building programs Community college education and other classroom training",Adult,,"United States",2016, "Vincennes University Logistics Training and Education Center: Final evaluation report.","Belville, J. Schoeph, K., Leger, R., Jenner, E., Maddox, D., Lass, K., & Beres, S. (2016). Vincennes University Logistics Training and Education Center: Final evaluation report. Retrieved from https://www.skillscommons.org/bitstream/handle/taaccct/9769/VU%20LTEC%20Final%20Evaluation%20Report%20TAACCCT%20R2_Sept%202016.pdf?sequence=1&isAllowed=y","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the Vincennes University Logistics Training and Education Center (LTEC) initiative on employment and earnings outcomes. This summary focuses on the estimated outcomes of the Fork Lift Essentials (FLE) program. The authors used an interrupted time series design to examine employment and earnings outcomes associated with the completion of LTEC's FLE program. The study found FLE program completion was significantly associated with improved earnings in the first quarter immediately following program completion. The quality of causal evidence presented in this report is low because the authors did not observe outcomes for multiple periods after the intervention. This means we are not confident that the estimated effects are attributable to the Logistics Training and Education Center initiative; other factors are likely to have contributed.","Logistics Training and Education Center (LTEC) Initiative","Capacity building programs Community college education and other classroom training","Adult, Veteran or military",,"United States",2016,https://www.skillscommons.org/bitstream/handle/taaccct/9679/VU%20LTEC%20Final%2… "The Green Jobs and Health Care impact evaluation: Findings from the impact study of four training programs for unemployed and disadvantaged workers","Martinson, K., Williams, J., Needels, K., Peck, L., Moulton, S., Paxton, N., Mastri, A., Copson, E., Comfort, A., & Brown-Lyons, M. (2016). The Green Jobs and Health Care impact evaluation: Findings from the impact study of four training programs for unemployed and disadvantaged workers. Retrieved from https://wdr.doleta.gov/research/FullText_Documents/ETAOP-2017-07%20Findings%20from%20the%20Impact%20Study.pdf","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine the impact of the Grand Rapids Community College (GRCC) Pathways to Prosperity program on education, earnings, and employment outcomes. The study was a randomized controlled trial. The authors used a baseline information form, the National Directory of New Hires (NDNH), a follow-up survey, and administrative program data to compare the outcomes between the treatment and control groups over an 18-month follow-up period. The study found that the GRCC Pathways to Prosperity program had a significant positive impact on completion rates for vocational training and life skills classes, and receipt of a vocational credential. The quality of causal evidence presented in this report is high because it is based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the GRCC Pathways to Prosperity program and not to other factors.","the Grand Rapids Community College (GRCC) Pathways to Prosperity Program","Basic skills Capacity building programs Community college education and other classroom training","Adult, Justice-involved, Other barriers, Unemployed, Low income",,"United States",2016,https://wdr.doleta.gov/research/FullText_Documents/ETAOP-2017-07%20Findings%20f… "Vincennes University Logistics Training and Education: Final evaluation report","Belville, J., Schoeph, K., Leger, R., Jenner, E., Maddox, D., Lass, K., & Beres, S. (2016). Vincennes University Logistics Training and Education Center: Final evaluation report. Retrieved from https://www.skillscommons.org/bitstream/handle/taaccct/9679/VU%20LTEC%20Final%20Evaluation%20Report%20TAACCCT%20R2_Sept%202016.pdf?sequence=1&isAllowed=y","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the Logistics Training and Education Center (LTEC) initiative on employment and earnings outcomes. This summary focuses on the estimated outcomes of the Tractor-Trailer Driver Training (TTDT) program.  The authors used a nonexperimental design to compare the outcomes of TTDT program participants to a matched comparison group consisting of two student cohorts: a historical cohort of students from previous enrollment years and a concurrent cohort of students that attended a different college campus. The study did not find significant relationships between completion of the TTDT program and employment status or quarterly earnings. The quality of the causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Logistics Training and Education Center initiative; other factors are likely to have contributed.  ","Logistics Training and Education Center (LTEC) Initiative","Capacity building programs Community college education and other classroom training","Adult, Veteran or military",,"United States",2016,https://www.skillscommons.org/bitstream/handle/taaccct/9679/VU%20LTEC%20Final%2… "Evaluation of the Connecticut Health and Life Sciences Career Initiative. Final report.","Mokher, C., & Pearson, J. (2016) Evaluation of the Connecticut Health and Life Sciences Career Initiative. Final report. Alexandria, VA: CNA Corporation.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Health and Life Sciences Career Initiative (HL-SCI) program on education outcomes. Using school records, the authors conducted a nonexperimental design to compare education outcomes of HL-SCI participants to a comparison group of non-participants. The study found no significant relationships between participation in HL-SCI and college persistence, credential completion, and credit accumulation. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention and did not include sufficient controls. This means we are not confident that the estimated effects are attributable to the HCI-SCI program; other factors are likely to have contributed.","the HL-SCI program","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs",Adult,,"United States",2016,https://www.cna.org/cna_files/pdf/CT%20HL-SCI%20Final%20Evaluation%20Report-FIN… "Waubonsee Community College Trade Adjustment Assistance Community College and Career Training (TAACCCT) grant final report","Burgin, X. D., Akrom, A., Qin, H., Ball, A., & Pontarelli, J. (2016). Waubonsee Community College Trade Adjustment Assistance Community College and Career Training (TAACCCT) grant final report. DeKalb, IL: The Office of Research, Evaluation, and Policy Studies, Northern Illinois University.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of Trade Adjustment Assistance Community College and Career Training (TAACCCT) grant-enhanced Waubonsee Community College (WCC) programs on student education and earnings outcomes. The study used a nonexperimental design to compare education and earnings outcomes of TAACCCT WCC students to a matched comparison group of students in a non-TAACCCT program. The study found TAACCCT WCC participation was associated with lower rates of program completion, when compared to comparison group participation. However, tests of statistical significance were not performed. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to TAACCCT-enhanced WCC programs; other factors are likely to have contributed.","WCC's enhanced programs","Basic skills Capacity building programs Community college education and other classroom training",Adult,,"United States",2016,https://www.skillscommons.org/bitstream/handle/taaccct/9654/TAACCCT%20Waubonsee… "Final external evaluation report: Trade Adjustment and Assistance Community College and Career Training Program Clovis Community College","Caffey, D. L. (2016). Final external evaluation report: Trade Adjustment and Assistance Community College and Career Training Program Clovis Community College. Fresno, CA: Clovis Community College.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of Clovis Community College’s (CCC) inclusive Nursing and enhanced Radiologic Technology (RADT) programs on education outcomes. The study used a nonexperimental design to compare the outcomes of students who were in the inclusive Nursing or enhanced RADT programs to a comparison group of students. The study found that participation in the Nursing and enhanced RADT program was significantly associated with higher program retention rates. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention and did not include sufficient controls. This means we are not confident that the estimated effects are attributable to the inclusive Nursing or enhanced RADT program; other factors are likely to have contributed.","Inclusive Nursing and Radiologic Technology Programs","Capacity building programs Community college education and other classroom training","Adult, Other",,"United States",2016, "Third party evaluation of MoManufacturingWINS: Implementation, outcomes, and impact","Cosgrove, J. J., Cosgrove, M. S., & Bragg, D. D. (2016). Third party evaluation of MoManufacturingWINs: Implementation, outcomes, and impact. St. Louis, MO: Cosgrove & Associates and Bragg & Associates.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of Missouri’s Manufacturing Workforce Innovation Networks(MMW) program on student education and employment outcomes. The study used a nonexperimental design to compare the outcomes of students who were in MMW to a comparison group of students in other manufacturing-technology related programs. The study found that MMW participation was significantly associated with higher retention and employment rates. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention and they did not include sufficient controls. This means we are not confident that the estimated effects are attributable to MMW; other factors are likely to have contributed.","Missouri’s Manufacturing Workforce Innovation Networks (MMW)","Basic skills Capacity building programs Community college education and other classroom training","Adult, Unemployed, Other, Low-skilled, Veteran or military",,"United States",2016,https://www.skillscommons.org/bitstream/handle/taaccct/10116/ThirdPartyFinalEva… "Third-party evaluation of implementation & impact of the Southwest Missouri Public Safety and Emergency Medical Initiative TAACCCT grant.","Cosgrove & Associates. (2016). Third-party evaluation of implementation & impact of the Southwest Missouri Public Safety and Emergency Medical Initiative TAACCCT grant. St. Louis, MO: Cosgrove & Associates.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of Crowder College’s enhanced Public Safety and Emergency Medical Initiative (PSP) program on education and employment outcomes. The study used a nonexperimental design to compare the outcomes of students who were in Crowder College’s enhanced PSP program to a comparison group of students who were not enrolled in the program. The study found that participation in the PSP program was significantly associated with higher program completion and employment rates than the comparison group. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to Crowder College’s enhanced PSP program; other factors are likely to have contributed.","Crowder College Public Safety and Emergency Medical Initiative (PSP) Program","Capacity building programs Community college education and other classroom training","Adult, Other barriers, Unemployed, Low-skilled",,"United States",2016,https://www.skillscommons.org/bitstream/handle/taaccct/9128/Crowder%20College_P… "Cuyahoga Community College Trade Adjustment Assistance Community College Career Training grant: Final report.","The New Growth Group, LLC. (2016). Cuyahoga Community College Trade Adjustment Assistance Community College Career Training grant: Final report. Retrieved from https://www.skillscommons.org/bitstream/handle/taaccct/9890/Tri-C%20Final%20Report.pdf?sequence=1&isAllowed=y","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to evaluate the impact of the TAACCCT-enhanced Additive Manufacturing (AM) programs or courses on education outcomes. Using data from the College Student Information System, the authors conducted a nonexperimental study to compare the educational outcomes of students who were enrolled in AM programs to a matched comparison group. The study found a significant association between AM program participation and increased credit hour accumulation. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the TAACCCT-enhanced Additive Manufacturing programs or courses; other factors are likely to have contributed.","the TAACCCT-enhanced Additive Manufacturing Programs","Basic skills Capacity building programs Community college education and other classroom training",Adult,,"United States",2016,https://www.skillscommons.org/bitstream/handle/taaccct/9890/Tri-C%20Final%20Rep… "Multi-State Advanced Manufacturing Consortium (M-SAMC) TAACCCT Round II grant final evaluation report.","Corporation for a Skilled Workforce & The New Grouth Group (2016). Multi-State Advanced Manufacturing Consortium (M-SAMC) TAACCCT Round II grant final evaluation report. Ann Arbor, MI: Corporation for a Skilled Workforce (CSW); Cleveland, OH: The New Growth Group, LLC","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Multi-State Advanced Manufacturing Consortium (M-SAMC) program participation on education outcomes. This summary focuses on the findings at the Alamo Colleges in Texas. The authors used a nonexperimental design to compare outcomes of M-SAMC program participants with a matched comparison group. The study did not find a significant relationship between participation in the M-SAMC programs and program completion. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the M-SAMC; other factors are likely to have contributed.","Multi-State Advanced Manufacturing Consortium (M-SAMC)","Capacity building programs Community college education and other classroom training",Adult,,"United States",2016,https://www.skillscommons.org/bitstream/handle/taaccct/9692/MSAMC%20Final%20Eva… "Multi-State Advanced Manufacturing Consortium (M-SAMC) TAACCCT Round II grant final evaluation report.","Corporation for a Skilled Workforce & The New Growth Group. (2016). Multi-State Advanced Manufacturing Consortium (M-SAMC) TAACCCT Round II grant final evaluation report. Ann Arbor, MI: Corporation for a Skilled Workforce (CSW); Cleveland, OH: The New Growth Group, LLC","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Unfavorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Multi-State Advanced Manufacturing Consortium (M-SAMC) program participation on education outcomes. This summary focuses on the findings at Bluegrass Community and Technical College in Kentucky. The authors used a nonexperimental design to compare outcomes of M-SAMC program participants with a matched comparison group. The study found that the odds of program completion were significantly lower for participants in the M-SAMC programs compared to participants in the comparison group. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the M-SAMC; other factors are likely to have contributed.","Multi-State Advanced Manufacturing Consortium (M-SAMC)","Capacity building programs Community college education and other classroom training",Adult,,"United States",2016,https://www.skillscommons.org/bitstream/handle/taaccct/9692/MSAMC%20Final%20Eva… "Multi-State Advanced Manufacturing Consortium (M-SAMC) TAACCCT Round II grant final evaluation report.","Corporation for a Skilled Workforce & The New Growth Group. (2016). Multi-State Advanced Manufacturing Consortium (M-SAMC) TAACCCT Round II grant final evaluation report. Ann Arbor, MI: Corporation for a Skilled Workforce (CSW); Cleveland, OH: The New Growth Group, LLC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Multi-State Advanced Manufacturing Consortium (M-SAMC) program participation on education outcomes. This summary focuses on the findings at Bridge Valley Community and Technical College in West Virginia. The authors used a nonexperimental design to compare outcomes of M-SAMC program participants with a matched comparison group. The study found that the odds of program completion were significantly higher for participants in the M-SAMC programs compared to participants in the comparison group. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the M-SAMC; other factors are likely to have contributed.","Multi-State Advanced Manufacturing Consortium (M-SAMC)","Capacity building programs Community college education and other classroom training",Adult,,"United States",2016,https://www.skillscommons.org/bitstream/handle/taaccct/9692/MSAMC%20Final%20Eva… "Multi-State Advanced Manufacturing Consortium (M-SAMC) TAACCCT Round II grant final evaluation report","Corporation for a Skilled Workforce & The New Growth Group. (2016). Multi-State Advanced Manufacturing Consortium (M-SAMC) TAACCCT Round II grant final evaluation report. Ann Arbor, MI: Corporation for a Skilled Workforce (CSW); Cleveland, OH: The New Growth Group, LLC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Unfavorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Multi-State Advanced Manufacturing Consortium (M-SAMC) program participation on education outcomes. This summary focuses on the findings at Danville Community College in Virginia. The authors used a nonexperimental design to compare outcomes of M-SAMC program participants with a matched comparison group. The study found that the odds of program completion were significantly lower for participants in the M-SAMC programs compared to participants in the comparison group. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the M-SAMC; other factors are likely to have contributed.","Multi-State Advanced Manufacturing Consortium (M-SAMC)","Capacity building programs Community college education and other classroom training",Adult,,"United States",2016,https://www.skillscommons.org/bitstream/handle/taaccct/9692/MSAMC%20Final%20Eva… "Multi-State Advanced Manufacturing Consortium (M-SAMC) TAACCCT Round II grant final evaluation report","Corporation for a Skilled Workforce, & The New Growth Group. (2016). Multi-State Advanced Manufacturing Consortium (M-SAMC) TAACCCT Round II grant final evaluation report. Ann Arbor, MI: Corporation for a Skilled Workforce (CSW); Cleveland, OH: The New Growth Group, LLC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Multi-State Advanced Manufacturing Consortium (M-SAMC) program participation on education outcomes. This summary focuses on the findings at Gadsden State Community College in Alabama. The authors used a nonexperimental design to compare outcomes of M-SAMC program participants with a matched comparison group. The study did not find a significant relationship between participation in the M-SAMC programs and program completion. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the M-SAMC; other factors are likely to have contributed.","Multi-State Advanced Manufacturing Consortium (M-SAMC)","Capacity building programs Community college education and other classroom training",Adult,,"United States",2016,https://www.skillscommons.org/bitstream/handle/taaccct/9692/MSAMC%20Final%20Eva… "Multi-State Advanced Manufacturing Consortium (M-SAMC) TAACCCT Round II grant final evaluation report","Corporation for a Skilled Workforce & The New Growth Group. (2016). Multi-State Advanced Manufacturing Consortium (M-SAMC) TAACCCT Round II grant final evaluation report. Ann Arbor, MI: Corporation for a Skilled Workforce (CSW); Cleveland, OH: The New Growth Group, LLC","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Multi-State Advanced Manufacturing Consortium (M-SAMC) program participation on education outcomes. This summary focuses on the findings at Henry Ford College in Michigan. The authors used a nonexperimental design to compare outcomes of M-SAMC program participants with a matched comparison group. The study found that the odds of program completion were significantly higher for participants in the M-SAMC programs compared to participants in the comparison group. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the M-SAMC; other factors are likely to have contributed.","Multi-State Advanced Manufacturing Consortium (M-SAMC)","Capacity building programs Community college education and other classroom training",Adult,,"United States",2016,https://www.skillscommons.org/bitstream/handle/taaccct/9692/MSAMC%20Final%20Eva… "Multi-State Advanced Manufacturing Consortium (M-SAMC) TAACCCT Round II grant final evaluation report","Corporation for a Skilled Workforce & The New Growth Group. (2016). Multi-State Advanced Manufacturing Consortium (M-SAMC) TAACCCT Round II grant final evaluation report. Ann Arbor, MI: Corporation for a Skilled Workforce (CSW); Cleveland, OH: The New Growth Group, LLC","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Multi-State Advanced Manufacturing Consortium (M-SAMC) program participation on education outcomes. This summary focuses on the findings at Jefferson Community and Technical College in Kentucky. The authors used a nonexperimental design to compare outcomes of M-SAMC program participants with a matched comparison group. The study did not find a significant relationship between participation in the M-SAMC programs and program completion. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the M-SAMC; other factors are likely to have contributed.","Multi-State Advanced Manufacturing Consortium (M-SAMC)","Capacity building programs Community college education and other classroom training",Adult,,"United States",2016,https://www.skillscommons.org/bitstream/handle/taaccct/9692/MSAMC%20Final%20Eva… "Multi-State Advanced Manufacturing Consortium (M-SAMC) TAACCCT Round II grant final evaluation report","Corporation for a Skilled Workforce & The New Growth Group. (2016). Multi-State Advanced Manufacturing Consortium (M-SAMC) TAACCCT Round II grant final evaluation report. Ann Arbor, MI: Corporation for a Skilled Workforce (CSW); Cleveland, OH: The New Growth Group, LLC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Multi-State Advanced Manufacturing Consortium (M-SAMC) program participation on education outcomes. This summary focuses on the findings at Oakland Community College in Michigan. The authors used a nonexperimental design to compare outcomes of M-SAMC program participants with a matched comparison group. The study did not find a significant relationship between participation in the M-SAMC programs and program completion. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the M-SAMC; other factors are likely to have contributed.","Multi-State Advanced Manufacturing Consortium (M-SAMC)","Capacity building programs Community college education and other classroom training",Adult,,"United States",2016,https://www.skillscommons.org/bitstream/handle/taaccct/9692/MSAMC%20Final%20Eva… "Multi-State Advanced Manufacturing Consortium (M-SAMC) TAACCCT Round II grant final evaluation report","Corporation for a Skilled Workforce & The New Growth Group. (2016). Multi-State Advanced Manufacturing Consortium (M-SAMC) TAACCCT Round II grant final evaluation report. Ann Arbor, MI: Corporation for a Skilled Workforce (CSW); Cleveland, OH: The New Growth Group, LLC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Unfavorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Multi-State Advanced Manufacturing Consortium (M-SAMC) program participation on education outcomes. This summary focuses on the findings at Pellissippi State Community College in Tennessee. The authors used a nonexperimental design to compare outcomes of M-SAMC program participants with a matched comparison group. The study found that the odds of program completion were significantly lower for participants in the M-SAMC programs compared to participants in the comparison group. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the M-SAMC; other factors are likely to have contributed.","Multi-State Advanced Manufacturing Consortium (M-SAMC)","Capacity building programs Community college education and other classroom training",Adult,,"United States",2016,https://www.skillscommons.org/bitstream/handle/taaccct/9692/MSAMC%20Final%20Eva… "Multi-State Advanced Manufacturing Consortium (M-SAMC) TAACCCT Round II grant final evaluation report","Corporation for a Skilled Workforce & The New Growth Group. (2016). Multi-State Advanced Manufacturing Consortium (M-SAMC) TAACCCT Round II grant final evaluation report. Ann Arbor, MI: Corporation for a Skilled Workforce (CSW); Cleveland, OH: The New Growth Group, LLC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Multi-State Advanced Manufacturing Consortium (M-SAMC) program participation on education outcomes. This summary focuses on the findings at Rock Valley College in Illinois. The authors used a nonexperimental design to compare outcomes of M-SAMC program participants with a matched comparison group. The study found that the odds of program completion were significantly higher for participants in the M-SAMC programs compared to participants in the comparison group. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the M-SAMC; other factors are likely to have contributed.","Multi-State Advanced Manufacturing Consortium (M-SAMC)","Capacity building programs Community college education and other classroom training",Adult,,"United States",2016,https://www.skillscommons.org/bitstream/handle/taaccct/9692/MSAMC%20Final%20Eva… "Multi-State Advanced Manufacturing Consortium (M-SAMC) TAACCCT Round II grant final evaluation report","Corporation for a Skilled Workforce & The New Growth Group. (2016). Multi-State Advanced Manufacturing Consortium (M-SAMC) TAACCCT Round II grant final evaluation report. Ann Arbor, MI: Corporation for a Skilled Workforce (CSW); Cleveland, OH: The New Growth Group, LLC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Multi-State Advanced Manufacturing Consortium (M-SAMC) program participation on education outcomes. This summary focuses on the findings at Spartanburg Community College in South Carolina. The authors used a nonexperimental design to compare outcomes of M-SAMC program participants with a matched comparison group. The study did not find a significant relationship between participation in the M-SAMC programs and program completion. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the M-SAMC; other factors are likely to have contributed.","Multi-State Advanced Manufacturing Consortium (M-SAMC)","Capacity building programs Community college education and other classroom training",Adult,,"United States",2016,https://www.skillscommons.org/bitstream/handle/taaccct/9692/MSAMC%20Final%20Eva… "Multi-State Advanced Manufacturing Consortium (M-SAMC) TAACCCT Round II grant final evaluation report","Corporation for a Skilled Workforce & The New Growth Group. (2016). Multi-State Advanced Manufacturing Consortium (M-SAMC) TAACCCT Round II grant final evaluation report. Ann Arbor, MI: Corporation for a Skilled Workforce (CSW); Cleveland, OH: The New Growth Group, LLC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Multi-State Advanced Manufacturing Consortium (M-SAMC) program participation on education outcomes. This summary focuses on the findings at Tennessee College of Applied Technology at Murfreesboro in Tennessee. The authors used a nonexperimental design to compare outcomes of M-SAMC program participants with a matched comparison group. The study did not find a significant relationship between participation in the M-SAMC programs and program completion. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the M-SAMC; other factors are likely to have contributed.","Multi-State Advanced Manufacturing Consortium (M-SAMC)","Capacity building programs Community college education and other classroom training",Adult,,"United States",2016,https://www.skillscommons.org/bitstream/handle/taaccct/9692/MSAMC%20Final%20Eva… "2016 I-AM annual evaluation report: Iowa Advanced Manufacturing Statewide Consortium","de la Mora, A., Kemis, M., Callen, E., & Starobin, S. (2016). 2016 I-AM annual evaluation report: Iowa Advanced Manufacturing Statewide Consortium. Ames, IA: Research Institute for Studies in Education (RISE), Iowa State University.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Iowa Advanced Manufacturing Consortium (I-AM) on welding student’s education, earnings, and employment outcomes. The study used a nonexperimental design to compare outcomes of students in the I-AM program to a matched comparison group of students. The study found that participating in the I-AM program was significantly associated with higher rates of credential attainment, larger numbers of certificates and welding awards earned, higher employment rates, and higher earnings. The quality of causal evidence presented in this study is low because the authors used a comparison group from previous enrollment years presenting a confounding factor. This means we are not confident that the estimated effects are attributable to I-AM; other factors are likely to have contributed.","the Iowa Advanced Manufacturing Consortium (I-AM)","Capacity building programs Community college education and other classroom training",Adult,,"United States",2016, "ShaleNET Round 2 TAACCCT grant third-party evaluation final report","Dunham, K., Hebbar, L., Kheman, D., Comeaux, A., Diaz, H., Folsom, L., & Kuang, S. (2016). ShaleNET Round 2 TAACCCT grant third-party evaluation final report. Oakland, CA: Social Policy Research Associates.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the ShaleNET program on earnings and employment. The study used a nonexperimental design to compare the outcomes of students who were in ShaleNET program to a matched comparison group of individuals receiving other federally funded employment services. The study found no statistically significant relationships between ShaleNET program participation and employment or quarterly earnings. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the ShaleNET program; other factors are likely to have contributed.",ShaleNET,"Capacity building programs Community college education and other classroom training",Adult,,"United States",2016,https://www.spra.com/wordpress2/wp-content/uploads/2016/12/ShaleNET-Full-Report… "Final evaluation report Trade adjustment Assistance Community College and Career Training (TAACCCT) Grant: Round 2 CyberSecurity Career Pathways Program","Pacific Research and Evaluation. (2016). Final evaluation report Trade Adjustment Assistance Community College and Career Training (TAACCCT) Grant: Round 2 CyberSecurity Career Pathways Program. Portland, OR: Pacific Research & Evaluation, LLC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the CyberSecurity Career Pathways Program (CSCPP) on education, earnings, and employment outcomes. The authors used a nonexperimental design to compare the outcomes of students who were in the CSCPP to a historical comparison group. When compared to a historical cohort, the study found a significant relationship between CSCPP participation and high rates of program completion and retention, and wage increases. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before program participation or include sufficient control variables. This means we are not confident that the estimated effects are attributable to CSCPP; other factors are likely to have contributed.","the CyberSecurity Career Pathways Program (CSCPP)","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs",Adult,,"United States",2016, "Final evaluation report Trade Adjustment Assistance Community College and Career Training (TAACCCT) Grant: Round 2.","Pacific Research and Evaluation, LLC. (2016). Final evaluation report Trade Adjustment Assistance Community College and Career Training (TAACCCT) Grant: Round 2. Portland, OR: Rogue Community College.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Education and skills gains-Low-No impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the Pathways to Allied Health Professions (PATH) program on education, earnings, and employment outcomes. Using institutional and student survey data, the authors conducted a nonexperimental study to compare the outcomes of PATH program participants to non-participants. The study found no significant associations between PATH program participation and education, earnings, and employment outcomes. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the PATH program; other factors are likely to have contributed.","the Pathways to Allied Health Professions (PATH) Program","Basic skills Capacity building programs Community college education and other classroom training",Adult,,"United States",2016,https://www.skillscommons.org/bitstream/handle/taaccct/9295/RCC%20TAACCCT%20Fin… "Retraining the Gulf Coast through Information Technology Pathways: Final impact evaluation report","Patnaik, A., & Prince, A. (2016). Retraining the Gulf Coast through Information Technology Pathways: Final Impact evaluation report. Austin, TX: The University of Texas at Austin, Lyndon B. Johnson School of Public Affairs.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Retraining the Gulf Coast Workforce through Information Technology Pathways Consortium (Gulf Coast IT Pathways) grant program on education outcomes. Using a nonexperimental design with institutional data from the college systems, the study authors compared students in the program to a matched historical cohort comparison group. The study found that the Gulf Coast IT Pathways program was significantly related to higher credential, certificate, or a degree attainment and higher credit hour accumulation. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Gulf Coast IT Pathways TAACCCT; other factors are likely to have contributed.","the Gulf Coast IT Pathways Program","Basic skills Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Dislocated or displaced worker, Low-skilled, Veteran or military",,"United States",2016,https://raymarshallcenter.org/files/2016/11/Retraining-the-Gulf-Coast-through-I… "Florida Trade Consortium evaluation final report","POS-IMPACT LLC. (2016). Florida Trade Consortium evaluation final report. Pembroke Pines, FL: POS-IMPACT LLC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages","Summary: The study’s objective was to examine the impact of participation in the Florida Transforming Resources for Accelerated Degrees and Employment (TRADE) Consortium training programs on earnings. The authors used a nonexperimental design to compare the earnings outcomes of TRADE program participants with those of non-participants. The study found that TRADE program participation was associated with wage increases. However, the study did not include tests of significance. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Florida TRADE program; other factors are likely to have contributed.","the Florida Transforming Resources for Accelerated Degrees and Employment (TRADE) Consortium","Capacity building programs Community college education and other classroom training",Adult,,"United States",2016,https://www.skillscommons.org/bitstream/handle/taaccct/15554/Final_TRADE%20Eval… "Making the Future: The Wisconsin strategy: Final evaluation report","Price, D., Sedlak, W., Roberts, B., & Childress, L. (2016). Making the Future: The Wisconsin strategy: Final evaluation report. Indianapolis, IN: Northeast Wisconsin Technical College.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine the impact of the Wisconsin Making the Future program on education, earnings, and employment outcomes. The study used a nonexperimental design to compare the outcomes of students who were in the Making the Future program to a matched comparison group. Using institutional research data from the community colleges and workforce, the authors conducted statistical models to examine differences between the groups. When compared to non-participating students, the study found that Making the Future program participation was associated with a significantly higher likelihood of credential attainment, credit accumulation, and receipt of a one-year technical diploma, a less than one-year technical diploma, and a local certificate. The quality of causal evidence presented in this study is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the Making the Future program, but other factors might also have contributed.","Making the Future","Capacity building programs Community college education and other classroom training",Adult,,"United States",2016,https://www.dvp-praxis.org/wp-content/uploads/2016/11/Final-Evaluation-Report-W… "Evaluation of the Alabama/Florida Technical Employment Network TAACCCT program","PTB & Associates. (2016). Evaluation of the Alabama/Florida Technical Employment Network TAACCCT program. Bethesda, MD: PTB & Associates.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Unfavorable impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the Alabama-Florida Technical Employment Network (AF-TEN) on student education and employment outcomes. The study used a nonexperimental design to compare the education and employment outcomes of students who were in AF-TEN-enhanced welding programs to a matched comparison group of program students from prior years. The study found that participation in the AF-TEN programs was significantly associated with fewer completed credit hours. The quality of causal evidence presented in this report is low because the authors used a comparison group from previous enrollment years, which presents a confound. This means we are not confident that the estimated effects are attributable to the AF-TEN intervention; other factors are likely to have contributed.","the Alabama-Florida Technical Employment Network (AF-TEN)","Capacity building programs Community college education and other classroom training","Adult, Dislocated or displaced worker",,"United States",2016,https://www.skillscommons.org/bitstream/handle/taaccct/15590/George%20C.%20Wall… "Evaluation of the AMP PLUS program: Final report","Public Policy Associates. (2016). Evaluation of the AMP PLUS program: Final report. Lansing, MI: Public Policy Associates, Incorporated.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the Advanced Manufacturing Pathways (AMP) PLUS program on education and employment outcomes. The authors used a nonexperimental design to compare the outcomes of students who participated in the AMP PLUS program to a historic comparison group using the college’s administrative data. The study found no statistically significant relationships between participating in the AMP PLUS program and student retention, degree completion, credit hours completed, or employment. The quality of causal evidence presented in this study is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the AMP PLUS program; other factors are likely to have contributed.","the Advanced Manufacturing Pathways (AMP) PLUS Program","Capacity building programs Community college education and other classroom training",Adult,,"United States",2016,https://www.skillscommons.org/bitstream/handle/taaccct/9571/FVTC%20TAACCCT%20Ro… "Contra Costa Community College District Design it–Build it–Ship it (DBS) final evaluation report","Rayyes, N., Abe, Y., Sanchez, R., Lai, F., Akiya, K., Chan, V., & Jennings, E. D. (2016). Contra Costa Community College District Design it–Build it–Ship it (DBS) final evaluation report. Oakland, CA: Impaq International.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Unfavorable impacts Earnings and wages Education and skills gains-Mod/high-Unfavorable impacts Education and skills gains Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine the impact of the Design it–Build it–Ship it (DBS) program on education, employment, and earnings outcomes. The authors used a nonexperimental design to compare education, earnings, and employment outcomes of DBS participants to a comparison group. The study found that DBS participation was significantly associated with lower rates of enrollment, fewer credentials/degrees earned, lower transfer rates to four-year colleges, and lower wages. The quality of causal evidence presented in this study is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the DBS program, but other factors might also have contributed.","the Design it–Build it–Ship it (DBS) Program","Capacity building programs Community college education and other classroom training","Adult, Dislocated or displaced worker, Unemployed",,"United States",2016,https://www.impaqint.com/sites/default/files/files/IMPAQ%20FINAL%20DBS%20Evalua… "Third-party evaluation services for the Trade Adjustment Assistance Community College and Career Training grant final report","Selzer, A. K., Sanchez, R., Michaelides, M., Shetty, S., & Bertane, C. (2016). Arizona Sun Corridor Get Into Energy Consortium (ASC-GIEC): Third-party evaluation services for the Trade Adjustment Assistance Community College and Career Training grant final report. Columbia, MD: IMPAQ International.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Arizona Sun Corridor Get Into Energy Consortium (ASC-GIEC) program on student education outcomes. The study used a nonexperimental design to compare the education outcomes of students who were in the ASC-GIEC program to a comparison group of students in other Career and Technical Education (CTE) programs. The study found that participation in the ASC-GIEC program was associated with higher program completion rates than the comparison program. However, the study did not include tests of statistical significance for this outcome. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the ASC-GIEC program; other factors are likely to have contributed.","the Arizona Sun Corridor Get Into Energy Consortium (ASC-GIEC) Program","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Dislocated or displaced worker",,"United States",2016,https://www.skillscommons.org/bitstream/handle/taaccct/15587/Estrella%20Mountai… "Project IMPACT: Innovations Moving People to Achieve Certified Training. Final evaluation report","Shain, M., & Grandgenett, N. (2016). Project IMPACT: Innovations Moving People to Achieve Certified Training. Final evaluation report. Omaha, NE: University of Nebraska.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages","Summary: The study’s objective was to examine the effect of Project IMPACT (Innovations Moving People to Achieve Certified Training) on earnings and wages. Using community college records and data from the Nebraska Department of Labor, the authors conducted a nonexperimental study to compare the differences in wages between Project IMPACT participants and nonparticipants. The study found no statistically significant relationship between Project IMPACT and earnings and wages. The quality of the causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to Project IMPACT; other factors are likely to have contributed.","Project IMPACT","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs",Adult,,"United States",2016,https://www.skillscommons.org/bitstream/handle/taaccct/9699/IMPACT%20Final%20Ex… "Final evaluation report: Implementation and outcomes of Credentials to Careers","Skilton-Sylvester, P., Myran, S., Myran, G., Ross, S., & Williams, M. (2016). Final evaluation report: Implementation and outcomes of Credentials to Careers. Canadian Lakes, MI: Myran & Associates LLC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages","Summary: The study’s objective was to examine the impact of the Credentials to Careers (C2C) program on earnings. The authors used a nonexperimental design to compare outcomes of C2C participants to a matched comparison group using data provided by the college. The study found that C2C program participation was significantly associated with a larger average percent increase in wages relative to the comparison group. The quality of causal evidence presented in this report is low because the authors did not use sufficient controls in their analysis. This means we are not confident that the estimated effects are attributable to the C2C program; other factors are likely to have contributed.","the Credentials to Careers (C2C) Program","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Dislocated or displaced worker, Unemployed",,"United States",2016,https://www.skillscommons.org/bitstream/handle/taaccct/15623/Final%20C2C%20Impl… "Final evaluation of Southwest Virginia Community College’s PluggedInVA TAACCCT Grant initiative","Topper, A., Munn, W., Bor, E., Clery, S., & Smith, B. (2016). Final evaluation of Southwest Virginia Community College’s PluggedInVA TAACCCT Grant initiative. Retrieved from: https://www.skillscommons.org//handle/taaccct/15650","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the PluggedInVA (PIVA) program on education and employment outcomes. Using college administrative and state workforce data, the authors conducted a nonexperimental study to compare outcomes between students in the PIVA program with a comparison group of non-participating students. The study found no statistically significant relationships between participation in the PIVA program and education or employment outcomes. The quality of causal evidence presented in this report is low because the authors did not ensure the groups being compared were similar before the intervention or include sufficient control variables. This means we are not confident that the estimated effects are attributable to PluggedInVA; other factors are likely to have contributed.","PluggedInVA (PIVA)","Capacity building programs Community college education and other classroom training","Adult, Unemployed, Other",,"United States",2016,https://www.skillscommons.org//handle/taaccct/15650 "Job training for a knowledge-based economy: The Quincy College Biotechnology and Compliance program","Van Dyke, B., Bayala, I., & Cutaia, K. (2016). Job training for a knowledge-based economy: The Quincy College Biotechnology and Compliance program. Quincy, MA: Quincy College.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Unfavorable impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Quincy College Biotechnology and Compliance program on education, earnings, and employment outcomes. The study used a nonexperimental design to assess the outcomes of students enrolled in the Biotechnology and Compliance program to a comparison group. The study found that Biotechnology and Compliance program participation was associated with higher rates of employment, degree attainment, and pursuit of further education, but lower earnings. However, the study did not include tests of statistical significance. The quality of casual evidence presented in this study is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Biotechnology and Compliance program; other factors are likely to have contributed.","Quincy College’s Biotechnology and Compliance Program","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs",Adult,,"United States",2016,https://www.skillscommons.org/bitstream/handle/taaccct/15632/Quincy%20College%2… "Evaluation of the Illinois Network for Advanced Manufacturing: Final Report","Westat. (2016). Evaluation of the Illinois Network for Advanced Manufacturing: Final Report. Rockville, MD: Westat & GEM Software Development, Inc.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the Illinois Network for Advanced Manufacturing (INAM) program on education, earnings, and employment outcomes. The study used a nonexperimental design to compare the outcomes of students who were in the INAM program to a comparison group of students who took similar courses before the creation of INAM. Using data from college databases and the Illinois Department of Employment Security, the authors conducted statistical models to examine differences in outcomes between the groups. The study found that participation in the INAM program was significantly associated with improved rates of certificate or degree completion. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the INAM program; other factors are likely to have contributed.","the Illinois Network for Advanced Manufacturing (INAM)","Capacity building programs Community college education and other classroom training","Adult, Dislocated or displaced worker, Unemployed, Other, Veteran or military",,"United States",2016,https://www.researchgate.net/publication/315664265_Evaluation_of_the_Illinois_N… ,"Wijma, C. (2016). East Los Angeles College: Technology & Logistics program TAACCCT final evaluation report. San Francisco, CA: WestEd.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the enhanced East Los Angeles College’s (ELAC) Technology and Logistics program on student’s education, earnings, and employment outcomes. The study used a nonexperimental design to compare the education, earnings, and employment outcomes of students in the ELAC Technology and Logistics program to a matched comparison group of students in the Automotive Technology program. The study found that participation in the ELAC Technology and Logistics program was significantly associated with improved course and degree completion. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the enhanced ELAC Technology and Logistics program; other factors are likely to have contributed.","the East Los Angeles College’s (ELAC) Technology and Logistics Program","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs",Adult,,"United States",2016, "Trade Adjustment Assistance Community College and Career Training II Grant Program (TAACCCT II): Summative Evaluation of the University of District of Columbia, Community College’s Transportation Academy","Yoder, B., & Ryland, A. (2016). Trade Adjustment Assistance Community College and Career Training II Grant Program (TAACCCT II): Summative Evaluation of the University of District of Columbia, Community College’s Transportation Academy. Retrieved from https://www.skillscommons.org/bitstream/handle/taaccct/15654/University%20of%20the%20District%20of%20Columbia%20-%20Final%20Evaluation%20-%202017.01.05.pdf?sequence=1&isAllowed=y","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Education and skills gains-Low-No impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the TAACCCT funded Transportation Academy program on education, earnings, and employment outcomes. The study used a nonexperimental design to compare education, earnings, and employment outcomes of Transportation Academy participants to a matched comparison group from three different institutional data sources. The study did not find a significant association between participation in the Transportation Academy program and education, earnings, or employment outcomes. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before intervention. This means we are not confident that the estimated effects are attributable to the Transportation Academy program; other factors are likely to have contributed.","the Transportation Academy Program","Capacity building programs Community college education and other classroom training","Adult, Unemployed, Other",,"United States",2016,https://www.skillscommons.org/bitstream/handle/taaccct/15654/University%20of%20… "The effects of eliminating the work search requirement on job match quality and other long-term employment outcomes.","Lachowska, M., Meral, M., & Woodbury, S.A. (2015). The effects of eliminating the work search requirement on job match quality and other long-term employment outcomes. Washington, DC: U.S. Department of Labor.",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-Unfavorable impacts Employment Public benefits receipt-Mod/high-Unfavorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of less-stringent work search requirements for unemployment insurance (UI) claimants on earnings, employment, and UI benefit receipt over a nine-year follow-up period. This study extended the work of Johnson and Klepinger (1991), the CLEAR profile of which is available here. The CLEAR profile of a related study, Lachowska et al. (2016), is available here. The study examined data from a randomized controlled trial conducted in the 1980s in Washington State. UI claimants were randomly assigned to one of four groups, each with different work search requirements and/or verification of that work search. The authors used administrative data to compare the outcomes of the groups up to nine years after the initial UI claims. The study found that the group with less-stringent work-search requirements was significantly less likely to be employed in the first quarter following their claims, compared with the groups with more-stringent requirements. In addition, they received more UI benefit payments for more weeks and exhausted UI benefits at a higher rate during the year following their initial claims. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the less-stringent work search requirements, and not to other factors.","Less stringent work search requirements","RESEA Unemployment Insurance","Dislocated or displaced worker, Unemployed",,"United States",2015,https://www.dol.gov/asp/evaluation/completed-studies/2013-2014-scholar-programs… "The promise of worker training: New insights into the effects of government funded training programs","McEntaffer, M. J. (2015). The promise of worker training: New insights into the effects of government funded training programs. (Doctoral dissertation). Retrieved from http://digitalcommons.unl.edu/businessdiss/51.","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of participation in a Workforce Investment Act (WIA) occupational skills training (OST) or on-the-job training (OJT) program on employment and earnings. In a nonexperimental analysis, the author compared average employment rates and earnings for people who received OST or OJT to those who did not receive either employment service. Employment and earnings data came from payroll tax records. The study found that individuals participating in OST or OJT were more likely to be employed and had higher earnings in the first and third quarters after exiting the program. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before program participation. This means we are not confident that the estimated effects are attributable to the WIA employment training programs; other factors are likely to have contributed.","the WIA Employment Training Programs","Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) training programs",Adult,,"United States",2015,http://digitalcommons.unl.edu/cgi/viewcontent.cgi?article=1055&context=business… "Job rationing in recessions: evidence from work-search requirements.","Toohey, D. (2015). Job rationing in recessions: evidence from work-search requirements. Newark, Delaware: University of Delaware.",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-No impacts Employment Public benefits receipt-Low-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of required contacts with employers on Unemployment Insurance (UI) claimants’ employment and UI benefit receipt. The study used a nonexperimental design in which the author compared the labor market outcomes of UI claimants in different states who were subject to different job search requirements between 2001 and 2013. The study found that an increase in the number of required contacts with employers was associated with decreases in the unemployment rate. Accounting for expected employment growth along with changes in the number of required contacts also decreased the unemployment rate. The study found no statistically significant relationships between the number of required contacts and UI claim duration. The quality of causal evidence presented in this report is low because the author did not account for differences in the age of UI claimants in the analysis. This means we are not confident that the estimated effects are attributable to required contacts with employers; other factors are likely to have contributed.","More stringent work search requirements","RESEA Unemployment Insurance","Dislocated or displaced worker, Unemployed",,"United States",2015, "An outcome evaluation of a prison work release program: Estimating its effects on recidivism, employment, and cost avoidance","Duwe, G. (2015). An outcome evaluation of a prison work release program: Estimating its effects on recidivism, employment, and cost avoidance. Criminal Justice Policy Review, 26(6), 531-554.",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study examined the impact of the Minnesota Department of Correction’s work release program on post-release employment, earnings, and recidivism outcomes for adult offenders. The author used a nonexperimental design (propensity score matching) to create a comparison group of nonparticipants who were similar to program participants. The author estimated the program’s effects by comparing these groups’ post-release employment, earnings, and recidivism outcomes using data from the Minnesota Bureau of Criminal Apprehension, Minnesota Department of Corrections, and the Minnesota Department of Employee and Economic Development. The author found that, on average, program participation decreased the risk of reconviction by 14 percent and of re-incarceration by 17 percent, but increased the risk of participants having their supervised release revoked for a technical violation by 78 percent. The quality of causal evidence presented in this report is moderate for outcomes related to recidivism and low for post-release employment and earnings outcomes. This means we are somewhat confident that the estimated effects on recidivism are attributable to the work release program, although other factors might also have contributed, and we are not confident that the estimated effects on employment and earnings are attributable to the program; other factors are likely to have contributed.","Minnesota Department of Correction’s work release program","Job search assistance and supportive services Reentry",Justice-involved,,"United States",2015, "The impact of a randomly assigned time and place management initiative on work and retirement expectations.","Cahill, K. E., James, J. B., & Pitt-Catsouphes, M. (2015). The impact of a randomly assigned time and place management initiative on work and retirement expectations. Work, Aging and Retirement, 1(4), 350-368.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Unfavorable impacts Employment","Summary: The study examined the impact of a time and place management (TPM) initiative at a medical provider on retirement expectations among workers ages 50 and older. The study was a randomized control trial and used a series of surveys and administrative data to estimate the impact. The study found that, when surveyed 12 months after randomization, employees in the treatment group were statistically significantly more likely to expect to directly exit their job as opposed to staying in their current job within the next five years. The quality of causal evidence presented in this report is moderate because the study was a randomized controlled trial with high attrition, but the authors did demonstrate that the treatment and control groups were similar before the intervention. This means we are somewhat confident that the estimated effects are attributable to TPM, but other factors might also have contributed.","Time and Placement Management (TPM)","Older workers' programs","Older worker","Health care and social assistance",,2015,https://hrs.isr.umich.edu/publications/biblio/8231 "A controlled trial of supported employment for people with severe mental illness and justice involvement","Bond, G. R., Kim, S. J., Becker, D. R., Swanson, S. J., Drake, R. E., Krzos, I. M., . . . Frounfelker, R. L. (2015). A controlled trial of supported employment for people with severe mental illness and justice involvement. Psychiatric Services, 66(10), 1027-1034.",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Individual Placement and Support (IPS) intervention on employment and recidivism outcomes relative to a job club program called Work Choice. The authors used an experimental design to estimate the impact of IPS and analyzed data from people’s self-reports on forms and interviews and electronic medical and employment records. The authors found positive statistically significant impacts of IPS on employment compared with the job club program. The authors found no statistically significant impacts of IPS on recidivism. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the IPS intervention and not to other factors.","the Individual Placement and Support (IPS) intervention","Health Reentry","Justice-involved, Unemployed",,"United States",2015,https://doi.org/10.1176/appi.ps.201400510 "An experimental evaluation of a comprehensive employment-oriented prisoner re-entry program","Cook, P. J., Kang, S., Braga, A. A., Ludwig, J., & O’Brien, M. E. (2015). An experimental evaluation of a comprehensive employment-oriented prisoner re-entry program. Journal of Quantitative Criminology, 31, 355-382.",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Milwaukee Safe Street Prisoner Release Initiative on employment, earnings, public benefit receipt, and recidivism. Drawing on administrative data from the Wisconsin Department of Corrections, the study used a randomized controlled trial to estimate program impacts. The authors used statistical models to compare the outcomes of treatment and comparison group members. The study found that those in the treatment group had significantly higher earnings and rates of employment and significantly lower likelihood of new arrests than those in the control group. The study found no significant differences between the groups in the likelihood of reimprisonment in the one year of follow-up. The quality of causal evidence presented in this report for the recidivism outcomes is moderate because it was based on a randomized controlled trial in which the authors did not account for the different probabilities of assignment to the treatment group; nevertheless, this study can be considered to have employed a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to Milwaukee Safe Street Prisoner Release Initiative and not to other factors. The quality of causal evidence presented in this report for the employment, earnings, and public benefit receipt outcomes is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Milwaukee Safe Street Prisoner Release Initiative; other factors are likely to have contributed.","the Milwaukee Safe Street Prisoner Release Initiative","Reentry Work based and other occupational training",Justice-involved,,"Urban, United States",2015,https://www.researchgate.net/profile/Philip_Cook2/publication/284942331_An_Expe… "What factors contributed to changes in employment during and after the great recession?","Farooq, A., & Kugler, A. D. (2015). What factors contributed to changes in employment during and after the great recession? IZA Journal of Labor Policy, 4(3), 1-28.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: This study examined the impact of the Work Opportunity Tax Credit (WOTC) on employment for veterans with disabilities and unemployed veterans. The study used a nonexperimental design to examine the effects of the WOTC on employment, based on data from the Annual Social and Economic (ASEC) supplement of the Current Population Survey from 2003 to 2013. The study showed no statistically significant relationships between the WOTC and employment for veterans with disabilities or for unemployed veterans. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that any estimated effects are attributable to the WOTC; other factors likely contributed to the outcomes. However, the study did not show any statistically significant effects.","the Work Opportunity Tax Credit","Veterans' reemployment Work Opportunity Tax Credit (WOTC)","Disability, Veteran or military",,"United States",2015,https://link.springer.com/article/10.1186/s40173-014-0029-y "Evaluation of automated vs. manual bagger exposures related to ergonomics, dust, and noise at a sand mine processing plant","Wilson, L. A. (2015). Evaluation of automated vs. manual bagger exposures related to ergonomics, dust, and noise at a sand mine processing plant (Unpublished master’s thesis). Montana Tech of the University of Montana, Butte, MT.","Mine Workers and Mine Health and Safety","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Health and safety-Low-Favorable impacts Health and safety","Summary: The study’s objective was to examine the impact of an automated bagging system on mine worker health and safety outcomes. Using data from a sand mining plant, the author used an interrupted time series design to compare the rates of mine worker injuries and health issues before and after implementing an automated bagging system. The study found that implementation of an automated bagging system is significantly associated with a reduction in noise exposure. The quality of causal evidence presented in this report is low because the authors did not observe outcomes for multiple periods before and after the intervention. This means we are not confident that the estimated effects are attributable to the automated bagging system; other factors are likely to have contributed.",,"Mine safety and health Workplace injury",,"Mining, quarrying, and oil and gas extraction","United States",2015,https://digitalcommons.mtech.edu/cgi/viewcontent.cgi?referer=https%3A//scholar… "Assessing the effects of virtual emergency training on mine rescue team efficacy","Hoebbel, C., Bauerle, T., Macdonald, B., & Mallett, L. (2015). Assessing the effects of virtual emergency training on mine rescue team efficacy. Paper presented at the meeting of the National Institute for Occupational Safety and Health, Interservice/Industry Training, Simulation, and Education Conference (I/ITSEC) in Pittsburgh, PA.","Mine Workers and Mine Health and Safety","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Health and safety-Low-Favorable impacts Health and safety","Summary: The study’s objective was to examine the impact of virtual mine rescue training on mine rescue process efficacy. Using survey data, the authors used an interrupted time series design to compare mine rescue team members’ self-reported process efficacy before and after virtual mine rescue training. The study found that the virtual mine rescue training was significantly associated with an increase in process efficacy. The quality of causal evidence presented in this report is low because the authors did not observe outcomes for multiple periods before and after the intervention. This means we are not confident that the estimated effects are attributable to the mine rescue training; other factors are likely to have contributed.",,"Mine safety and health Workplace injury",Adult,,"United States",2015,https://www.cdc.gov/Niosh/mining/UserFiles/works/pdfs/ateov.pdf "Veterans’ labor force participation: What role does the VA’s disability compensation program play?","Coile, C., Duggan, M., & Guo, A. (2015). Veterans’ labor force participation: What role does the VA’s disability compensation program play? American Economic Review, 105(5), 131-136.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study examined the impact of expanding eligibility for veterans’ Disability Compensation (DC) in 2001 and 2010 on labor force participation. The authors conducted a nonexperimental analysis to compare veteran and non-veteran labor force participation over time using the March Current Population Survey data from 1980 to 2014. The study found that veteran labor force participation was generally lower than that of non-veterans in the same 10-year age range during the periods following eligibility expansions. The quality of causal evidence presented in this report is low because there could be differences in external conditions that affected the treatment group and not the comparison group. This means we are not confident that the estimated effects are attributable to veterans’ receipt of DC; other factors are likely to have contributed to the findings.",DC,"Other wages and benefits Veterans' reemployment","Disability, Male, Veteran or military",,"United States",2015,https://www.aeaweb.org/articles?id=10.1257/aer.p20151062 "Evaluation of the social cash transfer pilot programme, Tigray region, Ethiopia-endline report","Berhane, G., Devereux, S., Hoddinott, J., Hoel, J., Roelen, K., Abay, K. Kimmel, M., Ledlie, N., & Woldu, T. (2015). Evaluation of the social cash transfer pilot programme, Tigray region, Ethiopia-endline report. New York, NY: UNICEF","Child Labor",,,"Child labor-Mod/high-Favorable impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of a conditional cash transfer program on child labor and school enrollment in two districts in Ethiopia (Abi Adi and Hintalo Wajirat). The study used a nonexperimental design to compare the outcomes of children who received the cash transfer to those who did not. Outcomes were measured using baseline and follow-up household surveys and analyzed using regression. The study found that the number of days that girls were engaged in household business (non-farm activities) significantly decreased in Abi Adi; no significant impacts were found for boys in Abi Adi or any children in the Hintalo Wajirat. The study also found that the rates of school enrollment significantly increased for girls aged 6-11 in Hintalo Wajirat; there were no significant impacts for boys in Hintalo Wajirat or any children in Abi Adi. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the conditional cash transfer program and not to other factors.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2015, "Psychological frictions and the incomplete take-up of social benefits: Evidence from an IRS field experiment","Bhargava, S., & Manoli, D. (2015). Psychological frictions and the incomplete take-up of social benefits: Evidence from an IRS field experiment. American Economic Review, 105(11), 3489-3529.","Behavioral Insights","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of complexity, program information, and stigma on the take-up rate of the Earned Income Tax Credit (EITC) among eligible taxpayers who had not previously claimed the credit. The authors conducted a randomized controlled trial, sending different combinations of materials to likely eligible taxpayers who had not previously claimed the EITC. They used tax data from the Internal Revenue Service (IRS) for tax year 2009. The study found that use of complex materials and a longer worksheet decreased the EITC take-up rate by 6 and 4 percentage points, respectively. Materials that displayed the potential tax credit amount increased the EITC take-up rate by 8 percentage points. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the experimental mailings, and not to other factors.",,"Behavioral Interventions","Adult, Employed",,"United States",2015, "Learning about job search: A field experiment with job seekers in Germany","Altmann, S., Falk, A., Jäger, S., & Zimmermann, F. (2015). Learning about job search: A field experiment with job seekers in Germany. Unpublished manuscript.","Behavioral Insights","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine whether providing job search information to unemployed job seekers affected their labor market outcomes. German citizens identified as unemployed were randomly assigned to the treatment group, which was mailed an informational brochure, or to the control group, which was not mailed a brochure. The Integrated Employment Biographies, an administrative database available through the German Federal Employment Agency, was the primary data source for the study. The study did not find any statistically significant effects of the brochure on the employment or earnings outcomes of the treatment group relative to the control group. However, the study did find positive impacts of the brochure on earnings and employment outcomes for the subgroup of individuals who had been identified as being at risk of long-term unemployment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the informational brochure, and not to other factors.",,"Job search assistance and supportive services Behavioral interventions","Adult, Unemployed",,International,2015,https://www.cens.uni-bonn.de/team/board/armin-falk/afjz-job-search-dp-150509.pdf "Doubling graduation rates: Three-year effects of CUNY’s Accelerated Study in Associate Programs (ASAP) for developmental education students","Scrivener, S., Weiss, M., Ratledge, A., Rudd, T., Sommo, C., & Fresques, H. (2015). Doubling graduation rates: Three-year effects of CUNY’s Accelerated Study in Associate Programs (ASAP) for developmental education students. New York: MDRC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the effectiveness of the Accelerated Study in Associate Programs (ASAP) at three City University of New York (CUNY) schools on credits earned and completion of a college degree. At the three participating schools, eligible students were randomly assigned to the treatment group, which could participate in ASAP, or to the control group, which could not participate in ASAP but could access existing services at the schools. The primary data sources were a baseline information form, the CUNY Institutional Research Database, and National Student Clearinghouse records. The study found that students in the ASAP group were significantly more likely to earn a degree from any college in the fourth, fifth, and sixth semesters following random assignment, compared with the control group. In addition, during the sixth semester following random assignment, the treatment group was significantly more likely to be enrolled in a four-year college than the control group. Over the six semesters of the study, students in the treatment group earned significantly more total credits, college-level credits, and developmental credits than the control group. The quality of causal evidence presented in this report is high because it was based on a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to ASAP and not to other factors.","the Accelerated Study in Associate Program (ASAP)","Community college education and other classroom training","Adult, Low income",,"United States",2015,http://www.mdrc.org/sites/default/files/doubling_graduation_rates_fr.pdf "Can compulsory dialogues nudge sick-listed workers back to work?","Markussen, S., Røed, K., & Schreiner, R. C. (2015). Can compulsory dialogues nudge sick-listed workers back to work? (IZA Discussion Paper No. 9090). Bonn, Germany: Institute for the Study of Labor (IZA).","Behavioral Insights","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of a compulsory dialogue meeting (DM) on the return to partial or full-time employment for long-term sick-listed workers in Norway. The authors compared differences in outcomes between long-term sick-listed workers whose absence started in July 2004 through June 2006 and those whose absence started in January 2009 through December 2010, during which time the DM program became compulsory. The authors used salary and social insurance data from the Norwegian Social Security Administration (SSA) to measure program impacts. The study found that increasing the probability of a sick-listed worker attending a DM resulted in a significant increase in base salary, for those who returned to full-time employment, of $1,436. It also resulted in a significantly lower probability of receiving temporary disability benefits two years later for those who returned to full-time employment (1.4 percent) and those who returned to either part- or full-time employment (2.3 percent). The quality of causal evidence presented in this report is low because the authors did not establish the comparability of the treatment and comparison groups. This means we are not confident that the estimated effects are attributable to compulsory DMs; other factors are likely to have contributed.","Dialogue Meeting (DM)","Behavioral Interventions","Unemployed, Adult",,International,2015,http://ftp.iza.org/dp9090.pdf "Becoming adults: One year impact findings from the youth villages’ Transitional Living evaluation","Valentine, E.J., Skemer, M., & Courtney, M.E. (2015). Becoming adults: One year impact findings from the youth villages’ Transitional Living evaluation. New York: MDRC.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Transitional Living program on education, earnings, and recidivism outcomes. The authors used a randomized controlled trial and estimated impacts by comparing the means of the treatment and control groups. Outcome data on education, earnings, and criminal involvement came from a 12-month survey conducted by the authors. The study found a statistically significant impact on earnings only. Youth in the treatment group earned an average $611 more than youth in the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Transitional Living, and not to other factors.","Transitional Living","Basic skills Other training and education Youth programs","Youth, Justice-involved, Disconnected youth",,"United States",2015,http://www.mdrc.org/sites/default/files/Becoming_Adults_FR.pdf "How do educational transfers affect child labor supply and expenditures? Evidence from Indonesia of impact and flypaper effects","De Silva, I., & Sumarto, S. (2015). How do educational transfers affect child labor supply and expenditures? Evidence from Indonesia of impact and flypaper effects. Oxford Development Studies, 43(4), 483-507. https://doi.org/10.1080/13600818.2015.1032232","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor","Summary: The objective of this study was to assess the impact of the Cash Transfer for the Poor Students Programme/Bantuan Siswa Miskin (BSM) program on child labor. The study used a nonexperimental design to assess the program’s impact. With data collected from a national survey, the authors compared the proportion of children that participated in work between those who received financial educational support in the past year before taking the survey, and matched comparison groups of children who had not received financial educational study. The study found that receipt of educational assistance was significantly associated with lower rates of child labor. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to BSM; other factors are likely to have contributed.","Cash Transfer for the Poor Students Programme/Bantuan Siswa Miskin (BSM)","Child labor","Other, Low income",,International,2015,https://mpra.ub.uni-muenchen.de/66767/ "Exploring the differential impact of public interventions on indigenous people: Lessons from Mexico's conditional cash transfer program","Lopez-Calva, L. F., & Patrinos, H. A. (2015). Exploring the differential impact of public interventions on indigenous people: Lessons from Mexico's conditional cash transfer program. Journal of Human Development and Capabilities, 16(3), 452-467. doi:10.1080/19452829.2015.1072378","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The objective of the study was to examine the impact of Mexico’s conditional cash transfer program (PROGRESA/Oportunidades) on child labor and school attendance for children ages 8 to 17 across 3 indigenous, Spanish-speaking, and bilingual households. Using survey data from a cluster randomized controlled trial, the authors analyzed the average program impact of the PROGRESA/Oportunidades program on indigenous households versus individuals who were bilingual or Spanish-speaking. The study found that the PROGRESA/Oportunidades program was significantly related to a decrease in child labor and an increase in school attendance for indigenous speaking children. The quality of causal evidence presented in this study is low because it was based on a randomized controlled trial with unknown attrition and the authors did not control for the required variables. As a result, we are not confident that the estimated effects are attributable to PROGRESA/Oportunidades; other factors are likely to have contributed.",PROGRESA/Oportunidades,"Child labor","Other, Low income",,"International, Rural",2015,https://www.researchgate.net/publication/242464961_Exploring_the_Differential_I… "The impact of financial education for youth in Ghana","Berry, J., Karlan, D., & Pradhan, M. (2015). The impact of financial education for youth in Ghana (Working Paper No. w21068). Cambridge, MA: National Bureau of Economic Research. doi:10.3386/w21068","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-No impacts Child labor Education and skills gains-Mod/high-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of two different financial literacy programs, Aflatoun and Honest Money Box, on child labor and school attendance of children in grades 5 and 7 in southern Ghana. This summary focuses on the comparison between the Aflatoun program group and the control group. The study was a randomized controlled trial conducted in three districts in southern Ghana. Schools in each district were randomly assigned into one of two treatment groups and a control group. Survey data were collected at baseline and at the end of the school year. Data were analyzed using regression. The study did not find any statistically significant effects on child labor or school attendance for children participating in the Aflatoun program compared to the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial with low attrition. This means we would be confident that any estimated effects would be attributable to the Aflatoun program and not to other factors. However, the study did not find statistically significant effects.","Aflatoun Program","Child labor",Other,,International,2015,https://www.nber.org/papers/w21068.pdf "The impact of financial education for youth in Ghana","Berry, J., Karlan, D., & Pradhan, M. (2015). The impact of financial education for youth in Ghana (Working Paper No. w21068). Cambridge, MA: National Bureau of Economic Research. doi:10.3386/w21068","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-No impacts Child labor Education and skills gains-Mod/high-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of two different financial literacy programs, Aflatoun and Honest Money Box, on child labor and school attendance of children in grades 5 and 7 in southern Ghana. This summary focuses on the comparison between the Honest Money Box program group and the control group. The study was a randomized controlled trial conducted in three districts in southern Ghana. Schools in each district were randomly assigned into one of two treatment groups and a control group. Survey data were collected at baseline and at the end of the school year. Data were analyzed using regression. The study did not find any statistically significant effects on child labor or school attendance for children participating in the Honest Money Box program. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial with low attrition. This means we would be confident that any estimated effects would be attributable to the Honest Money Box program and not to other factors. However, the study did not find statistically significant effects.","Honest Money Box Program","Child labor",Other,,International,2015,https://www.nber.org/papers/w21068.pdf "The effect of a severe health shock on work behavior: Evidence from different health care regimes.","Datta Gupta, N., Kleinjans, K. J., & Larsen, M. (2015). The effect of a severe health shock on work behavior: Evidence from different health care regimes. Social Science and Medicine, 136-137, 44-51.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the national health policies of the United States and Denmark on employment of older workers after a health shock, defined as a new cancer or cardiovascular disease diagnosis. The authors used a nonexperimental approach to compare the impact of a health shock on the likelihood of nonemployment in the United States’ private multipayer system with Denmark’s nationalized universal health care model. The authors used the data from the RAND Health and Retirement Study survey from 1994 to 2002 and Danish population registers for 1993 to 2001. The study found no differences between the United States and Denmark in the relationship between a health shock and employment for older workers. The quality of causal evidence presented in this report is low because the authors did not account for unobserved differences between the countries. This means we are not confident that differences in the association between health shocks and employment in the United States and Denmark are attributable to the national health care policies; other factors are likely to have contributed.","National Healthcare Policy","Health Older workers' programs","Adult, Older worker",,"International, United States",2015,https://www.sciencedirect.com/science/article/pii/S0277953615002816 "Employment outcomes among African American and white women with disabilities: Examining the inequalities.","Balcazar, F. E., & Suarez-Balcazar, Y. (2015). Employment outcomes among African American and white women with disabilities: Examining the inequalities. Women, Gender, and Families of Color, 3(2), 144-164.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-No impacts Employment","Summary: The study examined the impact of adult vocational rehabilitation (VR) services on employment outcomes for African American and white women. The authors used a statistical model and data from a Midwestern state VR system to compare the odds of employment after completing VR services for older versus younger women. The study found no significant difference in employment outcomes between older and younger women who completed VR services. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before receiving VR services. This means we are not confident that the estimated effects are attributable to participation in VR services; other factors are likely to have contributed.","Vocational Rehabilitation (VR) Services","Vocational rehabilitation","Adult, Older worker, Female, Black or African American, White, Disability",,"United States",2015, "Net impact study on annual earnings for the training benefits program 2002-2012","Aviles, G., Bordelon, C., Greenwell, A., Pham, L., Sinkler, A., & Stromsdorfer, E. (2015). Net impact study on annual earnings for the training benefits program 2002-2012. Olympia, WA: Washington State Employment Security Department",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Mixed impacts Earnings and wages Employment-Mod/high-Mixed impacts Employment Public benefits receipt-Mod/high-Mixed impacts Public benefit receipt","Summary: The study’s objective was to evaluate the impact and cost-benefit of the Training Benefits program on participants’ employment, earnings, and unemployment benefits. The study used a nonexperimental design to compare the outcomes of individuals who participated in the program with those who did not, based on data from the Washington Employment Security Department. Using several demographic characteristics, the authors created a matched comparison group to test the impact of the program on time employed, annual earnings, and receipt of unemployment benefits. The study found that program participation was associated with a decrease in employment and earnings in early follow up years, but an increase in employment and earnings in later years. However, the study did not include tests of statistical significance. The quality of causal evidence provided in this study is moderate because it is based on a well-implemented non-experimental design. This means we are somewhat confident that the estimated effects are attributable to the Training Benefits program, but other factors might have also contributed.","Training Benefits (TB) Program","Unemployment Insurance Work based and other occupational training","Adult, Unemployed",,"United States",2015, "The effect of health reform on retirement.","Levy, H., Buchmueller, T. C., & Nikpay, S. (2015). The effect of health reform on retirement (Research Paper 329). Ann Arbor, MI: Michigan Retirement Research Center.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the expansion of Medicaid to low-income adults in 2014 on retirement rates of workers ages 55 to 64. The authors used a nonexperimental analysis to compare those who lived in an expansion state to those who lived in other states. The study used data from the monthly Current Population Survey from January 2005 through July 2015. The study found no statistically significant relationships between Medicaid expansion and retirement. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the expansion of Medicaid; other factors are likely to have contributed.","Medicaid expansion","Health insurance Older workers' programs","Adult, Older worker, Low income",,"United States",2015,https://deepblue.lib.umich.edu/handle/2027.42/116062 "How much does access to health insurance influence the timing of retirement?","Coe, N. B., & Goda, G. S. (2015). How much does access to health insurance influence the timing of retirement? (SIEPR Discussion Paper No. 14-007). Stanford, CA: Stanford Institute for Economic Policy Research. City, ST: Publisher.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Unfavorable impacts Employment Public benefits receipt-Low-No impacts Public benefit receipt","Summary: The study examined the impact of state-level reforms of health insurance on early retirement and Social Security retirement benefit claims. The authors used 1996–2010 data from the Health and Retirement Study (HRS) and statistical models to compare the outcomes of individuals in states with state-level reforms of health insurance with those in non-reform states. The study found that employed individuals in states with non-group health insurance reform were significantly more likely to retire at age 63. The quality of causal evidence presented in this report is low because the authors did not demonstrate that individuals in states with state-level reforms of health insurance were similar to those in non-reform states. This means we are not confident that the estimated effects are attributable to the non-group health insurance reform; other factors are likely to have contributed.","Retiree Health Insurance","Health insurance Older workers' programs","Adult, Older worker",,"United States",2015, "The benefits of keeping idle hands busy: An outcome evaluation of a prisoner reentry employment program.","Duwe, G. (2015). The benefits of keeping idle hands busy: An outcome evaluation of a prisoner reentry employment program. Crime & Delinquency, 61(4), 559-586.",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Minnesota Department of Correction’s EMPLOY work release program on post-release employment, earnings, and recidivism outcomes for incarcerated adults. The author used propensity-score matching to create a comparison group of nonparticipants similar to EMPLOY program participants. The author estimated the program’s effects by comparing these groups’ post-release recidivism, employment, and earnings outcomes. Data from the Minnesota Department of Corrections provided recidivism information, and data from the Minnesota Department of Employee and Economic Development provided employment and earnings information. EMPLOY program participation decreased the risk of conviction for a new crime by 32 percent, the risk of reincarceration by 55 percent, and the risk of revocation for technical violations by 63 percent, on average. The quality of causal evidence presented in this report for recidivism outcomes is moderate because it was based on a well-implemented nonexperimental design that established that the criminal history of the two groups was similar before the intervention. This means we are somewhat confident that the estimated effects on recidivism are attributable to the EMPLOY program, but other factors might also have contributed. The quality of causal evidence presented in this report for employment outcomes is low because the author did not ensure that the groups being compared were similar in terms of employment history before the intervention. This means we are not confident that the estimated effects on employment outcomes are attributable to the EMPLOY program; other factors are likely to have contributed.","EMPLOY Program",Reentry,Justice-involved,,"United States",2015,http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.1019.6826&rep=rep1&typ… "An assessment of the effectiveness of prison work release programs on post-release recidivism and employment.","Bales, W. D., Clark, C., Scaggs, S., Ensley, D., Coltharp, P., Singer, A., & Blomberg, T. G. (2015). An assessment of the effectiveness of prison work release programs on post-release recidivism and employment. Tallahassee, FL: Florida Department of Corrections and Tallahassee, FL: Florida State University College of Criminology and Criminal Justice.",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of work release programs in the state of Florida on recidivism and employment outcomes for people released from prison. The authors used a nonexperimental design to create a comparison group of nonparticipants who were eligible for work release program services but did not participate. The authors estimated the work release program’s effects by comparing treatment and comparison groups’ post-release recidivism and employment outcomes using administrative data from the state of Florida for three years after release. The authors found that participating in a work release program decreased the risk of arrest for a new felony or misdemeanor crime by about 10 percent one year following release from prison, by about 8 percent two years following release, and by about 9 percent three years following release. The study also found that people who completed the work-release program were less likely to have a reconviction at three years following release from prison, but reconvictions were the same across groups at one and two years following release. People who completed the work release program were more likely to return to prison for any reason after one year, but returns were the same across groups after two or three years. The quality of causal evidence presented in this report is moderate for outcomes related to recidivism and low for outcomes related to employment. This means we are somewhat confident that the estimated effects on recidivism are attributable to the work release program, although other factors might also have contributed; we are not confident that the estimated effects on employment are attributable to the program, as other factors are likely to have contributed","Florida's Back to Work Program",Reentry,Justice-involved,,"United States",2015,https://www.ncjrs.gov/pdffiles1/nij/grants/249845.pdf "Fighting for Education: Financial Aid and Non-traditional Students","Barr, A. C. (2015). Fighting for Education: Financial Aid and Non-traditional Students. (Doctoral dissertation). Online Archive of University of Virginia Scholarship. https://doi.org/10.18130/V35Z6S.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the effects of Post-9/11 GI Bill on veterans’ college enrollment and degree attainment. The author investigated similar research questions in another study, the profile of which is available [here]. The study used regression methods in a nonexperimental analysis, drawing on data from Defense Manpower Data Center, the National Student Clearinghouse, and the Integrated Postsecondary Education Data System. The author used two statistical models to compare veterans eligible for the benefits with veterans who were not eligible. The study found a statistically significant positive relationship between the Post-9/11 GI Bill benefits and education for veterans who were eligible for the benefits and likely to take them up compared with veterans who were not eligible for the benefits and with veterans who were eligible but unlikely to take up the benefits. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Post-9/11 GI Bill; other factors are likely to have contributed.","Post-9/11 GI Bill","Other training and education","Veteran or military",,"United States",2015,https://doi.org/10.18130/V35Z6S "From the battlefield to the schoolyard: The short-term impact of the Post-9/11 GI Bill","Barr , A. (2015). From the battlefield to the schoolyard: The short-term impact of the Post-9/11 GI Bill. Journal of Human Resources, 50(3), 580-613.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the effects of Post-9/11 GI Bill on veterans’ college enrollment. The author investigated similar research questions in another study, the profile of which is available [here]. The study used regression methods in a nonexperimental analysis, drawing on data from the American Community Survey and Current Population Survey. The study compared college enrollment of veterans eligible for the GI Bill benefits with civilians, who were not eligible to receive the benefits. The study found that veterans eligible for the Post-9/11 GI Bill benefits were significantly more likely to enroll in college after the introduction of the bill compared with civilians. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Post-9/11 GI Bill; other factors are likely to have contributed.","Post-9/11 GI Bill","Other training and education","Veteran or military",,"United States",2015,http://jhr.uwpress.org/content/50/3/580.full.pdf "Veterans Homelessness Prevention Demonstration evaluation: Final report","Cunningham, M. K., Biess, J., Emam, D., & Burt., M. R. (2015). Veterans Homelessness Prevention Demonstration evaluation: Final report. Washington, DC: Urban Institute.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Favorable impacts Employment Public benefits receipt-Low-Mixed impacts Public benefit receipt","Summary: The study examined the effect of the Veterans Homelessness Prevention Demonstration (VHPD) program on the employment, earnings, public benefit receipt, and education and training outcomes of veterans at risk of homelessness. The study uses a nonexperimental design to examine whether there were changes in veterans’ outcomes from before the program began to six months after the program ended using self-reported data directly from the veterans. The study found statistically significant positive relationships between the VHPD program and veterans’ employment and earnings six months after the program ended compared with before the program. The study found mixed relationships between the VHPD program and public benefit receipt: significantly fewer veterans in the study received several types of public benefits, such as Temporary Assistance for Needy Families (TANF) or the Supplemental Nutrition Assistance Program (SNAP). Significantly more veterans in the study, however, received Veterans Pension benefits after the program compared with before it. The quality of causal evidence presented in this report is low because the authors did not account for trends in outcomes before the intervention. This means we are not confident that the estimated effects are attributable to the VHPD program; other factors are likely to have contributed.","the Veterans Homelessness Prevention Demonstration (VHPD) program","Job search assistance and supportive services Other training and education","Low income, Veteran or military, Homeless",,"United States",2015,http://apps.urban.org/features/homeless-veterans/ "Three accelerated developmental education programs: Features, student outcomes, and implications","Jaggars, S. S., Hodara, M, Cho, S., & Xu, D. (2015). Three accelerated developmental education programs: Features, student outcomes, and implications. Community College Review 43(1), 3-26. doi: 10.1177/0091552114551752","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of three accelerated developmental education programs on gatekeeper (entry-level) course completion and college-level credit accumulation. This summary focuses on the Accelerated Learning Program (ALP) at the Community College of Baltimore. This nonexperimental study used regression analysis and propensity score matching to compare the outcomes of students who participated in the ALP to those who did not. The study reported outcomes one year and three years after students first enrolled in the course. The study found that ALP students had significantly higher course completion rates, course enrollment rates, and credit accumulation than comparison students one year and three years after enrollment. The quality of causal evidence presented in this study is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the Accelerated Learning Program, but other factors might also have contributed.","Accelerated Developmental Education","Community college education and other classroom training","Adult, Other barriers",,"United States",2015,https://doi.org/10.1177%2F0091552114551752 "Three accelerated developmental education programs: Features, student outcomes, and implications","Jaggars, S. S., Hodara, M, Cho, S., & Xu, D. (2015). Three accelerated developmental education programs: Features, student outcomes, and implications. Community College Review 43(1), 3-26. doi: 10.1177/0091552114551752","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of three accelerated developmental education programs on gatekeeper (entry-level) course completion and college-level credit accumulation. This summary focuses on the accelerated developmental reading/writing program at Chabot College in California. This nonexperimental study used regression analysis and propensity score matching to compare the outcomes of students who participated in the accelerated reading/writing program to those who did not. The study reported outcomes one year and three years after students first enrolled in the course. The study found that students who participated in the accelerated program had significantly higher course completion rates, course enrollment rates, and credit accumulation than comparison students one year and three years after enrollment. The quality of causal evidence presented in this study is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the accelerated reading/writing program, but other factors might also have contributed.","Accelerated Developmental Education","Community college education and other classroom training",Adult,,"United States",2015,https://doi.org/10.1177%2F0091552114551752 "Three accelerated developmental education programs: Features, student outcomes, and implications","Jaggars, S. S., Hodara, M, Cho, S., & Xu, D. (2015). Three accelerated developmental education programs: Features, student outcomes, and implications. Community College Review 43(1), 3-26. doi: 10.1177/0091552114551752","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of three accelerated developmental education programs on gatekeeper (entry-level) course completion and college-level credit accumulation. This summary focuses on the FastStart Math Program at Denver Community College. This nonexperimental study used regression analysis and propensity score matching to compare the outcomes of students who participated in the FastStart math program to those who did not. The study reported outcomes one year and three years after students first enrolled in the course. The study found that students who participated in the FastStart Math Program had significantly higher course completion rates and course enrollment rates than comparison students one year and three years after enrollment. The quality of causal evidence presented in this study is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the FastStart Math Program, but other factors might also have contributed.","Accelerated Developmental Education","Community college education and other classroom training",Adult,,"United States",2015,https://doi.org/10.1177%2F0091552114551752 "Engaging community college students using an engineering learning community","Maccariella, J. (2015). Engaging community college students using an engineering learning community. (Unpublished doctoral dissertation). Old Dominion University, Norfolk, VA.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Education and skills gains-Mod/high-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Engineering Tutors and Leaning Communities (TLC) program on community college engineering students’ retention and graduation/transfer rates. The study used a nonexperimental design to compare the outcomes of students who participated in the Engineering TLC program to students who did not participate in the program, one and two semesters after program implementation. When compared to non-participating students, the study did not find a significant relationship between participation in the Engineering TLC program and student retention rates or graduation/transfer rates. The quality of causal evidence presented in this study is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the Engineering TLC program, but other factors might also have contributed.","the Engineering Tutors and Leaning Communities (TLC) program","Community college education and other classroom training Mentoring Science, Technology, Engineering, and Math (STEM) programs",Adult,,"United States",2015,https://digitalcommons.odu.edu/cgi/viewcontent.cgi?referer=https%3A//scholar.go… "Community value: The effect of an urban community college's learning community program on developmental English student retention, academic success, and graduation","Risolo, P. L. (2015). Community value: The effect of an urban community college's learning community program on developmental English student retention, academic success, and graduation (Unpublished doctoral dissertation). Creighton University, Omaha, NE.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Mixed impacts Education and skills gains","Summary: The study’s objective was to examine the impact of participation in a learning community during the first academic semester on community college students’ retention and graduation rates. The study used a nonexperimental design to compare the outcomes of students who participated in a learning community to those who did not participate. Using data from the college’s Institutional Research Department, the author tested for group differences in student retention after one year and graduation after four years. Compared to nonparticipating students, the study found that learning community students were significantly less likely to be retained after one year but more likely to graduate after four years. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the learning community program; other factors are likely to have contributed.","the learning communities","Community college education and other classroom training",Adult,,"United States",2015,https://dspace2.creighton.edu/xmlui/handle/10504/74383 "First Year Initiative's impact on developmental students' re-enrollment and course success at a community college","Rogers, S. S. (2015). First Year Initiative's impact on developmental students' re-enrollment and course success at a community college. (Unpublished doctoral dissertation). Wilmington University, New Castle, DE","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Mixed impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the First Year Initiative (FYI) program on community college students’ re-enrollment rates and successful completion of developmental math and reading courses. The study used a nonexperimental design to compare the outcomes of students who participated in the FYI program to eligible students who did not participate in the program. When compared to non-participating students, the study found that FYI program participation was associated with significantly higher re-enrollment rates and significantly lower successful course completes rates. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the FYI program; other factors are likely to have contributed.","the First Year Initiative (FYI) program","Community college education and other classroom training","Adult, Other barriers",,"United States",2015,https://search.proquest.com/openview/844c6b71d3a0c97530d29127a97348bd/1?pq-orig… "Third party evaluation of the impact of the Health Professions Pathways (H2P) Consortium.","Bragg, D. D., Giani, M. S., Fox, H. L., Bishop, C., & Bridges, K. (2015). Third party evaluation of the impact of the Health Professions Pathways (H2P) Consortium. Champaign, IL: Office of Community College Research and Leadership, University of Illinois at Urbana-Champaign.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Education and skills gains-Low-No impacts Education and skills gains Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Health Professions Pathways (H2P) Consortium on education, earnings, and employment outcomes. The study used a nonexperimental design to compare the outcomes of students who were in the H2P Consortium to a matched comparison group. The study found a statistically significant relationship between H2P participation and the likelihood to be employed and have higher wages in contrast to the comparison group. The quality of the causal evidence rating presented in this report is low because the authors used a cohort from a previous enrollment year for the comparison group presenting a confounding factor. This means we are not confident that the effects are attributable to the Health Professions Pathways (H2P) Consortium; other factors are likely to have contributed.","Health Professions Pathways (H2P) Consortium","Capacity building programs Community college education and other classroom training",Adult,,"United States",2015,https://occrl.illinois.edu/docs/librariesprovider4/h2p/impact.pdf "Third-party evaluation of the outcomes and impact of the National Information, Security, & Geospatial Technologies Consortium (NISGTC)","Bridges, K., Bishop, C., & Giani, M. (2015). Third-party evaluation of the outcomes and impact of the National Information, Security & Geospatial Technologies Consortium (NISGTC). Champaign, IL: Office of Community College Research and Leadership, University of Illinois at Urbana-Champaign.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study’s objective was to assess the impact of TAACCCT-funded programming offered at National Information Security & Geospatial Technology Consortium (NISGTC) colleges on educational and employment outcomes. Using student-level data collected by the colleges’ Institutional Research offices and states’ Unemployment Insurance data systems, the study used a nonexperimental design to compare the outcomes of students enrolled in NISGTC programs with students enrolled in similar programs of study prior to the grant. The study found that students in the NISGTC-affected programs were significantly more likely to attain credentials and have higher average quarterly earnings than students in the comparison group. The quality of causal evidence presented in this report is low because the authors did not use sufficient controls in their analysis for the education outcomes. This means we are not confident that the estimated effects are attributable to the NISGTC-affected programs; other factors are likely to have contributed.","National Information Security & Geospatial Technology Consortium (NISGTC) Programs","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Other, Low-skilled",,"United States",2015,https://occrl.illinois.edu/docs/librariesprovider4/nisgtc/nisgtc-impact.pdf "Evaluation of MoHealthWINS outcomes and impact","Cosgrove, J. J., Cosgrove, M. S., & Bragg, D. D. (2015). Evaluation of MoHealthWINS outcomes and impact. Retrieved from https://www.skillscommons.org/bitstream/handle/taaccct/5125/SEPTEMBER%202015%20FINAL%20VERSION%20OF%20MHW%20OUTCOME%20IMPACT%20EVALUATION%20REPORT.pdf?sequence=1&isAllowed=y","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to assess the relationship between the MoHealthWINS program and education and employment outcomes. The study used a nonexperimental design, where the program participants were compared to a matched comparison group. Using college administrative data, state employment data, and employer data, the authors compared the program completion and employment rates between the treatment and comparison group. The study found a significant relationship between program participation and the likelihood to complete the program and be employed post-program completion. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention or include sufficient control variables. This means we are not confident that the estimated effects are attributable to MoHealthWINS program; other factors are likely to have contributed.",MoHealthWINS,"Capacity building programs Community college education and other classroom training","Adult, Unemployed, Low-skilled, Veteran or military",,"United States",2015,https://www.skillscommons.org/bitstream/handle/taaccct/5125/SEPTEMBER%202015%20… "Gasper, J., & Henderson, K. (2014). Sector-focused career centers evaluation: Effects on employment and earnings after one year.","Gasper, J., & Henderson, K. (2014). Sector-focused career centers evaluation: Effects on employment and earnings after one year. New York: New York City Center for Economic Opportunity. Retrieved from http://www.nyc.gov/html/ceo/downloads/pdf/CEO-Sector_Based_Approaches_Evaluation_Report-2014_final.pdf.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: The study’s objective was to examine the impact of sector-focused career centers in New York City on employment and earnings. The authors estimated the effect of sector-focused career centers by comparing employment and earnings outcomes captured in New York State unemployment insurance data among participants in New York City sector-focused career centers against the outcomes for individuals served by New York City career centers without a specific sector focus who were deemed similar in terms of initial characteristics to the sector-focused group. This review was conducted in collaboration with the Employment Strategies for Low-Income Adults Evidence Review (ESER). Because ESER did not report findings for studies that received a low causal evidence rating, the CLEAR profile does not report the findings either. The quality of causal evidence presented in this report is low because the authors did not demonstrate that the groups were similar at baseline or make statistical adjustments for differences between the two groups in the analyses. This means we are not confident that the estimated effects are attributable to sector-focused career centers; other factors are likely to have contributed.","New York City Sector-focused Career Centers","Job search assistance and supportive services Other employment and reemployment","Low income","Manufacturing, Health care and social assistance, Transportation and warehousing","Urban, United States",2014,http://www.nyc.gov/html/ceo/downloads/pdf/CEO-Sector_Based_Approaches_Evaluatio… "Net impact and benefit-cost estimates of the workforce development system in Washington state. (Upjohn Institute Technical Report No. 13-029).","Hollenbeck, K. & Huang, W-J. (2014). Net impact and benefit-cost estimates of the workforce development system in Washington state. (Upjohn Institute Technical Report No. 13-029). Kalamazoo, MI: W.E. Upjohn Institute for Employment Research.","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment Public benefits receipt-Low-Unfavorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of apprenticeship programs on employment rates, earnings, and benefit receipt. The authors used a nonexperimental method to compare the short-term (3 quarters after program exit) and long-term (9–12 quarters after program exit) employment, earnings, and unemployment insurance benefits between those who took part in the apprenticeship programs and those who registered for services at the Labor Exchange (Employment Services). The study found that, compared to those who registered for services at the Labor Exchange, participants in the apprenticeship programs had higher employment rates, hours worked, earnings, and receipt of unemployment insurance benefits. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before program participation. This means we are not confident that the estimated effects are attributable to the apprenticeship programs; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","Apprenticeship Programs","Labor Exchange Registered apprenticeship Work based and other occupational training",Adult,,"United States",2014,http://research.upjohn.org/cgi/viewcontent.cgi?article=1032&context=up_technica… "Net impact and benefit-cost estimates of the workforce development system in Washington state. (Upjohn Institute Technical Report No. 13-029). [WIA Dislocated Workers]","Hollenbeck, K., & Huang, W-J. (2014). Net impact and benefit-cost estimates of the workforce development system in Washington state. (Upjohn Institute Technical Report No. 13-029). Retrieved from W.E. Upjohn Institute for Employment Research website: http://dx.doi.org/10.17848/tr13-029%20[WIA Dislocated Workers]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Workforce Investment Act (WIA) Dislocated Worker Program on the employment rate, earnings, and benefit receipt of dislocated workers in Washington State. The authors assigned dislocated workers to the treatment group if they received employment-related services through the WIA Dislocated Worker Program and exited from July 2005 to June 2006 or from July 2007 to June 2008. The comparison group comprised workers who registered for services at the Labor Exchange during this period. The study found that in both the short and long term the employment rate and average quarterly earnings increased for those in the treatment group compared to those in the comparison group. Benefit receipt decreased for those in the treatment group compared with those in the comparison group. The quality of causal evidence presented in this report is low because the treatment and comparison group were compared at different follow-up points and therefore were not equivalent. This means we are not confident that the estimated effects are attributable to the WIA Dislocated Worker Program; other factors are likely to have contributed.","the Workforce Investment Act (WIA) Dislocated Worker Program","Job search assistance and supportive services Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) training programs","Dislocated or displaced worker",,"United States",2014,http://research.upjohn.org/cgi/viewcontent.cgi?article=1032&context=up_technica… "Net impact and benefit-cost estimates of the workforce development system in Washington state. (Upjohn Institute Technical Report No. 13-029). [Community and Technical College Worker Retraining Program]","Hollenbeck, K., & Huang, W-J. (2014). Net impact and benefit-cost estimates of the workforce development system in Washington state. (Upjohn Institute Technical Report No. 13-029). Retrieved from W.E. Upjohn Institute for Employment Research website: http://dx.doi.org/10.17848/tr13-029%20 [Community and Technical College Worker Retraining Program]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment Public benefits receipt-Low-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Community and Technical College (CTC) Worker Retraining (WR) program on employment, earnings, and benefit receipt of long-term unemployed and dislocated workers who are eligible for or have exhausted their unemployment benefits in Washington State. The authors assigned workers to the treatment group if they received training through the CTC WR program and exited from July 2005 to June 2006 or from July 2007 to June 2008. The comparison group comprised workers who registered at the Labor Exchange. The study found that both short- and long-term employment and earnings increased for those who participated in the WR program compared to those in the Labor Exchange. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before program participation. This means we are not confident that the estimated effects are attributable to the CTC WR program; other factors are likely to have contributed.","Community and Technical College Worker Retraining (CTC WR) Program","Other training and education","Dislocated or displaced worker",,"United States",2014,http://research.upjohn.org/cgi/viewcontent.cgi?article=1032&context=up_technica… "Net impact and benefit-cost estimates of the workforce development system in Washington state. (Upjohn Institute Technical Report No. 13-029). [WIA Adult]","Hollenbeck, K., & Huang, W.-J. (2014). Net impact and benefit-cost estimates of the workforce development system in Washington state. (Upjohn Institute Technical Report No. 13-029). Retrieved from W.E. Upjohn Institute for Employment Research website: http://dx.doi.org/10.17848/tr13-029 [WIA Adult]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Workforce Investment Act (WIA) Adult Program on the employment rate, earnings, and benefit receipt of low-income adults in Washington State. The authors used a nonexperimental method to compare short-term (3 quarters after program exit) and long-term (9 to 12 quarters after program exit) employment, earnings, and Unemployment Insurance benefits between those who took part in the WIA Adult Program with those who registered for services at the Labor Exchange Employment Services. The study found that, compared with those who registered for services at the Labor Exchange, participants in the WIA Adult Program had higher employment rates and average quarterly earnings and lower receipt of unemployment insurance benefits. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before program participation. This means we are not confident that the estimated effects are attributable to the WIA Adult Program; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Workforce Investment Act (WIA) Adult Program","Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) training programs","Low-skilled, Low income",,"United States",2014,http://research.upjohn.org/cgi/viewcontent.cgi?article=1032&context=up_technica… "Net impact and benefit-cost estimates of the workforce development system in Washington state. (Upjohn Institute Technical Report No. 13-029). [Private career school programs]","Hollenbeck, K., & Huang, W.-J. (2014). Net impact and benefit-cost estimates of the workforce development system in Washington state. (Upjohn Institute Technical Report No. 13-029). Retrieved from W.E. Upjohn Institute for Employment Research website: http://dx.doi.org/10.17848/tr13-029 [Private career school programs]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Unfavorable impacts Employment Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of private career schools’ programs on the employment rate, earnings, and benefit receipt of adults who completed high school in Washington State. The authors used a nonexperimental method to compare short-term (3 quarters after program exit) and long-term (9 to 12 quarters after program exit) employment, earnings, and Unemployment Insurance benefits between those who took part in private career school programs with those who registered for services at the Labor Exchange Employment Services. The study found that, compared with those who registered for services at the Labor Exchange, participants in private career school programs had lower initial employment but higher long-term employment and earnings. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before program participation. This means we are not confident that the estimated effects are attributable to private career school programs; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Private Career School Programs","Other training and education",Adult,"Other services, Transportation and warehousing","United States",2014,http://research.upjohn.org/cgi/viewcontent.cgi?article=1032&context=up_technica… "Net impact and benefit-cost estimates of the workforce development system in Washington State. (Upjohn Institute Technical Report No. 13-029). [WIA Youth]","Hollenbeck, K., & Huang, W-J. (2014). Net impact and benefit-cost estimates of the workforce development system in Washington State. (Upjohn Institute Technical Report No. 13-029). Kalamazoo, MI: W.E. Upjohn Institute for Employment Research. Retrieved from W.E. Upjohn Institute for Employment Research website: http://dx.doi.org/10.17848/tr13-029. [WIA Youth]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Workforce Investment Act (WIA) Youth Program, held on community and technical college campuses, on the employment rate and earnings of low-income youth in Washington State. The authors used a nonexperimental method to compare the short-term (3 quarters after program exit) and long-term (9 to 12 quarters after program exit) employment and earnings between those who took part in the WIA Youth program relative to those who registered for services at the Labor Exchange (Employment Services). The study found that, compared with those who registered for services at the Labor Exchange, WIA Youth participants had higher employment and earnings. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before program participation. This means we are not confident that the estimated effects are attributable to the WIA Youth Program; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Workforce Investment Act (WIA) Youth Program","Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) Youth programs Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) training programs","Youth, Low-skilled, Low income",,"United States",2014,http://research.upjohn.org/cgi/viewcontent.cgi?article=1032&context=up_technica… "Net impact and benefit-cost estimates of the workforce development system in Washington State. (Upjohn Institute Technical Report No. 13-029). [VOC]","Hollenbeck, K., & Huang, W-J. (2014). Net impact and benefit-cost estimates of the workforce development system in Washington State. (Upjohn Institute Technical Report No. 13-029). Kalamazoo, MI: W.E. Upjohn Institute for Employment Research. Retrieved from W.E. Upjohn Institute for Employment Research website: http://dx.doi.org/10.17848/tr13-029. [VOC]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-Favorable impacts Employment Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of Vocational Rehabilitation (VOC) programs on the employment rate, earnings, and benefit receipt of adults with disabilities in Washington State. The authors used a nonexperimental method to compare the short-term (3 quarters after program exit) and long-term (9 to 12 quarters after program exit) employment, earnings, and Unemployment Insurance benefits between those who took part in VOC programs relative to those who were eligible, but did not receive services from VOC programs. The study found that, compared with those who did not receive services from VOC programs, VOC program participants had higher employment and earnings. Receipt of benefits was lower in the short-term for VOC program participants relative to those who did not receive VOC program services. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before program participation. This means we are not confident that the estimated effects are attributable to VOC programs; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Vocational Rehabilitation (VOC) Programs","Unemployment Insurance Vocational rehabilitation",Disability,,"United States",2014,http://research.upjohn.org/cgi/viewcontent.cgi?article=1032&context=up_technica… "Net impact and benefit-cost estimates of the workforce development system in Washington State. Upjohn Institute technical report no. 13-029. [Adult basic education programs on community and technical college campuses]","Hollenbeck, K., & Huang, W-J. (2014). Net impact and benefit-cost estimates of the workforce development system in Washington State. Upjohn Institute technical report no. 13-029. Kalamazoo, MI: W. E. Upjohn Institute for Employment Research. http://dx.doi.org/10.17848/tr13-029 [Adult basic education programs on community and technical college campuses]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Mixed impacts Employment Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of community and technical college campus Adult Basic Education (ABE) programs on the employment rate, earnings, and benefit receipt of adults in Washington State. The authors used a nonexperimental method to compare short-term (3 quarters after program exit) and long-term (9 to 12 quarters after program exit) employment, earnings, and unemployment insurance benefits between those who took part in the ABE program with those who registered for services at the Labor Exchange (Employment Services). The study found that, compared with those who registered for services at the Labor Exchange, the employment rate for ABE participants decreased and average quarterly earnings increased, in both the short and long terms. Compared with the Labor Exchange group, ABE participants received fewer benefits in the short and long terms. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups compared were similar before program participation. This means we are not confident that the estimated effects are attributable to the ABE program; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Adult Basic Education (ABE) Program","Other training and education",Adult,,"United States",2014,http://research.upjohn.org/cgi/viewcontent.cgi?article=1032&context=up_technica… "Twelve-month employment intervention outcomes for drug-involved offenders","Webster, J. M., Staton-Tindall, M., Dickson, M. F., Wilson, J. F., & Leukefeld, C. G. (2014). Twelve-month employment intervention outcomes for drug-involved offenders. American Journal of Drug & Alcohol Abuse, 40(3), 200-205.",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of a drug court employment intervention on participants’ employment and earnings one year after the intervention. The study is a randomized controlled trial. A total of 500 participants at two drug court sites in Kentucky were randomly assigned to receive either an employment intervention and a standard drug court program (the treatment group) or a standard drug court program alone (the control group). Using self-reported survey data from participants, the authors compared outcomes for the treatment and control groups. The study found that members of the treatment group worked an average of 210 days in the year after random assignment compared with 200 days for the control group; this was a statistically significant difference. The study found no significant impacts of the intervention on earnings. The quality of causal evidence presented in this report is low because it was based on a randomized controlled trial for which the study did not provide enough information to demonstrate that the groups had similar response rates on the survey, and it also did not account for other factors that could have affected the difference between the treatment and control groups. This means we are not confident that the estimated effects are attributable to the employment intervention; other factors are likely to have contributed.","the employment intervention","Substance abuse recovery Other employment and reemployment Reentry","Justice-involved, Other barriers",,"United States",2014,https://doi.org/10.3109/00952990.2013.858722 "The role of intensive case management services in reentry: The northern Kentucky female offender reentry project","McDonald, D., & Arlinghaus, S. L. (2014). The role of intensive case management services in reentry: The northern Kentucky female offender reentry project. Women & Criminal Justice, 24(3), 229-251.",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Mixed impacts Education and skills gains Employment-Low-Favorable impacts Employment","Summary: This study examined the impact of the Northern Kentucky Female Offender Reentry Project’s intensive case management (ICM) services on releasees’ education, employment, and recidivism outcomes. Using program data and administrative data from state and county judicial databases, the study compared outcomes of the treatment group, which received ICM services pre-release (in prison) and post-release (in the community), with outcomes of the comparison group, which only received ICM services pre-release (in prison). The study found mixed results for education, employment, and recidivism. The authors did not conduct statistical significance tests. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Female Offender Reentry Project’s pre- and post- release ICM services; other factors are likely to have contributed.","Northern Kentucky Female Offender Reentry Project’s intensive case management (ICM) services","Other employment and reemployment Reentry","Justice-involved, Female",,"United States",2014,https://doi.org/10.1080/08974454.2014.909759 "Substance Use Treatment and Reentry (STAR) program: Final evaluation report","Hunter, S. B., & Huang, C. Y. (2014). Substance Use Treatment and Reentry (STAR) program: Final evaluation report. Santa Monica, CA: RAND Corporation.",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Unfavorable impacts Employment","Summary: The study’s objective was to examine the impact of the Substance Use Treatment and Reentry (STAR) program on post-release employment and recidivism outcomes for justice-involved young adults in California. The authors used an interrupted time series design to compare the outcomes of justice-involved young adults before and after participating in the STAR program. They assessed the change in participants’ scores on the Center for Substance Abuse Treatment (CSAT) Government Performance Reporting Act assessments, which were administered at baseline and at 3, 6, and 12 months following program intake. The authors found statistically significant relationships between program participation and employment and recidivism outcomes. At six months after program intake, employment decreased by 26.7 percentage points but the number of participants who spent any time in a confined setting (jail, prison, juvenile hall) decreased by 11.5 percentage points. The quality of causal evidence presented in this report is low because the authors did not account for trends in outcomes before the intervention. This means we are not confident that the estimated effects on employment and recidivism are attributable to the program; other factors are likely to have contributed.","the Substance Use Treatment and Reentry (STAR) program","Substance abuse recovery Reentry","Youth, Justice-involved",,"United States",2014,https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5051995/ "High-involvement work practices and the opportunities for promotion in the organization","Bonet, R. (2014). High-involvement work practices and the opportunities for promotion in the organization. Industrial Relations, 53(2), 295-324. doi:10.1111/irel.12057","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Mixed impacts Employment","Summary: The study’s objective was to examine the impact of employees’ participation in high-involvement work practices (HIWP) on their expected promotions. The author used regression methods in a nonexperimental analysis to estimate impacts of participating in HIWP, drawing on self-reported data from a survey of for-profit company employees. The study found that employee participation in more HIWP was associated with a greater likelihood of expected promotions. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to participation in HIWP, but other factors might also have contributed.","High-Involvement Work Practices (HIWP)","Work based and other occupational training","Adult, Employed",,"United States",2014,https://doi.org/10.1111/irel.12057 "Directional control-response compatibility relationships assessed by physical simulation of an underground bolting machine","Steiner, L., Burgess-Limerick, R., & Porter, W. (2014). Directional control-response compatibility relationships assessed by physical simulation of an underground bolting machine. Human Factors, 56(2), 384-391. https://doi.org/10.1177/0018720813490953","Mine Workers and Mine Health and Safety","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Health and safety-Mod/high-Favorable impacts Health and safety","Summary: The study’s objective was to examine the impact of directional control-response relationships on errors made when controlling roof-bolting machines. The study was a randomized controlled trial conducted in a laboratory setting. The authors tested the role of the directional control-response relationships for roof-bolting machines on the amount of selection errors made by participants. The study found a significant effect of directional control-response relationships on the proportion of errors made for three of the five levers tested. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to directional control-response relationships for roof-bolting machines, and not to other factors.",,"Mine safety and health Workplace injury",Adult,,"United States",2014,https://doi.org/10.1177/0018720813490953 "Occupational radon exposure and lung cancer mortality: Estimating intervention effects using the parametric G formula","Edwards, J. K., McGrath, L. J., Buckley, J. P., Schubauer-Berigan, M. K., Cole, S. R., & Richardson, D. B. (2014). Occupational radon exposure and lung cancer mortality: Estimating intervention effects using the parametric G formula. Epidemiology, 25(6), 829-834. https://doi.org/10.1097/ede.0000000000000164","Mine Workers and Mine Health and Safety","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Health and safety-Mod/high-No impacts Health and safety","Summary: The study’s objective was to examine the impact of three different historical U.S. radon exposure standards on lung cancer mortality. The author used statistical models and data from the Colorado Plateau Uranium Miners cohort to estimate the risk of lung cancer death based on different limits of radon exposure. The study found that all three federal standards that limited radon exposure were associated with lower cumulative lung cancer mortality by age 90. However, tests of statistical significance were not reported. The quality of causal evidence presented in this report is moderate because it is based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the historical radon exposure standards, but other factors might also have contributed.",,"Mine safety and health Workplace injury",Adult,,"United States",2014,https://doi.org/10.1097/ede.0000000000000164 "CogSMART compensatory cognitive training for traumatic brain injury: Effects over 1 year","Twamley, E. W., Thomas, K. R., Gregory, A. M., Jak, A. J., Bondi, M. W., Delias, D. C., & Lohr, J. B. (2014). CogSMART compensatory cognitive training for traumatic brain injury: Effects over 1 year. Journal of Head Trauma Rehabilitation, 30(6), 391-401.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of Cognitive Symptom Management and Rehabilitation Therapy (CogSMART) and enhanced supported employment (ESE) on employment, earnings, and health outcomes. The authors conducted a randomized controlled trial that randomly assigned participants to the intervention and comparison groups. Employment data came from weekly reports on job attainment, hours worked, and wages earned. The study did not find any statistically significant relationships between CogSMART plus ESE and employment, earnings, or health outcomes. The quality of causal evidence presented in this report is low because the study had a confounding factor. Specifically, one interventionist delivered CogSMART plus ESE and another interventionist implemented services to the comparison group, which makes it impossible to separate the effect of CogSMART plus ESE from the effect of the individual interventionists. This means we are not confident that the estimated effects are attributable to CogSMART plus ESE; other factors are likely to have contributed to the findings.","CogSMART Plus ESE","Health Job search assistance and supportive services Supported employment or other employment supports Veterans' reemployment","Disability, Veteran or military",,"United States",2014,https://doi.org/10.1097/HTR.0000000000000076 "The impact of ABS program participation on long-term economic outcomes","Reder, S. (2014). The impact of ABS program participation on long-term economic outcomes. Washington, DC: United States Department of Education, Office of Career, Technical and Adult Education.",Literacy,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages","Summary: The study’s objective was to examine the impact of Adult Basic Skills (ABS) training on earnings and wages. The author used a nonexperimental design to compare the outcomes of adults who participated in various levels of ABS training to a matched comparison group who did not, over a ten-year time period. The study found a significant relationship between participating in ABS training and higher income, with a greater increase in income for those with at least 100 hours of ABS training. The study also found that wages were significantly associated with the length of time since training and intensity of training, with higher wages among participants who had attained 100 hours of ABS training in earlier years. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to Adult Basic Skills training; other factors are likely to have contributed.",,"Basic skills","Adult, Other barriers, Low-skilled",,"United States",2014,https://lincs.ed.gov/publications/pdf/ABS_EconomicOutcomes.pdf "The impact of ABS program participation on long-term GED attainment","Reder, S. (2014). The impact of ABS program participation on long-term GED attainment. Washington, DC: United States Department of Education, Office of Career, Technical and Adult Education.",Literacy,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of Adult Basic Skills (ABS) training on GED attainment. The author used a nonexperimental design to compare the outcomes of adults who participated in various levels of ABS training to a matched comparison group who did not, over a ten-year time period. The study found that ABS participants had significantly higher rates of GED attainment than adults who did not participate in ABS training. The quality of causal evidence presented in this report is moderate because it is based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to Adult Basic Skills training, but other factors might also have contributed.",,"Basic skills","Adult, Other barriers, Low-skilled",,"United States",2014,https://lincs.ed.gov/publications/pdf/ABS_GED.pdf "A little help may be no help at all: Child labor and scholarships in Nepal","Datt, G., & Uhe, L. (2014). A little help may be no help at all: Child labor and scholarships in Nepal. Monash Business School Department of Economics Discussion Paper, 50/14.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Mixed impacts Child labor","Summary: The study’s objective was to examine the impact of school scholarships in Nepal on child labor. Using the 2010 Nepal Living Standards Survey III, the authors used a nonexperimental design to compare the labor outcomes of scholarship recipients to those who did not receive scholarships. The study found that scholarship receipt was significantly related to an increase in extended-economic work for girls. However, higher scholarship values were significantly related to a reduction in the number of hours spent in economic and extended-economic work for girls. The quality of causal evidence presented in the study is low because the authors did not control for pre-intervention outcomes. This means we are not confident that the estimated effects are attributable to the scholarship program; other factors are likely to have contributed.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2014,https://www.monash.edu/business/economics/research/publications/2014/5014childl… "Does promoting school attendance reduce child labour? Evidence from Burkina Faso’s Bright project","de Hoop, J. & Rosati, F. C. (2014). Does promoting school attendance reduce child labour? Evidence from Burkina Faso’s Bright project. Economics of Education Review, 39, 78-96. doi:10.1016/j.econedurev.2013.11.001","Child Labor","Study Type: Descriptive Analysis",,,"Summary: The study’s objective was to examine the impact of the BRIGHT project on school participation and child labor in Burkina Faso in West Africa. The study used a regression discontinuity design. Villages were assigned to the treatment and comparison groups based on a numeric score (a constructed index score of how likely the program would be to benefit girls). Villages above the cut-off score received the program; villages below did not receive the program. Using survey data from schools and households, the authors analyzed the impact of the program on child labor, school enrollment, and school attendance for children aged 5-12. The study found that participation in the BRIGHT project was significantly associated with an increase in the probability of children working in the family business or selling goods on the streets. However, program participation was also significantly related to an increase in school enrollment and attendance. This study used a regression discontinuity design and therefore was reviewed using CLEAR’s descriptive study evidence review guidelines. As such, it does not receive a causal rating.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2014,https://www.sciencedirect.com/science/article/pii/S0272775713001556 "The impact of the Kenya CT-OVC programme on children's activities","de Hoop, J., Ranzani, M., Rosati, F. C. (2014). The impact of the Kenya CT-OVC programme on children’s activities (Working Paper). Retrieved from http://www.ucw-project.org/attachment/The_impact_of_the_Kenya_CT-OVC20140423_144552.pdf","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-No impacts Education and skills gains","Summary: The purpose of the study was to assess the impact of the Kenya Cash Transfer for Orphans and Vulnerable Children Program on child labor and school participation. The study used a randomized controlled trial to assess the intervention. Child outcomes were compared between the treatment and control group households, using data from follow-up surveys administered two years after the start of the intervention. The study found a 5 percent reduction in the proportion of children in the treatment group who were working in unpaid labor or conducting household chores compared to the control group. The quality of causal evidence presented in this report is low because randomization was compromised and the authors did not ensure that the groups being compared were similar before the intervention. This means that if there were significant effects, we would not be confident that they were attributable to Kenya CT-OVC; other factors are likely to have contributed.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2014,http://www.ucw-project.org/attachment/The_impact_of_the_Kenya_CT-OVC20140423_14… "Sustained gains: Year Up’s continued impacts on young adults’ earnings","Roder, A., & Elliott, M. (2014). Sustained gains: Year Up’s continued impacts on young adults’ earnings. New York: Economic Mobility Corporation.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-No impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the effect of the Year Up program on employment, earnings, and education outcomes. Year Up is an intensive, yearlong program that provides training and internships in financial operations and information technology for young adults from low-income urban communities. About 200 students in three cities were randomly assigned to the treatment group, which was eligible to participate in Year Up beginning in September 2007, or the control group, which was not eligible to participate in Year Up in 2007. Members of the control group were eligible to reapply to the program after 10 months, and many did. The authors compared the outcomes of the treatment and control groups using data collected through telephone interviews with participants four years after random assignment. The authors reported a positive, statistically significant impact of Year Up on earnings measured three years after random assignment, but these impacts did not extend to the fourth year after random assignment. Cumulatively, treatment group members earned $13,645 more than the control group over years 2 through 4 after random assignment, and they were more likely to have been employed in a field targeted by the program. The quality of the causal evidence presented in this study is moderate because, although it was based on a randomized controlled trial with high attrition, the authors demonstrated that the treatment and control groups were similar before the intervention. This means we have confidence that the estimated effects are attributable at least in part to Year Up, although other factors could also have contributed.","Year Up","Basic skills Other training and education Work based and other occupational training Youth programs","Youth, Black or African American, Hispanic of any race, Low-skilled, Low income",,"United States, Urban",2014,http://economicmobilitycorp.org/uploads/sustained-gains-economic-mobility-corp… "The impact of rehabilitation and counseling services on the labor market activity of Social Security Disability (SSDI) beneficiaries","Weathers, R., & Bailey, M. (2014). The impact of rehabilitation and counseling services on the labor market activity of Social Security Disability (SSDI) beneficiaries. Journal of Policy Analysis & Management, 33(3), 623-648.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine up to 36 month employment and earnings impacts of the Accelerated Benefits Demonstration (ABD), an effort to provide immediate health insurance and employment and benefits counseling to new, uninsured Social Security Disability Insurance (SSDI) recipients during the 24 month Medicare eligibility waiting period.  About 2,000 eligible people were randomly assigned to participate in the ABD. Evaluation data sources included a baseline telephone interview, a 12-month follow-up survey, the Master Beneficiary Record data file, the Summary Earnings Record data file, and Ticket to Work SSA administrative records. The authors estimated the impacts on earnings and employment outcomes for each of three years following enrollment. The study found positive impacts on employment and earnings for those receiving ABD telephonic services. The quality of causal evidence presented in this study is high because it is a well-implemented randomized controlled trial. This means that we are confident that the estimated effects are attributable to the intervention and not to other factors.","Accelerated Benefits Demonstration","Disability insurance Health insurance Supplemental security income (SSI) Vocational rehabilitation",Disability,,"United States",2014, "Earnings and disability program participation of Youth Transition Demonstration Participants after 24 months","Hemmeter, J. (2014). Earnings and disability program participation of Youth Transition Demonstration Participants after 24 months. Social Security Bulletin, 74(1), 1–26.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: This study’s objective was to measure 24-month impacts for the six Youth Transition Demonstration (YTD) sites that used a randomized evaluation. YTD projects provided services to help youth with disabilities improve their education and employment outcomes and become more economically self-sufficient. Data were collected from the Master Earnings File (MEF), Supplemental Security Record (SSR), Master Beneficiary Record (MBR), and Numerical Identification System (Numident) file. The authors estimated program impacts on measures of paid employment and Social Security disability benefit receipt. The study found that, in three of the sites examined, YTD participants were more likely to have at least some earnings in the first calendar years after random assignment; this was also the case for three sites in the second calendar year after random assignment. However, YTD had no statistically significant impacts on average earnings during either calendar year. In four of the six sites, YTD participants were more likely to receive Supplemental Security Income (SSI) 24 months after random assignment. The quality of the causal evidence presented in this report is high because it is based on a well-implemented randomized controlled trial. This means we can be confident that the estimated impacts are attributable to YTD, and not other factors.","the Youth Transition Demonstration","Disability insurance Supplemental security income (SSI) Youth programs","Disability, Youth",,"United States",2014,http://www.ssa.gov/policy/docs/ssb/v74n1/v74n1p1.html "Given time it worked: Positive outcomes from a SSDI benefit offset pilot after the initial evaluation period","Delin, B., Hartman, E., & Sell, C. (2014). Given time it worked: Positive outcomes from a SSDI benefit offset pilot after the initial evaluation period. Journal of Disability Policy Studies, 1-11.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of Wisconsin’s Benefit Offset Pilot Demonstration (BOPD), which provided a more-generous work incentive for Social Security Disability Insurance (SSDI) recipients, on recipients’ employment status and earnings. Although the original evaluation of BOPD was a randomized controlled trial, this study focused on the outcomes of a nonrandom subset of BOPD participants who had completed a trial work period (TWP). Data sources included Wisconsin Unemployment Insurance administrative records and Social Security Administration (SSA) administrative data to evaluate study sample outcomes for 2009 and 2010. The study found that treatment group members who completed a TWP were significantly more likely to be employed or earn at least three times more than the substantial gainful activity (SGA) amount than control group TWP completers over the eight quarters of follow-up. However, there were no significant impacts on earnings. The quality of the causal evidence presented in this report is moderate because it is based on a well-implemented nonexperimental design. This means we have confidence that the effects estimated in this study are attributable at least in part to the BOPD. However, as with any nonexperimental analysis, other factors not accounted for in the study could also have contributed to the estimated effects.","the Benefit Offset Pilot Demonstration","Disability insurance Other wages and benefits Supplemental security income (SSI)",Disability,,"United States",2014, "A random assignment evaluation of learning communities at Kingsborough Community College: Seven years later","Weiss, M. J., Mayer, A., Cullinan, D., Ratledge, A., Sommo, C., & Diamond, J. (2014). A random assignment evaluation of learning communities at Kingsborough Community College: Seven years later. New York: MDRC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Mod/high-No impacts Education and skills gains Employment-Mod/high-No impacts Employment","Summary: The study aimed to examine the impact of the Opening Doors learning communities at Kingsborough Community College in New York on progress toward completing a degree, actual completion of a degree, employment, and earnings. It measured impacts seven years after random assignment. Students in the Opening Doors learning communities took three linked courses during one semester and received tutoring and case management services. The study was a randomized controlled trial. Eligible students were randomly assigned to either the treatment group, which was offered the opportunity to participate in one of the learning communities, or the control group, which was not allowed to enroll in a learning community. The primary data sources were a baseline survey on the background characteristics of students, student transcripts, degree attainment information from the National Student Clearinghouse, and employment and earnings information from Unemployment Insurance (UI) wage records in New York. The study found no significant impacts on the number of credits earned or attempted, completion of any college degree, or employment or earnings in the seventh year after random assignment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects would be attributable to the learning communities, and not to other factors.","Opening Doors Learning Communities at Kingsborough Community College","Community college education and other classroom training","Adult, Low income",,"United States",2014,http://www.mdrc.org/sites/default/files/A_Random_Assignment_Evaluation_of_Learn… "Summer jobs reduce violence among disadvantaged youth","Heller, S. (2014). Summer jobs reduce violence among disadvantaged youth. Science, 346(6214), 1219-1223.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of One Summer Plus, a summer jobs program for high school-age students, on educational and criminal justice outcomes. Students from 13 high schools were recruited to the program and randomly assigned to one of two treatment groups or a control group. Students in the jobs-only treatment group were offered 25 hours per week of paid employment; students in the jobs + SEL treatment group were offered 15 hours of paid employment and 10 hours of social-emotional learning (SEL) weekly. Students in the control group were excluded from the program but free to pursue other opportunities. The study found that students in the One Summer Plus program had significantly fewer arrests for violent crimes in the 16 months following random assignment, compared with students in the control group (5 arrests per 100 youth compared with 9 arrests per 100 youth, equivalent to a 43 percent reduction). There were no statistically significant impacts of the program on the other criminal justice or educational outcomes examined. The quality of causal evidence presented in this report is high because it was based on a well-conducted randomized controlled trial.","One Summer Plus","Other employment and reemployment Youth programs",Youth,,"United States, Urban",2014, "The labor-market returns to community college degrees, diplomas, and certificates","Jepsen, C., Troske, K., & Coomes, P. (2014). The labor-market returns to community college degrees, diplomas, and certificates. Journal of Labor Economics, 32(1), 95-121.",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages","Summary: The study’s objective was to examine the effect of earning community college degrees, diplomas, and certificates on students’ later earnings. Using administrative data from the Kentucky Community and Technical College System (KCTCS), the National Student Clearinghouse, and Kentucky’s unemployment insurance program, the authors compared the outcomes of students who completed college degrees, diplomas, and certificates with those of students who did not. The study found that community college degrees, diplomas, and certificates improved earnings for those who received them, compared with those who did not receive them but were otherwise similar. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design; this is the highest causal evidence rating possible for a nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to earning community college degrees, diplomas, and certificates, but other factors might also have contributed.","the Program Under Study","Other training and education","Adult, Female, Male",,"United States",2014, "Community college men and women: A test of three widely held beliefs about who pursues computer science","Denner, J., Werner, L., O’Connor, L., & Glassman, J. (2014). Community college men and women: A test of three widely held beliefs about who pursues computer science. Community College Review, 42(4), 342-362.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study's objective was to examine factors that affect motivation to pursue a computer and information sciences (CIS) degree, with the intention of informing strategies to increase the number of community college students, particularly females, who go on to enroll in a CIS degree program at a four-year university. Specific factors examined were programming and/or video-gaming experience; support from peers, instructors, mentors, and family members; and level and type of motivation to pursue a CIS degree. The authors administered a series of three (baseline and 6- and 18-month follow-up) surveys to students enrolled in an introductory programming class at one of 15 California community colleges and ran multiple linear regression models by gender to determine each of the three factors’ influence on the student’s plan to pursue a four-year CIS degree, comparing results for women versus men. The study found that female students, who were overall less likely to intend to pursue a four-year CIS degree, reported receiving significantly less encouragement from their peers to persist in computer science and spending less time playing computer games than male students. Predictors for women choosing to pursue a four-year CIS degree changed over time: strong immediate (baseline) predictors were interest in computer science, video gaming, and peer encouragement; a year after baseline, the strongest predictors were expectations for success and interest in solving problems.",,"Youth programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Youth, Female",,"United States",2014, "Cognitive Symptom Management and Rehabilitation Therapy (CogSMART) for veterans with traumatic brain injury: Pilot randomized controlled trial","Twamley, E., Jak, A., Delis, D., Bondi, M., & Lohr, J. (2014). Cognitive Symptom Management and Rehabilitation Therapy (CogSMART) for veterans with traumatic brain injury: Pilot randomized controlled trial. Journal of Rehabilitation Research and Development, 51(1), 59-70.","Disability Employment Policy, Veterans","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of adding Cognitive Symptom Management and Rehabilitation Therapy (CogSMART) to standard supported employment programming for veterans with a history of traumatic brain injury (TBI) and persistent related postconcussive symptoms. Veterans were referred to the program and completed a series of baseline neurocognitive and neuropsychological assessments to determine eligibility. Eligible veterans were randomly assigned to either the CogSMART treatment group, which received supported employment, enhanced by CogSMART sessions, or to a control group that did not participate in CogSMART sessions. The study found that veterans in the CogSMART group demonstrated statistically significant reductions in postconcussive symptoms and improvements in prospective memory functioning. Although a higher proportion of the treatment group entered competitive employment within 14 weeks of starting the program—50 percent compared to 26 percent in the control group—the difference was not statistically significant. The quality of causal evidence presented in this study is low because it is a randomized controlled trial with high or unknown attrition and no control variables included in the analysis. This means we are not confident that the estimated effects are attributable to CogSMART. Other factors are likely to have contributed.","Cognitive Symptom Management and Rehabilitation Therapy","Vocational rehabilitation Veterans' reemployment","Disability, Veteran or military",,"United States",2014, "Mapping success: Performance-based scholarships, student services, and developmental math at Hillsborough Community College","Sommo, C., Boynton, M., Collado, H., Diamond, J., Gardenhire, A., Ratledge, A., . . . Weiss, M. J. (2014). Mapping success: Performance-based scholarships, student services, and developmental math at Hillsborough Community College. New York: MDRC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Mathematics Access Performance Scholarship (MAPS) on completion of developmental and college-level math, credits attempted and earned, and retention at two Hillsborough Community College campuses in Florida (the Dale Mabry campus and the Brandon campus). Developmental math students were randomly assigned to the MAPS program or to the control group. College transcripts were used to assess outcomes. The study found that students in the treatment group attempted and earned more math credits and were more likely to complete Intermediate Algebra (a developmental math course). The quality of causal evidence provided in this study is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the MAPS program and not to other factors.","the Mathematics Access Performance Scholarship (MAPS)","Basic skills Community college education and other classroom training","Adult, Other barriers",,"United States",2014,http://test.mdrc.org/sites/default/files/PBS-HCC%202014%20Full%20Report.pdf "The role of secondary school and community college collaborations to increase Latinas in engineering in a rural community","Starobin, S., & Bivens, G. (2014). The role of secondary school and community college collaborations to increase Latinas in engineering in a rural community. New Directions for Community Colleges, 2014(165), 17-23.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study described factors that might increase young Latinas’ enrollment in pre-engineering programs. The authors reviewed a case study of middle and high school Latina students in the rural Midwest who were participating in a national education pipeline program intended to facilitate a pathway to science, technology, engineering, and mathematics (STEM) degrees and careers. The authors recommended the following for recruiting and retaining rural Latina students in a pre-engineering program: (1) have a program leader with a similar background to students, including a knowledge of culture and language, to facilitate better connections with them; (2) familiarize students with the physical space of higher education institutions to reduce intimidation; and (3) interact with students’ families to facilitate family support.",,"Youth programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Youth, Hispanic of any race",,"United States",2014, "Distinctive and unique outreach programs: Promoting academic excellence and diversity","Monaco, P., & Morse, A. (2014). Distinctive and unique outreach programs: Promoting academic excellence and diversity. Proceedings of the 2014 American Society for Engineering Education Annual Conference & Exposition. Washington, DC: American Society for Engineering Education.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study examined a series of residential environmental engineering summer camps run by a southern technology university that were intended to stimulate interest in STEM fields, primarily for girls and underrepresented minority groups. Three different types of summer camps were offered for different populations: international mixed-gender Brazilian students, female-only, and local mixed-gender students. The authors reviewed qualitative data collected from 81 4th- through 12th-grade students participating in one of five summer camp sessions. These data included pre-session oral surveys; ongoing observations of class participation; and post-session group discussions, activity worksheets that asked for open-ended application of STEM theories to examples, and oral surveys. According to post-session discussions and surveys, across the five camp sessions, about 65 percent of camp participants, of whom 25 percent were females, expressed interest in pursuing a STEM major. The authors also reported that the females had higher levels of participation and engagement in female-only sessions compared with mixed-gender sessions.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Other barriers, Female",,"United States",2014,https://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=1&cad=rja&uact=8&… "Exploring gender imbalance among STEM doctoral degree recipients (Issue brief)","Gillen, A., & Tanenbaum, C. (2014, September). Exploring gender imbalance among STEM doctoral degree recipients (Issue brief). Washington, DC: American Institutes for Research.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study’s main objective was to accurately identify the nature of gender imbalances in the receipt of science, technology, engineering, and mathematics (STEM) degrees, specifically isolating imbalances at the doctoral level. Using data from the U.S. Department of Education’s Integrated Postsecondary Education Data System (IPEDS), the authors calculated the ratio of women to men earning doctoral degrees by field, controlling for the number who completed an undergraduate degree in the same field (called “prepared” students). The study found that, overall, men are overrepresented in 76 percent of doctoral fields. This means that, after controlling for the number of students who complete an undergraduate degree in a given field, more men than women are completing doctoral degrees in the same field. However, there is slightly less gender imbalance of prepared students earning doctoral degrees in all STEM fields than in non-STEM fields, even though the absolute number of men receiving STEM doctoral degrees is higher. The authors suggest that because female undergraduate STEM majors persist from undergraduate to graduate levels at almost the same rate (90 percent as often) as men, gender imbalance must be addressed earlier in the academic pipeline to address overall disparities in the receipt of STEM doctoral degrees.",,"Science, Technology, Engineering, and Math (STEM) programs","Female, Male, STEM professional",,"United States",2014,http://www.air.org/sites/default/files/downloads/report/STEM%20PhDs%20Gender%20… "The persistent effect of temporary affirmative action","Miller, C. (2014). The persistent effect of temporary affirmative action (Unpublished job market paper). Cambridge, MA: MIT Department of Economics.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to determine the effect of affirmative action requirements for federal contractors through Executive Order 11246 on African American employment shares at the establishment level. The study used establishment transitions between federal contractor and non-contractor status to pinpoint the effects of affirmative action regulation using multiple regression analysis. The author based his analysis on EEO-1 Employer Information Report files from 1978–2004. The study found that federal contractors subject to the affirmative action Executive Order increased African American employment share by 0.13–0.15 percentage points each year relative to non-contractors not subject to the Order. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to affirmative action requirements under Executive Order 11246, but other factors might also have contributed.","Executive Order 11246","Executive Order 11246 (E.O. 11246)","Black or African American",,"United States",2014,http://economics.cornell.edu/sites/default/files/files/events/Conrad.Miller_jmp… "Mentoring practices proven to broaden participation in STEM disciplines","Crumpton-Young, L., Elde, A., & Ambrose, K. (2014, June). Mentoring practices proven to broaden participation in STEM disciplines. Paper presented at 2014 American Society for Engineering Education Annual Conference, Indianapolis, IN.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study identified effective mentoring practices, mostly at postsecondary institutions, for women and minority students in science, technology, engineering, and mathematics (STEM) fields. The authors surveyed 25 randomly selected mentor programs or individuals who received a National Science Foundation award for being successful in mentoring students who are typically underrepresented (including women) in STEM. The survey asked award recipients to rate their performance on 22 mentoring practices using a scale ranging from not doing well to doing exceptionally well. The authors deemed those mentoring practices rated most highly as best practices. The study found that the highest-rated mentoring practices were being passionate about mentees and their development, creating opportunities for mentees, setting high expectations for mentees’ performance, providing needed support to mentees, and respecting mentees’ confidentiality. Conversely, the lowest-rated practices set the mentor in an authoritative light and included providing constant feedback to and having constant contact with mentees.",,"Mentoring Science, Technology, Engineering, and Math (STEM) programs","Youth, Female, Black or African American, Asian, Hispanic of any race, Multiracial, American Indian or Alaska Native, Native Hawaiian or other Pacific Islander",,"United States",2014,https://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=1&ved=0ahUKEwiM7t… "An examination of the impact of accelerating community college students’ progression through developmental education","Hodara, M., & Jaggars, S. (2014). An examination of the impact of accelerating community college students’ progression through developmental education. Journal of Higher Education, 85(2), 246-276.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Education and skills gains-Mod/high-Mixed impacts Education and skills gains","Summary: The study’s objective was to examine the impact of accelerated developmental writing and math sequences on enrollment, persistence, and academic achievement outcomes at six City University of New York (CUNY) community colleges. At some colleges, students assigned to the lowest level of developmental writing or math were required to complete an accelerated sequence of only one or two developmental courses before moving to college-level courses, compared with the longer sequence of two or three courses required at other colleges. This nonexperimental study used regression analysis and propensity-score matching to estimate the impact of accelerated developmental writing and math sequences among students in need of developmental courses from 2001 to 2007. CUNY’s Office of Institutional Research provided students’ data. The study reported outcomes three years after students first enrolled in community college. The study found that students in the shorter math and writing sequences were more likely to enroll in and pass college-level math and writing. Students in the shorter writing sequence earned more credits, on average, within three years and were more likely to earn an associate’s or bachelor’s degree within five years than those in the longer writing sequence. Among students who enrolled in college English, however, those who had taken the shorter English sequence were 2.5 percentage points less likely to pass college English. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the accelerated developmental education program, but other factors might also have contributed.","Accelerated Developmental Education","Basic skills Community college education and other classroom training","Adult, Other barriers",,"United States",2014, "Actions against poverty: The impact of career technical education","Rabren, K., Carpenter, J., Dunn, C., & Carney, J. (2014). Actions against poverty: The impact of career technical education. Career Development and Transition for Exceptional Individuals, 37(1), 29-39.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of participation in career or technical education (career tech) on post-high school employment for people with specific learning or intellectual disabilities who lived in relatively high-poverty areas. The authors estimated regression models comparing employment outcomes for youth who participated in career tech with those who did not, while controlling for differences in demographic characteristics. The study found that career tech participants were 0.235 times more likely than those in the comparison group to be employed when leaving high school. Career tech participants were also 0.064 times more likely to be employed at any point within the first year after high school (0.066 times for those who were unemployed upon leaving high school). These findings were statistically significant. The quality of causal evidence presented in this report is low because the study did not control for students’ degree of disadvantage. This means we are not confident that the estimated effects are attributable to career tech participation; other factors are likely to have contributed.","Career Tech","Other employment and reemployment Other training and education Youth programs","Youth, Disability, Other barriers",,"United States",2014, "Reference-dependent job search: Evidence from Hungary","DellaVigna, S., Lindner, A., Reizer, B., & Schmieder, J. (2014). Reference-dependent job search: Evidence from Hungary. Unpublished working paper.","Behavioral Insights","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study’s objective was to empirically test a behavioral model of job search using a reform in Hungary’s Unemployment Insurance (UI) program. The authors compared rates of exit from unemployment in groups of claimants who entered UI before and after the reform’s implementation in November 2005. The authors used social security and UI data from Hungary’s Institute of Economics and National Employment Service. The study found support for the behavioral job search model and theorized that approximately budget-neutral transitions to two-step UI systems could speed claimants’ exit out of unemployment. The quality of causal evidence presented in this report is low because it cannot account for factors other than the UI program that also changed over the period of study and could also have influenced the outcomes of interest. This means we are not confident that the estimated effects are attributable to Hungary’s 2005 UI reform; other factors are likely to have contributed.","Hungary’s Unemployment Insurance Reform","Unemployment Insurance Behavioral Interventions Job search assistance and supportive services","Adult, Unemployed, Dislocated or displaced worker",,International,2014,http://eml.berkeley.edu/~sdellavi/wp/HungaryUIRD_wp_2014_07_20.pdf "Students as teachers: Effectiveness of a peer-led STEM learning programme over 10 years","Drane, D., Micari, M., & Light, G. (2014). Students as teachers: Effectiveness of a peer-led STEM learning programme over 10 years. Educational Research & Evaluation, 20(3), 210-230.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Gateway Science Workshop (GSW) program at a university in the United States on course grades. Using administrative data on course grades from more than 20,000 students in biology, chemistry, physics, engineering, and math courses, the authors estimated regression models to determine the impact of the GSW program. The study found no significant relationship between GSW program participation and students’ grades for either gender. The quality of causal evidence presented in this report is low because the authors did not adequately adjust for existing differences between treatment and comparison students. This means we are not confident that the estimated effects are attributable to the GSW program. Other factors are likely to have contributed.","the Gateway Science Workshop Program","Science, Technology, Engineering, and Math (STEM) programs Youth programs",Youth,,"United States",2014, "Does attending a STEM high school improve student performance? Evidence from New York City","Wiswall, M., Stiefel, L., Schwartz, A., & Boccardo, J. (2014). Does attending a STEM high school improve student performance? Evidence from New York City. Economics of Education Review, 40, 93-105.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of New York City (NYC) STEM high schools on math and science test-taking behavior and scores. The study used regression analyses to compare outcomes for students who attended a STEM-focused high school with those who attended a regular public high school. The study used administrative data from the NYC Department of Education. The study found that young women attending STEM high schools in NYC were more likely to take various New York State Regents Examinations in math and science and to score higher on biology tests compared with young women who attended non-STEM public high schools. The quality of causal evidence presented in this study is low because the treatment and comparison groups were not equivalent on key measures at baseline. This means we are not confident that the estimated effects are attributable to STEM high schools; other factors are likely to have contributed.","New York City (NYC) STEM High Schools","Science, Technology, Engineering, and Math (STEM) programs Youth programs",Youth,,"United States",2014, "Impact of a 5-week collegiate-level residential STEM summer program on secondary school students (Research to practice)","Campbell, B., Robb, S., Abbott, S., & Mutunga, S. (2014). Impact of a 5-week collegiate-level residential STEM summer program on secondary school students (Research to practice). Proceedings of the 2014 American Society for Engineering Education Annual Conference & Exposition. Washington, DC: American Society for Engineering Education.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Attitudes-Low-Favorable impacts Attitudes","Summary: The study’s objective was to examine the impact of participating in the Pennsylvania Governor’s School for the Sciences’ (PGSS) five-week residential program in summer 2013 on high school seniors’ attitudes toward and interest in science, technology, engineering, and math (STEM). Using surveys developed for the study, the authors compared the outcomes of students before and after participating in the PGSS program. The study found that female students had a significantly improved disposition toward technology and general science and a significantly higher interest in the specific fields of chemistry, computer science, and math at the end of the program, compared to the start of the program. The quality of causal evidence presented in this report is low because the authors did not observe outcomes for multiple periods before the intervention nor account for selection into the intervention. This means we are not confident that the estimated effects are attributable to the PGSS program; other factors are likely to have contributed.","the Pennsylvania Governor’s School for the Sciences (PGSS)","Science, Technology, Engineering, and Math (STEM) programs","Youth, Female",,"United States",2014,https://peer.asee.org/impact-of-a-5-week-collegiate-level-residential-stem-summ… "The (surprising) efficacy of academic and behavioral intervention with disadvantaged youth: Results from a randomized experiment in Chicago","Cook, P., Dodge, K., Farkas, G., Fryer, R., Guryan, J., Ludwig, J. Mayer, S., Pollack, H., & Steinberg, L. (2014). The (surprising) efficacy of academic and behavioral intervention with disadvantaged youth: Results from a randomized experiment in Chicago. Cambridge, MA: National Bureau of Economic Research.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Becoming a Man (BAM) program on youths’ academic outcomes, including grade point averages (GPAs), course failures, and achievement test scores. BAM provided mentoring and socialization activities to enhance cognitive, decision-making, and social skills. The study was a randomized controlled trial conducted in one high school on the south side of Chicago, Illinois, in 2012–2013. Eligible youth were randomly assigned to one of three conditions: (1) a treatment group receiving BAM only, in which individuals could participate in the BAM program; (2) a treatment group receiving BAM plus tutoring, in which individuals could participate in the BAM program and received daily tutoring in math; or (3) the control group, which could not participate in BAM but could access existing services at their school. The authors estimated regressions to measure the impact of the BAM program on academic achievement using administrative data from Chicago Public Schools. The study found that youth offered the opportunity to participate in BAM—either with or without supplemental tutoring—had significantly higher math achievement test scores than youth in the control group. In addition, youth in the BAM program group and the BAM plus tutoring program group had significantly higher math GPAs than members of the control group. The quality of causal evidence presented in this report is high for the GPA and course failures outcomes because it was based on a randomized controlled trial with low attrition. This means we are confident that the estimated effects are attributable to BAM and/or the tutoring sessions, and not to other factors. The quality of causal evidence is moderate for the math and reading achievement outcomes because these outcomes had high attrition but the authors included sufficient controls in their analysis. This means we are somewhat confident that the estimated effects are attributable to BAM and/or tutoring sessions, but other factors might also have contributed.","Becoming a Man","Mentoring Other training and education Youth programs Behavioral Interventions","Youth, Male, Low-skilled, Low income",,"United States, Urban",2014,http://www.nber.org/papers/w19862.pdf "Military veterans marching towards entrepreneurship: An exploratory mixed methods study","Kerrick, S., Cumberland, D., Church-Nally, M., & Kemelgor, B. (2014). Military veterans marching towards entrepreneurship: An exploratory mixed methods study. International Journal of Management Education, 12(3), 469-478.","Entrepreneurship and Self-Employment","Study Type: Descriptive Analysis",,,"Summary: The study examined the relationship between an entrepreneurship education program for military veterans, VetStart, on entrepreneurship attitudes and behaviors. The VetStart program included 10 weeks of entrepreneurship courses followed by nine months of business mentorship and reimbursement of start-up business costs. Fourteen military veterans from a Midwestern community participated in the study over an 18-month period from spring 2012 to spring 2013. The authors used participants’ survey responses before and after participation in the program to measure participants’ level of entrepreneurial passion and frequency of consultations with informal networks (which included family, friends, business associates, and other entrepreneurs) about their new business ideas. The authors defined entrepreneurial passion along three dimensions: founding passion (interest in creating a new organization as an entrepreneur), inventing passion (interest in developing new products or ideas as an entrepreneur), and developing passion (interest in expanding an existing entrepreneurial idea or organization). The study found that the VetStart participants had higher levels of founding, inventing, and developing passion after the program than they did before it. The study also found that the VetStart participants consulted their informal networks regarding their business ideas more after the program than before it.",,"Mentoring Other training and education","Veteran or military",,"United States",2014, "Work-related CBT versus vocational services as usual for unemployed persons with social anxiety disorder: A randomized controlled pilot trial.","Himle, J., Bybee, D., Steinberger, E., Laviolette, W., Weaver, A., Vlnka, S., Golenberg, Z., Levine, D., Heimberg, R., & O’Donnell, L. (2014). Work-related CBT versus vocational services as usual for unemployed persons with social anxiety disorder: A randomized controlled pilot trial. Behaviour Research and Therapy, 63, 169-176.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the effect of group-based, work-related cognitive-behavioral therapy (CBT) on work-related outcomes of unemployed, homeless people diagnosed with social anxiety disorder. The study was a randomized controlled trial. The authors randomly assigned eligible participants to either a treatment group, which received work-related CBT and vocational services, or to a control group, which received vocational services alone. Trained independent evaluators collected the self-reported data used in the study. The study found that participants assigned to the treatment group had higher job search self-efficacy and activity than participants assigned to the control group. The quality of causal evidence presented in this report is low. This means we are not confident that the estimated effects on employment are attributable to work-based CBT; other factors are likely to have contributed.",,"Job search assistance and supportive services","Unemployed, Low income, Homeless",,"United States",2014, "Training program impacts and the onset of the Great Recession. [Dislocated worker sample]","Heinrich, C.J., and Mueser, P. (2014). Training program impacts and the onset of the Great Recession. Columbia, MO: Department of Economics, University of Missouri-Columbia, unpublished. [Dislocated worker sample]",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Mixed impacts Earnings and wages","Summary: The study’s objective was to examine whether participation in the Workforce Investment Act (WIA) Dislocated Worker Program services increased participants' earnings and if so, whether those gains were greater during a recessionary period than in periods before and after the recession. The authors analyzed administrative data to compare the quarterly earnings of participants receiving services through the WIA Dislocated Worker Program with those of a matched comparison group that received Wagner-Peyser Employment Services (ES). The study presented impacts separately by gender and program year. The study found that males receiving services through the WIA Dislocated Worker Program from July 2007 to December 2007 (before the recession), from January 2008 to June 2008 (at the beginning of the recession), and from July 2008 to June 2009 (during the worst of the recession) earned less than males in the comparison group in most of the 16 follow-up quarters examined. In no quarter did females participating in the WIA Dislocated Worker Program before, during, or after the recession earn more than females in the comparison group. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the WIA Dislocated Worker Program services, but other factors might also have contributed. The report also examined the impacts of WIA Adult Program services; that profile is available here.","the Workforce Investment Act (WIA) Dislocated Worker Program","Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) training programs Job search assistance and supportive services","Dislocated or displaced worker, Female, Male",,"United States",2014,https://www.missourieconomy.org/pdfs/WDQI_MissouriReport_TrainingProgramImpacts… "Training program impacts and the onset of the Great Recession. [TAA sample]","Heinrich, C.J., and Mueser, P. (2014). Training program impacts and the onset of the Great Recession. Columbia, MO: Department of Economics, University of Missouri-Columbia, unpublished. [TAA sample]",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Unfavorable impacts Earnings and wages","Summary: The study’s objective was to examine whether participation in the Trade Adjustment Assistance (TAA) Program services increased participants’ earnings and, if so, whether those gains were greater during a recessionary period than in periods before and after the recession. The authors analyzed administrative data to compare the quarterly earnings of TAA participants with those of a matched comparison group that received Wagner-Peyser Employment Services (ES). The study presented impacts separately by gender and program year. The study found that males and females who received services through the TAA Program earned less, on average, than the comparison group during almost all of the 16 follow-up quarters examined. This held regardless of whether the participants began receiving services before, during, or after the recession. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to services received through the TAA Program, but other factors might also have contributed.","the Trade Adjustment Assistance (TAA) Program","Job search assistance and supportive services Other training and education","Dislocated or displaced worker, Female, Male",,"United States",2014,https://www.empiwifo.uni-freiburg.de/sonstige-dateien/heinrich-mueser_trainingi… "Training program impacts and the onset of the Great Recession. [Adult sample]","Heinrich, C.J., and Mueser, P. (2014). Training program impacts and the onset of the Great Recession. Columbia, MO: Department of Economics, University of Missouri-Columbia, unpublished. [Adult sample]",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Mixed impacts Earnings and wages","Summary: The study’s objective was to examine whether participation in the Workforce Investment Act (WIA) Adult Program services increased participants' earnings and if so, whether those gains were greater during a recessionary period than in periods before and after the recession. The authors analyzed administrative data to compare the quarterly earnings of participants receiving services through the WIA Adult Program with those of a matched comparison group that received Wagner-Peyser Employment Services (ES). The study presented impacts separately by gender and program year. The study found that males and females receiving services from the WIA Adult Program from June to December 2007 (before the recession) earned more, on average, than the comparison group in some, but not all, of the 16 follow-up quarters examined. Males and females receiving services from July 2008 to June 2009 and from July 2009 to June 2010 (after the onset of the recession) tended to earn less, on average, than the comparison group in most of the 16 follow-up quarters. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the WIA Adult Program services, but other factors might also have contributed. The report also examined the impacts of WIA Dislocated Worker services; that profile is available here.","the Workforce Investment Act (WIA) Adult Program","Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) training programs","Dislocated or displaced worker, Female, Male",,"United States",2014,https://www.missourieconomy.org/pdfs/WDQI_MissouriReport_TrainingProgramImpacts… "Net impact and benefit-cost estimates of the workforce development system in Washington state. (Upjohn Institute Technical Report No. 13-029). [Community and Technical College Job Prep Training]","Hollenbeck, K., & Huang, W-J. (2014). Net impact and benefit-cost estimates of the workforce development system in Washington state. (Upjohn Institute Technical Report No. 13-029). Retrieved from W.E. Upjohn Institute for Employment Research website: http://dx.doi.org/10.17848/tr13-029%20[Community and Technical College Job Prep Training]",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of Community and Technical College (CTC) Job Preparatory Training on employment rates, average quarterly earnings, and benefit receipt of high school graduates and/or those age 18 or older in Washington State. The authors assigned participants to the treatment group if they received technical job training through the CTC Job Preparatory Training program and exited from July 2005 to June 2006 or from July 2007 to June 2008. The comparison group comprised workers who registered for services with the Labor Exchange program during this period. The study found that both short- and long-term employment and earnings increased for those who participated in the CTC training program compared to those in the Labor Exchange. In addition, short- and long-term receipt and value of benefits decreased for those in the treatment group. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before program participation. This means we are not confident that the estimated effects are attributable to CTC Job Preparatory Training program; other factors are likely to have contributed.","Community and Technical College (CTC) Job Preparatory Training Program","Other training and education Community college education and other classroom training",Adult,,"United States",2014,http://research.upjohn.org/cgi/viewcontent.cgi?article=1032&context=up_technica… "Evaluation of the NYC Business Solutions Customized Training Program","Hamilton, J., & Chen, E. (2014). Evaluation of the NYC Business Solutions Customized Training Program. New York: New York City Center for Economic Opportunity.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: The study’s objective was to examine the impact of the New York City Business Solutions Customized Training program on earnings. The authors used administrative data on training and payroll to compare the earnings of participants in the customized training program to those of three different matched comparison groups. This review was conducted in collaboration with the Employment Strategies for Low-Income Adults Evidence Review (ESER). Because ESER did not report findings for studies that received a low causal evidence rating, the CLEAR profile does not report the findings either. The quality of causal evidence presented in this report is low because the authors did not show that the groups were similar before the intervention, and they did not sufficiently account for potential differences in their analysis. This means we are not confident that the estimated effects are attributable to the customized training program; other factors are likely to have contributed.","the New York City Business Solutions Customized Training Program","Other training and education Work based and other occupational training","Low income",,"United States",2014,http://www.nyc.gov/html/ceo/downloads/pdf/CEO_CT_final_report_2014.pdf "The impact of earnings disregards on the behavior of low‐income families.","Matsudaira, J. D., & Blank, R. M. (2014). The impact of earnings disregards on the behavior of low‐income families. Journal of Policy Analysis and Management, 33(1), 7-35.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-No impacts Employment Public benefits receipt-Low-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of earnings disregards—the amount of earned income that is not counted when calculating whether someone is eligible for public benefits—for welfare assistance on the employment, earnings, and public assistance receipt of low-skilled single mothers. The study used a difference-in-differences approach to compare the outcomes of women before and after changes in the disregard rate within their state relative to women in other states over the same time period. The study did not find any statistically significant effects of earnings disregards on the outcomes of interest. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design; this is the highest causal evidence rating possible for a nonexperimental design. This means we would be somewhat confident that any estimated effects would be attributable to earnings disregards, but other factors might also have contributed. However, the study did not find statistically significant effects.","Earnings Disregards for Welfare Assistance","Other employment and reemployment","Female, Parent, Low income",,"United States",2014, "Work outcomes after benefits counseling among veterans applying for service connection for a psychiatric condition","Rosen, M. I., Ablondi, K., Black, A. C., Mueller, L., Serowik, K. L., Martino, S., . . . Rosenheck, R. A. (2014). Work outcomes after benefits counseling among veterans applying for service connection for a psychiatric condition. Psychiatric Services, 65(12), 1426-1432.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study examined the impact of benefits counseling on employment and earnings. The study was a randomized controlled trial and collected self-reported data directly from veterans. At one month, the study did not find a statistically significant relationship between benefits counseling and employment. Looking at data across all time periods, the study found a statistically significant relationship between benefits counseling and the number of days of paid work. For the outcomes at one month, the quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects would be attributable to benefits counseling and not to other factors. However, the study did not find statistically significant effects at one month. For all other outcomes, the quality of causal evidence presented in this study is low because the study had high attrition and the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to benefits counseling; other factors are likely to have contributed.","Benefits Counseling","Health Veterans' reemployment","Veteran or military",,"United States",2014,https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4713007/ "Cash transfer programme, productive activities and labour supply: Evidence from a randomised experiment in Kenya","Asfaw, S., Davis, B., Dewbre, J., Handa, S., & Winters, P. (2014). Cash transfer programme, productive activities and labour supply: Evidence from a randomised experiment in Kenya. The Journal of Development Studies, 50(8), 1172-1196. doi: 10.1080/00220388.2014.919383","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to assess the impact of a monthly cash transfer program on household food consumption, resources, and work, including child labor. The study used survey data from a clustered randomized controlled trial. Households from seven districts in Kenya were randomly assigned to either the treatment or control group. Within those locations, 20 percent of the poorest households were recruited if they had one or more children 17 years old or younger who was an orphan or had a chronically ill parent or caregiver.  The study found a statistically significant relationship between the program and a reduction in farm labor for children ages 10-15. This relationship was significant for boys but not for girls. There was also a statistically significant relationship between the program and an increase in school enrollment for children ages 12-18. The quality of causal evidence presented in this report is low because it was based on a randomized controlled trial with high attrition and the authors did not demonstrate that groups were similar at baseline. This means we are not confident that the estimated effects are attributable to the Kenya Cash Transfer Programme for Orphans and Vulnerable Children; other factors are likely to have contributed.","Kenya Cash Transfer Programme for Orphans and Vulnerable Children (CT-OVC) Experiment","Child labor","Other barriers, Other, Low income",,International,2014, "Effects of cash transfers on child labor and schooling in Kenya","Owoko, S. A. (2014). Effects of cash transfers on child labor and schooling in Kenya (Unpublished master's thesis). Nairobi, Kenya: University of Nairobi.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The objective of the study was to assess the impact of Kenya’s Cash Transfer to the Orphaned and Vulnerable Children (CT-OVC) program on children’s participation in work and school. The study used a post-test only design to assess differences in school enrollment and work participation between 5-17 year-old children in the CT-OVC program and those who were not in the program. The study found that receipt of the cash transfer was significantly related to lower rates of child labor and higher rates of school enrollment. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to CT-OVC; other factors are likely to have contributed.","Kenya Cash Transfer for Orphans and Vulnerable Children Program (Kenya CT-OVC)","Child labor","Other barriers, Other",,International,2014, "The impact of Oportunidades on school participation and child labour","Ranzani, M., & Rosati, F. (2014). The impact of Oportunidades on school participation and child labour. Rome, Italy: Understanding Children’s Work.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of Mexico’s conditional cash transfer program (Oportunidades) on school attendance and participation in work for children ages 8 to 14 (during the time of the intervention). Using survey data from a randomized controlled trial, the authors analyzed the average program impact of the Oportunidades program on schooling and work for boys and girls using a statistical model. The study found that Oportunidades significantly increased school participation for boys and girls and significantly decreased participation in work for boys only. The quality of the causal evidence presented in this study is moderate because, although it was based on a randomized controlled trial with high attrition, the authors demonstrated that the treatment and control groups were similar before the intervention. This means we have confidence that the estimated effects are attributable at least in part to Oportunidades, although other factors could also have contributed.",Oportunidades,"Child labor",Other,,International,2014,http://www.ucw-project.org/attachment/Oportunidades_school_part_child_labour_Ja… "You get what you pay for: Schooling incentives and child labor","Edmonds, E. V., & Shrestha, M. (2014). You get what you pay for: Schooling incentives and child labor. Journal of Development Economics, 111, 196-211. doi:10.1016/j.jdeveco.2014.09.005","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-No impacts Child labor Education and skills gains-Mod/high-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of financial schooling incentives (a scholarship and stipend) on school attendance and carpet weaving (a worst form of child labor) among youth ages 10-16 in Nepal. This summary focuses on the comparison between the scholarship treatment group and the control group. The study was a randomized controlled trial (RCT) in which children were randomly assigned to receive one of two schooling incentives (a scholarship or stipend) or to participate in the control group that did not receive any incentives. Using administrative data from schools and survey data, the authors analyzed the impact of the treatment conditions on school attendance and child labor at the end of the school year and 16 months after the intervention ended. The study found no statistically significant difference in rates of involvement in weaving carpets or the hours worked between the scholarship treatment and control groups. There was also no statistically significant difference in rates of school attendance or school enrollment between the two groups. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Schooling Incentives Project Scholarship, and not to other factors. However, the study did not find statistically significant effects.","Schooling Incentives Project","Child labor Tuition assistance","Other, Low income",,International,2014,https://www.sciencedirect.com/science/article/pii/S0304387814001047 "You get what you pay for: Schooling incentives and child labor","Edmonds, E. V., & Shrestha, M. (2014). You get what you pay for: Schooling incentives and child labor. Journal of Development Economics, 111, 196-211. doi:10.1016/j.jdeveco.2014.09.005","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of financial schooling incentives (a scholarship and stipend) on school attendance and carpet weaving (a worst form of child labor) among youth ages 10-16 in Nepal. This summary focuses on the comparison between the stipend treatment group and the control group. The study was a randomized controlled trial (RCT) in which children were randomly assigned to receive one of two schooling incentives (a scholarship or stipend) or to participate in the control group that did not receive any incentives. Using administrative data from schools and survey data, the authors analyzed the impact of the treatment conditions on school attendance and child labor at the end of the school year and 16 months after the intervention ended. The study found that the stipend treatment group had significantly higher levels of school attendance and lower rates of carpet weaving than the control group at the end of the school year. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Schooling Incentives Project Stipend, and not to other factors.","Schooling Incentives Project","Child labor Tuition assistance","Other, Low income",,International,2014,https://www.sciencedirect.com/science/article/pii/S0304387814001047 "You get what you pay for: Schooling incentives and child labor","Edmonds, E. V., & Shrestha, M. (2014). You get what you pay for: Schooling incentives and child labor. Journal of Development Economics, 111, 196-211. doi:10.1016/j.deveco.2014.09.005","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-No impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of financial schooling incentives (a scholarship and stipend) on school attendance and carpet weaving (a worst form of child labor) among youth ages 10-16 in Nepal. This summary focuses on the comparison between the scholarship treatment group and the stipend treatment group. The study was a randomized controlled trial (RCT) in which children were randomly assigned to receive one of two schooling incentives (a scholarship or stipend) or to participate in the control group that did not receive any incentives. Using administrative data from schools and survey data, the authors analyzed the impact of the treatment conditions on school attendance and child labor at the end of the school year and 16 months after the intervention ended. The study found that the stipend treatment group had significantly higher levels of school attendance than the scholarship treatment group at the end of the school year. However, the study found no statistically significant difference in rates of involvement in weaving carpets or the hours worked between the two groups. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Schooling Incentives Project, and not to other factors.","Schooling Incentives Project","Child labor Tuition assistance","Other, Low income",,International,2014,https://www.sciencedirect.com/science/article/pii/S0304387814001047 "Reducing child labour in Panama: An impact evaluation","Andisha, N., Chiquito-Saban, O., Emmerich, E., Figueroa, A., Jiang, Y., Lee, J. H., Manning, D., Ortega-Sanchez, A., & Gawande, K. (2014.) Reducing child labour in Panama: An impact evaluation. Journal of Development Effectiveness, 6(2), 128-146.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor","Summary: The study’s objective was to examine the impact of two components of the DESTINO program—CEC (a tutoring course) and EPA (an alternative primary school program)—on children’s participation in agricultural work in Panama. This summary focuses on the comparison between the CEC treatment group and the comparison group. The study used a nonexperimental comparison group design. Using post-intervention survey data, the authors compared the outcomes for children in schools receiving CEC services to those that were the same age as the CEC children but did not participate in the program. The study found that participation in the CEC program was significantly associated with a reduction in the number of hours that children worked per day but not the probability of children working. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the CEC program; other factors are likely to have contributed.","DESTINO’s CEC program","Child labor","Other barriers, Other",,International,2014,https://www.researchgate.net/publication/271673211_Reducing_child_labour_in_Pan… "Reducing child labour in Panama: An impact evaluation","Andisha, N., Chiquito-Saban, O., Emmerich, E., Figueroa, A., Jiang, Y., Lee, J. H., Manning, D., Ortega-Sanchez, A., & Gawande, K. (2014.) Reducing child labour in Panama: An impact evaluation. Journal of Development Effectiveness, 6(2), 128-146.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-No impacts Child labor","Summary: The study’s objective was to examine the impact of two components of the DESTINO program—CEC (a tutoring course) and EPA (an alternative primary school program)—on children’s participation in agricultural work in Panama. This summary focuses on the comparison between the EPA treatment group and the comparison group. The study used a nonexperimental comparison group design. Using post-intervention survey data, the authors compared the outcomes for children receiving the EPA program to children over 12, who had not received the CEC program and were not attending school. The study found that there were no significant relationships between participation in the EPA program and child work participation or hours worked. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the EPA program; other factors are likely to have contributed.","DESTINO’s EPA program","Child labor","Other barriers, Other",,International,2014,https://www.researchgate.net/publication/271673211_Reducing_child_labour_in_Pan… "The impact of Brazil's Bolsa Familia Program on school attendance, age-grade discrepancy, and child labor","de Lima Amaral, E. F., Goncalves, G. Q., & Weiss, C. (2014). The impact of Brazil's Bolsa Familia Program on school attendance, age-grade discrepancy, and child labor. Journal of Social Science for Policy Implications, 2, 101-125","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Unfavorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The purpose of the study was to examine the impact of the Brazilian conditional cash transfer program, Bolsa Familia, on child labor and school enrollment. The authors used a nonexperimental design to compare the outcomes of children ages 7 to 14 who resided in families who met the income threshold for the Bolsa Familia program compared with those who had not, based on data from the 2010 Brazilian Census. The study found that receipt of the cash transfer was significantly associated with an increase in school enrollment. However, receipt of the transfer was also associated with significantly higher rates of work. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to Bolsa Familia program; other factors are likely to have contributed.","Bolsa Familia","Child labor","Other, Low income",,International,2014, "The effects of prison-based educational programming on recidivism and employment","Duwe, G., & Clark, V. (2014). The effects of prison-based educational programming on recidivism and employment. The Prison Journal, 94(4), 454–478. [Comparison #2: between post-secondary degree completion and no post-secondary degree completion]",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-No impacts Employment","Summary: The study examined whether obtaining a post-secondary degree through Minnesota’s Department of Corrections (MnDOC) affected former inmates’ post-release employment, earnings, and recidivism. The authors also investigated whether obtaining a secondary degree impacted similar outcomes, the profile of which can be found here. The authors used a nonexperimental design (propensity score matching) to create a comparison group of former prisoners who were similar to program graduates but who did not complete a post-secondary degree while incarcerated. The authors estimated the program’s effects using data from the Minnesota Department of Employee and Economic Development, the Minnesota Bureau of Criminal Apprehension, and the Correctional Operations Management System database maintained by MnDOC. The authors found that completing a post-secondary degree reduced the risk of reconviction by 16 percent and re-incarceration for a new crime by 24 percent and had no statistically significant effect on revocations for technical violations. The quality of causal evidence on recidivism outcomes presented in this report is moderate because it is based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to completing a post-secondary degree through MnDOC, but other factors might also have contributed.","MnDOC’s educational programs","Other training and education Reentry",Justice-involved,,"United States",2014, "The effects of prison-based educational programming on recidivism and employment","Duwe, G., & Clark, V. (2014). The effects of prison-based educational programming on recidivism and employment. The Prison Journal, 94(4), 454–478. [Comparison #1: between secondary degree completion and no secondary degree completion]",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study examined whether obtaining a secondary degree through Minnesota’s Department of Corrections (MnDOC) affected former inmates’ post-release employment, earnings, and recidivism. The authors also investigated whether obtaining a post-secondary degree impacted similar outcomes, the profile of which can be found here. The authors used a nonexperimental design (propensity score matching) to create a comparison group of former prisoners who were similar to the secondary degree program graduates but who did not complete a secondary degree while incarcerated. The authors estimated the program’s impact using data from the Minnesota Department of Employee and Economic Development, the Minnesota Bureau of Criminal Apprehension, and the Correctional Operations Management System database maintained by MnDOC. The authors found no relationship between completing a secondary degree and recidivism. The quality of causal evidence on recidivism outcomes presented in this report is moderate because it is based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects would have been attributable to completing a secondary degree through MnDOC if the study had found statistically significant effects.","MnDOC’s educational programs","Community college education and other classroom training Reentry Other training and education",Justice-involved,,"United States",2014, "An experimental evaluation of a nationally recognized employment-focused offender reentry program.","Farabee, D., Zhang, S. X., & Wright, B. (2014). An experimental evaluation of a nationally recognized employment-focused offender reentry program. Journal of Experimental Criminology, 10(3), 309–322.",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study examined the impact of an employment-focused offender reentry program (STRIVE) operated in Southern California on the education, employment, and recidivism outcomes of a sample of people released from prison or jail between 2008 and 2011. Study members were randomly assigned to either receive STRIVE services (the treatment) or a list of other resources in the community, but not STRIVE services (the control). The primary data sources were interviews conducted at baseline and 12 months after random assignment and administrative recidivism data provided by the California Department of Justice. The study found no statistically significant relationships between STRIVE and education, employment, or recidivism 12 months after random assignment. The study also found no statistically significant relationship between STRIVE and recidivism two years after random assignment. The quality of causal evidence presented in this report is low because it was based on a randomized controlled trial with fewer members of the control group participating in the study at follow-up than members of the STRIVE intervention group (thus, the study has high attrition). The authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects would have been attributable to the STRIVE program if the study had found statistically significant effects.","the STRIVE program","Reentry Other training and education",Justice-involved,,"United States",2014, "Retiree health insurance for public school employees: Does it affect retirement?","Fitzpatrick, M. D. (2014). Retiree health insurance for public school employees: Does it affect retirement? Journal of Health Economics, 38, 88-98.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Mixed impacts Employment","Summary: The study’s objective was to examine the impact of an Illinois Public Schools retiree health insurance program on the retirement rates of eligible staff ages 55 to 75. The study used a nonexperimental approach to compare the retirement rates of eligible staff with those of staff who were not eligible and staff in years prior to the introduction of the health insurance program who would have been eligible. The author used data from the Illinois Public Schools' Teacher Service Record database from 1970 to 1992. The study found that eligibility for the program was associated with an overall decrease in retirement age, with eligible staff more likely to retire at ages 55 or 56, but less likely to retire after age 65 compared with those who were not eligible for the program. The quality of the causal evidence presented in this report is low because the study is a nonexperimental analysis that does not account for possible differences in the groups. This means we are not confident that the estimated effects are attributable to the Illinois Public Schools Teachers Retirement Health Insurance Plan; other factors are likely to have contributed.","Illinois Public Schools Teachers Retirement Health Insurance Plan","Employer provided retirement benefits Health insurance Older workers' programs","Adult, Older worker",,"United States",2014,https://www.nber.org/papers/w19524 "Who pays the high health costs of older workers? Evidence from prostate cancer screening mandates.","Bailey, J. (2014). Who pays the high health costs of older workers? Evidence from prostate cancer screening mandates. Applied Economics, 46(32), 3931-3941. doi:10.1080/00036846.2014.948673","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Unfavorable impacts Earnings and wages Employment-Mod/high-Unfavorable impacts Employment","Summary: The study examined the impact of state mandates that health insurance plans cover prostate cancer screenings on the earnings and employment of men older than age 50 The study used nonexperimental regression analyses to compare older men in states that had enacted a mandate with women, younger men, and older men living in states without a mandate. The author used data from the Current Population Survey(CPS) between 1990 and 2009. The study found that older men in states with mandates had lower wages and were less likely than the comparison group to be employed. The quality of causal evidence presented in this study is moderate, because it is a well-implemented nonexperimental study. This means we are somewhat confident that the estimated effects are attributable to the prostrate screening mandate, but other factors might also have contributed.","Prostate cancer screening mandates","Health insurance Older workers' programs","Adult, Older worker, Male",,"United States",2014,https://sites.temple.edu/jamesbailey/files/2013/08/Who-Pays-the-High-Health-Cos… "The economics of federal tax and employment laws: Empirical evidence from three studies.","Figinski, T. F. (2013). The economics of federal tax and employment laws: Empirical evidence from three studies. (Doctoral dissertation). Retrieved from ProQuest. Accession No. 1415455735.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment Public benefits receipt-Low-Unfavorable impacts Public benefit receipt","Summary: The study examined the impact of removing the Social Security earnings test on Social Security claims, earnings, and labor force participation for female beneficiaries. The study used a statistical model and the data from the Social Security Administration’s Benefit and Earnings Public Use File to estimate impacts. The study found that removing the earnings test was associated with an increase in Social Security claims among women who were primary or spousal beneficiaries and with an increase in average earnings and in labor force participation among women who were primary beneficiaries. The qaulity of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the change in Social Security earings test. This means we are not confident that the estimated effects are attributable to the removal of the Social Security earnings test; other factors are likely to have contributed.","Social Security 2000 Earnings Test Removal","Federal retirement benefits Older workers' programs","Adult, Older worker, Female",,"United States",2014, "Did age discrimination protections help older workers weather the Great Recession?","Neumark, D., & Button, P. (2014). Did age discrimination protections help older workers weather the Great Recession? Journal of Policy Analysis and Management, 33(4), 566-601. doi:10.1002/pam.21762","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Unfavorable impacts Employment","Summary: The study examined whether the strong age discrimination laws moderated the impact of the Great Recession on employment outcomes of older workers. The study used statistical models and the data from the 2003–2011 Current Population Survey (CPS) and 2004–2011 Quarterly Workforce Indicators to estimate impacts. The study found that states with stronger age discrimination laws had experienced increases in unemployment rates, longer unemployment durations, and decreases in hiring rates for some types of older workers relative to younger workers in the months during and following the Great Recession. The quality of causal evidence presented in this study is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the differential effect of the Great Recession on older workers in states with strong age discrimination laws, but other factors might also have contributed.","Age Discrimination Laws","Older workers' programs Other disparities or discrimination in employment and earnings","Adult, Older worker, Female, Male",,"United States",2014,https://www.nber.org/papers/w19216 "Influential leadership in a diverse retail environment: implications for reducing voluntary employee turnover","Jackson, S. (2014). Influential leadership in a diverse retail environment: implications for reducing voluntary employee turnover. (Doctoral dissertation). Retrieved from ProQuest. Accession No. 1640901590.","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of a retail store management intervention on voluntary employee turnover. The author used a nonexperimental design to compare the rate of voluntary turnover of employees in stores whose management received the intervention with the rate of stores in the same retail chain whose management did not. The author estimated impacts using store administrative data on employee turnovers as well as an employee opinion survey. The study found that treatment group stores experienced a decrease in voluntary employee turnover and that the comparison group stores did not. The author did not test this outcome statistically. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the retail store management intervention; other factors are likely to have contributed.","the retail store management intervention","Other training and education",Employed,,"United States",2014,https://scholarworks.waldenu.edu/cgi/viewcontent.cgi?referer=https%3A//scholar… "A comparison of student outcomes and overall retention between a 10-week accelerated and a 15-week traditional curriculum in a postsecondary apprenticeship training program","Adams, G. (2013). A comparison of student outcomes and overall retention between a 10-week accelerated and a 15-week traditional curriculum in a postsecondary apprenticeship training program (Doctoral dissertation). Available from ProQuest Dissertations & Theses A&I. (Accession No. 3575536).","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Training-Low-Favorable impacts Training","Summary: The study’s objective was to examine the impact of compressed delivery of a World Class Shipbuilding apprenticeship program on program retention. The Apprentice School of Newport News Shipbuilding compressed its delivery of program instructional hours from 75 weeks (five 15-week terms) to 40 weeks (four 10-week terms) in January 2009. The author compared administrative data on program completion for all apprentices who enrolled at the school from January 2004 to December 2008 (the comparison group) with those who enrolled from January 2009 to June 2012 (the treatment group). The study found that students who enrolled in the 40-week program were 17 percentage points more likely to be retained in the program than students who enrolled in the 75-week program, a statistically significant finding. The quality of causal evidence presented in this report is low because the treatment and comparison groups were not equivalent before the intervention, and the author did not adjust for these differences during analysis. This means we are not confident that the estimated effects are attributable to the compression of the apprenticeship program; other factors are likely to have contributed.","the Apprentice School of Newport News Shipbuilding","Registered apprenticeship Work based and other occupational training",Adult,Manufacturing,"United States",2013, "“Somebody who was on my side:” A qualitative examination of Youth Initiated Mentoring","Spencer, R., Tugenberg, T., Ocean, M., Schwartz, Sarah E., & Rhodes, J. (2013). “Somebody who was on my side:” A qualitative examination of Youth Initiated Mentoring. Youth & Society, 1-23.","Opportunities for Youth","Study Type: Descriptive Analysis",,,"Summary: This report explored and described in detail the experiences of youth in a mentoring program known as Youth Initiated Mentoring. The youth were 16- to 18-year-old school dropouts who were a part of national study of the National Guard Youth ChalleNGe program. As part of Youth Initiated Mentoring, youth had to identify and recruit their own mentors, as opposed to a traditional mentoring process in which a program selects a mentor for the youth. The authors conducted retrospective qualitative interviews with a sample of 30 former ChalleNGe participants. To analyze the data, the authors used an iterative thematic approach to identify important themes. The analysis found that most participants selected mentors they knew from prior relationships or with whom they had similar background and/or experiences, such as family, family friends, and individuals connected with the school or in the community. Mentors encouraged youth to meet their goals, raised their self- esteem and confidence, and improved their relationships with others. Mentors were also viewed as important to youths’ completion of the ChalleNGe program.","Youth Initiated Mentoring in the National Guard Youth ChalleNGe","Mentoring Youth programs",Youth,,"United States",2013, "Mentor status, occupational context, and protégé career outcomes: Differential returns for males and females","Dougherty, T. W., Dreher, G. F., Arunachalam, V., & Wilbanks, J. E. (2013). Mentor status, occupational context, and protégé career outcomes: Differential returns for males and females. Journal of Vocational Behavior, 83(3), 514-527. [Study 1, Contrast 1: senior male mentor versus no mentor]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages","Summary: The study’s objective was to examine the role of informal mentoring on annual compensation, as well as the moderating effects of mentor status and gender. The authors investigated similar research questions in other studies, the profiles of which are available [here]. The authors used statistical methods to analyze self-reported data on earnings, mentoring relationships, and employee characteristics collected through questionnaires administered to graduates of business programs at two large state universities. The study found that employees with senior mentors who were male earned more compensation than those with no mentors. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to informal mentoring; other factors are likely to have contributed.",Mentoring,"Other wages and benefits Mentoring","Adult, Employed",,"United States",2013,https://doi.org/10.1016/j.jvb.2013.08.001 "Mentor status, occupational context, and protégé career outcomes: Differential returns for males and females","Dougherty, T. W., Dreher, G. F., Arunachalam, V., & Wilbanks, J. E. (2013). Mentor status, occupational context, and protégé career outcomes: Differential returns for males and females. Journal of Vocational Behavior, 83(3), 514-527. [Study 1, Contrast 2: other mentor versus no mentor]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages","Summary: The study’s objective was to examine the role of informal mentoring on annual compensation, as well as the moderating effects of mentor status and gender. The authors investigated similar research questions in other studies, the profiles of which are available [here]. The authors used statistical methods to analyze self-reported data on earnings, mentoring relationships, and employee characteristics collected through questionnaires administered to graduates of business programs at two large state universities. The study found no statistically significant difference in compensation between study participants with non-senior mentors and those with no mentors. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that any estimated effects would be attributable to informal mentoring; however, the study did not find any statistically significant effects.",Mentoring,"Other wages and benefits Mentoring","Adult, Employed",,"United States",2013,https://doi.org/10.1016/j.jvb.2013.08.001 "Mentor status, occupational context, and protégé career outcomes: Differential returns for males and females","Dougherty, T. W., Dreher, G. F., Arunachalam, V., & Wilbanks, J. E. (2013). Mentor status, occupational context, and protégé career outcomes: Differential returns for males and females. Journal of Vocational Behavior, 83(3), 514-527. [Study 2, Contrast 1: senior mentor versus no mentor]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages","Summary: The study’s objective was to examine the role of informal mentoring on annual compensation, as well as the moderating effects of mentor status. The authors investigated similar research questions in other studies, the profiles of which are available [here]. The authors used statistical methods to analyze self-reported data on earnings, mentoring relationships, and employee characteristics collected through questionnaires administered to the software engineering department of a major aerospace manufacturing firm. The study found no statistically significant differences between the earnings of employees with senior mentors and those with no mentors. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that any estimated effects would be attributable to informal mentoring; however, the study did not find any statistically significant effects.",Mentoring,"Other wages and benefits Mentoring","Adult, Employed",,"United States",2013,https://doi.org/10.1016/j.jvb.2013.08.001 "Mentor status, occupational context, and protégé career outcomes: Differential returns for males and females","Dougherty, T. W., Dreher, G. F., Arunachalam, V., & Wilbanks, J. E. (2013). Mentor status, occupational context, and protégé career outcomes: Differential returns for males and females. Journal of Vocational Behavior, 83(3), 514-527. [Study 2, Contrast 2: non-senior mentor versus no mentor]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages","Summary: The study’s objective was to examine the role of informal mentoring on annual compensation, as well as the moderating effects of mentor status. The authors investigated similar research questions in other studies, the profiles of which are available [here]. The authors used statistical methods to analyze self-reported data on earnings, mentoring relationships, and employee characteristics collected through questionnaires administered to the software engineering department of a major aerospace manufacturing firm. The study found no statistically significant differences between the earnings of employees with non-senior mentors and those with no mentors. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that any estimated effects would be attributable to informal mentoring; however, the study did not find any statistically significant effects.",Mentoring,"Other wages and benefits Mentoring","Adult, Employed",,"United States",2013,https://doi.org/10.1016/j.jvb.2013.08.001 "Does federally-funded job training work? Nonexperimental estimates of WIA training impacts using longitudinal data on workers and firms","Andersson, F., Holzer, H. J., Lane, J. I., Rosenblum, D., & Smith, J. (2013). Does federally-funded job training work? Nonexperimental estimates of WIA training impacts using longitudinal data on workers and firms (Discussion paper no. 7621). Bonn, Germany: IZA. [Adult Program ONLY]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Mixed impacts Earnings and wages Employment-Mod/high-Mixed impacts Employment","Summary: The study’s objective was to examine the impact of the Workforce Investment Act (WIA) adult program’s training services on the employment and earnings of low-income adults. The authors investigated similar research questions in another study, whose profile can be found [here]. The other study examined the effects of WIA’s dislocated worker program’s training services on the employment and earnings of dislocated workers. The authors used statistical analysis to compare the earnings and employment outcomes of WIA-registered low-income adults who received training services to the outcomes of those who were registered in WIA, but did not receive training services. The study found that employment was significantly lower for the treatment group than it was for the comparison group in the first quarters after WIA registration (Quarters 1 and 2 in State A and Quarters 1–4 in State B), but later became and generally stayed significantly higher in Quarters 6 through 12 in both states. Total earnings in the third year after WIA registration were significantly higher for the treatment group than the comparison group. People in the treatment group earned $1,257 and $1,703 more than those in the comparison group in State A and State B, respectively. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design; this is the highest causal evidence rating possible for a nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the WIA adult program training services, but other factors might also have contributed to the effects.","Workforce Investment Act (WIA) Program Training Services","Adult and Dislocated Worker programs Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA)","Unemployed, Low income",,"United States",2013,https://www.nber.org/papers/w19446.pdf "Does federally-funded job training work? Nonexperimental estimates of WIA training impacts using longitudinal data on workers and firms","Andersson, F., Holzer, H. J., Lane, J. I., Rosenblum, D., & Smith, J. (2013). Does federally-funded job training work? Nonexperimental estimates of WIA training impacts using longitudinal data on workers and firms (Discussion paper no. 7621). Bonn, Germany: IZA. [Dislocated Worker Program ONLY]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Mixed impacts Earnings and wages Employment-Mod/high-Mixed impacts Employment","Summary: The study’s objective was to examine the impact of the Workforce Investment Act (WIA) dislocated worker program’s training services on the employment and earnings of dislocated workers. The authors investigated similar research questions in another study. The other study examined the effects of WIA’s adult program’s training services on the employment and earnings of low-income adults. The authors used a regression model with inverse propensity weights to compare the earnings and employment outcomes of WIA-registered dislocated workers who received training services to the outcomes of those who were registered in WIA, but did not receive training services. The study found that employment was initially significantly lower for the treatment group than for the comparison group in the quarters after WIA registration (Quarters 1 and 2 in State A and Quarters 1–4 in State B), but later became and stayed significantly higher in general in Quarters 6 through 12 in both states. The treatment group earned significantly less than the comparison group in the three years after WIA registration. People in the treatment group earned an average of $5,567 and $5,227 less than those in the comparison group in State A and State B, respectively. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design; this is the highest causal evidence rating possible for a nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the training services received from the WIA dislocated workers program, but other factors might also have contributed.","the Workforce Investment Act (WIA) Dislocated Worker Program","Adult and Dislocated Worker programs Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA)","Dislocated or displaced worker",,"United States",2013,https://www.nber.org/papers/w19446.pdf "The impact of career mentoring and psychosocial mentoring on affective organizational commitment, job involvement, and turnover intention","Craig, C. A., Allen, M. W., Reid, M. F., Riemenschneider, C. K., & Armstrong, D. J. (2013). The impact of career mentoring and psychosocial mentoring on affective organizational commitment, job involvement, and turnover intention. Administration & Society, 45(8), 949–973. doi:10.1177/0095399712451885","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Mixed impacts Employment","Summary: This study examines the relationship between mentoring and employees’ employment outcomes. Specifically, the study examines the relationship between psychosocial mentoring and turnover intention. The authors used a statistical model in a nonexperimental analysis to determine the relationship between mentoring and employment outcomes using data from a convenience sample of information technology (IT) staff in one state agency of a state located in the south-central region of the United States. The study found a statistically significant favorable relationship between one type of mentoring, psychosocial mentoring, and turnover intention. In other words, if a respondent reported participating in psychosocial mentoring, they tended to be less likely to intend to leave the job. There was no statistically significant relationship between the other type of mentoring in the study, career mentoring, and turnover intention. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups compared were similar before the intervention. This means we are not confident that the estimated relationships are attributable to psychosocial mentoring; other factors are likely to have contributed.",,Mentoring,"STEM professional","Professional, scientific, and technical services","United States",2013,https://journals.sagepub.com/doi/10.1177/0095399712451885 "Veterans Health Administration vocational services for Operation Iraqi Freedom/Operation Enduring Freedom Veterans with mental health conditions","Twamley, E., Baker, D., Norman, S., Pittman, J., Lohr, J., & Resnick, S. (2013). Veterans Health Administration vocational services for Operation Iraqi Freedom/Operation Enduring Freedom Veterans with mental health conditions. Journal of Rehabilitation Research & Development, 50(5), 663-670.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: This study examined the impact of supported employment encounters on competitive employment for Operation Iraqi Freedom/Operation Enduring Freedom (OIF/OEF) veterans with mental health conditions. The study used statistical tests to examine differences between groups of OIF/OEF veterans with specified mental health conditions who had at least one supported employment encounter versus those who did not. The data for this study came from two nationwide Veterans Health Administration (VHA) databases for fiscal years 2008 and 2009. The study showed that having at least one supported employment encounter was associated with obtaining competitive employment. The quality of causal evidence presented in this report is low because the authors were not able to establish that the treatment and comparison groups were similar before the intervention. This means we are not confident that the estimated effects are attributable to VHA-supported employment encounters; other factors likely contributed to the effects.",,"Job search assistance and supportive services Veterans' reemployment","Veteran or military",,"United States",2013,https://doi.org/10.1682/jrrd.2012.08.0137 "Effects of structured vocational services in ex-offender veterans with mental illness: 6-month follow-up","LePage, J. P., Lewis, A. A., Washington, E. L., Davis, B., & Glasgow, A. (2013). Effects of structured vocational services in ex-offender veterans with mental illness: 6-month follow-up. Journal of Rehabilitation Research & Development, 50(2), 183-191. doi:10.1682/JRRD.2011.09.0163 [Full About Face vs. self-study]","Reentry, Veterans","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: This study examined the impact of About Face (AF) vocational classes on competitive employment. In this nonexperimental study, the authors used statistical analyses to compare the employment outcomes of two groups of justice-involved veterans: (1) those who participated in the AF classes (full AF program) and (2) those who did not take the classes but had access to the AF manual to study on their own (self-study program). The authors collected monthly data from participants in person or over the phone. The study revealed significantly higher competitive employment among justice-involved veterans in the full AF program (40.7 percent hired) than in the self-study condition (11.9 percent hired). The study also showed that justice-involved veterans in the full AF program worked more months on average than justice-involved veterans in the self-study condition (1.37 months vs. 0.16 months). The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the AF program; other factors likely contributed to the findings.","About Face","Job search assistance and supportive services Veterans' reemployment","Veteran or military",,"United States",2013,https://www.rehab.research.va.gov/JOUR/2013/502/pdf/lepage502.pdf "Effects of structured vocational services in ex-offender veterans with mental illness: 6-month follow-up","LePage, J. P., Lewis, A. A., Washington, E. L., Davis, B., & Glasgow, A. (2013). Effects of structured vocational services in ex-offender veterans with mental illness: 6-month follow-up. Journal of Rehabilitation Research & Development, 50(2), 183-191. doi:10.1682/JRRD.2011.09.0163 [Full About Face vs. VERC]","Reentry, Veterans","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study examined the impact of About Face (AF) vocational classes on competitive employment. In this nonexperimental study, the authors used statistical analyses to compare the employment outcomes of two groups of veterans: (1) those who participated in the AF classes (full AF program) and (2) those who only had access to the Veterans Employment Resource Center (VERC). The authors collected monthly data from participants in person or over the phone. The study revealed significantly higher competitive employment in the full AF program (40.7 percent hired) than in the VERC-only condition (16.7 percent hired). The study also showed that veterans in the full AF program worked more months on average than veterans in the VERC-only condition (1.37 months vs. 0.35 months). The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the AF program; other factors likely contributed to the findings.","About Face","Job search assistance and supportive services Veterans' reemployment","Veteran or military",,"United States",2013,https://www.rehab.research.va.gov/JOUR/2013/502/pdf/lepage502.pdf "Effects of structured vocational services in ex-offender veterans with mental illness: 6-month follow-up","LePage, J. P., Lewis, A. A., Washington, E. L., Davis, B., & Glasgow, A. (2013). Effects of structured vocational services in ex-offender veterans with mental illness: 6-month follow-up. Journal of Rehabilitation Research & Development, 50(2), 183-191. doi:10.1682/JRRD.2011.09.0163 [Self-study vs. VERC]","Reentry, Veterans","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-No impacts Employment","Summary: The study examined the impact of self-study of the About Face (AF) manual on competitive employment. In this nonexperimental study, the authors used statistical analyses to compare the employment outcomes of two groups of justice-involved veterans: (1) those who had access to the AF manual to study on their own (self-study program) and (2) those who only had access to the Veterans Employment Resource Center (VERC). The authors collected monthly data from participants in person or over the phone. The study showed no significant differences in competitive employment between the self-study condition (11.9 percent hired) and the VERC-only condition (16.7 percent hired). The study also showed no significant differences in average months employed (0.16 months for the self-study condition and 0.35 months for the VERC-only condition). The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the AF manual; other factors likely contributed to the findings.","About Face","Job search assistance and supportive services Veterans' reemployment","Veteran or military",,"United States",2013,https://www.rehab.research.va.gov/JOUR/2013/502/pdf/lepage502.pdf "Shape-coding and length-coding as a measure to reduce the probability of selection errors during the control of industrial equipment","Steiner, L. J., & Burgess-Limerick, R. (2013). Shape-coding and length-coding as a measure to reduce the probability of selection errors during the control of industrial equipment. IIE Transactions on Occupational Ergonomics and Human Factors, 1(4), 224-234. https://doi.org/10.1080/21577323.2013.844209","Mine Workers and Mine Health and Safety","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Health and safety-Low-Favorable impacts Health and safety Health and safety-Mod/high-Favorable impacts Health and safety","Summary: The study’s objective was to examine the impact of shape-coding and length-coding of roof-bolting machine levers on selection errors made when controlling the machines. The authors conducted three separate laboratory experiments to test the role of shape-coding and length-coding of roof-bolting machine levers on the amount of selection errors made by participants. In experiments 1 and 2, participants were randomized into different lever conditions (shape-coded, length-coded, or non-coded). In experiment 3, the participants used shape-coded levers only and the lever order was changed half-way through the experiment. The study found that the proportion of errors significantly improved over time for all lever conditions, indicating a learning effect. The study also found that participants in the length-coded group made significantly fewer selection errors than those in the non-coded group when the order of levers changed. The quality of causal evidence presented in this report is high for experiments 1 and 2 because they were based on well-implemented randomized controlled trials. This means we are confident that the estimated effects are attributable to shape-coding and length-coding, and not to other factors. The quality of causal evidence provided in this study is low for experiment 3 because there are not sufficient pre and post measures of the outcome. This means that we are not confident that the estimated effects are attributable to shape-coding; other factors are likely to have contributed.",,"Mine safety and health Workplace injury",Adult,,"United States",2013,https://doi.org/10.1080/21577323.2013.844209 "Effect of control order on steering a simulated underground coal shuttle car","Burgess-Limerick, R., Zupanc, C., & Wallis, G. (2013). Effect of control order on steering a simulated underground coal shuttle car. Applied Ergonomics, 44(2), 225-229. https://doi.org/10.1016/j.apergo.2012.07.007","Mine Workers and Mine Health and Safety","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Health and safety-Mod/high-Favorable impacts Health and safety","Summary: The study’s objective was to examine the impact of first-order and second-order joystick controls on mining shuttle car steering accuracy over multiple trials. The study was a randomized controlled trial conducted in a laboratory setting. The authors compared the steering accuracy of mining shuttle car operators when the operators were using a first-order versus second-order joystick steering mechanism and how the accuracy varied with repeated trials. The study found that the operators using the first-order joystick control had significantly better steering accuracy than those using the second-order joystick control. Both groups significantly improved over the three trials and the difference in the performance of the two groups lessened over the three trials. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the joystick mechanism, and not to other factors.",,"Mine safety and health Workplace injury",,"Mining, quarrying, and oil and gas extraction","United States",2013,https://doi.org/10.1016/j.apergo.2012.07.007 "The impact of veterans’ preference on the composition and quality of the federal civil service","Lewis, G. B. (2013). The impact of veterans’ preference on the composition and quality of the federal civil service. Journal of Public Administration Research & Theory, 23(2), 247-265.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Mixed impacts Employment","Summary: The study’s objective was to examine the impact the federal practice of giving preference to veterans during the federal employment hiring process had on federal employment. The author used a nonexperimental design to compare federal employment outcomes of veterans and non-veterans, drawing on data from the 1990 and 2000 U.S. Census, the American Community Surveys from 2006–2009, and federal employee personnel records from the Central Personnel Data File from 2000–2009. The study found that the odds of federal employment compared to private-sector employment were 2.7 to 4.4 times greater for veterans than non-veterans. The study also found that veterans advanced slower than non-veterans after 5 and 10 years of employment. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the veterans’ preference policy in federal hiring; other factors are likely to have contributed.","Veterans’ Preference Policy in Hiring for Federal Government Positions","Veterans' reemployment","Veteran or military",,"United States",2013,https://academic.oup.com/jpart/article-abstract/23/2/247/1000440 "Impact evaluation: Combating worst forms of child labor by reinforcing policy response and promoting sustainable livelihoods and educational opportunities in Egypt, 2011-2012","ICF International. (2013). Impact evaluation: Combating worst forms of child labor by reinforcing policy response and promoting sustainable livelihoods and educational opportunities in Egypt, 2011-2012. Calverton, MD: Author.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The purpose of the study was to examine the impact of Combating Worst Forms of Child Labor by Reinforcing Policy Response and Promoting Sustainable Livelihoods and Educational Opportunities in Egypt (CWCLP) on schooling and work for children ages 6 to 11 (at the time of the baseline survey). Using survey data from a randomized controlled trial, the authors analyzed the impact of the CWCLP program on schooling and work after approximately 12-16 months of implementation (the timing of implementation varied). When compared to control group children, the study found that CWCLP participating children spent significantly less time in economic activities and unpaid household services and significantly more time in school-related activities. Participating children also had significantly higher school enrollment and significantly higher school attendance than children in the control group. The quality of causal evidence presented in this report is moderate because, although it was based on a randomized controlled trial with high attrition, the authors demonstrated that the treatment and control groups were similar before the intervention. This means we are somewhat confident that the estimated effects are attributable to the CWCLP program, but other factors might also have contributed.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2013, "Youth Initiated Mentoring: Investigating a new approach to working with vulnerable adolescents","Schwartz, S., Rhodes, J., Spencer, R., & Grossman, J. (2013). Youth Initiated Mentoring: Investigating a new approach to working with vulnerable adolescents. American Journal of Community Psychology, 52, 155–169.","Opportunities for Youth","Study Type: Descriptive Analysis",,,"Summary: The study examined Youth Initiated Mentoring (YIM) within the context of the National Guard Youth ChalleNGe Program (NGYCP). Unlike a traditional mentoring program in which mentors are assigned to youth, under YIM, youth nominate their own mentors. The authors conducted a quantitative analysis using data from the 9-, 21- and 38-month follow-up surveys administered as part of a national evaluation of NGYCP, along with qualitative analysis of interviews with a subsample of NGYCP participants. The study found that YIM mentors included family friends, extended family members and godparents, school and extracurricular staff, and religious leaders. By the 38-month follow-up survey, 56 percent of youth reported still being in contact with their mentors. In addition, NGYCP youth who were in contact with their mentors at the 38-month follow-up showed significant benefits on a range of outcomes compared with the control group.","Youth Initiated Mentoring in the National Guard Youth ChalleNGe","Mentoring Youth programs","Youth, Disconnected youth",,"United States",2013, "BOND implementation and evaluation: First-year snapshot of earnings and benefit impacts for Stage 1","Stapleton, D., Wittenburg, D., Gubits, D., Judkins, D., Mann, D.R., & McGuirk, A. (2013). BOND implementation and evaluation: First-year snapshot of earnings and benefit impacts for Stage 1. Cambridge, MA: Abt Associates, Inc.; Princeton, NJ: Mathematica Policy Research.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Public benefits receipt-Mod/high-No impacts Public benefit receipt Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to measure eight-month impacts for Stage 1 of the Benefit Offset National Demonstration (BOND), which tested whether a more-generous work incentive for Social Security Disability Insurance (SSDI) recipients affected their employment rates, earnings, and reliance on benefits.  The study was a randomized controlled trial; eligible SSDI recipients were randomly assigned to the treatment group, which was eligible for the benefit offset, or a control group that was not. The authors analyzed data from the Master Earnings File (MEF), Master Beneficiary Record (MBR), and Supplemental Security Record (SSR). The study found that the BOND intervention had no significant impact on total earnings or total SSDI benefits paid over the eight-month follow-up period. The quality of causal evidence presented in this report is high because it is based on a well-conducted randomized controlled trial. This means we are confident that the effects estimated in the study are attributable solely to the BOND, and not to other factors.","the Benefit Offset National Demonstration","Disability insurance Other wages and benefits Supplemental security income (SSI)",Disability,,"United States",2013,http://www.ssa.gov/disabilityresearch/documents/BOND_Deliverable%2024c1_DRAFT_S… "Initial impacts of the Ticket to Work program for young new Social Security disability awardees: Estimates based on randomly assigned mail months","Stapleton, D., Mamun, A., & Page, J. (2013). Initial impacts of the Ticket to Work program for young new Social Security disability awardees: Estimates based on randomly assigned mail months. Princeton, NJ: Mathematica Policy Research, Center for Studying Disability Policy.","Disability Employment Policy, Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment","Summary: This study examined impacts of the Ticket to Work (TTW) program, a work incentive program for Social Security disability recipients, on achieving Social Security Disability Insurance (SSDI) return-to-work earnings benchmarks and SSDI benefit suspension or termination for work. The study sample included SSDI recipients who entered the rolls from July 1999 to October 2003, were ages 18 to 39, and were not concurrently receiving Supplemental Security Income (SSI). The authors used data from the Ticket Research File (TRF), a Social Security administrative data file, for the analysis. The study found that TTW did not have a statistically significant impact on SSDI return to work earnings benchmarks or the number of SSDI recipients who had their benefits suspended or terminated due to work. The quality of the causal evidence presented in this report is moderate, the highest possible rating for a nonexperimental study. This means we are somewhat confident that the estimated effects are attributable to TTW, but other factors might have contributed.","Ticket to Work","Disability insurance Supplemental security income (SSI) Supported employment or other employment supports","Disability, Low income",,"United States",2013,http://www.mathematica-mpr.com/~/media/publications/pdfs/disability/ttw_initial… "Trends in the Composition and Outcomes of Young Social Security Disability Awardees","Ben-Shalom, Yonatan, and Stapleton, David. (2013). Trends in the Composition and Outcomes of Young Social Security Disability Awardees. Michigan Retirement Research Center (MRRC) working paper, WP 2013-284. Retrieved from http://www.mrrc.isr.umich.edu/publications/papers/pdf/wp284.pdf.","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: A large share of new Social Security Disability (SSD) recipients—workers with disabilities and adult children with disabilities—are younger than 40. Better information on the backgrounds, impairments, personal characteristics, and employment outcomes of these recipients would help policymakers develop programs tailored to the needs and circumstances of various subgroups of such recipients. This study used administrative data on young SSD awardees first awarded benefits from 1996 to 2007 to examine trends in their composition and outcomes. Most of the data come from the 2009 version of the Disability Analysis File, a data file originally constructed to support analysis of the effects of the Ticket to Work program. The study found that the composition of young SSD awardees changed substantially during this period. It also found that young awardees differed from older SSD awardees along many dimensions other than age. The findings raised several important policy issues. Most important, policymakers have to consider other options for the support of youth and young adults with disabilities—options that do not discourage work while promoting dependence.",,"Disability insurance Supplemental security income (SSI)","Disability, Youth",,"United States",2013, "Return-to-Work Outcomes among Social Security Disability Insurance Program Beneficiaries","Ben-Shalom, Yonatan, and Mamun, Arif. (2013). Return-to-Work Outcomes among Social Security Disability Insurance Program Beneficiaries. Princeton, NJ: Mathematica Policy Research, Center for Studying Disability Policy.","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: This study followed a sample of working-age Social Security Disability Insurance (DI) program recipients for five years after their first benefit award to describe how certain factors helped or hindered their return-to-work outcomes. The study used linear probability models to estimate how individual and environmental factors were associated with achieving return-to-work milestones, across seven primary impairment groups: affective disorders, other psychiatric disorders, intellectual disability, sensory impairments, back disorders, other musculoskeletal disorders, and other physical disorders. The study found that the probability of achieving employment milestones increased with sensory impairments, being black, years of education, and DI award at initial adjudication level. It decreased with age at DI award, back and other musculoskeletal disorders, higher levels of DI benefits at award, receipt of Supplemental Security Income or Medicare at time of DI award, age, and higher state unemployment rates, among other factors. The study also found that differences across age and impairment group persisted after accounting for other characteristics.",,"Disability insurance Supplemental security income (SSI)",Disability,,"United States",2013, "Linking Youth Transition Support Services: Results from Two Demonstration Projects","Camacho, Christa B., & Hemmeter, Jeffrey. (2013). Linking Youth Transition Support Services: Results from Two Demonstration Projects. Social Security Bulletin, 73(1).","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: This study explored the findings of a 2003–2009 evaluation of the Youth Transition Demonstration (YTD) program, which offered employment and self-sufficiency services and other support services to transition-age youth with disabilities. The study used a sample of youth ages 14 to 25 with disabilities, who were served by 2 of the 10 YTD projects in operation. It summarized the outcomes of 2 YTD projects and described the experiences of one youth from each of the 2 projects who successfully completed the program. The study found that youth who received enhanced transition services and used YTD waivers of Social Security Administration program rules had many YTD program successes; however, the project duration was too short to yield long-term findings. Although the outcomes reported in this article were not causal, they suggested that youth with disabilities can enter the workforce and achieve some self-sufficiency.",,"Disability insurance Supplemental security income (SSI) Youth programs","Youth, Disability",,"United States",2013,http://www.ssa.gov/policy/docs/ssb/v73n1/v73n1p59.html "The impact of a written benefits analysis by Utah benefit counseling/WIPA program on vocational rehabilitation outcomes","Wilhelm, S., and McCormick, S. (2013). The impact of a written benefits analysis by Utah benefit counseling/WIPA program on vocational rehabilitation outcomes. Journal of Vocational Rehabilitation 39, 219–222.","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: This report examined whether a written benefits analysis provided as part of the Utah Benefits Planning Assistance & Outreach Program Vocational Rehabilitation (VR) program was associated with the employment and earnings outcomes and closure status of VR clients that received the benefits analysis compared with those who did not. For people who had at least one change in employment status over the study period, a multivariate analysis tested the difference in employment between the two groups. On average, those who received a written analysis were 18.4 percent more likely to be employed than those who did not. However, for those employed at least one of the quarters, having a written analysis was not associated with an increase in their earnings.",,"Vocational rehabilitation",Disability,,"United States",2013, "Predictors of financial self-sufficiency among Social Security beneficiaries with psychiatric disabilities","Russinova, Zlatka, Rogers, E. Sally, Langer Ellison, Marsha, Bloch, Philippe, Lyass, Asya, & Wewiorski, Nancy. (2013). Predictors of financial self-sufficiency among Social Security beneficiaries with psychiatric disabilities. Journal of Vocational Rehabilitation, 38, 49–66.","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: This study explored factors associated with the capacity of Social Security recipients with psychiatric disabilities to leave the Social Security disability rolls due to substantial gainful work activity. Data were from a survey conducted from May 2004 to January 2005 as part of a subsequent study of 213 participants in an earlier intervention that offered mental health treatment and assistance in finding competitive jobs to adults with psychiatric disabilities. Results suggested that people with higher occupational status, higher levels of proactive coping skills, and without medical comorbidities were more likely than other beneficiaries with psychiatric disabilities to terminate Social Security disability benefits and achieve financial self-sufficiency due to gainful employment.",,"Health Disability insurance Supplemental security income (SSI) Job search assistance and supportive services",Disability,,"United States",2013, "Can benefits and work incentives counseling be a path to future economic self-sufficiency for SSI/SSDI beneficiaries?","Nazarov, Z. (2013). Can benefits and work incentives counseling be a path to future economic self-sufficiency for SSI/SSDI beneficiaries? Center for Retirement Research Working Paper 17.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages","Summary: This study’s objective was to determine whether benefits and work incentives counseling provided by New York State’s vocational rehabilitation (VR) agency increased earnings and increased the number of hours worked among Social Security disability benefit recipients. The primary data source for this study was New York State administrative data. The author conducted an instrumental variables analysis and a propensity score matching analysis. Weekly earnings for individuals who received benefits and work incentives counseling were higher than earnings among nonrecipients, with differences estimated between 40 and 31 percent by instrumental variables analysis, and between 12.5 and 10.9 percent by propensity score matching. The effect of benefits and work incentives counseling on case closure was estimated to be positive under both methods but was not statistically significant. The quality of causal evidence provided in this study is moderate. This means we are somewhat confident that the estimated effects are attributable to the counseling, but other factors might also have contributed.","the Vocational Rehabilitation (VOC) Programs","Disability insurance Supplemental security income (SSI) Vocational rehabilitation",Disability,,"United States",2013,http://crr.bc.edu/working-papers/can-benefits-and-work-incentives-counseling-be… "Enhancing GED instruction to prepare students for college and careers: Early success in LaGuardia Community College’s Bridge to Health and Business program","Martin, V. & Broadus, J. (2013). Enhancing GED instruction to prepare students for college and careers: Early success in LaGuardia Community College’s Bridge to Health and Business program. New York: MDRC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of LaGuardia Community College’s general educational development (GED) Bridge to Health and Business program on GED completion, college enrollment, and college persistence. The study was a randomized controlled trial. Eligible students (369 in total) were randomly assigned to either the treatment group, which could participate in the GED Bridge program, or the control group, which could not participate in the GED Bridge program but could participate in a traditional GED preparation course. The study found that, compared with students randomly assigned to the traditional GED Prep course, those offered enrollment in the GED Bridge to Health and Business program were more likely to complete the GED course, pass the GED exam within a year, enroll in a City University of New York (CUNY) community college by the end of the study, and reenroll for a second semester at a CUNY community college by the end of the study. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the GED Bridge to Health and Business program, and not to other factors.","the GED Bridge to Health and Business Program","Basic skills Community college education and other classroom training","Adult, Other barriers, Low income",,"United States",2013,http://www.mdrc.org/sites/default/files/Enhancing_GED_Instruction_brief.pdf "Stimulating opportunity: An evaluation of ARRA-funded subsidized employment programs","Roder, A. & Elliott, M. (2013). Stimulating opportunity: An evaluation of ARRA-funded subsidized employment programs. New York: Economic Mobility Corporation. Retrieved from http://economicmobilitycorp.org/uploads/stimulating-opportunity-full-report.pdf.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of subsidized employment programs in five states on the employment and earnings outcomes of unemployed people. The focus of this profile is Florida’s Back to Work program, which placed participants in partially subsidized jobs in which employers were expected to cover 5 to 20 percent of the employee’s wages for up to one year. For the evaluation of the Florida Back to Work program, the authors used administrative wage data to compare the employment and earnings outcomes of program participants with the employment and earnings outcomes of a similar group of people who were not placed in subsidized employment. The study found that participants in Florida Back to Work were more likely to be employed and earned $1,921 more in the year following the program than those in the comparison group. The quality of causal evidence presented in this report is low because the authors did not include sufficient controls in their analysis. This means we are not confident that the estimated effects are attributable to the subsidized employment program. Other factors are likely to have contributed.","Florida's Back to Work Program","Other employment and reemployment","Unemployed, Low income",,"United States",2013,http://economicmobilitycorp.org/uploads/stimulating-opportunity-full-report.pdf "Preventing youth violence and dropout: A randomized field experiment (No. w19014)","Heller, S., Pollack, H. A., Ander, R., & Ludwig, J. (2013). Preventing youth violence and dropout: A randomized field experiment (No. w19014). Cambridge, MA: National Bureau of Economic Research.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Becoming a Man program on arrest and educational outcomes. The study was a randomized controlled trial. Eligible male youth from 18 public schools in disadvantaged neighborhoods were screened for eligibility. The 2,740 who met requirements were randomly assigned to one of three treatment groups or a control group. The study found that being offered the opportunity to participate in the program reduced violent crime arrests during the program year and improved schooling outcomes in both the program and follow-up years. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Becoming a Man program, and not to other factors.","Becoming a Man","Other training and education Safety Youth programs Behavioral Interventions","Youth, Disconnected youth, Male, Low income",,"United States, Urban",2013,http://faculty.chicagobooth.edu/workshops/AppliedEcon/past/pdf/jensludwigyouthv… "Not lack of ability but more choice: Individual and gender differences in choice of careers in science, technology, engineering, and mathematics","Wang, M., Eccles, J., & Kenny, S. (2013). Not lack of ability but more choice: Individual and gender differences in choice of careers in science, technology, engineering, and mathematics. Psychological Science, 24(5), 770-775.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: This paper examined whether people with high math and verbal abilities were more likely to work in STEM occupations at the age of 33 compared with people with high math but only moderate verbal abilities. The authors also considered whether employment in STEM occupations varied by gender. The authors surveyed 1,490 people drawn from a national longitudinal study in the United States—once in 1992 when the respondents were in 12th grade and again in 2007 when the respondents were 33 years old—to ask about occupation type. They also collected math and verbal Scholastic Assessment Test (SAT) scores for these people, as well as the number of high school mathematics courses taken and parental reports of parental education and family income. The authors used regression analyses of longitudinal survey data and other descriptive statistical techniques. The study found that students’ high school math and verbal abilities predicted whether they worked in a STEM field at age 33. Of those with moderate verbal and high math abilities, 49 percent worked in a STEM job at age 33, whereas only 34 percent of those with both high verbal and math abilities worked in a STEM job. Though more women were in the high math and high verbal abilities group than men, the likelihood of someone with both high math and verbal abilities choosing to work in a STEM occupation did not vary by gender but did vary by the individual’s self-perception on abilities in math in 12th grade. The authors argued that people with high math and high verbal abilities could find a wider variety of jobs that fit their skill sets, which might explain why fewer of those in this group pursued STEM careers than those with high math but moderate verbal abilities.",,"Science, Technology, Engineering, and Math (STEM) programs","Female, Male, STEM professional",,"United States",2013, "Hardhats, boots and goggles revisited: STEM career development for the 21st century","Conley, A., McMillan, S., & Tovar, L. (2013). Hardhats, boots and goggles revisited: STEM career development for the 21st century. Career Planning & Adult Development Journal, 29(2), 81-92.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The article discussed how career counselors can use social cognitive career theory (SCCT), a theory that one’s background and characteristics influence self-efficacy and ultimately career choice, to better engage and support underrepresented (minority and female) people in STEM careers. The authors used the SCCT framework to provide advice for how to increase minority participation in STEM, including how career counselors can use it to expand vocational interests to include STEM careers, clarify career goals, strenthen clients’ self-efficacy (with which STEM underrepresented minority groups often struggle), explore and manage existing discrimination, and build support systems. The article provided an in-depth example of how a career counselor might apply these SCCT techniques to a high school student. The authors concluded that SCCT is a useful tool to encourage underrepresented populations to pursue STEM careers, as it specifically takes into account societal barriers that these individuals face. A list of 16 recommended online career development resources that align with SCCT principles was provided.",,"Mentoring Science, Technology, Engineering, and Math (STEM) programs Preventing discrimination","Education professional",,"United States",2013, "STEM faculty and parental leave: Understanding an institution’s policy within a national policy context through structuration theory","Schimpf, C., Santiago, M., Hoegh, J., Banerjee, D., & Pawley, A. (2013). STEM faculty and parental leave: Understanding an institution’s policy within a national policy context through structuration theory. International Journal of Gender, Science and Technology, 5(2), 103-125.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: This study summarized the role of various factors, both within and outside a university, in shaping use of the university’s parental leave policy. The authors conducted semistructured interviews in 2009–2010 with 10 science, technology, engineering and math (STEM) faculty members (7 women and 3 men) at a Midwestern university. The interviews aimed to study the barriers STEM faculty face in using the university’s parental leave policy. The authors analyzed these data using a variety of qualitative coding techniques. The study found that faculty under-used the university’s parental leave policy for several reasons. First, the opinions of their department chairs and their peers often shaped faculty’s willingness to take parental leave. If faculty felt that their department heads, fellow faculty members, laboratory personnel, and students were supportive of parental leave policies, they were more willing to participate, because they felt less pressure to maintain their typical teaching and research workload after having a child. Additionally, the authors suggested that both knowledge of the parental leave policy and understanding of what was covered, among both the faculty themselves and their supervisors and administrators, was important to ensure that the policy was applied correctly in each specific case. The study also noted that faculty saw limitations in the university’s policy because it did not cover professional obligations outside the school, including writing and revising journal articles or managing externally funded laboratory experiments.",,"Other employer services Science, Technology, Engineering, and Math (STEM) programs","STEM professional, Parent",,"United States",2013, "Gender equity issues in CTE and STEM education","Toglia, T. (2013). Gender equity issues in CTE and STEM education. TechDirections, 72, 14-18.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: This article summarized current gender equity issues in career and technical education (CTE) as well as in STEM fields for high school and college students. Using findings from various other published studies, the author discussed the progression of the Carl D. Perkins Act of 1984, which required states to employ a sex equity coordinator to mitigate gender bias and stereotypes, over the past three decades, and how it has affected women’s involvement in nontraditional careers, such as electrical work and plumbing. The study also briefly summarized other gender equity trends in CTE and STEM fields, including why women choose to not work in CTE and STEM fields and how gender disparities in various industries can be detrimental to society at large. The author found that the Perkins Act and its various reauthorizations had aimed to improve female participation in nontraditional career fields, but lack of funds limited the legislation’s influence. The author also identified additional factors influencing women’s career choices—including gender-role socialization, socioeconomic status, parents’ education level and expectations for their daughters, and advice from guidance counselors—as perpetuating gender disparities in these fields. The author concluded that gender disparities in STEM and CTE careers can lead to an underdevelopment of human resources and capital at the societal level. The study concluded with a list of suggested strategies to counter existing gender inequities in CTE and STEM, including offering mentoring programs to provide female students with role models in CTE fields, removing gender-biased images or messaging from textbooks and other educational materials, increasing parental education on nontraditional career options for women, and training guidance counselors to address gender equity issues.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Female, Male",,"United States",2013, "Motivational pathways to STEM career choices: Using expectancy–value perspective to understand individual and gender differences in STEM fields","Wang, M., & Degol, J. (2013). Motivational pathways to STEM career choices: Using expectancy–value perspective to understand individual and gender differences in STEM fields. Developmental Review, 33(4), 1-37","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: This paper was a literature review of research about gender differences in STEM education levels and careers in the United States, including any evidence available for specific cultural, biological, and psychological theories for gender differences in STEM. The authors summarized evidence from existing studies, organized around three main types of influences on decision making: psychological (perceived self-competence, goals, and interests); socialization (societal and cultural beliefs that shape an individual’s belief and value systems); and biological (hormonal and genetic factors). The authors found evidence of psychological influences on women’s participation in STEM careers, including women preferring more people-oriented jobs than STEM careers typically provide, and women leaving more intensive STEM careers after having children because of their work–family preferences. In terms of socialization influences, the authors found evidence of the importance of school factors, including teachers’ instructional practices, the structure of schools or classrooms, and teachers’ abilities to forge positive relationships with students, in influencing female students’ interest and abilities in STEM fields. In addition, the study highlighted evidence that values, belief systems, and family support can influence girls’ interest and success in STEM fields. The study noted that other studies have found biological differences in terms of hormone production and brain organization between men and women, but that these differences have not conclusively been linked to any behavior or ability levels in men and women.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Female, Male",,"United States",2013, "Learning communities’ impact on student success in developmental English","Barnes, R., & Piland, W. (2013). Learning communities’ impact on student success in developmental English. Community College Journal of Research and Practice, 37(12), 954-965.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Mixed impacts Education and skills gains","Summary: The study’s objective was to evaluate the impact of learning communities (linked courses coupled with special services, such as in-course tutoring) on course passage rates for students enrolled in developmental English courses at an urban community college in Southern California. The authors used administrative data to compare outcomes of students enrolled in learning community developmental English courses with those of students enrolled in traditional developmental English courses in the same semesters.  The study found that students enrolled in the higher-level developmental English learning community, consisting of the linked courses English 051/056, were more likely to pass English 051 than their counterparts who took the course in the traditional format. Students enrolled in the lower-level developmental English learning community (English 042/043) were less likely to pass English 043 than their counterparts in the traditional version of the course. The quality of causal evidence provided in this study is low because the authors did not include sufficient controls in their analysis. This means we are not confident that the estimated effects are attributable to learning communities. Other factors are likely to have contributed.","Learning Communities","Basic skills Community college education and other classroom training","Adult, Other barriers",,"United States, Urban",2013, "Early college, early success: Early college high school initiative impact study","Berger, A., Turk-Bicakci, L., Garet, M., Song, M., Knudson, J., Haxton, C., Zeiser, K., Hoshen, G., Ford, J., Stephan, J., Keating, K., & Cassidy, L. (2013). Early college, early success: Early college high school initiative impact study. Washington, DC: American Institutes for Research.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the effect of Early Colleges, which exposed high school students to college classes, on students’ high school achievement, persistence, and graduation; college enrollment; and college degree attainment. The study compared outcomes for students who participated in the Early Colleges’ admissions lotteries and were offered enrollment with the outcomes for students who participated in the lotteries but were not offered enrollment. The study found that Early Colleges had positive and statistically significant effects on high school and college achievement. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to being offered admission in an Early College, and not to other factors.","Early Colleges",,"Other barriers",,"United States, Urban",2013,http://www.air.org/sites/default/files/downloads/report/ECHSI_Impact_Study_Repo… "From the shop floor to the kitchen floor: Maternal occupational complexity and children’s reading and math skills","Yetis-Bayraktar, A., Budig, M., & Tomaskovic-Devey, D. (2013). From the shop floor to the kitchen floor: Maternal occupational complexity and children’s reading and math skills. Work and Occupations, 40(1), 37-64.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The authors sought to determine whether the complexity of a mother’s occupation (or the quality of employment as defined by its task complexity, autonomy, and authority) affected her 6- to 13-year-old children’s math and reading test scores. The study considered both the complexity of the mother’s occupation when her children were ages 6 to 13 as well as the complexity of her occupation in her children’s earliest years (birth to age 3). The authors analyzed data from the 1984–1996 Panel Study of Income Dynamics and its 1997 Child Development Supplement to determine the relationship between maternal occupational complexity and children’s scores on the Revised Woodcock-Johnson Test of Achievement. The analysis first accounted for traits associated with mothers’ employment status, that is, whether the mother was employed. Assuming the mother was employed, the authors then assessed the association between the complexity of the mother’s occupation and her children’s performance on the reading and math sections of the test. The study found that a one-point increase on the maternal white collar occupational complexity scale was associated with a 2.49-point increase in children’s test scores, whereas a one-point increase on the blue collar occupational complexity scale corresponded to a 1.01-point gain in test scores. Maternal occupational complexity during the child’s first three years also was associated with increased test scores later in life; a one-point gain in white collar occupational complexity in the first three years of the child’s life was associated with a 3.7-point increase in test scores when the child was ages 6 to 13.",,"Other employment and reemployment","Employed, Female, Parent",,"United States",2013, "Attracting girls to civil engineering through hands-on activities that reveal the communal goals and values of the profession","Colvin, W., Lyden, S., & León de, l. B. (2013). Attracting girls to civil engineering through hands-on activities that reveal the communal goals and values of the profession. Leadership & Management in Engineering, 13(1), 35-41.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study determined the impact of a four-week series of civil engineering workshops on Australian middle school girls’ perceptions of engineers and the engineering profession. The goal of the workshops—which included hands-on activities and discussions of engineering theory, examples, and careers—was to familiarize girls with engineering and depict it as a profession in which communal goals are central, which research shows that women value more than men. The authors asked female students in grades 5 and 6 to draw and write about an engineer (the Draw an Engineer Test [DAET]) before and after they attended the workshops. The DAET was analyzed for the engineer’s characteristics, such as gender, work activity, and themes (for example, teamwork). The students also completed feedback forms at the end of the program. The authors found that by the end of the workshops, students were more likely to draw and describe engineers as women and happy as compared with the pre-program assessment in which the students often depicted engineers as car mechanics. Participants also referenced communal goals more frequently in the follow-up assessment. Participants reported in feedback forms a preference for hands-on activities over interactive discussions.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Female",,International,2013, "Women in community colleges: Access to success","St. Rose, A., & Hill, C. (2013). Women in community colleges: Access to success. Washington, DC: American Association of University Women.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The authors described two programs partnering with California community colleges—the Mathematics, Engineering, Science Achievement Community College Program (MCCP) and the CalWomen Tech Program—that aim to encourage women to pursue careers in science, technology, engineering, and mathematics (STEM). The two initiatives approach this goal in different ways: MCCP prepares women to transfer from two- to four-year STEM degree programs, whereas CalWomen Tech encourages participation in non-traditional career and technical education programs in STEM, such as information technology and automotive repair. MCCP offers a wide array of academic, career, and social support services, from academic tutoring and advising to a cohort-based course progression. CalWomen Tech’s promotional materials target women, such as “women in technology” websites that highlight the employment and salary opportunities available to women who choose non-traditional career paths, and skill-building or “bridge” courses that lay the groundwork for more advanced study. In 2010, 38 percent of MCCP transfer students from two- to four-year degree programs were women. Of those transferring to programs in life sciences or mathematics, more than 50 percent were women. After partnering with CalWomen Tech, female enrollment in City College of San Francisco’s computer networking and information technology program increased from 19 percent in 2006 to 33 percent in 2008, with persistent enrollment rates through 2010. Similarly, CalWomen Tech helped Evergreen Valley College raise female retention in its automotive technology program from 58 percent to 88 percent over the course of two years.",,"Youth programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Youth, Female",,"United States",2013,http://www.aauw.org/files/2013/05/women-in-community-colleges.pdf "An outcome evaluation of an adult education and postsecondary alignment program: The Accelerate New Mexico experience","Rivera, M., Davis, M., Feldman, A., & Rachkowski, C. (2013). An outcome evaluation of an adult education and postsecondary alignment program: The Accelerate New Mexico experience. Problems and Perspectives in Management, 11(4), 105-120.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Attitudes-Low-Favorable impacts Attitudes","Summary: The study’s objective was to examine the impact of the Accelerate New Mexico Math Camp on outcomes for community college students, including women and minority students traditionally underrepresented in STEM. The study used course-administered assessments to compare the math competency and attitudes about math of students before and after participation in the Accelerate summer program. The authors found that students (both male and female) who participated in the Accelerate program had higher math competency and less anxiety about math after completing the program, compared with their competency and anxiety measured before enrollment in the program. The quality of causal evidence presented in this report is low. This means we are not confident that the estimated effects are attributable to the Accelerate New Mexico Math Camp program; other factors are likely to have contributed.","the Accelerate New Mexico Math Camp","Science, Technology, Engineering, and Math (STEM) programs Community college education and other classroom training Youth programs","Youth, Other barriers, Female",,"United States",2013, "The Engineering Admissions Partnership Program: A navigation strategy for community college students seeking a pathway into engineering","Laugerman, M., Shelley, M., Mickelson, S., & Rover, D. (2013). The Engineering Admissions Partnership Program: A navigation strategy for community college students seeking a pathway into engineering. International Journal of Engineering Education, 29(5), 1260-1269.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Engineering Admissions Partnership Program (E-APP) on retention rates of community college students who transferred to Iowa State University (ISU) to pursue an engineering degree. The intervention consisted of coordinated academic advising, peer mentoring, campus visits, and online social and professional networking. The study used student record data to examine outcomes for a treatment group of ISU students who participated in E-APP and a matched comparison group of ISU students who did not participate. The study found that E-APP had positive impacts on first-year retention rates at ISU. The quality of causal evidence presented in this report is low because the authors did not include sufficient controls in the analysis. This means we are not confident that the estimated effects are attributable to E-APP. Other factors are likely to have contributed.","the Engineering Admission Partnership Program (E-APP)","Community college education and other classroom training",Adult,,"United States",2013, "Why academic STEM mothers feel they have to work harder than others on the job","Kmec, J. (2013a). Why academic STEM mothers feel they have to work harder than others on the job. International Journal of Gender, Science, & Technology, 5(2), 80-101.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: This report analyzed faculty members’ perceptions of how hard they have to work at their job based on their sex and parental status, specifically in the context of science, technology, engineering, and mathematics (STEM) disciplines that are typically characterized by a masculine work culture. The objective was to contribute to the knowledge base on gender issues in academic professions and the specific challenges that working mothers in STEM fields face. The study used data from the 2011 Faculty Caregiving and Workplace and Culture survey administered online to about 300 tenure-line faculty members in all disciplines at a large public U.S. university. The author conducted regression analyses to estimate the link between faculty members’ sex, parental status, academic discipline, and their level of agreement with the statement, “My job requires me to work very hard.” The regression controlled for several factors that might affect faculty members’ perceptions of how hard they have to work at their job, such as length of time at current institution, academic rank, perceived job demand levels, feelings of being valued, marital status, age of children, household/family responsibilities, and degree to which household responsibilities are perceived to affect job performance. The study found that mothers in STEM fields were more likely to strongly agree that they have to work very hard at their job, compared to fathers in both STEM and non-STEM fields and mothers in non-STEM fields, after controlling for a number of factors related to perceptions of effort required. Specifically, fathers in STEM and non-STEM fields were 84 percent and 92 percent less likely, respectively, to strongly agree that they have to work very hard at their job than mothers in STEM fields. Similarly, mothers in non-STEM fields were about 81 percent less likely than mothers in STEM fields to agree that they have to work very hard at their job.",,"Science, Technology, Engineering, and Math (STEM) programs Other disparities or discrimination in employment and earnings","Female, Male, STEM professional, Parent",,"United States",2013, "Accelerating change for women faculty of color in STEM: Policy, action, and collaboration","Institute for Women’s Policy Research. (2013). Accelerating change for women faculty of color in STEM: Policy, action, and collaboration. Washington, DC: Institute for Women’s Policy Research.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: This report highlighted a 2013 convening of stakeholders who discussed barriers to becoming successful STEM faculty for black, Hispanic, and Native American women, and strategies to overcome those barriers. The Institute for Women’s Policy Research organized the convening. The report was compiled from a series of conference sessions presented at the convening by about 50 experts from various academic, political, corporate, and community sectors. Session topics included the current status of women of color in STEM, areas of progress and nonprogress, and current initiatives to increase the representation of women of color in STEM faculty positions. Attendees provided recommendations for improvement. Conference representatives identified three main barriers to the advancement of minority female faculty: workplace climate policies that did not meet the needs of female faculty of color, a lack of multicultural perspectives, and a lack of embracement of diversity in academic departments. Health, financial, and family issues and obligations; high community service demands; and a lack of social support also created unique challenges for this population. Recommendations for improvement included raising awareness of underrepresentation of minority women in STEM faculty positions, monitoring and publicizing institutions’ progress on diversity in STEM faculty, and tailoring faculty mentoring programs or tools to effectively serve female faculty of color.",,"Science, Technology, Engineering, and Math (STEM) programs Other disparities or discrimination in employment and earnings","Female, STEM professional, Black or African American, Hispanic of any race, American Indian or Alaska Native","Professional, scientific, and technical services","United States",2013,http://www.iwpr.org/publications/pubs/accelerating-change-for-women-faculty-of-… "An effective model for enhancing underrepresented minority participation and success in geoscience undergraduate research","Blake, R., Liou-Mark, J., & Chukuigwe, C. (2013). An effective model for enhancing underrepresented minority participation and success in geoscience undergraduate research. Journal of Geoscience Education, 61(4), 405-414.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: This study described the implementation of the National Science Foundation Research Experiences for Undergraduates (REU) program at New York City College of Technology. This year-long program aimed to retain undergraduates in STEM disciplines and prepare them for STEM careers, especially for underrepresented minority groups, including women. The authors, as directors of the REU program, described each of its components, including research, minicourses, seminars and workshops, mentoring, support and networking opportunities, and presenting at and attending conferences. Outcomes were discussed in terms of post-program experiences and achievements, as well as quotes from program participants. Overall, the authors concluded that the program was successful in terms of demonstrated interest in, attendance in, or completion of a STEM graduate program; achievement in STEM publications; and attainment of STEM awards. These outcomes were complemented by five quotes from student participants who discussed how the program changed their academic lives.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Other barriers, Female",,"United States",2013, "Exploring women engineering faculty’s mentoring networks","Long, Z., Buzzanell, P., Kokini, K., Wilson, R., Batra, J., & Anderson, L. (2013). Exploring women engineering faculty’s mentoring networks. Proceedings of the 2013 American Society for Engineering Education Annual Conference & Exposition, Washington, DC.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study described how women in academic STEM positions (compared with corporate environments) constructed their own mentoring networks; it also explored the mentoring configurations female academics preferred as support for their careers. The authors conducted in-depth semistructured interviews with seven female engineering faculty at a single large Midwestern university, creating detailed maps of the faculty members’ mentoring networks and evaluating the nature, importance, and perceived value of each connection. The study found that the female faculty were generally dissatisfied with formal mentoring relationships and instead sought mentors on their own. Faculty selected these informal mentors from among those with whom they had an existing relationship, such as a friend or co-committee member. Mentees selected multiple mentors with mixed backgrounds and characteristics to serve different purposes (for example, discussing work-life balance or career advancement) and mentees typically had at least one mentor outside of the department or university to discuss more confidential matters. Findings were generally consistent with mentor relationships in a corporate setting.",,"Mentoring Science, Technology, Engineering, and Math (STEM) programs","Female, STEM professional",,"United States",2013,http://www.asee.org/public/conferences/20/papers/6463/download "Conditional cash transfers in New York City: The continuing story of the Opportunity NYC—Family Rewards demonstration","Riccio, J., Dechausay, N., Miller, C., Nunez, S., Verma, N., & Yang E. (2013). Conditional cash transfers in New York City: The continuing story of the Opportunity NYC—Family Rewards demonstration. New York, NY: MDRC.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employer benefits receipt-Mod/high-Favorable impacts Employer benefits receipt Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of Family Rewards, an experimental privately funded conditional cash transfer program in New York City, on earnings, employment, public benefits receipt, and education. The study was based on a randomized controlled trial and estimated the effect of the Family Rewards program on low-income families. The authors used New York City and New York State administrative data to compare average outcomes between families offered access to the program and families excluded from the program, after adjusting for chance initial differences between the groups. The authors found that, on average, the Family Rewards program decreased the likelihood of ever being employed at an Unemployment Insurance (UI)-covered job in the first year by 2 percentage points, but increased monthly earnings by $353 and decreased the share of families receiving income from Supplemental Security Income (SSI) or disability benefits by 3.9 percentage points. The authors also found that parents in the Family Rewards program group were 4.2 percentage points more likely to have achieved any trade license training certification. The quality of causal evidence presented in this report is high for most outcomes because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Family Rewards program, and not to other factors. However, some outcomes in the study receive a moderate or low causal evidence rating, meaning that we are less confident that the estimated effects are attributable to the Family Rewards program; other factors may have contributed.","the Family Rewards Program","Other employment and reemployment Other training and education","Low income, Parent",,"United States, Urban",2013,http://files.eric.ed.gov/fulltext/ED545453.pdf "Acceleration through a holistic support model: An implementation and outcomes analysis of FastStart@CCD","Edgecombe, N., Jaggers, S., Baker, E., & Bailey, T. (2013). Acceleration through a holistic support model: An implementation and outcomes analysis of FastStart@CCD. Community College Research Center Report. New York: Teachers College, Columbia University.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: This study’s objective was to examine the impact of the FastStart developmental math program on college persistence, credit accumulation, and course completion. This study used transcript data from students at the Community College of Denver to compare outcomes of students who chose to participate in the FastStart developmental math program with the outcomes of students who participated in the standard developmental math program. The study found that students in the FastStart program were significantly more likely than students in the comparison group to complete the highest-level developmental math course and to enroll in and complete a gatekeeper math class. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to FastStart, but other factors might also have contributed.","the FastStart Program","Community college education and other classroom training","Adult, Other barriers",,"United States",2013,http://files.eric.ed.gov/fulltext/ED539910.pdf "Perfectionism moderates stereotype threat effects on STEM majors’ academic performance","Rice, K., Lopez, F., Richardson, C., & Stinson, J. (2013). Perfectionism moderates stereotype threat effects on STEM majors’ academic performance. Journal of Counseling Psychology, 60(2), 287-293.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of “stereotype threat priming” on students’ grades in postsecondary science, technology, engineering, and mathematics (STEM) courses and on self-reported feelings of self-efficacy in science. The authors argued that women and racial minorities perform worse in certain fields, such as STEM, when they feel threatened by stereotypes implying that their gender or race makes them inferior to their male or white peers. For this study, the authors primed treatment students to think about their gender, race, and ethnicity before completing a survey to measure self-efficacy in science. This priming was intended to make feelings of stereotype threat more acute. The study randomly assigned students majoring in a STEM field to either the treatment group, which received stereotype threat priming before taking the survey, or the control group, which took the same survey but did not receive stereotype threat priming. The authors collected data from an author-generated online survey on feelings of self-efficacy and from academic records for course grades. The study found that the stereotype threat priming had no significant effects by gender when comparing outcomes for the treatment and control groups. The quality of causal evidence presented in this report is low because this is a randomized controlled trial with unknown attrition, and the authors did not control for background characteristics likely to affect the outcomes of interest. This means we are not confident that the estimated effects would have been attributable to stereotype threat priming; other factors are likely to have contributed.","the Evaluation of Stereotype Threat Priming","Science, Technology, Engineering, and Math (STEM) programs Other disparities or discrimination in employment and earnings","Other barriers, Female, STEM professional",,"United States",2013, "Improving student outcomes via comprehensive supports: Three-year outcomes from CUNY’s Accelerated Study in Associate Programs (ASAP)","Kolenovic, Z., Linderman, D., & Karp, M. (2013). Improving student outcomes via comprehensive supports: Three-year outcomes from CUNY’s Accelerated Study in Associate Programs (ASAP). Community College Review, 41(4), 271-291.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Accelerated Study in Associate Programs (ASAP) conducted by the City University of New York (CUNY) on retention, credit accrual, transfer, and degree attainment at six CUNY campuses. The authors used administrative data from the CUNY Office of Institutional Research and Assessment to match students who participated in ASAP with similar students who enrolled the previous year and did not participate in ASAP and compared their outcomes. The study found that ASAP students had higher one-year retention rates, were more likely to graduate within two or three years, and accrued more credits than comparison students. The quality of causal evidence presented in this report is low because the analysis compared students in different cohorts, and we cannot rule out the possibility that differences in outcomes between the two groups were due to other changes taking place at the same time that only affected one of the cohorts. This means we are not confident that the estimated effects are attributable to ASAP; other factors likely contributed.","the Accelerated Study in Associate Program (ASAP)","Community college education and other classroom training",Adult,,"United States",2013, "When trying hard isn’t natural: Women’s belonging with and motivation for male-dominated STEM fields as a function of effort expenditure concerns","Smith, J., Lewis, K., Hawthorne, L., & Hodges, S. (2013). When trying hard isn’t natural: Women’s belonging with and motivation for male-dominated STEM fields as a function of effort expenditure concerns. Personality & Social Psychology Bulletin, 39(2), 131-143. [Study 2]","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Attitudes-Low-Unfavorable impacts Attitudes","Summary: The study’s objective was to examine the impact of male-dominated marketing of a fictitious eco-psychology program on female students’ interest in pursuing the program. Authors randomly assigned 49 female students in an introductory psychology course to receive a brochure about a fictitious one-year master’s program in eco-psychology that was presented as either male-dominated or gender-neutral. Students were then asked to rate their motivation to enroll in the program. The study found that female students who read the male-dominated brochure displayed statistically significantly lower interest in pursuing the program than those in the gender-neutral group. The quality of causal evidence presented in this report is low because the authors did not include sufficient controls in their analysis to account for differences between the treatment and comparison groups. This means we are not confident that the estimated effects are attributable to type of brochure reviewed; other factors are likely to have contributed.",,"Science, Technology, Engineering, and Math (STEM) programs","Female, STEM professional",,"United States",2013, "When trying hard isn’t natural: Women’s belonging with and motivation for male-dominated STEM fields as a function of effort expenditure concerns","Smith, J., Lewis, K., Hawthorne, L., & Hodges, S. (2013). When trying hard isn’t natural: Women’s belonging with and motivation for male-dominated STEM fields as a function of effort expenditure concerns. Personality & Social Psychology Bulletin, 39(2), 131-143. [Study 3]","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Attitudes-Low-Favorable impacts Attitudes","Summary: The study examined the effect of providing information about effort requirements to succeed in a fictitious male-dominated eco-psychology master’s program on female students’ attitudes toward their ability to succeed in this field. The authors randomly assigned 48 female undergraduates to receive one of four verbal messages from an advisor about their ability to succeed in a fictitious master’s program in eco-psychology; the women also received a printed brochure distributed to all study groups. The messages varied in terms of emphasis placed on students’ ability versus level of effort. Specifically, three of the message groups conveyed that student success depended on (1) their natural ability (natural ability group), (2) putting in more effort than peers (more effort group), or (3) putting in the same high level of effort as peers (normal effort group). The advisors did not discuss effort requirements with the fourth group that served as a control group (the no information group). Students then immediately completed a questionnaire measuring self-doubt, perceived confidence, future interest in eco-psychology, and how well they thought they would fit into the program. The study found that students in the normal effort group exhibited a significantly higher sense of academic belonging to and future interest in the eco-psychology program than the other three groups. They also had higher perceived competence compared with the more effort group and exhibited lower self-doubt than the no information and more effort groups. The quality of causal evidence presented in this report is low because the authors did not include sufficient controls in their analysis to account for differences between each group, which is required of randomized controlled trials (RCTs) with high attrition. This means we are not confident that the estimated effects are attributable to the type of message the study participants received; other factors are likely to have contributed.",,"Science, Technology, Engineering, and Math (STEM) programs","Female, STEM professional",,"United States",2013, "A randomized controlled trial to improve health among women receiving welfare in the U.S.: The relationship between employment outcomes and the economic recession.","Kneipp, S., Kairalla, J. & Sheely, A. (2013). A randomized controlled trial to improve health among women receiving welfare in the U.S.: The relationship between employment outcomes and the economic recession. Social Science & Medicine, 80, 130-140.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the Public Health Nurse (PHN) intervention on employment outcomes. The authors conducted a randomized controlled trial. Researchers used self-reported job beginning and ending dates to determine whether a participant was employed over a nine-month period. The authors found no statistically significant effect of PHN on any employment in the first nine months after random assignment. The quality of causal evidence presented in this study is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects would be attributable to PHN and not to other factors. However, the study did not find statistically significant effects.","Public Health Nurse Intervention","Other employment and reemployment","Disability, Low income",,"United States",2013, "Can post-employment services combined with financial incentives improve employment retention for welfare recipients?","Dorsett, R., Hendra, R., Robins, P. K., & Williams, S. (2013). Can post-employment services combined with financial incentives improve employment retention for welfare recipients? Evidence from the Texas Employment Retention and Advancement evaluation. (No. 1413-13). Madison, WI: Institute for Research on Poverty.",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Texas Employment Retention and Advancement (ERA) program on employment entry and retention in two sites: Corpus Christi and Fort Worth. The authors conducted a non-experimental study using data originally collected for a randomized controlled trial. They analyzed survey data and state Unemployment Insurance records to estimate the effects of the ERA program on employment entry and retention. The study found a positive and statistically significant relationship between participation in the ERA program and the likelihood of transitioning into employment and between ERA and employment retention at the Corpus Christi site. The quality of causal evidence presented in this report is low because the authors did not account for differences in wages or employment between the ERA and comparison groups before the beginning of the ERA program. This means we are not confident that the estimated effects are attributable to the Texas ERA program; other factors are likely to have contributed.","Texas Employment Retention and Advancement (ERA)","Job search assistance and supportive services Other wages and benefits","Unemployed, Low income, Female",,"United States",2013,http://www.niesr.ac.uk/sites/default/files/publications/dp409_0.pdf "Does federally-funded job training work? Nonexperimental estimates of WIA training impacts using longitudinal data on workers and firms. [Dislocated Workers ONLY]","Andersson, F., Holzer, H. J., Lane, J. I., Rosenblum, D., & Smith, J. (2013). Does federally-funded job training work? Nonexperimental estimates of WIA training impacts using longitudinal data on workers and firms (Discussion paper no. 7621). Bonn, Germany: IZA. [Dislocated Workers ONLY]",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Mixed impacts Earnings and wages Employment-Mod/high-Mixed impacts Employment","Summary: The study’s objective was to examine the impact of the Workforce Investment Act (WIA) dislocated worker program’s training services on the employment and earnings of dislocated workers. The authors used a regression model with inverse propensity weights, to compare the earnings and employment outcomes of WIA-registered dislocated workers who received training services to the outcomes of those who were registered in WIA but did not receive training services. The study found that the treatment group earned significantly less than the comparison group in the three years after WIA registration. Individuals in the treatment group earned an average of $5,567 and $5,227 less than those in the comparison group in State A and State B, respectively. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design; this is the highest causal evidence rating possible for a nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the training services received, but other factors might also have contributed","Workforce Investment Act (WIA) Program Training Services","Adult and Dislocated Worker programs Work based and other occupational training Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) training programs","Dislocated or displaced worker",,"United States",2013,http://ftp.iza.org/dp7621.pdf "Is Internet job search still ineffective?","Kuhn, P., & Mansour, H. (2013). Is Internet job search still ineffective? The Economic Journal, 124 (December), 1213-1233.",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Mixed impacts Employment","Summary: The study’s objective was to determine whether the finding from a previous study that Internet job searches increased unemployment duration was upheld using more recent data. Specifically, the authors compared the impact of Internet job searches on unemployment duration using survey data from 2005–2008 to the estimated impact from a prior study on Internet job searches that used 1998–2001 survey data. The study used a nonexperimental design to compare the impacts of Internet job searches on the duration of unemployment at two different time periods. For the first time period, the authors analyzed data from the United States Current Population Survey (CPS) from 1998 to 2001. For the second time period, the authors used data from the National Longitudinal Survey of Youth (NLSY) 1997 sample, covering 2005 to 2008. The study found that in the earlier period (1998–2001) unemployed adults who used the Internet for any job search activities were unemployed 22 percent longer than those who did not use the Internet, whereas in the later period (2005–2008) young adults who used the Internet for job search activities were reemployed 25 percent faster than comparable workers who did not use the Internet as part of their job search strategy. Thus, the study found that the effect of using the Internet as part of a job search strategy on unemployment durations reversed in the 10 years covered by the two studies. The quality of causal evidence presented in this report is low because the authors did not account for other factors that might have affected unemployment duration. This means we are not confident that the estimated effects are attributable to the use of Internet search activities; other factors might have contributed.",,"Job search assistance and supportive services","Adult, Unemployed",,"United States",2013, "Does federally-funded job training work? Nonexperimental estimates of WIA training impacts using longitudinal data on workers and firms (Discussion paper no. 7621) [Adults ONLY]","Andersson, F., Holzer, H. J., Lane, J. I., Rosenblum, D., & Smith, J. (2013). Does federally-funded job training work? Nonexperimental estimates of WIA training impacts using longitudinal data on workers and firms (Discussion paper no. 7621). Bonn, Germany: IZA. [Adults ONLY]",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Workforce Investment Act (WIA) adult program’s training services on the employment and earnings of low-income adults. The authors used statistical analysis to compare the earnings and employment outcomes of WIA-registered low-income adults who received training services to the outcomes of those who were registered in WIA but did not receive training services. The study found that total earnings in the third year after WIA registration were significantly higher for the treatment group than the comparison group. Individuals in the treatment group earned $1,257 and $1,703 more than those in the comparison group in State A and State B, respectively. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design; this is the highest causal evidence rating possible for a nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the training services received, but other factors might also have contributed.","Workforce Investment Act (WIA) Program Training Services","Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) training programs",Adult,,"United States",2013,http://ftp.iza.org/dp7621.pdf "Evaluating the impact of dental care on housing intervention program outcomes among homeless veterans","Nunez, E., Gibson, G., Jones, J. A., & Schinka, J. A. (2013). Evaluating the impact of dental care on housing intervention program outcomes among homeless veterans. American Journal of Public Health, 103(S2), S368-S373.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study examined the impact of the Veterans Affairs (VA) Homeless Veteran Dental Program on employment outcomes of homeless veterans. The authors used VA administrative data to compare the employment outcomes of veterans who received dental care through the VA Homeless Veteran Dental Program with those of veterans who did not. The study found that participating in the VA Homeless Veteran Dental Program was associated with greater employment and financial stability. The quality of causal evidence presented in this report is low because the authors did not ensure the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the VA Homeless Veteran Dental Program; other factors are likely to have contributed.","VA Homeless Veteran Dental Program","Health Veterans' reemployment","Veteran or military, Homeless",,"United States",2013,https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3969121/ "Does Pantawid foster dependence or encourage work? Evidence from a randomized experiment","Orbeta, A., & Paqueo, V. (2013). Does Pantawid foster dependence or encourage work? Evidence from a randomized experiment. Philippine institute for Development Studies. Retrieved from http://nap.psa.gov.ph/ncs/12thncs/papers/INVITED/IPS-09%20Social%20Protection%20Statistics/IPS-09_2%20Impact_of_4Ps_on_Labor_Market_Outcomes%20AO-VP-new.pdf  ","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-No impacts Child labor","Summary: The study’s objective was to examine the impact of a conditional cash transfer program, called Pantawid Pamilya Pilipino Program (Pantawid) on child work participation and hours children worked per week. Using household survey data from a randomized controlled trial, the authors analyzed the impact of the Pantawid program on child work participation almost 24-months after implementation. The study found that there were no significant relationships between participation in the program and child work participation or hours worked per week. The quality of causal evidence presented in this report is low because it based on a randomized controlled trial with unknown attrition and the authors did not control for pre-existing differences. This means we are not confident that the estimated effects are attributable to Pantawid; other factors are likely to have contributed. However, the study did not find statistically significant effects.","Pantawid Pamilya Pilipino Program","Child labor","Other, Low income",,International,2013,http://nap.psa.gov.ph/ncs/12thncs/papers/INVITED/IPS-09%20Social%20Protection%2… "Teenage school attendance and cash transfers: An impact evaluation of PANES","Amarante, V., Ferrando, M., & Vigorito, A. (2013). Teenage school attendance and cash transfers: An impact evaluation of PANES. Economia, 61-93.","Child Labor","Study Type: Descriptive Analysis",,"Child labor-Low-No impacts Child labor Education and skills gains-Low-No impacts Education and skills gains","Summary: This objective of this study was to examine the impact of a conditional cash transfer program, National Plan for Social Emergency Assistance (PANES), on child labor and school attendance for children 14-17 years old in Uruguay. The primary design was a regression discontinuity design (RDD) using households within a 2 percent range of the cutoff score. The authors also used a difference-in-differences (DID) approach. The study used administrative data collected before the launch of the program and household surveys implemented in two follow-up waves (at two months and 18 months after the program ended). The authors compared the differential effects of receiving the program on outcomes for those in the treatment group versus those in the comparison group. The study found no statistically significant relationships between the PANES program and child labor or schooling. The quality of causal evidence presented in this report under the DID design is low. The RDD does not receive a causal rating.","National Plan for Social Emergency Assistance (PANES)","Child labor","Other, Low income",,International,2013,https://www.researchgate.net/publication/265975653_Teenage_School_Attendance_an… "Training and retirement patterns.","Montizaan, R., Cörvers, F., & de Grip, A. (2013). Training and retirement patterns. Applied Economics, 45(15), 1991-1999. doi:10.1080/00036846.2011.646066","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Unfavorable impacts Employment","Summary: The study’s objective was to examine the impact of firm-specific training and general training on older men’s retirement decisions The study used a nonexperimental design and data from the U.S. National Longitudinal Survey of Older Men for 1966 to 1983 to estimate impacts. The study found that workers with firm-specific training were more likely to retire within the time period studied and to have jobs with a mandatory retirement age than workers without firm-specific training. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before receiving training and did not account for self-selection into training. This means we are not confident that the estimated effects are attributable to firm-specific or general training; other factors are likely to have contributed.","Firm-specific & General Training","Work based and other occupational training","Adult, Older worker, Male",,"United States",2013,https://www.researchgate.net/publication/236021967_Training_and_retirement_patt… "The link between pensions and retirement timing: Lessons from California teachers.","Brown, K. M. (2013). The link between pensions and retirement timing: Lessons from California teachers. Journal of Public Economics, 98(C), 1-14.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study examined the impact of pension reform under the California State Teachers’ Retirement System (CalSTRS) on retirement timing. The author used a statistical model and data from retirement-eligible employees in Los Angeles Unified School District from 1997 to 2000 to estimate the impact. The study found public school employees were more likely to work an extra year in response to changes in pension plans that provided additional bonuses tied to age and tenure. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the changes in CalSTRS. This means we are not confident that the estimated effects are attributable to the changes in CalSTRS; other factors are likely to have contributed.","CalSTRS Defined Benefit Program","Older workers' programs Other wages and benefits","Adult, Older worker",,"United States",2013,https://eml.berkeley.edu//~saez/course/brown_jpube13.pdf "Does retiree health insurance encourage early retirement?","Nyce, S., Schieber, S. Shoven, J. B., Slavov, S., & Wise, D. A. (2013). Does retiree health insurance encourage early retirement? Journal of Public Economics, 104, 40-51.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Unfavorable impacts Employment","Summary: The study’s objective was to examine the impact of employer-provided retiree health insurance on early retirement. The authors used a nonexperimental design to compare early retirement outcomes of employees who are eligible for retiree health insurance with that of those who have no coverage. The study found that people who were employed at age 57 and eligible for employer-subsidized retiree health coverage were significantly more likely to retire at ages 62 to 64 (before becoming eligible for Medicare at age 65) compared with those with no coverage. The quality of causal evidence presented in this report is low because the authors did not account for other factors that could have affected the difference between the treatment and comparison groups. This means we are not confident that the estimated effects are attributable to retiree health insurance; other factors are likely to have contributed.","Retiree Health Insurance","Employer provided retirement benefits Older workers' programs","Adult, Older worker",,"United States",2013,https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3770310/ "The impact of uncapping of mandatory retirement on postsecondary institutions.","Weinberg, S. L., & Scott, M. A. (2013). The impact of uncapping of mandatory retirement on postsecondary institutions. Educational Researcher, 42(6), 338-348.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study examined the impact of uncapping mandatory retirement on retirement ages at postsecondary institutions The study used a statistical model to examine the age of retirement before and after the policy change in 1993. It used data on faculty’s employment and retirement from a research university with multiple schools. The study found that uncapping was associated with a statistically significant increase in the retirement age among those who retired from the university. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar nor did they control for differences between the groups. This means we are not confident that the estimated effects are attributable to the federal Age Discrimination in Employment Act (ADEA); other factors are likely to have contributed.","Age Discrimination Employment Act (ADEA)","Federal retirement benefits Older workers' programs","Adult, Older worker",,"United States",2013,https://www.researchgate.net/publication/258134776_The_Impact_of_Uncapping_of_M… "Do stronger age discrimination laws make Social Security reforms more effective?","Neumark, D., & Song, J. (2013). Do stronger age discrimination laws make Social Security reforms more effective? Journal of Public Economics, 108, 1-16.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Mixed impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study examined whether the strength of state age discrimination protections affected rates of Social Security benefit claiming and employment outcomes of older workers. The study used a nonexperimental design and the data on Social Security claiming and employment outcomes from the Health and Retirement Study (HRS) to estimate the impacts. The study found that among older men affected by the 1983 Social Security reform, age discrimination protections were associated with increases in employment rates between age 62 and the full retirement age and delayed benefit claiming. The quality of casual evidence presented in this report is moderate because the study was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to state age discrimination laws, but other factors might also have contributed.","The 1983 Social Security Reform","Older workers' programs Other disparities or discrimination in employment and earnings","Adult, Older worker, Male",,"United States",2013,https://ideas.repec.org/a/eee/pubeco/v108y2013icp1-16.html "Impact of the Reemployment and Eligibility Assessment (REA) Initiative in Nevada","Michaelides, M., Poe-Yamagata, E., Benus, J., & Tirumalasetti, D. (2012). Impact of the Reemployment and Eligibility Assessment (REA) Initiative in Nevada. Columbia, MD: IMPAQ International, LLC.",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of the Reemployment and Eligibility Assessment (REA) Initiative in Nevada on Unemployment Insurance (UI) benefits receipt, employment, and earnings after six quarters.  The study was a randomized controlled trial. Of some 33,000 first-time UI claimants eligible for the study, about 5,100 were randomly assigned to the treatment group, which had to take part in REA and reemployment services (RES) to retain UI eligibility, and the rest were randomly assigned to the control group, which was not required to participate in such services. The authors compared state administrative records on UI payments and covered employment of the two groups to estimate the program’s effectiveness. The study found that, in the first six calendar quarters following the initial claim, REA services substantially reduced the average duration and amount of UI benefits receipt, increased employment rates, and increased earnings. The quality of causal evidence presented in this study is high because it is based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the REA services, and not other factors.","Reemployment Eligibility Assessment","RESEA Job search assistance and supportive services Other employment and reemployment","Dislocated or displaced worker, Unemployed",,"United States",2012,http://wdr.doleta.gov/research/FullText_Documents/ETAOP_2012_08_REA_Nevada_Foll… "Understanding the impact of Career Academy attendance: An application of the principal stratification framework for causal effects accounting for partial compliance.","Page, L. C. (2012). Understanding the impact of Career Academy attendance: An application of the principal stratification framework for causal effects accounting for partial compliance. Evaluation Review, 36(2), 99-132.","Career Academies","Study Type: Descriptive Analysis",,,"Summary: The author investigated the impact of the duration of Career Academy enrollment on monthly average earnings following high school graduation using data from a randomized controlled trial conducted by MDRC over a 15-year period. The MDRC study estimated the impact of the offer to attend a Career Academy, whereas this study estimated the impact of attending an academy through graduation. Career Academies’ distinctive features include their division of a large high school into smaller learning communities, integration of career learning into the curriculum, and partnerships with local employers. The analysis centered on three of the nine sites that participated in the original MDRC evaluation. The author used a principal stratification framework and Bayesian inference to estimate the impact of duration of enrollment on monthly earnings following graduation. The author estimated an average impact of $588 per month for males who received an offer to enroll in a Career Academy and remained enrolled in the academy throughout high school; this was higher than the impact of approximately $300 per month estimated from the original study, which included in the sample those who were offered the opportunity to attend a Career Academy but did not do so. These positive impacts were not found for females.","Career Academies",,,,,2012, "An effectiveness assessment and cost-benefit analysis of Registered Apprenticeship in 10 states","Reed, D., Liu, A., Kleinman, R., Mastri, A., Reed, D., Sattar, S., & Ziegler, J. (2012). An effectiveness assessment and cost-benefit analysis of Registered Apprenticeship in 10 states. Oakland, CA: Mathematica Policy Research.","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Registered Apprenticeship (RA) program on employment and earnings. The authors compared outcomes for participants in the RA program with people eligible for the program who did not participate in it. They used Unemployment Insurance wage record data to estimate regression models, controlling for demographic characteristics and pre-intervention measures of earnings and employment. The study found that employment rates were 8.6 percentage points higher among RA participants than those completing none of the program both six and nine years after program enrollment. Average annual earnings were $6,595 higher among RA participants than those completing none of the program in the sixth year after enrollment and $5,839 higher in the ninth year after enrollment. These differences were all statistically significant. The quality of the causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects were attributable to the RA program, but other factors might also have contributed.","Registered Apprenticeship (RA)","Registered apprenticeship Work based and other occupational training",Adult,,"United States",2012,https://wdr.doleta.gov/research/FullText_Documents/ETAOP_2012_10.pdf "Does occupational training by the trade adjustment assistance program really help reemployment? Success measured as occupation matching.","Park, J. (2012). Does occupational training by the trade adjustment assistance program really help reemployment? Success measured as occupation matching. Review of International Economics, 20(5), 999-1016.","Apprenticeship and Work-Based Training, Job Search Assistance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Mixed impacts Employment","Summary: The study’s objective was to examine the impact of training funded by Trade Adjustment Assistance (TAA) on dislocated workers’ employment. The author used a nonexperimental approach to compare the reemployment rate among TAA beneficiaries who completed a TAA-funded training program with that of those who did not complete training, and compared the reemployment rate among those who participated in each type of TAA-funded training with that of those who did not participate in any training, after adjusting for workers’ characteristics. The study found that, among TAA beneficiaries, completion of a training program was associated with higher reemployment rates. The study also found that participation in TAA-funded customized training was associated with lower reemployment rates, while participation in occupational training or in on-the-job training was associated with higher reemployment rates compared with not participating in training. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the program. This means we are not confident that the estimated effects are attributable to TAA-funded training; other factors are likely to have contributed.","Trade Adjustment Assistance (TAA)-Funded Training","Community college education and other classroom training Work based and other occupational training","Dislocated or displaced worker",,"United States",2012, "A cost-benefit analysis of the National Guard Youth ChalleNGe Program. Technical report.","Perez-Arce, F., Constant, L., Loughran, D., & Karoly, L. (2012). A cost-benefit analysis of the National Guard Youth ChalleNGe Program. Technical report. Santa Monica, CA: RAND.","Opportunities for Youth","Study Type: Descriptive Analysis",,,"Summary: This report estimates the social return on investment of the National Guard Youth ChalleNGe program, a disciplinary and educational intervention for unemployed youth ages 16 to 18 who are not in school. Related reports examined impacts of the program at 10 sites measured at 9, 21, and 36 months. The authors used several types of data to determine the program’s costs and benefits. For costs, the data included program budgets and the March 2010 Current Population Survey. For benefits, the main data source was the impact estimates from the 36-month follow-up and data from the National Longitudinal Survey of Youth, 1979 cohort (NLSY79). The authors calculated the operating and opportunity costs of the program per admitted cadet and compared this to the lifetime benefits of being admitted to the program, including increased earnings, decreased dependence on social welfare, and decreased criminal activity. The study found that net benefits of the program, from the perspective of society as a whole, were $25,549 per admittee, a return on investment of 166 percent. The government incurred negative net benefits, largely due to covering the bulk of the operating costs, and the participants had substantial, positive net benefits.","the National Guard Youth ChalleNGe Program","Basic skills Community college education and other classroom training Mentoring Other training and education Youth programs",Youth,,"United States",2012, "Does trade adjustment assistance make a difference?","Reynolds, K. M., & Palatucci, J. S. (2012). Does trade adjustment assistance make a difference? Contemporary Economic Policy, 30(1), 43-59. [TAA versus no TAA]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of Trade Adjustment Assistance (TAA) on the employment and earnings of displaced manufacturing workers. The authors investigated similar research questions in another study, examining the impact of TAA services including training relative to TAA services not including training, the profile of which is available [here]. The study uses a nonexperimental design to compare the outcomes of workers displaced from manufacturing jobs from 2003 to 2005 who received services through TAA with the outcomes of a comparison group of workers displaced during the same period who likely did not receive assistance. The authors collected data on the treatment and comparison groups from different sources. Data for program participants were based on U.S. Department of Labor Trade Act Participant reports. Data for the comparison group were based on the Displaced Worker Survey from the Current Population Survey. The study did not find statistically significant relationships between receiving TAA and the employment or earnings of participants compared with those who did not receive assistance from the program. The quality of causal evidence provided in this study is low because the study uses a nonexperimental design, and the authors did not demonstrate that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to TAA; other factors are likely to have contributed.","Trade Adjustment Assistance (TAA)-Funded Training","Adult and Dislocated Worker programs Job search assistance and supportive services Work based and other occupational training","Other barriers",,"United States",2012,http://faculty.smu.edu/Millimet/classes/eco7377/papers/reynolds%20palatucci%202… "Does trade adjustment assistance make a difference?","Reynolds, K. M., & Palatucci, J. S. (2012). Does trade adjustment assistance make a difference? Contemporary Economic Policy, 30(1), 43-59. [TAA with training versus TAA without training]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of Trade Adjustment Assistance (TAA) on the employment and earnings of participants displaced from jobs in the manufacturing sector who did and did not receive training services through TAA. The authors investigated similar research questions in another study examining the impact of TAA services relative to no TAA services, the profile of which is available [here]. The study uses a nonexperimental design to compare the outcomes of TAA participants who received job training and other program services with outcomes of a comparison group of participants who obtained a training waiver but received other forms of program assistance. Data for program participants were based on U.S. Department of Labor Trade Act Participant reports. The study found statistically significant relationships between receiving job training through the TAA program and employment and earnings when compared with participants who obtained a training waiver but received other forms of program assistance. The quality of causal evidence provided in this study is low because the study uses a nonexperimental design, and the authors did not demonstrate that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to TAA; other factors are likely to have contributed.","Trade Adjustment Assistance (TAA)-Funded Training","Adult and Dislocated Worker programs Job search assistance and supportive services Other training and education","Dislocated or displaced worker",,"United States",2012,http://faculty.smu.edu/Millimet/classes/eco7377/papers/reynolds%20palatucci%202… "Minnesota’s Affordable Homes Program: Evaluating the effects of a prison work program on recidivism, employment and cost avoidance","Northcutt Bohmert, M., & Duwe, G. (2012). Minnesota’s Affordable Homes Program: Evaluating the effects of a prison work program on recidivism, employment and cost avoidance. Criminal Justice Policy Review, 23(3), 327-351. [Study 1, Contrast 2: Affordable Homes Program completers versus matched nonparticipants]",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The authors examine the impact of completing Minnesota’s Affordable Homes Program (AHP) on post-release employment, earnings, and recidivism outcomes for people who were previously incarcerated. The authors also investigated whether participation in the program impacted similar outcomes, the profile of which is available here. The authors used a nonexperimental design (propensity score matching) to create a comparison group of nonparticipants who were similar to program completers. The authors used data from the Minnesota Department of Employee and Economic Development, the Minnesota Bureau of Criminal Apprehension, and the Minnesota Department of Corrections to compare these groups’ post-release employment, earnings, and recidivism. Completion of AHP was associated with lower recidivism, higher employment, and higher earnings; these results were statistically significant. The quality of causal evidence presented in this report for program completers compared with nonparticipants is low because the authors did not fully account for possible existing differences between the study groups. This means we are not confident that estimated effects between program completers and nonparticipants are attributable to AHP; other factors are likely to have contributed.","Minnesota’s Affordable Homes Program (AHP)",Reentry,Justice-involved,,"United States",2012,https://journals.sagepub.com/doi/pdf/10.1177/0887403411411911 "Minnesota’s Affordable Homes Program: Evaluating the effects of a prison work program on recidivism, employment and cost avoidance","Northcutt Bohmert, M., & Duwe, G. (2012). Minnesota’s Affordable Homes Program: Evaluating the effects of a prison work program on recidivism, employment and cost avoidance. Criminal Justice Policy Review, 23(3), 327-351. [Study 1, Contrast 1: Affordable Homes Program participants versus matched nonparticipants].",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The authors examine the impact of participation in Minnesota’s Affordable Homes Program (AHP) on post-release employment, earnings, and recidivism outcomes for people who were previously incarcerated. The authors also investigated whether completion of the program impacted similar outcomes, the profile of which is available here. The authors used a nonexperimental design (propensity score matching) to create a comparison group of nonparticipants who were similar to program participants. The authors used data from the Minnesota Department of Employee and Economic Development, the Minnesota Bureau of Criminal Apprehension, and the Minnesota Department of Corrections to compare these groups’ post-release employment, earnings, and recidivism. • Participation in AHP was not associated with statistically significant effects on employment, earnings, or the recidivism as measured by rearrest, felony reconviction, or re-incarceration for a new crime. The quality of causal evidence presented in this report for program participants compared with nonparticipants is low for post-release employment and earnings but moderate for outcomes related to recidivism. This means we are not confident in the report’s employment and earnings outcomes, but we are somewhat confident in its recidivism outcomes.","Minnesota’s Affordable Homes Program (AHP)",Reentry,Justice-involved,,"United States",2012,https://journals.sagepub.com/doi/pdf/10.1177/0887403411411911 "The effects of hiring tax credits on employment of disabled veterans","Heaton, P. (2012). The effects of hiring tax credits on employment of disabled veterans. Santa Monica, CA: Rand Corporation. Occasional Paper. Retrieved from https://www.rand.org/content/dam/rand/pubs/occassional papers/2012/RAND_OP 366.pdf.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study examined the impact of the 2007 Work Opportunity Tax Credit (WOTC) on the employment and earnings outcomes among veterans with disabilities. The authors used a nonexperimental approach and data from the American Community Survey Public Use Microdata Sample to compare the employment and earnings outcomes of veterans who were eligible for the WOTC with those of veterans who were not. The study found an approximately 2 percentage point increase in employment, a 0.58 hour increase in weekly hours, and a 40 percent increase in wage income among veterans with disabilities who were eligible for WOTC compared to veterans and nonveterans with other characteristics. The quality of causal evidence presented in this report is moderate because it relied on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the WOTC program, but other factors might also have contributed to the findings.","Work Opportunity Tax Credit","Veterans' reemployment Work Opportunity Tax Credit (WOTC)","Disability, Veteran or military",,"United States",2012,https://www.rand.org/pubs/occasional_papers/OP366.html "Randomized government safety inspections reduce worker injuries with no detectable job loss","Levine, D., Toffel, M., & Johnson, M. (2012). Randomized government safety inspections reduce worker injuries with no detectable job loss. Science, 336(6083), 907-911.","OSHA Enforcement","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Health and safety-Mod/high-Favorable impacts Health and safety","Summary: The study’s objective was to examine the effect of random OSHA inspections on firms’ injury-related outcomes and performance. To do this, the authors used a regression model to compare changes over time in firms randomly chosen to receive inspections to changes in uninspected firms. The study found that the number of injuries and the cost of injuries declined after OSHA inspected a firm. In addition, the study found no evidence that the firms OSHA inspected had lower employment, sales, or credit ratings or were less likely to continue to operate than firms OSHA did not inspect. The quality of causal evidence presented in this study is moderate because the study used a well-conducted nonexperimental design. This means we have confidence that the estimated effects are attributable at least in part to OSHA inspections. However, other factors not accounted for in the study could also have contributed to the estimated effects.","OSHA Enforcement Activities","Inspections Workers compensation Workplace injury",Employed,,"United States",2012, "A new estimate of the impact of OSHA inspections on manufacturing injury rates, 1998-2005","Haviland, A., Burns, R., Gray, W., Ruder, T., & Mendeloff, J. (2012). A new estimate of the impact of OSHA inspections on manufacturing injury rates, 1998-2005. American Journal of Industrial Medicine, 55(11), 964-975.","OSHA Enforcement","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Health and safety-Low-Favorable impacts Health and safety","Summary: The study’s objective was to determine the effect of OSHA inspections on injuries in single-facility manufacturing firms in Pennsylvania between 1998 and 2005. The study used a regression model to compare the changes in workplace injuries of firms that had received particular types of inspections to those that had not received those types of inspections. The study found that inspections with penalties were associated with a statistically significantly decrease in injuries by an average of 19 to 24 percent annually in the two years after the inspection. The quality of the causal evidence presented in this study is low. This means we are not confident that the differences in workplace injuries between firms that received particular types of OSHA inspections and firms that did not receive those types of inspections are attributable to the inspections.","OSHA Enforcement Activities","Inspections Workplace injury",Employed,Manufacturing,"United States",2012, "A visual warning system to reduce struck-by or pinning accidents involving mobile mining equipment","Sammarco, J., Gallagher, S., Mayton, A., & Srednicki, J. (2012). A visual warning system to reduce struck-by or pinning accidents involving mobile mining equipment. Applied Ergonomics, 43(6), 1058-1065. https://doi.org/10.1016/j.apergo.2012.03.006","Mine Workers and Mine Health and Safety","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Health and safety-Mod/high-Favorable impacts Health and safety","Summary: The study’s objective was to examine the impact of a visual warning system on motion detection time. The study was an experiment conducted in a laboratory setting. The authors assessed whether installing a visual warning system on a continuous mining machine improved participant motion detection time. The study found that the visual warning system significantly improved speed of detection for a variety of machine movements. Also, dynamic and flashing lighting patterns significantly enhanced motion detection time compared to static or non-flashing lights. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the visual warning system, and not to other factors.",,"Mine safety and health Workplace injury",Adult,,"United States",2012,https://doi.org/10.1016/j.apergo.2012.03.006 "Bridging the gap: An impact study of eight developmental summer bridge programs in Texas","Barnett, E. A., Bork, R. H., Mayer, A. K., Pretlow, J., Wathington, H. D., & Weiss, M. J. (2012). Bridging the gap: An impact study of eight developmental summer bridge programs in Texas. New York: National Center for Postsecondary Research.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study's objective was to assess the impact of developmental summer bridge programs on college-level course completion, academic persistence, and the number of credits attempted and earned. The study was a randomized controlled trial conducted across eight colleges in Texas. Eligible students were randomly assigned to either the treatment or control groups. The authors conducted statistical models to examine differences in outcomes between the groups over two years. The study found that students in the summer bridge program earned significantly fewer credits for developmental courses than students in the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the developmental summer bridge programs, and not to other factors.","Developmental Summer Bridge Programs","Employment and Training Services Training and Education Basic skills Community college education and other classroom training Mentoring",Adult,,"United States",2012,https://ccrc.tc.columbia.edu/publications/bridging-gap-impact-developmental-sum… "Case study of East Mississippi Community College's plan to assist the Sara Lee Corporation employees due to plant closing (Unpublished doctoral dissertation)","Hanson, B. J. (2012). Case study of East Mississippi Community College's plan to assist the Sara Lee Corporation employees due to plant closing (Unpublished doctoral dissertation). Mississippi State University.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study's objective was to examine the impact of Eastern Mississippi Community College's (EMCC) workforce services training on earnings and employment. The study used a nonexperimental design to compare the outcomes of individuals receiving manufacturing training, non-manufacturing training, or no training. Using data from the Statewide Longitudinal Integrated Workforce Management System, the author conducted statistical models to examine the differences between groups. The study found a positive statistically significant relationship between manufacturing training and employment. The quality of causal evidence presented in this report is low because the author did not include sufficient control variables. This means we are not confident that the estimated effects are attributable to EMCC's workforce services training; other factors are likely to have contributed.","Eastern Mississippi Community College's Workforce Services Training","Employment and Training Services Training and Education Basic skills Capacity building programs Community college education and other classroom training","Adult, Dislocated or displaced worker, Low-skilled",,"United States",2012,https://ir.library.msstate.edu/handle/11668/20149 "Educational and child labour impacts of two food-for-education schemes: Evidence from a randomised trial in rural Burkina Faso","Kazianga, H., De Walque, D., & Alderman, H. (2012). Educational and child labour impacts of two food-for-education schemes: Evidence from a randomised trial in rural Burkina Faso. Journal of African Economies, 21(5), 723-760. doi:10.1093/jae/ejs010.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor Education and skills gains-Mod/high-Mixed impacts Education and skills gains","Summary: The study’s objective was to examine the impact of two food-for-education programs (a school meals program and a take home rations program) on education and labor outcomes for children. This summary focuses on the comparison between the take home rations treatment group and the control group. The study was a randomized controlled trial (RCT) conducted in low-income villages in northern rural Burkina Faso, West Africa. Villages were randomly assigned to one of two treatment groups or a control group. Survey data were collected from randomly selected households located close to the schools in the villages. Outcomes were analyzed using difference-in-differences models. The study found that the take home rations program significantly decreased productive labor for all children, with a larger decrease for girls than boys. For children enrolled in school at the time of the survey, the program significantly decreased productive labor for all children. The study also found that the take home rations program significantly increased school enrollment for all children. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the take home rations program, and not to other factors.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2012,https://doi.org/10.1093/jae/ejs010 "Educational and child labour impacts of two food-for-education schemes: Evidence from a randomised trial in rural Burkina Faso","Kazianga, H., De Walque, D., & Alderman, H. (2012). Educational and child labour impacts of two food-for-education schemes: Evidence from a randomised trial in rural Burkina Faso. Journal of African Economies, 21(5), 723-760. doi:10.1093/jae/ejs010.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Compliance-Mod/high-Unfavorable impacts Compliance Education and skills gains-Mod/high-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of two food-for-education programs (a school meals program and a take home rations program) on education and labor outcomes for children. This summary focuses on the comparison between the school meals treatment group and the control group. The study was a randomized controlled trial (RCT) conducted in low-income villages in northern rural Burkina Faso, West Africa. Villages were randomly assigned to one of two treatment groups or a control group. Survey data were collected from randomly selected households located close to the schools in the villages. Outcomes were analyzed using difference-in-differences models. The study found that the school meals program significantly increased all labor (productive labor plus domestic labor/household chores) for boys enrolled at the time of survey. However, the study also found that the school meals program significantly increased school enrollment for all children. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the school meals program, and not to other factors.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2012,https://doi.org/10.1093/jae/ejs010 "The impact of regulatory enforcement and consultation visits on workers’ compensation claims incidence rates and costs, 1999–2008","Foley, M., Fan, J., Rauser, E., & Silverstein, B. (2012). The impact of regulatory enforcement and consultation visits on workers’ compensation claims incidence rates and costs, 1999–2008. American Journal of Industrial Medicine, 55(11), 976-990.","OSHA Enforcement","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Health and safety-Low-Favorable impacts Health and safety","Summary: The study’s objective was to determine the impact of inspections and consultations by Washington State’s Department of Occupational Safety and Health (DOSH) on workers’ compensation claim rates and their associated costs. The study used regression models to compare changes in the claim rates and claim costs across years for firms that had a DOSH inspection or consultation with those that did not. The study found that DOSH activities were associated with statistically significant reductions in workers’ compensation claim rates. The study also found reductions in claims’ costs in firms with DOSH activities, but this was not statistically significant. The quality of the causal evidence presented in this study is low. This means we do not have confidence that the effects estimated in this study are attributable to DOSH activities.","OSHA Enforcement Activities","Inspections Other health and safety Workers compensation Workplace injury",Employed,,"United States",2012, "The Social Security Administration’s Youth Transition Demonstration Projects: Interim report on the Career Transitions Program","Fraker, T., Baird, P., Mamun, A., Manno, M., Martinez, J., Reed, D., & Thompkins, A. (2012). The Social Security Administration’s Youth Transition Demonstration Projects: Interim report on the Career Transitions Program. Princeton, NJ: Mathematica Policy Research.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: This study’s objective was to measure 12-month impacts of the Maryland Career Transitions Program (CTP), one of six project sites of the larger Social Security Administration (SSA)-sponsored Youth Transition Demonstration (YTD) projects that used a randomized evaluation. CTP provided services to help youth with severe emotional disturbances or significant mental illness improve their education and employment outcomes and become more self-sufficient. Data were collected from a baseline survey and 12-month follow-up survey, the Ticket Research File (TRF), and the Master Earnings File (MEF). The authors estimated program impacts on measures of paid employment, educational attainment, and Social Security disability benefit receipt. The study found that CTP did not achieve any statistically significant impacts on employment, earnings, total income, or Social Security disability benefit receipt during the 12-month follow-up period. However, CTP participants were more likely to enroll in postsecondary education than members of the control group. The quality of causal evidence presented in the study is high for the education and SSA benefit receipt outcomes because they are based on a well-implemented randomized controlled trial with low attrition. However, the quality of causal evidence is moderate for employment, earnings, and total income because sample attrition for these outcomes was high.","the Youth Transition Demonstration Projects, Career Transitions Program","Disability insurance Supplemental security income (SSI) Youth programs",Disability,,"United States",2012,http://www.mathematica-mpr.com/~/media/publications/PDFs/disability/YTD_CTP_Int… "Small cues change savings choices","Choi, J., Haisley, E., Kurkoski, J., & Massey, C. (2012). Small cues change savings choices. National Bureau of Economic Research working paper 17843. Cambridge, MA: NBER.","Behavioral Finance: Retirement","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employer benefits receipt-Low-Favorable impacts Employer benefits receipt","Summary: The study’s objective was to gauge the effect of savings cues on 401(k) contribution rates by exposing randomly selected groups of employees to different hypothetical savings rates or amounts. The authors analyzed the relationship between exposure to savings rate cues and savings choices among employees at an unnamed U.S. technology company who contributed less than the maximum yearly amount to their retirement savings plans prior to the intervention. Overall, the authors found that participants adjusted their 401(k) contribution rates in response to cues. Those who were cued with the maximum contribution amount were 5.7 percent more likely than those who received no cue to contribute at maximal levels. The quality of causal evidence provided in this study is low because it is a randomized controlled trial with unknown attrition and unknown equivalence of the analytic groups. This means we are not confident the estimated effects are attributable to savings cues; other factors are likely to have contributed.","Savings Cue","Employer provided retirement benefits",Employed,,"United States",2012,http://www.nber.org/papers/w17843 "The Social Security Administration’s Youth Transition Demonstration projects: Interim report on Broadened Horizons, Brighter Futures","Fraker, T., Honeycutt, T., Mamun, A., Manno, M., Martinez, J., O’Day, B., Reed, D., & Thompkins, A. (2012). The Social Security Administration’s Youth Transition Demonstration projects: Interim report on Broadened Horizons, Brighter Futures. Princeton, NJ: Mathematica Policy Research.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Mod/high-No impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: This study’s objective was to measure 12-month impacts of the Florida Broadened Horizons, Brighter Futures (BHBF) program, one of six project sites of the larger Youth Transition Demonstration (YTD) projects that used randomized evaluations.  The Social Security Administration (SSA) sponsored the evaluation. BHBF provided services to help youth with severe disabilities improve their employment outcomes and become more economically self-sufficient. Data were collected from baseline and 12-month follow-up surveys, the Ticket Research File (TRF), and Master Earnings File (MEF). The authors estimated program impacts on measures of paid employment, educational attainment, and Social Security disability benefit receipt. The study found that BHBF had statistically significant impacts on employment and Social Security disability benefit receipt at the 12-month follow-up. There were no impacts on educational attainment or earnings. The quality of causal evidence presented in this report is high because it is based on a well-conducted randomized controlled trial. This means we are confident that the effects estimated in the study are attributable solely to BHBF, and not to other factors.","the Youth Transition Demonstration Projects, Broadended Horizons, Brighter Futures","Disability insurance Supplemental security income (SSI) Youth programs","Youth, Disability",,"United States",2012,http://www.mathematica-mpr.com/~/media/publications/pdfs/disability/ytd_miami_i… "The Social Security Administration’s Youth Transition Demonstration Projects: Interim report on West Virginia Youth Works","Fraker, T., Mamun, A., Manno, M., Martinez, J., Reed, D., Thompkins, A., & Wittenburg, D. (2012). The Social Security Administration’s Youth Transition Demonstration Projects: Interim report on West Virginia Youth Works. Princeton, NJ: Mathematica Policy Research.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-No impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to measure 12-month impacts of the West Virginia Youth Works project, one of six project sites of the larger Social Security Administration (SSA)-sponsored Youth Transition Demonstration (YTD) that used a randomized evaluation. Youth Works provided services to help youth with disabilities improve their education and employment outcomes and become more economically self-sufficient. Data were collected from a baseline survey and 12-month follow-up survey, the Ticket Research File (TRF), and the Master Earnings File (MEF). The authors estimated program impacts on measures of paid employment, educational attainment, and Social Security disability benefit receipt. The study found that Youth Works had positive impacts on employment, earnings, and total income after one year of implementation. There were no impacts on educational attainment and Social Security disability benefit receipt. The quality of causal evidence presented in the study is high for the education, employment, and SSA benefit receipt outcomes because they are based on a well-implemented randomized controlled trial with low attrition. However, the quality of causal evidence is moderate for earnings and total income because sample attrition for these outcomes was high.","the Youth Transition Demonstration Projects, West Virginia Youth Works Program","Disability insurance Supplemental security income (SSI) Youth programs","Youth, Disability",,"United States",2012,http://www.mathematica-mpr.com/~/media/publications/pdfs/disability/ytd_wv_inte… "What will my account really be worth? An experiment on exponential growth bias and retirement saving","Goda, G.S., Manchester, C.F., & Sojourner, A. (2012). What will my account really be worth? An experiment on exponential growth bias and retirement saving. National Bureau of Economic Research working paper 17927. Cambridge, MA: NBER.","Behavioral Finance: Retirement","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employer benefits receipt-Mod/high-Favorable impacts Employer benefits receipt","Summary: The study’s objective was to determine how general or personalized information on projected retirement savings account balances and annual retirement income affects employees’ retirement savings decisions. A group of university employees were randomly assigned to one of four conditions: Participants in the planning treatment group received general retirement savings information, including enrollment instructions for the university’s voluntary retirement plan. Participants in the balance treatment group received all planning treatment materials plus personalized projections of retirement fund balances and access to an online customization tool. Participants in the income treatment group received all planning and balance treatment materials plus a personalized projection of income during retirement. Participants in the control group received no intervention and were in departments with only control group members. The study analyzed retirement-fund contribution data from the university’s Office of Human Resources using fixed-effects regressions. The study also collected and analyzed additional survey data regarding financial literacy, tolerance for delayed gratification, tendency to procrastinate, and beliefs about saving. Participants in the income treatment group contributed $85.42 more on average, annually, to their retirement savings accounts than did members of the control group. Both this group and those in the balance treatment group exhibited statistically significant increases in the probability of changing their contribution amounts of 1.2 and 1.4 percentage points, respectively. The quality of causal evidence provided in this study is high. This means that we are confident that the estimated effects are attributable to the different levels of the intervention and not to other factors.","Providing General Information and Personalized Savings and Income Projections","Employer provided retirement benefits",Employed,,"United States",2012,http://www.nber.org/papers/w17927 "The impact of work incentive benefits counseling on employment outcomes: Evidence from two return-to-work demonstrations","Delin, Barry S., Hartman, Ellie C., & Sell, Christopher W. (2012). The impact of work incentive benefits counseling on employment outcomes: Evidence from two return-to-work demonstrations. Journal of Vocational Rehabilitation, 36, 97-107. DOI:10.3233/JVR-2012-0585.","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: This study investigated the influence that different amounts of work incentive benefits counseling had on employment outcomes for people receiving Social Security disability benefits. The study used data from two similar Social Security Administration (SSA) sponsored return-to-work projects implemented in Wisconsin since 1999 to address two research questions: (1) Does the amount (dosage) of work incentive benefits counseling influence employment outcomes? and (2) What factors, including prior employment outcomes, influence the dosage of work incentive benefits counseling services received? Although conclusions based on data from two relatively small projects located in a single state cannot fully settle the issue, results from linear regression models suggested that receiving higher dosages of benefits counseling services led to better employment outcomes. The study also showed that participants with stronger pre-enrollment employment outcomes received more service (a higher dosage of benefits counseling) than those who had weaker ones.",,"Disability insurance Other wages and benefits Supplemental security income (SSI)",Disability,,"United States",2012, "Transformative graduate education programs: An analysis of impact on STEM and non-STEM Ph.D. completion","Kniola, D., Chang, M., & Olsen, D. (2012). Transformative graduate education programs: An analysis of impact on STEM and non-STEM Ph.D. completion. Higher Education, 63(4), 473–495. doi:10.1007/s10734-011-9453-8","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to determine whether universities participating in Transformative Graduate Education Programs (TGPs) conferred a greater number of science, technology, engineering, and mathematics (STEM) doctoral degrees, particularly to women and underrepresented candidates of color. The study also examined whether TGPs resulted in a greater number of non-STEM doctoral degrees, but that is not the focus of this review. The authors analyzed data from the Integrated Postsecondary Education Data System to estimate the impact of a university’s participation in one of seven TGPs during the 2003–2005 period, controlling for institutional characteristics. The study found that TGPs were associated with a higher number of doctoral degrees awarded in STEM fields to women across all institutions. The quality of causal evidence presented in this report is low. This means we are not confident that the estimated effects are attributable to universities’ participation in TGPs. Other factors are likely to have contributed.","Transformative Graduate Education Programs (TGPs)","Science, Technology, Engineering, and Math (STEM) programs","Other barriers, Female, STEM professional",,"United States",2012, "Thrift Savings Plan. (2012). Participant behavior and demographics: Analysis of 2008–2012.","Thrift Savings Plan. (2012). Participant behavior and demographics: Analysis of 2008–2012.","Behavioral Finance: Retirement","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employer benefits receipt-Low-Mixed impacts Employer benefits receipt","Summary: The study’s objective was to determine whether changes in the design of the Thrift Savings Plan (TSP) led to changes in federal employees’ participation in and contributions to the Federal Employee Retirement System (FERS). In 2009 and 2010, TSP instituted two major changes, a decrease in the waiting period for eligibility to receive employer matching contributions and automatic enrollment in a Government Securities Investment Fund (G Fund). This study used an interrupted time series design to compare employees’ investment behaviors before and after the TSP design changes. It used data from the TSP record-keeping system and the Office of Personnel Management (OPM). Across the TSP participants analyzed, participation in FERS increased by about 4 percentage points from 2009 to 2012, whereas the average deferral rate decreased slightly from the 2008 level. TSP’s design changes were not associated with how often employees monitored their FERS investments. The quality of causal evidence presented in this study is low, meaning that we are not confident that the estimated effects are attributable to TSP design changes. Other factors are likely to have contributed.","Immediate Contributions and Automatic Enrollment in the Thrift Savings Plan","Employer provided retirement benefits",Employed,,"United States",2012, "The effects of learning communities for students in developmental education: A synthesis of findings from six community colleges","Visher, M., Weiss, M., Weissman, E., Rudd, T., & Wathington, H. (2012). The effects of learning communities for students in developmental education: A synthesis of findings from six community colleges. New York: National Center for Postsecondary Research.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of developmental education learning communities at six community colleges across the United States on enrollment, credits attempted, and credits earned over the program semester and two follow-up semesters. Students in the learning communities took a developmental course that was linked to either a college-level course or a student success course, depending on the specific school, during one semester. One community college also provided students in the learning communities with tutoring and case management services. The study pooled data from six randomized controlled trials, in which eligible students were randomly assigned to either the treatment group, which was offered the opportunity to participate in the learning community program, or the control group, which could not participate in the learning community program. The primary data sources were a baseline survey on background characteristics and student transcripts. The study found that the treatment group had significantly higher full-time registration rates and earned significantly more total cumulative credits during the program semester than the control group, but these differences were not significant in the two follow-up semesters. In addition, the study found no significant impacts on course enrollment rates or total cumulative credits attempted in the program semester or the two follow-up semesters. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the learning communities, and not to other factors.","Learning Communities","Basic skills Community college education and other classroom training","Adult, Other barriers",,"United States",2012,http://www.mdrc.org/sites/default/files/LC%20A%20Synthesis%20of%20Findings%20FR… "Commencement day: Six-year effects of a freshman learning community program at Kingsborough Community College","Sommo, C., Mayer, A.K., Rudd, T., & Cullinan, D. (2012). Commencement day: Six-year effects of a freshman learning community program at Kingsborough Community College. New York: MDRC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Opening Doors learning communities at Kingsborough Community College in New York on progress toward completing a degree and actual completion of a degree. Impacts were measured six years after random assignment. Students in the Opening Doors learning communities took three linked courses during one semester and were provided with tutoring and case management services. The study was a randomized controlled trial. Eligible students were randomly assigned to either the treatment group, which was offered the opportunity to participate in one of the learning communities, or the control group, which was not allowed to enroll in a learning community. The primary data sources were a baseline survey on the background characteristics of students, students’ transcripts, and degree attainment information from the National Student Clearinghouse. The study found no significant impacts on the total number of semesters enrolled, total credits earned, percentage of participants who earned a degree, percentage of participants who earned a bachelor’s degree or higher or an associate’s degree, or the percentage of participants who ever enrolled in a four-year institution. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects would be attributable to the Opening Doors learning communities, and not to other factors.","Opening Doors Learning Communities at Kingsborough Community College","Community college education and other classroom training",Adult,,"United States",2012,http://www.mdrc.org/sites/default/files/Commencement%20Day%20FR.pdf "Demonstration to Maintain Independence and Employment (DMIE): Final report","Whalen, D., Gimm, G., Ireys, H., Gilman, B., & Croake, S. (2012). Demonstration to Maintain Independence and Employment (DMIE): Final report. Princeton, NJ: Mathematica Policy Research.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The report’s objective was to examine the impacts of the Demonstration to Maintain Independence and Employment (DMIE). DMIE was implemented in Hawaii, Kansas, Minnesota, and Texas with the aim of preventing or delaying people with disabilities from leaving the workforce and applying for Social Security Disability Insurance (SSDI) and Supplemental Security Income (SSI) benefits.  The study was a randomized controlled trial examining DMIE’s impact on employment, earnings, benefit applications and receipt, and health status. Study data sources included the Ticket Research File (TRF), Master Earnings File (MEF), and survey data. Because DMIE recruitment methods, participant populations, and services offered varied substantially across states, the authors reported impacts separately for each state and for Minnesota and Texas pooled together. With few exceptions, DMIE did not achieve statistically significant impacts on employment, annual earnings, or disability benefit applications. In Hawaii, DMIE participants worked fewer hours and reported fewer instrumental activities of daily living limitations. In Minnesota and Texas, the program reduced federal disability benefit receipt. The quality of the causal evidence is high for most outcomes examined, which means that we are confident that the estimated impacts are attributable solely to the DMIE. However, for some outcomes, including the hours worked in Hawaii, the quality of the causal evidence is moderate, which means that factors other than DMIE might have contributed to the estimated effects.","Demonstration to Maintain Independence and Employment (DMIE)","Health Disability insurance Supplemental security income (SSI) Vocational rehabilitation",Disability,,"United States",2012,http://www.mathematica-mpr.com/~/media/publications/PDFs/disability/dmie_final… "Investing for retirement: The moderating effect of fund assortment size on the 1/n heuristic","Morrin, M., Inman, J. J., Broniarczyk, S. M., Nenkov, G., & Reuter, J. (2012). Investing for retirement: The moderating effect of fund assortment size on the 1/n heuristic. Fox School of Business Research Paper No. 14-009, 1–38.","Behavioral Finance: Retirement","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employer benefits receipt-Mod/high-Favorable impacts Employer benefits receipt","Summary: Experiments using U.S. households The study’s objective was to examine whether increases in the number of funds offered in a retirement plan caused investors to allocate their contributions more evenly across all available investment options. The authors administered one survey to a nationally representative sample of U.S. households and two surveys to people from consumer panels. The surveys contained information on hypothetical savings plans that were manipulated to include either a small or large fund assortment size. Participants were instructed to choose the plans in which they would invest and indicate the percentage they would invest in each of the chosen funds. The study found that participants were more likely to allocate hypothetical investments across all available funds when offered a small versus large assortment size. The quality of the causal evidence presented in this portion of the study is moderate because, although the authors controlled for observable characteristics of samples members and there was no evidence that survey versions were systematically assigned to sample members, the Clearinghouse for Labor Evaluation and Research (CLEAR) could not confirm that survey versions were randomly assigned. Analysis of employees’ data  The study’s objective was to determine whether the number of fund options offered by a 401(k) plan influenced the investment behavior of plan members. The authors compared investment behaviors among employees offered 10 or 19 fund options for investment, controlling for employees’ characteristics. The analysis used administrative data on contributions to the defined contribution plan of the Oregon University System. The study used an interrupted time series (ITS) design that analyzed changes in outcomes before and after an increase in the number of available investment options. The analysis demonstrated that offering a larger fund assortment size was associated with a statistically insignificant decrease in the tendency of employees to invest in all available funds and spread invested dollars evenly among chosen alternatives. The quality of causal evidence presented in this study is low. This means that we are not confident that the estimated effects are solely attributable to fund assortment size; other factors are likely to have contributed.","Informational Interventions for Households and Workers","Employer provided retirement benefits",Employed,,"United States",2012, "The Social Security Administration’s Youth Transition Demonstration Projects: Interim report on Broadened Horizons, Brighter Futures","Fraker, T., Honeycutt, T., Mamun, A., Manno, M., Martinez, J., O’Day, B., Reed, D., & Thompkins. A. (2012). The Social Security Administration’s Youth Transition Demonstration Projects: Interim report on Broadened Horizons, Brighter Futures. Report submitted to the Social Security Administration. Washington, DC: Mathematica Policy Research.","Disability Employment Policy","Study Type: Implementation Analysis",,,"Summary: This report presented an interim implementation and impact analysis on the Broadened Horizons, Brighter Futures (BHBF) Youth Transition Demonstration (YTD) project. The program sought to help youth with disabilities ages 16 through 22 who received Supplemental Security Income and resided in Miami-Dade County maximize their self-sufficiency. The study examined implementation of BHBF, focusing on major aspects of service delivery, including the background, local context and service environment. It also provided information on participants’ characteristics and satisfaction with the program. The authors conducted qualitative analysis of staff and participant interviews, including data collected from site visits; and descriptive quantitative analysis of participants’ baseline and follow-up survey data and service utilization data from a management information system. The study found that participants began receiving services soon after enrollment. Some services were more challenging to implement than others, but all participants received some project services and most received at least one of the four major types of service: benefits planning, employment, education, and case management.  Study findings related to implementation challenges and solutions are potentially applicable to other current or future projects that provide employment-related services to youth with disabilities.","the Youth Transition Demonstration Projects, Broadended Horizons, Brighter Futures","Supplemental security income (SSI) Youth programs Vocational rehabilitation","Youth, Disability",,"United States",2012,http://www.mdrc.org/sites/default/files/interim_report_broadened_horizons.pdf "The Social Security Administration’s Youth Transition Demonstration projects: Interim report on West Virginia Youth Works","Fraker, T., Mamun, A., Manno, M., Martinez, J., Reed, D., Thompkins, A., & Wittenburg, D. (2012). The Social Security Administration’s Youth Transition Demonstration projects: Interim report on West Virginia Youth Works. Report submitted to the Social Security Administration. Washington, DC: Mathematica Policy Research.","Disability Employment Policy","Study Type: Implementation Analysis",,,"Summary: This report presented an interim implementation and impact analysis on the West Virginia Youth Works Youth Transition Demonstration (YTD) project. The program sought to help youth with disabilities ages 14 through 25 who lived in 19 specific West Virginia counties to maximize their economic self-sufficiency. The study examined implementation of Youth Works, focusing on major aspects of service delivery, including the background, local context, and service environment. It provided information on participants’ characteristics and satisfaction with the program. The authors conducted qualitative analysis of staff and participant interviews, including data collected from site visits, and descriptive quantitative analysis of participants’ baseline and follow-up survey data and service utilization data from a management information system. Overall, the study found that Youth Works faced some substantial challenges, but that all participants received some project services and most received at least one contact for each of the four types of service: benefits planning, employment, education, and case management. Study findings related to implementation challenges and solutions are potentially applicable to other current or future projects that provide employment-related services to youth with disabilities.","the Youth Transition Demonstration Projects, West Virginia Youth Works Program","Supplemental security income (SSI) Youth programs Vocational rehabilitation","Youth, Disability",,"United States",2012,http://www.mdrc.org/sites/default/files/WV%20YTD%20Report%2012-3-2012.pdf "A randomized controlled trial of supported employment among veterans with posttraumatic stress disorder","Davis, L., Leon, A., Toscano, R., Drebing, C., Ward, L., Parker, P., ..., & Drake, R. (2012). A randomized controlled trial of supported employment among veterans with posttraumatic stress disorder. Psychiatric Services, 63(5), 464-470.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of individual placement and support (IPS) on competitive employment, earnings, and income for U.S. military veterans with posttraumatic stress disorder (PTSD). The study was a randomized controlled trial conducted at the Tuscaloosa Veterans Affairs (VA) Medical Center. Treatment group members received IPS services, whereas the control group received standard Vocational Rehabilitation Program (VRP) services. Data sources included patients’ records from the clinical research coordinator and daily logs completed by participants. The study found that IPS had positive impacts on competitive employment and gross income. The quality of causal evidence presented in this report is high because it is based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to IPS, and not other factors.","Individual Placement and Support and Vocational Rehabilitation Program","Vocational rehabilitation Veterans' reemployment Supported employment or other employment supports","Disability, Veteran or military",,"United States",2012, "Gender and career outcomes of U.S. engineers","Frehill, L. (2012). Gender and career outcomes of U.S. engineers. International Journal of Gender, Science and Technology, 4(2), 149-166.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: This study addressed two research questions concerning the retention rates of engineers in the United States: whether more women leave the engineering field because of family-related concerns than men and whether more women than men move into managerial work. The author analyzed data from the National Science Foundation’s public use Science and Engineering Statistical Data System (SESTAT) for 2006. SESTAT includes three surveys: the National Survey of College Graduates, the National Survey of Recent College Graduates, and the Survey of Doctorate Recipients. The study sample was 17,004 people. The study found that the retention rate for women in the engineering field was 70 percent, compared with 86 percent retention for men, and more women cited family-related issues as a reason for departure than did men. However, family-related issues were not the main reason for leaving the engineering field for either gender—female respondents noted a change in career or professional interests as their main reason for departure, whereas a lack of pay or promotion opportunities were the main reasons cited by men. The study also found that women engineers were less likely to currently hold management positions compared with male respondents. For example, 49 percent of male respondents indicated that they supervised employees in their current position, compared with 33 percent of female respondents.",,"Science, Technology, Engineering, and Math (STEM) programs Other disparities or discrimination in employment and earnings","Female, Male, STEM professional",,"United States",2012, "The role of parents and teachers in the development of gender-related math attitudes","Gunderson, E., Ramirez, G., Levine, S., & Beilock, S. (2012). The role of parents and teachers in the development of gender-related math attitudes. Sex Roles, 66, 153-166.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study’s objective was to summarize existing literature and identify future areas for research related to the relationship between parents’ and teachers’ gender stereotypes in math and children’s mathematics performance and self-concept. The authors summarized the findings of recent studies that examined parents’, teachers’, and students’ math gender stereotypes, focusing on impressions of success—whether boys or girls had above-average ability in math or were likely to succeed in math—as well as reasons for that success, particularly natural ability and effort. The authors suggested three new directions for future research on this topic based on their review of the literature. First, research could investigate the links among parents’ and teachers’ math anxiety, self-efficacy, and teaching self-efficacy and their children’s or students’ attitudes. A second direction involved transmission of gender differences in theories of math intelligence—that is, whether mathematical ability is fixed or can improve through effort. Finally, research has shown that children identify with math gender stereotypes from a young age, but does not yet suggest a mechanism through which children acquire these stereotypes.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Female, Male",,"United States",2012, "Adolescent girls’ experiences and gender-related beliefs in relation to their motivation in math/science and English","Leaper, C., Farkas, T., & Brown, C. (2012). Adolescent girls’ experiences and gender-related beliefs in relation to their motivation in math/science and English. Journal of Youth and Adolescence, 41(3), 268-282.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study examined factors that influence teenage girls’ academic motivation in math, science, and English. The authors analyzed survey data from 579 girls ages 13 to 18 years old in Georgia and California to estimate predictors of the girls’ academic motivation in math, science, and English. The survey asked about the youths’ (1) academic motivation for each subject; (2) grades in these subjects; (3) perceptions of support from family and peers in these subjects; (4) attitudes on gender identity, measured by perceived parental and peer pressure to conform with traditional gender roles, the degree to which the youth perceived themselves to be so-called typical girls, and youths’ level of contentedness with the gender expectations they face; (5) opinions on gender egalitarianism of specific tasks, such as making decisions for the family; and (6) exposure to feminism, as measured by whether the youth had heard of the women’s rights movement and feminism through media or conversations with family or friends, as well as whether the youth knew that their mothers, teachers, or classmates identified as feminists. The study found that the following factors were positively associated with the girls’ motivation in math and science: mother and peer support in these subjects, belief in gender equality, less pressure from parents to conform to gender norms, holding gender-egalitarian beliefs, and exposure to feminism ideas and/or feminists.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Female",,"United States",2012, "Women, men, and academic performance in science and engineering: The gender difference in undergraduate grade point averages","Sonnert, G., & Fox, M. (2012). Women, men, and academic performance in science and engineering: The gender difference in undergraduate grade point averages. Journal of Higher Education, 83(1), 73-101.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study tested a hypothesis that women have higher undergraduate grade point averages (GPAs) than their male peers (referred to as a GPA advantage), and that the difference is most pronounced in STEM fields with fewer female students and fewer female faculty members. In addition, the authors tested a second hypothesis that women’s GPA advantage was driven by institution type, with larger advantages existing at institutions offering specific programs supporting women in science and engineering, compared with institutions without such programs. The authors used data from the Integrated Postsecondary Data System and from a survey of 499 university and college registrars in the United States to examine the academic performance of undergraduate students in biology, the physical sciences, and engineering from 1984 to 2000. They used regression models to compare the GPAs of male and female students over time both across and within the three fields, controlling for the percentage of female majors, degree recipients, and faculty within each field at each institution in a given year. The study found that women’s GPAs across the three fields were, on average, 0.1 points (on a 4.0-point scale) higher than men’s during the study period. The study also found that in the physical sciences field, the percentage of female degree recipients was significantly associated with women’s GPA advantage—when more women earned degrees in physical sciences, the GPA advantaged diminished; however, this finding did not hold in the biology or engineering fields. The study found that the strongest predictor of women’s GPA advantage across fields was the type of institution, with a larger advantage occurring at nonresearch institutions compared with research institutions. In addition, the study found that at nonresearch institutions with programs specifically supporting women in science and engineering, women’s GPA advantage was even larger.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Female, Male",,"United States",2012, "Exploring the impact of learning communities at a community college: An effort to support students enrolled in a developmental math course (Doctoral dissertation)","VonHandorf, T. (2012). Exploring the impact of learning communities at a community college: An effort to support students enrolled in a developmental math course (Doctoral dissertation). Retrieved from ProQuest Dissertations and Theses database. (UMI No. 3504070)","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of a learning community consisting of linked courses (a developmental math course and a student success course) on students’ retention and persistence in community college. The author compared mean outcomes for students enrolled in the learning community (the treatment group) and students enrolled in the same nonlearning community developmental math course in previous semesters (the comparison group). The study used administrative data to measure retention in the developmental math course and persistence into the next semester. The study found no statistically significant differences in outcomes between the treatment and comparison groups. The quality of the causal evidence presented in this report is low because the author did not control for relevant student characteristics in the analysis. This means we are not confident that the estimated effects are attributable to the learning community. Other factors are likely to have contributed.","Learning Communities","Basic skills Community college education and other classroom training","Adult, Other barriers",,"United States",2012, "Affirmative action and the occupational advancement of minorities and women during 1973-2003","Kurtulus, F. (2012). Affirmative action and the occupational advancement of minorities and women during 1973-2003. Industrial Relations, 52(2), 213-246.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the effect of affirmative action requirements for federal contractors on the occupational employment shares of minorities and women at federal contractors and noncontractors from 1973 to 2003. The author used a nonexperimental design to examine establishments’ employment share of race, ethnicity, and gender groups in seven occupational categories over time using data from annual EEO-1 Employer Information Report files. The study found that, among firms that became federal contractors from 1973 to 2003, the share of Hispanic women, white women, African American women, and African American men significantly increased in some skilled occupational categories compared with firms that did not become federal contractors in that period. The study also found that the share of African American men and women increased significantly in manual jobs at federal contractor firms, compared with nonfederal contractor firms in that period. The quality of causal evidence presented in this report is moderate because it was based on a strong non-experimental design. This means we are somewhat confident that the estimated effects are attributable to affirmative action requirements for federal contractors, but other factors might also have contributed.","Affirmative Action Legislation","Affirmative action Executive Order 11246 (E.O. 11246) Civil Rights Act of 1964",Other,,"United States",2012, "Engineering students' beliefs about research: Sex differences, personality, and career plans","Woodcock, A., Graziano, W., Branch, S., Ngambeki, I., & Evangelou, D. (2012). Engineering students' beliefs about research: Sex differences, personality, and career plans. Journal of Engineering Education, 101 (3), 495-511.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The authors explored the relationships among male and female engineering major undergraduates’ perceptions of research and researchers, their intellectual orientation toward people versus objects, and their interest in pursuing engineering research careers. The authors administered an online study to second-year or higher undergraduate students in the engineering, life sciences, and psychology departments of a large research university in the midwestern United States. They used regression analysis to identify beliefs and personality traits that predict interest in engineering research careers for male and female students. The study found that having a “Thing Orientation”—a predisposition to focus on objects and their manipulation instead of a tendency to notice and identify with others’ emotions—significantly predicts research interest and has a greater association with research interest among female engineering students than among their male classmates. The authors also sought to discover the pathway through which Thing Orientation promotes interest in a research career by identifying associations between Thing Orientation and beliefs about research. For the female students in this sample, Thing Orientation was positively associated with the beliefs that research is innovative and transformative, requires repetitive lab work, and calls for creativity and collaboration. In turn, these beliefs affect female engineering students’ interest in research careers; the belief that research is innovative and transformative is positively associated with interest in a research career.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Female, Male",,"United States",2012, "Women in industrial engineering: Stereotypes, persistence, and perspectives","Brawner, C., & Camacho, M. (2012). Women in industrial engineering: Stereotypes, persistence, and perspectives. Journal of Engineering Education, 101(2), 288-318.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: This study explored why more women major in industrial engineering in college than other engineering fields. The authors tabulated quantitative data from eight colleges and universities in the southeastern region of the United States using data from the Multiple-Institution Database for Investigating Engineering Longitudinal Development (MIDFIELD). They also conducted focus groups with 20 female industrial engineering students and qualitatively analyzed the content of industrial engineering department websites at the eight MIDFIELD institutions. The study found that students transferred into an industrial engineering major program after taking several semesters of coursework in another field at the university. It found no evidence that women with weak academic records were more likely to choose industrial engineering over other engineering majors. Focus group participants felt that their department had a warm, familial atmosphere, and that the major provided a more general background in engineering, which could offer them more flexible job opportunities in a variety of related fields. This was consistent with departmental websites, which marketed themselves as having a strong sense of community and collegiality, and stressed the wide range of career opportunities available to their graduates as problem solvers for society and industry.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Female",,"United States",2012, "Learning communities for students in developmental English: Impact studies at Merced College and the Community College of Baltimore County","Weissman, E., Cullinan, D., Cerna, O., Safran, S., & Richman, P. (2012). Learning communities for students in developmental English: Impact studies at Merced College and the Community College of Baltimore County. New York: MDRC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of learning communities on academic progression among students in need of developmental English courses at Merced Community College in Merced, California, and the Community College of Baltimore County (CCBC), in Maryland. The study was a randomized controlled trial that compared outcomes of the treatment and control groups during the program semester and the subsequent semester. The primary data source was transcript data from the colleges. The study found that students assigned to the Learning Communities Demonstration at Merced attempted and earned more developmental English credits in the program semester than students in the control group. The study did not find any statistically significant impacts of the learning communities at CCBC. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Learning Communities Demonstration, and not to other factors.","the Learning Communities Demonstration","Basic skills Community college education and other classroom training","Adult, Other barriers",,"United States",2012,http://files.eric.ed.gov/fulltext/ED529251.pdf "New evidence of success for community college remedial English students: Tracking the outcomes of students in the Accelerated Learning Program (ALP)","Cho, S. W., Kopko, E., Jenkins, D., & Jaggars, S.S. (2012). New evidence of success for community college remedial English students: Tracking the outcomes of students in the Accelerated Learning Program (ALP) (CCRC Working Paper No. 53). New York: Columbia University, Community College Research Center.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Education and skills gains-Mod/high-Mixed impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Community College of Baltimore County’s Accelerated Learning Program (ALP) on course progression, persistence, and completion outcomes. In this program, students who otherwise would have taken a developmental English course instead took English 101, as well as an eight-person companion course designed to help the students pass English 101. With student-level, college administrative data, the authors used regression models and propensity score matching to compare outcomes of ALP students to those of comparison students in traditional courses. The study found that ALP students were more likely than comparison students to attempt and complete college-level English courses, persist to the next year, and attempt and complete more credits. However, ALP students were less likely to earn a certificate degree than comparison students. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the ALP, but other factors might also have contributed.","the Accelerated Learning Program","Community college education and other classroom training","Adult, Other barriers",,"United States",2012,http://files.eric.ed.gov/fulltext/ED538995.pdf "The efficacy of learning communities in assisting developmental students in achieving graduation and accumulation of credit hours in a southern metropolitan community college","Ashley, W. (2012). The efficacy of learning communities in assisting developmental students in achieving graduation and accumulation of credit hours in a southern metropolitan community college (Doctoral dissertation). Retrieved from ProQuest Dissertations and Theses database. (UMI No. 3522188)","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of learning communities on college credits earned and the completion of a college degree at Hinds Community College in Raymond, Mississippi. The study used school records to compare a treatment group of developmental education students who were living on campus and assigned to a learning community with a comparison group of students who lived off campus and did not participate in a learning community. The study found no significant differences in outcomes between the treatment and comparison groups. The quality of causal evidence presented in this report is low because the author did not control for preexisting differences between the treatment and comparison groups. This means we would not be confident that any estimated effects would be attributable to learning communities. However, the study found no statistically significant effects.","Learning Communities","Basic skills Community college education and other classroom training","Adult, Other barriers",,"United States",2012, "The more things change, the more they stay the same? Prior achievement fails to explain gender inequality in entry into STEM college majors over time","Riegle-Crumb, C., King, B., Grodsky, E., & Muller, C. (2012). The more things change, the more they stay the same? Prior achievement fails to explain gender inequality in entry into STEM college majors over time. American Educational Research Journal, 49(6), 1048-1073.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study explored whether U.S. students’ prior achievement in math and science contributed to higher enrollment rates for men versus women in physical science and engineering degree programs in the 1980s, 1990s, and 2000s. The authors analyzed data from the High School and Beyond Study (1980s), the National Education Longitudinal Study (1990s), and the Educational Longitudinal Study (2000s) to determine whether gender was correlated with college major choice, after controlling for three different measures of prior academic achievement. The study found that female students were approximately 20 percentage points less likely to declare a science, technology, engineering, and mathematics (STEM) major than male students. However, prior achievement in math and science, as measured by GPA, average standardized test scores, and position along the test score distribution, did very little to explain this gender gap. The study found that girls’ higher performance in English versus math and science only somewhat accounted for the gender gap in college major choice. Factors such as ethnicity and socioeconomic status were more influential.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Female",,"United States",2012, "Can job search assistance do harm? Long-term effects of the Washington Alternative Work Search Experiment","Cebi, M., Lachowska, M., & Woodbury, S. (2012). Can job search assistance do harm? Long-term effects of the Washington Alternative Work Search Experiment. Unpublished manuscript.",,"Study Type: Descriptive Analysis",,,"Summary: The study’s objective was to examine the effects of the Washington Alternative Work Search Experiment on the employment, earnings, and unemployment insurance benefit receipt among those who participated in the job search assistance offered as part of the experiment. CLEAR did not complete a review of this study because, although it is publicly available, according to the authors, the research is incomplete.",,"Job search assistance and supportive services",Adult,,"United States",2012,http://coin.wne.uw.edu.pl/wiem/papers_2012/Lachowska.pdf "Exploring bias in math teachers’ perceptions of students’ ability by gender and race/ethnicity","Riegle-Crumb, C., & Humphries, M. (2012). Exploring bias in math teachers’ perceptions of students’ ability by gender and race/ethnicity. Gender & Society, 26(2), 290-322.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: This study aimed to inform the literature on gender stereotypes in classrooms by studying whether teachers displayed bias by underestimating the ability of 10th-grade female and minority students in high school math classes, even after taking into account students’ grades and test scores. The study analyzed survey data from students and teachers across the United States who were part of the Educational Longitudinal Study of 2002, which followed 15,000 10th-grade students through college and into the labor force. The authors estimated multinomial logistic regression models to determine whether teachers were more likely to underestimate the academic ability of female, black, and Hispanic students compared to white male students, controlling for grade point average (GPA), test scores, and student, teacher, and school characteristics. Results were generated separately for students in low-level, average-level, and advanced-level high school math courses. The study found that in low-level and advanced-level math classes, teachers were less likely to say that the course was too easy for white female students as compared to white male students. In average-level math classes, teachers were both less likely to say that the course was too easy and more likely to say that it was too difficult for white female students, compared to white male students. These findings did not extend to minority female students nor to minority male students, who, after controlling for GPA and test scores, were just as likely to be rated by teachers as being in a course that was too easy or too difficult for them as white male students.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Other barriers, Female",,"United States",2012, "What can a multifaceted program do for community college students? Early results from an evaluation of Accelerated Study in Associate Programs (ASAP) for developmental education students","Scrivener, S., Weiss, M., & Sommo, C. (2012). What can a multifaceted program do for community college students? Early results from an evaluation of Accelerated Study in Associate Programs (ASAP) for developmental education students. New York: MDRC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Accelerated Study in Associate Programs (ASAP) on full-time enrollment, credits attempted, and credits earned.  The study was a randomized controlled trial. Data sources included a baseline information form (BIF), which collected demographic and background characteristics and students’ records from the City University of New York (CUNY), including students’ transcripts and CUNY assessment test data. The study found that ASAP had significant impacts on full-time enrollment, credits attempted, and credits earned during the first, second, and third semesters following random assignment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to ASAP, and not to other factors.","the Accelerated Study in Associate Program (ASAP)","Basic skills Community college education and other classroom training","Adult, Other barriers, Low income",,"United States",2012,http://files.eric.ed.gov/fulltext/ED532840.pdf "Increasing opportunities for low-income women and student parents in science, technology, engineering, and math at community colleges","Costello, C. (2012). Increasing opportunities for low-income women and student parents in science, technology, engineering, and math at community colleges. Washington, DC: Institute for Women’s Policy Research.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: This study examined the enrollment patterns for low-income women and students with children (including mostly mothers and some fathers, collectively referred to as student parents) in STEM fields at community colleges in the United States, comparing outcomes for 2000–2001 to 2008–2009. In addition, the study presented examples of promising strategies to encourage low-income women and student parents to participate in STEM education at community colleges. To assess the involvement of low-income women and student parents in STEM fields at community colleges, the author analyzed publicly available data, including data from the U.S. Department of Labor and the National Center for Education Statistics at the U.S. Department of Education. The author also completed a review of existing programs at community colleges that encourage low-income women and student parents to participate in STEM fields, and consulted with 16 experts to formulate suggestions for additional programs to support these students in STEM fields. The study found that in the 2008–2009 school year, women earned 22 percent of associate’s degrees awarded in STEM fields—a 7 percentage point reduction in the proportion of STEM associate degrees earned by women eight years earlier. The study also found that, in 2008, roughly one-third of community college students were parents and student parents with children younger than 12 who ultimately earned a baccalaureate or master’s degree in a STEM field were more likely to have attended a community college at some point than students without young children. Given the decline in women’s share of STEM associate degrees earned over the study observation period, as well as the high proportion of student parents in STEM fields who attend community colleges (compared with students without young children), the author highlighted potential strategies to increase and improve the involvement of low-income women and student parents in STEM fields at community colleges, including targeted recruitment, financial support, child care services, strong developmental education options, and specific counseling and academic support for women. These recommendations were informed by information gathered from existing programs and consultation with experts.",,"Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Female, Male, Parent, Low income",,"United States",2012,http://www.iwpr.org/initiatives/student-parent-success-initiative/increasing-op… "Helping parents to motivate adolescents in mathematics and science: An experimental test of a utility-value intervention","Harackiewicz, J., Rozek, C., Hulleman, C., & Hyde, J. (2012). Helping parents to motivate adolescents in mathematics and science: An experimental test of a utility-value intervention. Psychological Science, 23(8), 899-906.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of providing information to parents about the importance of STEM on their children’s decisions to enroll in advanced high school math and science courses. The study was based on a subsample of 188 students and their parents included in the Wisconsin Study of Families and Work (WSFW) 1990–1991 birth cohort. Students were randomly assigned at the end of 9th grade to either a treatment group that was given brochures and access to a website that promoted STEM at the beginning of 10th grade, or to the control group, to which no materials were provided. The authors measured STEM course enrollment using students’ self-reported responses to the WSFW surveys and the students’ high school transcripts. The study found that students in the treatment group took significantly more math and science classes than students in the control group (predicted means of 8.31 versus 7.50 semesters), but outcomes did not vary by gender. The quality of causal evidence provided in this study is high. This means we are confident that the estimated effects are attributable to the information provided to parents about the importance of STEM, and not to other factors.",,"Science, Technology, Engineering, and Math (STEM) programs Youth programs","Adult, Parent",,"United States",2012, "More than a job: Final results from the evaluation of the Center for Employment Opportunities (CEO) transitional jobs program","Redcross, C., Millenky, M., Rudd, T., and Levshin, V. (2012). More than a job: Final results from the evaluation of the Center for Employment Opportunities (CEO) transitional jobs program. OPRE Report 2011-18. Washington, DC: Office of Planning, Research, and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of a comprehensive employment program on ex-offenders’ employment and wages. The authors randomly assigned former prisoners to an employment program offering transitional job placement and other services or to a control condition providing a more limited set of services. Employment and earnings data were collected quarterly for three years and compared between the two groups, controlling for characteristics before random assignment. The study found that treatment group members were 24.5 percentage points more likely to be employed during the first year after random assignment than control group members. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the employment program, and not to other factors.","the Center for Employment Opportunities (CEO) Transitional Jobs Program","Job search assistance and supportive services Other employment and reemployment Reentry",Justice-involved,,"Urban, United States",2012,http://www.acf.hhs.gov/sites/default/files/opre/more_than_job.pdf "Enhanced Early Head Start with employment services: 42-month impacts from the Kansas and Missouri sites of the Enhanced Services for the Hard-to-Employ Demonstration and Research Project","Hsueh, J., and Farrell, M. (2012). Enhanced Early Head Start with employment services: 42-month impacts from the Kansas and Missouri sites of the Enhanced Services for the Hard-to-Employ Demonstration and Research Project. OPRE Report 2012-05. Washington DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of Enhanced Early Head Start (EHS) participation on employment, earnings, and public assistance receipt for low-income families with young children. The study used a randomized controlled trial design, assigning eligible families to either the Enhanced EHS program or existing services. To estimate the program’s impacts, the authors used administrative employment and earnings data, as well as a 42-month follow-up survey emphasizing respondents’ employment, income, and public assistance receipt. Outcomes were adjusted for characteristics before random assignment. The study found that the longest period of continuous employment during the 3.5-year follow-up period was, on average, 2.5 months shorter for mothers in the Enhanced EHS group than mothers in the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to Enhanced EHS services, and not to other factors.","Enhanced Early Head Start","Other employment and reemployment","Low income, Parent",,"United States, Rural",2012,http://www.acf.hhs.gov/sites/default/files/opre/kansas_missouri.pdf "Success of joint programs between junior and senior colleges","Krudysz, M., Walser, A., & Alting, A. (2012). Success of joint programs between junior and senior colleges. American Society for Engineering Education.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Joint/Dual (JD) program on retention and graduation rates for community college and undergraduate engineering students who were under-represented minorities and women. JD students received dual admission to a community college as well as a senior college, and transitioned into the upper division of the baccalaureate engineering program at the senior college upon successful completion of lower-division courses and degree requirements at the community college. This study used data from junior and senior colleges within a major urban university system to compare outcomes of a treatment group of JD program participants and a comparison group of transfers into the urban university system from other, nonparticipating community colleges. This study found that first- and second-year retention rates were higher for JD program participants than for transfers from other community colleges, but did not conduct statistical tests of these differences. The quality of causal evidence presented in this report is low because the authors did not include controls for relevant student characteristics in the analysis. This means we are not confident that the estimated effects are attributable to the JD program. Other factors are likely to have contributed.","the Joint/Dual Program","Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Female, Other",,"Urban, United States",2012,https://www.asee.org/public/conferences/8/papers/3558/download "The impact of curricular learning communities on furthering the engagement and persistence of academically underprepared students at community colleges","McIntosh, J. (2012). The impact of curricular learning communities on furthering the engagement and persistence of academically underprepared students at community colleges (Doctoral dissertation). Retrieved from ProQuest Dissertation and Theses database. (UMI No. 3509985)","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of basic skills curricular learning communities on the persistence of underprepared community college students at 13 community colleges in eight states. Curricular learning communities enroll cohorts of students in sets of two or three linked courses. The study used student survey and administrative enrollment data in a quasi-experimental design in which the treatment group enrolled in the basic skills curricular learning communities and the comparison group did not enroll in the learning communities but took other, similar courses. The study found that students enrolled in the basic skills curricular learning communities were 1.27 times more likely to be enrolled in a postsecondary educational institution in the year following program enrollment, compared with students not enrolled in learning communities. The quality of causal evidence presented in this report is low because the author did not include sufficient controls in the analysis. This means we are not confident that the estimated effects are attributable to basic skills curricular learning communities. Other factors are likely to have contributed.","Basic Skills Curricular Learning Communities","Community college education and other classroom training","Adult, Other barriers",,"United States",2012, "Notes on behavioral economics and labor market policy","Babcock, L., Congdon, W., Katz, L., & Mullainathan, S. (2012). Notes on behavioral economics and labor market policy. IZA Journal of Labor Policy, 1(1), 1-14.","Behavioral Insights","Study Type: Descriptive Analysis",,,"Summary: The article’s objective was to assess how behavioral economics can inform labor policy reforms to increase policy efficiency. The authors used behavioral economic theory to explain barriers to successful policies related to unemployment insurance, job search assistance, and job training. They also proposed policy solutions to overcome these barriers. For unemployment insurance, the authors recommended implementing wage loss insurance that subsidizes reemployment wages to counteract individuals’ tendencies to set high reservation wages when seeking employment, which slows their return to work. They also recommended providing small, immediate, and high frequency reminders and incentives to search for work. To increase participation in job search assistance, the authors recommended policies that automatically put unemployed individuals into services and/or to make job search assistance more user-friendly and personalized. Similarly, to increase participation in job training programs, the authors recommended streamlining or simplifying training offerings and providing guidance to reduce the burden on the prospective users to select and start a program. Simplifying the decision-making process by creating a competitive training market could also be beneficial to prospective users.",,"Job search assistance and supportive services Unemployment Insurance Other training and education","Adult, Unemployed",,"United States",2012, "Signing at the beginning makes ethics salient and decreases dishonest self-reports in comparison to signing at the end","Shu, L., Mazar, N., Gino, F., Ariely, D., & Bazerman, M. (2012). Signing at the beginning makes ethics salient and decreases dishonest self-reports in comparison to signing at the end. Proceedings of the National Academy of Sciences, 109(38), 15197-15200.","Behavioral Insights","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Attitudes-Mod/high-Favorable impacts Attitudes","Summary: The study’s objective was to examine whether placing a signature line at the beginning of a form, rather than at the end, which is more common, discouraged dishonesty. The authors conducted three separate randomized experiments. In experiments 1 and 2, individuals completed math puzzles and were asked to report the number of puzzles they completed, as well as their expenses for traveling to the site where the experiment was conducted. In experiment 3, individuals acquiring a new car insurance policy were asked to report their current cars’ odometer readings on an insurance form. In each experiment, individuals were randomly assigned either to receive a form requiring a signature at the top, or to receive a form requiring a signature at the bottom. The study found that, across the three experiments, participants who signed at the top of the form were less likely to respond dishonestly than participants who signed the form at the bottom or did not sign the form at all. The quality of causal evidence presented in this report is high because it was based on three well-implemented randomized controlled trials. This means we are confident that the estimated effects are attributable to the placement of the signature line on the forms, and not to other factors.",,"Behavioral Interventions",Adult,,"United States",2012, "Inspiring girls and their female after school educators to pursue computer science and other STEM careers","Koch, M., & Gorges, T. (2012). Inspiring girls and their female after school educators to pursue computer science and other STEM careers. International Journal of Gender, Science and Technology, 4(3), 294-312.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Attitudes-Low-No impacts Attitudes","Summary: The study’s objective was to examine the impact of facilitating Build IT, an extracurricular information technology (IT) program for middle-school girls, on the facilitators’ interest in STEM education and careers. The authors also described outcomes for girls who participated in the facilitator-led program. The study relied on a survey administered to 31 program facilitators after they had been involved with the program for one year. The study found no statistically significant relationships between facilitating Build IT and interest in STEM education and careers. The quality of causal evidence presented in this report is low because the authors did not use a research design that supported causal inference or control for factors other than Build IT that could contribute to the observed outcomes.","Build IT","Science, Technology, Engineering, and Math (STEM) programs Youth programs","Youth, Other barriers, Female",,"United States",2012, "A study of the impact of a first-year experience initiative on first-year developmental education student success and persistence","Spencer, K. (2012). A study of the impact of a first-year experience initiative on first-year developmental education student success and persistence (Doctoral dissertation). Retrieved from ProQuest Dissertations and Theses database. (UMI No. 3542047)","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Achieving the Dream learning community program on students’ retention and completion of developmental English and math courses at a community college in Michigan. The study used students’ records to compare outcomes of developmental education students who enrolled in the Achieving the Dream program to outcomes of those who took standard developmental courses. The study found no significant differences between the treatment and comparison groups in retention rates or in completion of English or math developmental courses. The quality of causal evidence presented in this study is low because the author did not include sufficient controls in the analysis. This means we are not confident that the estimated effects are attributable to Achieving the Dream. Other factors are likely to have contributed.","Achieving the Dream","Community college education and other classroom training","Adult, Low income, Other",,"United States",2012, "The effects of hands-on activities on middle school females’ spatial skills and interest in engineering and technology-based careers","Phelps, M. (2012). The effects of hands-on activities on middle school females’ spatial skills and interest in engineering and technology-based careers. Proceedings of the 2012 American Society for Engineering Education Annual Conference & Exposition. Washington, DC: American Society for Engineering Education.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Attitudes-Low-Favorable impacts Attitudes","Summary: The study’s objective was to examine the impact of participating in technology-based three-dimensional hands-on activities on middle school girls’ interest in becoming an engineer or technologist. The activities took place at a 2006 Society of Women Engineers-sponsored event and included designing and constructing a vehicle and assembling an electrical circuit. The author conducted statistical analyses to compare self-reported career interests of girls who participated in the hands-on activities and those who did not, as measured by a program-administered survey. The study found that participation in the hands-on activities was positively related to increased interest in becoming an engineer or technologist. The quality of causal evidence presented in this report is low. This means we are not confident that the estimated effects are attributable to the hands-on activities; other factors are likely to have contributed.","the Intervention","Science, Technology, Engineering, and Math (STEM) programs Youth programs","Youth, Female","Professional, scientific, and technical services","United States",2012,https://peer.asee.org/the-effects-of-hands-on-activities-on-middle-school-femal… "Expanding Your Horizons: The impact of a one-day STEM conference on middle school girls’ and parents’ attitude toward STEM careers","Massi, L., Reilly, C., Johnson, D., & Castner, L. (2012). Expanding Your Horizons: The impact of a one-day STEM conference on middle school girls’ and parents’ attitude toward STEM careers. Proceedings of the 2012 American Society for Engineering Education Annual Conference & Exposition. Washington, DC: American Society for Engineering Education.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Attitudes-Low-No impacts Attitudes","Summary: The study’s objective was to estimate the effects of a one-day annual conference on middle school girls’ (grades 6–8) and their parents’ interest in and knowledge of science, technology, engineering, and mathematics (STEM). The goal of the conference, which was held at a large metropolitan, public university in central Florida, was to encourage young girls to consider STEM careers. The authors administered a single questionnaire to conference attendees that asked about attendees’ knowledge of and interest in STEM before and after the conference. The survey was included in backpacks distributed at the beginning of the day, and participants were reminded to complete it at the end of the day. Of the 214 middle school girls and 103 parent attendees, 80 percent of the girls and 37 percent of the parents turned in a completed survey. The authors did not conduct any statistical tests to measure changes in knowledge of and interest in STEM before and after participating in the conference. The quality of causal evidence presented in this report is low because the authors measured pre-intervention knowledge of and interest in STEM after participation in the intervention, which may be subject to recall bias. This means we are not confident that any estimated effects would be attributable to the Expanding Your Horizons (EYH) conference, but other factors are likely to have contributed. Further, the authors did not conduct statistical analysis to measure whether observed changes in outcomes were actually significant.","the Expanding Your Horizons (EYH) Conference","Science, Technology, Engineering, and Math (STEM) programs Youth programs","Youth, Female",,"United States",2012,https://www.asee.org/public/conferences/8/papers/3204/download "Returning to work after prison: Final results from the Transitional Jobs Reentry Demonstration","Jacobs, E. (2012). Returning to work after prison: Final results from the Transitional Jobs Reentry Demonstration. New York: MDRC.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Transitional Jobs Reentry Demonstration (TJRD) on ex-offenders’ employment and wages. The author used a randomized controlled trial to assign former prisoners to the transitional jobs program or to a group that was offered job search assistance and compared the two groups’ employment and earnings outcomes two years after random assignment, controlling for participants’ characteristics before random assignment. The study found that members of the transitional jobs group were significantly more likely (by 29 percentage points) than control group members to be employed at any point during the two years after random assignment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the TJRD, and not to other factors.","the Transitional Jobs Reentry Demonstration (TJRD)","Job search assistance and supportive services Other employment and reemployment Reentry","Justice-involved, Unemployed, Male",,"United States",2012,http://www.mdrc.org/sites/default/files/full_626.pdf "Employment growth from public support of innovation in small firms","Link, A., & Scott, J. (2012). Employment growth from public support of innovation in small firms. Economics of Innovation and New Technology, 21(7), 655-678.","Entrepreneurship and Self-Employment","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the effects of the Small Business Innovation Research (SBIR) program, a competitive program providing small businesses with funding for technological innovations, on employment growth of SBIR-recipient firms. The study used regression analysis to compare firms’ actual levels of employment in 2005 with the levels of employment predicted by their characteristics before receiving the Phase II award. The study found no statistically significant relationships between SBIR funding and firms’ employment. The quality of causal evidence presented in this report is low. This means we are not confident that the estimated effects are attributable to SBIR funding; other factors are likely to have contributed.","the SBIR Program","Other training and education",Self-employed,"Small business","United States",2012, "More than a job: Final results from the evaluation of the Center for Employment Opportunities (CEO) transitional job program","Redcross, C., Millenky, M., & Rudd, T. (2012). More than a job: Final results from the evaluation of the Center for Employment Opportunities (CEO) transitional job program. New York: MDRC.",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine the impact of the Center for Employment Opportunities (CEO) transitional job program on earnings and employment outcomes. The authors conducted a randomized controlled trial. They used administrative data from New York State and New York City, along with data from the National Directory of New Hires and the CEO program itself, to measure earnings and employment outcomes. The study did not find any significant differences between CEO program participants and the control group in Year 2 or Year 3 on any employment or earnings outcomes. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to CEO program, and not to other factors.","The Center for Employment Opportunities (CEO) Transitional Job Program","Job search assistance and supportive services Other employment and reemployment",Justice-involved,,"United States",2012,http://www.mdrc.org/sites/default/files/full_451.pdf "What strategies work for the hard-to-employ? Final results of the hard-to-employ demonstration and evaluation project and selected sites from the Employment Retention and Advancement project. [NYC SACM]","Butler, D., Alson, J., Bloom, D., Deitch, V., Hill, A., Hsueh, J., Jacobs, E., Kim, S., McRoberts, R., & Redcross, C. (2012). What strategies work for the hard-to-employ? Final results of the hard-to-employ demonstration and evaluation project and selected sites from the Employment Retention and Advancement project. (OPRE Report 2012-08.) Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. [NYC SACM]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-No impacts Employment Public benefits receipt-Low-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Substance Abuse Case Management (SACM) program on employment, earnings, and public assistance receipt after two years. The authors attempted to implement a randomized controlled trial, but they used a process that resulted in nonrandom assignment. The study estimated impacts by comparing the regression-adjusted outcomes of the treatment and control groups, using data collected from New York City public assistance records and Unemployment Insurance wage records for New York State. The study found no statistically significant relationships between SACM and employment, earnings, or public assistance receipt. The quality of causal evidence presented in this report is low because the assignment mechanism was nonrandom and the authors did not demonstrate that the treatment and control groups were similar. This means we would not be confident that any estimated effects would be attributable to the Substance Abuse Case Management program; other factors are likely to have contributed. However, the study did not find statistically siginificant effects.","the Substance Abuse Case Management (SACM) Program","Other employment and reemployment Substance abuse recovery","Low income",,"United States, Urban",2012,http://www.acf.hhs.gov/sites/default/files/opre/strategies_work.pdf "What strategies work for the hard-to-employ? Final results of the Hard-to-Employ demonstration and evaluation project and selected sites from the Employment Retention and Advancement project. [NYC PRIDE]","Butler, D., Alson, J., Bloom, D., Deitch, V., Hill, A., Hsueh, J., Jacobs, E., Kim, S., McRoberts, R., & Redcross, C. (2012). What strategies work for the hard-to-employ? Final results of the Hard-to-Employ demonstration and evaluation project and selected sites from the Employment Retention and Advancement project. (OPRE Report 2012-08). Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. [NYC PRIDE]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Personal Roads to Individual Development and Employment (PRIDE) program on employment, earnings, and public assistance receipt. The study was a randomized controlled trial. The authors estimated the impact of PRIDE by comparing the outcomes of the treatment and control groups four years after random assignment using data from public assistance records and Unemployment Insurance wage records. The study found that those assigned to the PRIDE group were more likely to be employed and received less in cash assistance in the four years following random assignment than those in the control group. The quality of causal evidence presented in this report is low because the study had a shift in the probability of assignment and did not sufficiently demonstrate that the treatment and control groups were similar. This means we are not confident that the estimated effects are attributable to PRIDE; other factors are likely to have contributed.","the Personal Roads to Individual Development and Employment (PRIDE) Program","Other employment and reemployment Unemployment Insurance","Low income",,"United States",2012,http://www.acf.hhs.gov/sites/default/files/opre/strategies_work.pdf "What strategies work for the hard-to-employ? Final results of the Hard-to-Employ demonstration and evaluation project and selected sites from the Employment Retention and Advancement project. [Minnesota Tier 2]","Butler, D., Alson, J., Bloom, D., Deitch, V., Hill, A., Hsueh, J., Jacobs, E., Kim, S., McRoberts, R., & Redcross, C. (2012). What strategies work for the hard-to-employ? Final results of the Hard-to-Employ demonstration and evaluation project and selected sites from the Employment Retention and Advancement project. (OPRE report 2012-08). Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. [Minnesota Tier 2]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study examined the impact of the Minnesota Tier 2 program on employment, earnings, and receipt of public assistance for unemployed single parents. The study was a randomized controlled trial. The authors estimated the impact of the Tier 2 program by comparing the outcomes of the treatment and control groups four years after random assignment using data from Minnesota public assistance records and Unemployment Insurance wage records. The study found no statistically significant relationships between the Minnesota Tier 2 program and employment, earnings, or receipt of public assistance. The quality of causal evidence presented in this report is high for the employment and earnings outcomes because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects on earnings and employment would be attributable to the Minnesota Tier 2 program, and not to other factors. The public assistance outcomes receive a low rating, which means we would not be confident that any estimated effects on public assistance would be attributable to the Minnesota Tier 2 program; other factors are likely to have contributed. However, the study did not find any statistically significant effects on employment, earnings, or benefit receipt.","the Minnesota Tier 2 Program","Other employment and reemployment Substance abuse recovery","Low income, Parent",,"United States",2012,http://www.acf.hhs.gov/sites/default/files/opre/strategies_work.pdf "Strategies to help low-wage workers advance: Implementation and final impacts of the Work Advancement and Support Center (WASC) demonstration. [Dayton—Move Up]","Miller, C., Tessler, B. L., & Van Dok, M. (2012). Strategies to help low-wage workers advance: Implementation and final impacts of the Work Advancement and Support Center (WASC) demonstration. New York: MDRC. [Dayton—Move Up]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of participation in Dayton—Move Up, a Work Advancement and Support Center (WASC), on participants’ earnings, employment, educational attainment, and benefit receipt. This study was a randomized controlled trial and used administrative data from the Ohio Department of Job and Family Services and the National Student Clearinghouse to measure outcomes. The authors used a 12-month follow-up survey with a random subset of participants to measure receipt of work supports and job characteristics. The study found that the treatment group was 6.4 percentage points more likely to obtain a license or certificate than the control group and 6.2 percentage points more likely to have ever received Food Stamps one year after the program began. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to Dayton—Move Up and not to other factors.","Work Advancement and Support Center (WASC), Dayton—Move Up","Job search assistance and supportive services Other employment and reemployment Other training and education","Low income",,"United States",2012,http://www.mdrc.org/sites/default/files/full_627.pdf "Strategies to help low-wage workers advance: Implementation and final impacts of the Work Advancement and Support Center (WASC) demonstration. [San Diego—EARN!]","Miller, C., Tessler, B. L., & Van Dok, M. (2012). Strategies to help low-wage workers advance: Implementation and final impacts of the Work Advancement and Support Center (WASC) demonstration. New York: MDRC. [San Diego—EARN!]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of participation in San Diego—EARN!, a Work Advancement and Support Center (WASC), on participants’ earnings, employment, educational attainment and benefit receipt. This study was a randomized controlled trial and used administrative data from the Employment Development Department in California, the San Diego County Health and Human Service Agency, and the National Student Clearinghouse to measure outcomes. The authors used a 12-month follow-up survey with a random subset of participants to measure receipt of work supports and job characteristics. The study found that members of the treatment group were 5.7 percentage points more likely than the control group to have ever received Food Stamps one year after the program began. The study also found that members of the treatment group received an average of $155 more in Food Stamps than the control group one year after the program began and an average of $320 more in Food Stamps than the control group three years after the program began. The quality of causal evidence presented in this report is high for outcomes measured with administrative data. This means we are confident that the estimated effects on these outcomes are attributable to San Diego—EARN! and not to other factors. However, outcomes measured with survey data receive a low causal evidence rating, meaning that we are not confident that the estimated effects are attributable to San Diego—EARN!; other factors may have contributed.","Work Advancement and Support Center Demonstration (WASC), San Diego—EARN!","Job search assistance and supportive services Other employment and reemployment Other training and education","Low income",,"United States, Urban",2012,http://www.mdrc.org/sites/default/files/full_627.pdf "Strategies to help low-wage workers advance: Implementation and final impacts of the Work Advancement and Support Center (WASC) demonstration. [Academy for Career Advancement—Bridgeport]","Miller, C., Tessler B. L., & Van Dok, M. (2012). Strategies to help low-wage workers advance: Implementation and final impacts of the Work Advancement and Support Center (WASC) demonstration. New York: MDRC. [Academy for Career Advancement—Bridgeport]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of participation in the Academy for Career Advancement—Bridgeport, a Work Advancement and Support Center (WASC) on participants’ earnings, employment, educational attainment, and benefit receipt. This study was a randomized controlled trial and used administrative data from the Department of Labor, the Department of Social Services in Connecticut, and the National Student Clearinghouse to measure outcomes. The authors also used a 12-month follow-up survey with a random subset of participants to measure receipt of work supports and job characteristics. The study found that members of the treatment group were 3.9 percentage points less likely than the control group to have ever been employed in a Unemployment Insurance-covered job one year after the program began, and that members of the treatment group were 8.9 percentage points more likely to obtain a license or certificate one year after the program began than members of the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to Academy for Career Advancement—Bridgeport and not to other factors.","Work Advancement and Support Center Demonstration, Academy for Career Advancement—Bridgeport","Job search assistance and supportive services Other employment and reemployment Other training and education Unemployment Insurance","Low income",,"United States",2012,http://www.mdrc.org/sites/default/files/full_627.pdf "Does trade adjustment assistance make a difference?","Reynolds, K.M., & Palatucci, J.S. (2012). Does trade adjustment assistance make a difference? Contemporary Economic Policy, 30(1), 43-59. doi:10.1111/j.1465-7287.2010.00247.x",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the Trade Adjustment Assistance (TAA) Program on the employment and earnings of displaced workers in the manufacturing sector from 2003 to 2005. The study uses a nonexperimental design to compare the outcomes of TAA recipients with a comparison group of nonrecipients who were also displaced from manufacturing jobs during the same period as the treatment group. The study found no statistically significant relationship between TAA participation and employment or earnings when comparing TAA recipients with displaced workers who did not participate in TAA. However, when comparing the TAA recipients who received training with recipients who did not receive training, the study found a significant relationship between training and employment and earnings. The quality of causal evidence provided in this study is low because the authors did not sufficiently account for potential differences between the study groups. This means we are not confident that estimated effects are attributable to the TAA program; other factors are likely to have contributed.","the Trade Adjustment Assistance (TAA) Program","Job search assistance and supportive services Other training and education","Dislocated or displaced worker",,"United States",2012, "Estimated impacts for participants in the Trade Adjustment Assistance (TAA) program under the 2002 amendments.","Schochet, P.Z., D’Amico, R., Berk, J., Dolfin, S., & Wozny, N. (2012). Estimated impacts for participants in the Trade Adjustment Assistance (TAA) program under the 2002 amendments. Princeton, NJ: Mathematica Policy Research.",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Unfavorable impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-Unfavorable impacts Employment Public benefits receipt-Mod/high-Unfavorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Trade Adjustment Assistance (TAA) Program on education and training, employment, earnings, and public benefit receipt. The study used a nonexperimental method to match those who took part in the TAA Program to a similar group of nonparticipants. The authors used data from telephone surveys and administrative records to compare education, employment, earnings, and public benefits receipt outcomes across the groups. The study found that education and training programs completion and educational attainment were higher among TAA participants than similar nonparticipants. Employment, earnings, and receipt of cash assistance were lower for TAA participants than for similar nonparticipants, and a larger percentage of TAA participants than nonparticipants received Unemployment Insurance (UI) benefits and food stamps. The quality of causal evidence presented in this study is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to TAA, but other factors might also have contributed.","the Trade Adjustment Assistance (TAA) Program","Job search assistance and supportive services Other training and education","Dislocated or displaced worker",,"United States",2012,https://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=1&cad=rja&uact=8&… "Pre- and post- wage differences of trade adjustment assistance job training participants in Arkansas. (Doctoral dissertation).","Gordon, K.H. (2012). Pre- and post- wage differences of trade adjustment assistance job training participants in Arkansas. (Doctoral dissertation). Retrieved from ProQuest Dissertations & Theses A&I. (1266388644).",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Unfavorable impacts Earnings and wages","Summary: The study’s objective was to examine the impact of the Trade Adjustment Assistance (TAA) Program on the wages of dislocated workers. The author used a nonexperimental method to compare the earnings outcomes of participants before and after they participated in the TAA program. The author also compared the change in earnings between those who completed the TAA-funded training and those who started but did not complete TAA-funded training The study found that participants had significantly lower wages in the three quarters after TAA program participation compared with the three quarters before program participation. The study also found that the change in wages differed by education level and employment tenure. The quality of causal evidence presented in this report is low because the author did not account for pre-intervention trends in earnings or account for differences between the treatment and comparison groups. This means we are not confident that the estimated effects are attributable to TAA program; other factors are likely to have contributed.","the Trade Adjustment Assistance (TAA) Program","Job search assistance and supportive services Other employment and reemployment Other training and education","Dislocated or displaced worker",,"United States",2012,http://scholarworks.uark.edu/cgi/viewcontent.cgi?article=1631&context=etd "Are conditional cash transfers effective in urban areas? Evidence from Mexico","Behrman, J. R., Gallardo-Garcıa, J., Parker, S. W., Todd, P. E., & Velez-Grajales, V. (2012). Are conditional cash transfers effective in urban areas? Evidence from Mexico. Education Economics, 20(3), 233-259.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of Mexico’s conditional cash transfer program (PROGRESA/Oportunidades) on school enrollment and employment in paid activities for children ages 6 to 18 in urban areas. The study used a nonexperimental design to evaluate schooling and work outcomes from PROGRESA/Oportunidades program 1 and 2 years after implementation in urban areas. The study found that PROGRESA/Oportunidades was significantly related to reduced labor rates for boys who were 12-14 in the first and second year, and girls ages 15 to 18 in the first year. The program was also significantly related to an increase in school enrollment for boys and girls. The quality of causal evidence presented in this study is low because the authors did not ensure that the groups were similar before program participation. This means we are not confident that the estimated effects are attributable to PROGRESA/Oportunidades; other factors are likely to have contributed.",PROGRESA/Oportunidades,"Child labor","Other, Low income",,"International, Urban",2012, "Effect of the Mchinji Social Cash Transfer Pilot Scheme on children's schooling, work and health outcomes: A multilevel study using experimental data","Luseno, W. K. (2012). Effect of the Mchinji Social Cash Transfer Pilot Scheme on children's schooling, work and health outcomes: A multilevel study using experimental data (Doctoral dissertation). University of North Carolina at Chapel Hill, Chapel Hill, North Carolina. Retrieved from ProQuest Dissertations & Theses A&I (Accession No. 1240627043).","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Mixed impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The objective of the study was to examine the impact of the Mchinji Social Cash Transfer Pilot Scheme (SCTPS) on child labor and school outcomes.  The study was a randomized controlled trial conducted in the Mchinji district of Malawi. Within the district, eight villages were randomly assigned to either the treatment or control groups. Using survey data, the author compared the child labor and school outcomes of children ages 6-17 in households that received the cash transfer with those that did not receive the cash transfer. The study found that when compared to the control group, children in the Mchinji SCTPS program had significantly: 1) increased school enrollment; 2) fewer school absences; and 3) worked fewer hours outside of the home. An unexpected finding was that children participating in the Mchinji SCTPS also had significantly higher rates of domestic work when compared to children in the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Mchinji Social Cash Transfer Pilot Scheme and not to other factors.","Mchinji Social Cash Transfer Pilot Scheme (SCTPS)","Child labor","Other barriers, Other, Low income",,International,2012,https://cdr.lib.unc.edu/indexablecontent/uuid:7052544c-df44-46b5-aa01-500991b72… "Cash transfers and children's education and labour among Malawi's poor","Miller, C., & Tsoka, M. (2012). Cash transfers and children's education and labour among Malawi's poor. Development Policy Review, 30(4), 499-522. doi:10.1111/j.1467-7679.2012.00586.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The purpose of the study was to assess the effects of an unconditional cash transfer program, the Malawi Social Cash Transfer Scheme (SCTS), on child school participation and child labor. To assess the program’s effects, the authors used a randomized controlled trial in which villages were randomly assigned to the treatment group, which would receive the intervention, and the control group, which would not. Child labor was assessed using household surveys, and schooling outcomes were assessed using household surveys and school records. To understand the program’s impact on child school and work participation, the authors compared change in these outcomes over the first year of the program. The study found that children participating in the intervention had significantly greater decreases in school absences over one year, relative to the comparison group. In addition, over one year there was a significantly lower increase in the percent of both boys and girls who worked for income if they were in the intervention group rather than the comparison group. The quality of causal evidence presented in this study is moderate because, although it was based on a randomized controlled trial with high attrition, the treatment and control groups were similar before the intervention. This means we are somewhat confident that the estimated effects are attributable to the Malawi Social Cash Transfer Scheme, but other factors might also have contributed.","Malawi Social Cash Transfer Scheme","Child labor","Other barriers, Other, Low income",,International,2012,http://interactions.eldis.org/sites/interactions.eldis.org/files/database_sp/Ma… "Poverty alleviation and child labor","Edmonds, E. V., & Schady, N. (2012). Poverty alleviation and child labor. American Economic Journal: Economic Policy, 4(4), 100-124.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The purpose of the study was to examine the impact of unconditional cash transfers on child labor, within the Bono de Desarrollo Humano (BDH) program. The study was a randomized controlled trial, where households within each local parish were randomly assigned to either the treatment group, who are eligible for the cash transfers, or the control group, who are not. The authors compared child labor and school enrollment outcomes, using a follow-up survey administered over a year after the program began. The study found that children were significantly less likely to participate in child labor and more likely to be enrolled in school if they were assigned to the treatment group than if they were assigned to the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Bono de Desarrollo Humano program, and not to other factors.","Bono de Desarrollo Humano (BDH) program","Child labor","Other, Low income",,International,2012,https://www.aeaweb.org/articles?id=10.1257/pol.4.4.100 "From protection to production: Productive impacts of the Malawi Social Cash Transfer scheme","Covarrubias, K., Davis, B. & Winters, P. (2012). From protection to production: Productive impacts of the Malawi Social Cash Transfer scheme, Journal of Development Effectiveness, 4(1), 50-77.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to assess the impact of the Malawi Social Cash Transfer Scheme (SCTS) on household work activities, including child labor. The study used household survey data from a randomized controlled trial. Due to pre-existing baseline differences between the original treatment and control groups, the authors used a matched comparison group design to compare child schooling and labor outcomes between children in the treatment group and those in the control group. The study found that the SCTS program significantly decreased the proportion of children in paid domestic work outside of the household and the proportion of children pulled from school to work for food or money. The quality of causal evidence presented in this report is moderate because there was compromised randomization but the authors ensured that the groups being compared were similar before the intervention. This means we are somewhat confident that the estimated effects are attributable to the Malawi Social Cash Transfer Scheme (SCTS); however, other factors might have also contributed.","Malawi Social Cash Transfer Scheme","Child labor","Other, Low income",,International,2012,http://www.fao.org/fileadmin/user_upload/p2p/Publications/MalawiSCT_ProductiveI… "An evaluation of the effect of correctional education programs on post-release recidivism and employment: An empirical study in Indiana","Nally, J., Lockwood, S., Knutson, K., & Ho, T. (2012). An evaluation of the effect of correctional education programs on post-release recidivism and employment: An empirical study in Indiana. The Journal of Correctional Education, 63(1), 69-89.",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Mod/high-No impacts Employment","Summary: The study examined the effect of Indiana’s correctional education program on individuals’ employment, earnings, and recidivism outcomes after release from prison. The authors used administrative data from the Indiana Department of Corrections (IDOC) and Indiana Department of Workforce Development to compare individuals who participated in correctional education programs while in custody with those who did not. The study found that participation in correctional education programs was associated with a lower likelihood of recidivism. The quality of causal evidence presented in this study is low because the authors did not ensure that the groups being compared were similar before the intervention.","Indiana’s Correctional Education Programs","Job search assistance and supportive services Other employment and reemployment Reentry",Justice-involved,,"United States",2012,https://www.thefreelibrary.com/An+evaluation+of+the+effect+of+correctional+educ… "Income tax and older American workers’ job transition into self-employment.","Choi, S. (2012). Income tax and older American workers’ job transition into self-employment. Korea and the World Economy, 13(2), 189-214.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Unfavorable impacts Employment","Summary: The study examined the effect of a progressive income tax on the likelihood of transitioning to self-employment among older workers. The study used a nonexperimental approach (the exponential hazard model) that compared the likelihood of transitioning from a wage job to self-employment based on the marginal taxes a worker would expect to pay. The author used the data from the Health and Retirement Study in 1992 matched to the Social Security Administration Master Earnings File from 1980 to 1991, which contains W-2 records of earnings from both wage work and self-employment. The study found that a more progressive tax (that is, a tax schedule that increases sharply toward the higher end) or higher marginal tax rates reduces the likelihood of entering self-employment. The quality of causal evidence presented in this report is low because the author did not ensure that the groups with higher or lower marginal tax rates were similar before a change in the tax schedule. This means we are not confident that the estimated effects are attributable to changes in marginal taxes; other factors are likely to have contributed.","Progressive Income Tax","Other employment and reemployment","Adult, Older worker, Employed",,"United States",2012, "The efficacy of supported employment for middle-aged and older people with schizophrenia.","Twamley, E. W., Vella, L., Burton, C. Z., Becker, D. R., Bell, M. D., & Jeste, D. V. (2012). The efficacy of supported employment for middle-aged and older people with schizophrenia. Schizophrenia Research, 135(1-3), 100-104.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study examined the impact of Individual Placement and Support (IPS) on competitive employment for older people with schizophrenia The study was a randomized controlled trial (RCT) conducted at a community mental health clinic and used weekly work logs cross-referenced with pay stubs to measure employment outcomes over a 12-month period. The study found that IPS was positively associated with employment and earnings. The quality of causal evidence presented in this report is low because the RCT has a confounding factor. This means we are not confident that the estimated effects are attributable to the IPS program; other factors are likely to have contributed.","Individual Placement and Support and Vocational Rehabilitation Program","Health Individuals facing barriers to employment Job search assistance and supportive services","Adult, Older worker, Disability",,"United States",2012,https://psycnet.apa.org/record/2011-30184-001 "Tax elasticity of labor earnings for older individuals","Alpert, A. & Powell, D. (2012). Tax elasticity of labor earnings for older individuals. (Report no. 2012-272). Ann Arbor, MI: University of Michigan Retirement Research Center, University of Michigan.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study examined the impact of tax changes on people’s employment, retirement, and labor income outcomes. The study uses a nonexperimental approach and the data from the Health and Retirement Study to estimate the effect. The study found positive statistically significant relationships between increases in after-tax labor income and the employment of men and women as well as the delay in retirement for men. The study also found a positive statistically significant relationship between increases in the marginal net-of-tax rate and earnings for women. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to tax changes from the Economic Growth and Tax Relief Reconciliation Act (EGTRRA), the Jobs and Growth Tax Relief Reconciliation Act (JGTRRA), and their marriage tax penalty relief provision, but other factors might also have contributed.","Tax Changes","Older workers' programs Other employment and reemployment","Adult, Older worker",,"United States",2012,https://deepblue.lib.umich.edu/bitstream/handle/2027.42/94533/wp272.pdf?sequenc… "Changes in social adjustment with cognitive processing effects of treatment and association with PTSD symptoms","Monson, C. M., Macdonald, A., Vorstenbosch, V., Schnaider, P., Goldstein, E. S. R., Ferrier-Auerbach, A. G., & Mocciola, K. E. (2012). Changes in social adjustment with cognitive processing effects of treatment and association with PTSD symptoms. Journal of Traumatic Stress, 25, 519-526.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages","Summary: The study’s objective was to examine the impact of cognitive processing therapy on earnings. The study is a randomized controlled trial that collected self-reported data directly from veterans. There were no statistically significant relationships between cognitive processing therapy and earnings. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to cognitive processing therapy; other factors are likely to have contributed.","Cognitive Processing Therapy",Health,"Veteran or military",,"United States",2012,https://cptforptsd.com/wp-content/uploads/2016/11/Monson-Macdonald_2012_JTS-soc… "Effectiveness of supported employment for veterans with spinal cord injuries: Results from a randomized multisite study","Ottomanelli, L., Goetz, L. L., Suris, A., McGeough, C., Sinnott, P. L., Toscano, R., … Thomas, F. P. (2012). Effectiveness of supported employment for veterans with spinal cord injuries: Results from a randomized multisite study. Archives of Physical Medicine and Rehabilitation, 93(5), 740-747. [CONTRAST 1: Non-experimental study]",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study examined the impact of supported employment on the employment outcomes for veterans with spinal cord injuries. The authors used statistical comparisons in a non-experimental analysis to estimate the relationship between supported employment services and employment, drawing on self-reported data for employment information and chart review data from the spinal cord injury centers in six Veterans Affairs Medical Centers to obtain demographic information . The study found statistically significant positive relationships between supported employment and veterans’ employment outcomes compared to treatment as usual. The quality of causal evidence presented in the report is low because there are preexisting differences between the intervention and comparison groups. This means we are not confident that the estimated effects are attributable to supported employment; other factors are likely to have contributed.","Individual Placement and Support (IPS) model of supported employment","Veterans' reemployment","Disability, Veteran or military",,"United States",2012,https://doi.org/10.1016/j.apmr.2012.01.002 "Effectiveness of supported employment for veterans with spinal cord injuries: Results from a randomized multisite study","Ottomanelli, L., Goetz, L. L., Suris, A., McGeough, C., Sinnott, P. L., Toscano, R., … Thomas, F. P. (2012). Effectiveness of supported employment for veterans with spinal cord injuries: Results from a randomized multisite study. Archives of Physical Medicine and Rehabilitation, 93(5), 740-747.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The study aimed to examine the impact of supported employment on the employment outcomes of veterans with spinal cord injuries. The study included a randomized controlled trial and collected self-reported data directly from veterans and chart review data from the spinal cord injury centers in six Veterans Affairs Medical Centers (VAMCs) to obtain demographic information. The study found statistically significant positive impacts on employment as a result of supported employment compared to treatment as usual. The quality of causal evidence presented in the report is high because it used a well-implemented experimental design. This means that we are confident that the estimated effects are attributable to supported employment and not to other factors.","Individual Placement and Support (IPS) model of supported employment","Veterans' reemployment","Disability, Veteran or military",,"United States",2012,https://doi.org/10.1016/j.apmr.2012.01.002 "Impact of the Reemployment and Eligibility Assessment Initiative","Poe-Yamagata, E., Benus, J., Bill, N., Carrington, H., Michaelides, M., & Shen, T. (2011). Impact of the Reemployment and Eligibility Assessment Initiative. Columbia, MD: IMPAQ International. [Florida sample]",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: This study’s objective was to assess the effectiveness of the Reemployment and Eligibility Assessment (REA) Initiative in Florida, a program that provided eligibility and reemployment case management services to Unemployment Insurance (UI) claimants, on UI benefits receipt, employment, and earnings. The study randomly assigned 80,531 eligible UI claimants to either the treatment group or the control group. Those in the treatment group were required to participate in REA services to retain their UI eligibility. Data for the analysis came from UI administrative and wage records.  The study found statistically significant reductions in weeks of UI benefits receipt, total amount of UI benefits received, and the probability of benefits exhaustion for the REA treatment group. In addition, participants in REA had a statistically significantly higher probability of employment and earnings over the four follow-up quarters. The quality of causal evidence presented in this report is high because it is based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the REA initiative, and not to other factors.","Reemployment Eligibility Assessment","RESEA Job search assistance and supportive services Other employment and reemployment","Dislocated or displaced worker, Unemployed",,"United States",2011,http://wdr.doleta.gov/research/FullText_Documents/ETAOP_2012_08_Impact_of_the_R… "Impact of the Reemployment and Eligibility Assessment Initiative","Poe-Yamagata, E., Benus, J., Bill, N., Carrington, H., Michaelides, M., & Shen, T. (2011). Impact of the Reemployment and Eligibility Assessment Initiative. Columbia, MD: IMPAQ International. [Idaho sample]",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: This study’s objective was to assess the effectiveness of the Reemployment and Eligibility Assessment (REA) Initiative in Idaho, a program that provided eligibility and reemployment case management services to Unemployment Insurance (UI) claimants, on duration and amount of UI benefits receipt. The study randomly assigned 18,156 eligible claimants to either the treatment group, which was eligible for REA services, or the control group, which was not offered REA services. Within the treatment group, claimants were randomly assigned either to receive a letter requiring them to enter work search activities into an online system, or to receive both the letter and an in-person interview. Data for the analysis comes from UI administrative records. The study found statistically significant reductions in weeks of UI benefits receipt, total amount of UI benefits received, total number of weeks receiving UI benefits, and the probability of benefits exhaustion for the treatment group. The quality of causal evidence presented in this report is high because it is based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the REA initiative, and not to other factors.","Reemployment Eligibility Assessment","RESEA Job search assistance and supportive services Other employment and reemployment","Dislocated or displaced worker, Unemployed",,"United States",2011,http://wdr.doleta.gov/research/FullText_Documents/ETAOP_2012_08_Impact_of_the_R… "Impact of the Reemployment and Eligibility Assessment Initiative","Poe-Yamagata, E., Benus, J., Bill, N., Carrington, H., Michaelides, M., & Shen, T. (2011). Impact of the Reemployment and Eligibility Assessment Initiative. Columbia, MD: IMPAQ International. [Illinois sample]",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: This study’s objective was to assess the effectiveness of the Reemployment and Eligibility Assessment (REA) Initiative in Illinois, a program that provided eligibility and reemployment case management services to Unemployment Insurance (UI) claimants, on duration and amount of UI benefits receipt. The study was a randomized controlled trial that assigned 3,112 eligible UI claimants to the treatment or control group. Those in the treatment group were required to participate in REA services to retain their UI eligibility. Data for the analysis came from UI administrative records. The study found no statistically significant impacts on any UI benefits receipt outcomes examined. The quality of causal evidence presented in this report is high because it is based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the REA initiative, and not to other factors.","Reemployment Eligibility Assessment","RESEA Job search assistance and supportive services Other employment and reemployment","Dislocated or displaced worker, Unemployed, High-skilled",,"United States",2011,http://wdr.doleta.gov/research/FullText_Documents/ETAOP_2012_08_Impact_of_the_R… "Impact of the Reemployment and Eligibility Assessment Initiative","Poe-Yamagata, E., Benus, J., Bill, N., Carrington, H., Michaelides, M., & Shen, T. (2011). Impact of the Reemployment and Eligibility Assessment Initiative. Columbia, MD: IMPAQ International. [Nevada sample]",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: This study’s objective was to assess the effectiveness of the Reemployment and Eligibility Assessment (REA) Initiative in Nevada, a program that provided eligibility and reemployment case management services to Unemployment Insurance (UI) claimants, on duration and amount of UI benefits receipt. The study was a randomized controlled trial. Of some 33,000 first-time UI claimants eligible for the study, about 5,100 were randomly assigned to the treatment group, which had to take part in REA and reemployment services (RES) to retain UI eligibility, and the rest were randomly assigned to the control group, which was not required to participate in such services. The authors compared state administrative records on UI benefits to estimate the program’s effectiveness. The study found statistically significant reductions in weeks of UI benefits receipt, total amount of UI benefits received, total number of weeks receiving UI benefits, and the probability of benefits exhaustion for the treatment group. The quality of causal evidence presented in this report is high because it is based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the REA initiative, and not to other factors.","Reemployment Eligibility Assessment","RESEA Job search assistance and supportive services Other employment and reemployment","Dislocated or displaced worker, Unemployed",,"United States",2011,http://wdr.doleta.gov/research/FullText_Documents/ETAOP_2012_08_Impact_of_the_R… "After-school programs for high school students: An evaluation of after-school matters.","Hirsch, B., Hedges, L., Stawicki, J., & Mekinda, M. (2011). After-school programs for high school students: An evaluation of after-school matters. Evanston, IL: Northwestern University.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-No impacts Education and skills gains Employment-Mod/high-No impacts Employment","Summary: The report’s objective was to evaluate the impact of the After School Matters (ASM) apprenticeship program on academic outcomes in high school and on the likelihood of being hired for a summer or permanent entry-level position in the labor market. For this evaluation, 535 students from 10 high schools in Chicago were randomly assigned to the treatment group, which could enroll in ASM, or the control group, which could not. Outcome data were derived from high school records from both semesters of the academic year of study participation and a mock job interview at the end of the spring semester of the same year. The study reported no statistically significant impacts of participation in ASM on high school grade point average (GPA), number of classes failed, school absences, or likelihood of being hired for a permanent or summer entry-level position. The quality of the causal evidence presented in this report is high for all academic outcomes. This means we are confident that estimated impacts for these outcomes would be solely attributable to ASM, and not other factors. For the likelihood of employment outcomes, the quality of evidence is moderate. This means we have confidence that the effects estimated in this study would be attributable at least in part to the ASM program, though other factors could also have contributed.","After School Matters","Other training and education Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States, Urban",2011, "Would people behave differently if they better understood Social Security? Evidence from a field experiment","Liebman, J., & Luttmer, E. (2011). Would people behave differently if they better understood Social Security? Evidence from a field experiment. National Bureau of Economic Research working paper no. 17287. Cambridge, MA: NBER.","Behavioral Finance: Retirement, Behavioral Insights","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence",,"Summary: The study’s objective was to examine the impact of providing information about Social Security rules and benefits on labor force participation, knowledge of Social Security, and claiming of Social Security benefits. Workers nearing retirement age were randomly assigned into either the treatment group, which was sent an informational brochure about Social Security and invited to a 15-minute web tutorial on Social Security provisions, or to the control group, which was not offered this information but could seek other publicly available information about Social Security. The authors measured outcomes through a follow-up survey conducted 13 months after random assignment. The study found that, on average, members of the treatment group were more likely to work for pay in the last month and were more likely to be aware that Social Security benefits were based on the number of years with the highest earnings, compared with the control group. However, there were no statistically significant differences between the two groups on any other outcomes related to earnings and employment, Social Security benefit receipt, or understanding Social Security rules. The quality of causal evidence presented in this report is moderate because it was based on a well-conducted randomized controlled trial with high attrition and adequate control variables. This means we are somewhat confident that the estimated effects are attributable to providing information about Social Security provisions, but other factors might also have contributed.",,,Employed,,,2011,http://www.nber.org/papers/w17287.pdf "Analysis of Associations between Contemporaneous Job Corps Performance Measures and Impact Estimates from National Corps Study.","Fortson, J., & Schochet, P. (2011). Analysis of Associations between Contemporaneous Job Corps Performance Measures and Impact Estimates from National Corps Study. Princeton, NJ: Mathematica Policy Research.","Opportunities for Youth","Study Type: Descriptive Analysis",,,"Summary: An analysis for the National Job Corps Study found no relationship between estimated impacts on participants and Job Corps center aggregate performance measures. This study sought to determine whether adjusting the performance measures to account for characteristics of students attending the centers would yield performance measures that predict estimated impacts. Job Corps is a national vocationally focused education and training program for disadvantaged youth between ages 16 and 24. The authors used data from multiple sources, particularly the National Job Corps study. They conducted quantitative analysis of survey data to compute center-level impacts and regression analysis to compute adjusted center-level performance measures. The analysis found that, although the performance measures adjusted for individual and local area characteristics had a modest impact on the relative performance rankings of the centers, they did not predict participant impacts more accurately than the unadjusted performance measures.","Job Corps","Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",2011,http://www.mathematica-mpr.com/publications/pdfs/labor/jobcorps_performance.pdf "Staying on course: Three-year results of the National Guard Youth ChalleNGe Evaluation.","Millenky, M., Bloom, D., Muller-Ravett, S., & Broadus, J. (2011). Staying on course: Three-year results of the National Guard Youth ChalleNGe Evaluation. New York: MDRC.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment Training-Mod/high-Favorable impacts Training","Summary: This report presents results from a three-year follow-up study of the National Guard Youth ChalleNGe program, a disciplinary and educational intervention for unemployed youth ages 16 to 18 who are not in school. Earlier reports examined outcomes at 9 and 21 months. The program’s effectiveness was evaluated using a randomized controlled trial conducted in 10 states. This report examined the effects of the program on participants’ educational attainment, earnings, employment, and other outcomes measured through a survey conducted about three years after participants entered the study. The study found statistically significant, positive impacts of the ChalleNGe program on employment, earnings, education, and training outcomes measured after three years. The quality of causal evidence presented in this study is high because it is a well-conducted randomized controlled trial. This means we have confidence that the effects estimated in this study are attributable to the National Guard Youth ChalleNGe program.","the National Guard Youth ChalleNGe Program","Basic skills Community college education and other classroom training Mentoring Other training and education Youth programs",Youth,,"United States",2011,http://www.mdrc.org/sites/default/files/full_510.pdf "Beyond a summer work experience: The Recovery Act 2009 Post-Summer Youth Employment Initiative.","Holcomb, P., Ziegler, J., & Laird, E. (2011). Beyond a summer work experience: The Recovery Act 2009 Post-Summer Youth Employment Initiative. Princeton, NJ: Mathematica Policy Research.","Opportunities for Youth","Study Type: Implementation Analysis",,,"Summary: Funded by the American Recovery and Reinvestment Act of 2009, the Summer Youth Employment Initiative (SYEI) aimed to reverse the steep decline in youth employment during the recession by providing employment opportunities for youth in the summer of 2009. The 2009 Post-SYEI allowed states and local workforce investment areas to provide extended work experiences to older disconnected youth ages 18 to 24 from October 2009 through March 2010. The authors conducted in-depth site visits to eight selected study sites and analyzed the data using qualitative methods. The authors reported that the study sites effectively built upon the implementation of the SYEI by using the same service delivery structure and extending the work experiences of those youth who had already participated in the summer program. The longer time frame for the work experiences was seen as a benefit by participants and employers. Post-SYEI programs also focused on ensuring the alignment between participants’ interests and their work experiences. The authors recommended three considerations for the design of similar policies targeting older out-of-school youth in the future: allowing sufficient time to design such programs, because the needs of older out-of-school youth differ from those of younger youth who are traditionally served by these types of programs; supporting a year-round, not only summer, work experience; and incorporating a transition strategy from the work experience into future opportunities.","Summer Youth Employment Initiative (SYEI)","Basic skills Job search assistance and supportive services Work based and other occupational training Youth programs","Youth, Disconnected youth, Low-skilled, Low income",,"United States",2011,http://wdr.doleta.gov/research/FullText_Documents/ETAOP_201_03.pdf "Adolescent perspectives of the ecological impact of a summer youth employment program.","Grant, N. (2011). Adolescent perspectives of the ecological impact of a summer youth employment program. Doctoral dissertation. Wichita, KS: Wichita State University. Available at http://soar.wichita.edu/handle/10057/5056.","Opportunities for Youth","Study Type: Descriptive Analysis",,,"Summary: Using personal stories of youth who participated in the Area IV Kansas Summer Youth Employment Program (SYEP), the author sought to describe the ecosystems of urban youth, their relationships with adults, and the impacts of their participation in SYEP. SYEP was a summer program funded as part of the American Recovery and Reinvestment Act of 2009. It provided disadvantaged youth with summer employment and job skills training over two summers. The author interviewed 10 participating youth and analyzed their personal stories using ecological systems theory and a social capital framework. The author also analyzed documents containing the youths’ demographic and employment records. The author concluded that programs such as SYEP helped disadvantaged youth to make networking connections, learn ways of interacting in the workplace, and open doors to job opportunities that historically have not been available to those with lower socioeconomic status.","Summer Youth Employment Programs (Area IV Kansas)","Basic skills Work based and other occupational training Youth programs","Youth, Disconnected youth, Low-skilled, Low income",,"United States",2011,http://www.workforce-ks.com/modules/showdocument.aspx?documentid=2206 "A promising start: Initial impacts of Year Up on low-income young adults’ careers.","Roder, A., & Elliott, M. (2011). A promising start: Initial impacts of Year Up on low-income young adults' careers. Economic Mobility Corporation.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Mixed impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-No impacts Employment","Summary: This report presents preliminary findings for the impacts of the Year Up program, which provides technical skills training and internships to low-income adults ages 18 to 24. The authors randomly assigned eligible applicants to either be invited to participate in the program immediately (treatment group) or gain entry after 10 months (control group). They compared the outcomes of treatment and control group members for approximately two years after random assignment. The authors reported many statistically significant and positive impacts of the program in the second year after random assignment. These included impacts on annual earnings and hourly wages. The quality of causal evidence is low because the randomized controlled trial had high attrition and the study did not show that the groups being compared were equivalent prior to the program. This means we are not confident that the estimated effects are attributable to Year Up. Other factors are likely to have contributed.","Year Up","Mentoring Work based and other occupational training Youth programs","Youth, Low income","Finance and insurance","United States, Urban",2011, "Participation in the transition assistance program and job placement outcomes of U.S. veterans","Silva, E. (2011). Participation in the transition assistance program and job placement outcomes of U.S. veterans. (Publication No. AAI1491543) [Master’s dissertation, University of Rhode Island]. ProQuest.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the Transition Assistance Program (TAP) on employment success—an outcome that reflects both employment and the desired number of work hours. The study involved a nonexperimental comparison group analysis that compared veterans who participated in TAP to those who did not, using data from the Current Population Survey and Veterans Supplement. The study showed no statistically significant relationship between TAP and veterans’ employment success. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we could not be confident that any estimated effects would be attributable to TAP and not to other factors. However, the study did not show any statistically significant effects.","the Transition Assistance Program","Job search assistance and supportive services Veterans' reemployment","Veteran or military",,"United States",2011,https://digitalcommons.uri.edu/dissertations/AAI1491543/ "Residential treatment for homeless female veterans with psychiatric and substance use disorders: Effect on 1-year clinical outcomes","Harpaz-Rotem, I., Rosenheck, R. A., & Desai, R. (2011). Residential treatment for homeless female veterans with psychiatric and substance use disorders: Effect on 1-year clinical outcomes. Journal of Rehabilitation Research & Development, 48(8), 891-899.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The study examined the impact of community residential treatment on female veterans’ employment and health outcomes. The study team used statistical tests to examine the differences between two groups: (1) people who were offered at least 30 or more days of residential treatment (RT) services at Veterans Affairs (VA) medical centers and (2) people who were not offered these services or were offered these services for less than 30 days. The data for this study came from case managers, discharge summaries, interviews, and standardized self-reported measures. The study showed that receiving RT services was associated with a greater number of days worked but with mixed results on health outcomes. The quality of causal evidence presented in this report is moderate because it is based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the RT program, but other factors might also have contributed to the effects.","Residential Treatment","Health Veterans' reemployment","Female, Veteran or military",,"United States",2011,https://www.researchgate.net/profile/Ilan_Harpaz-Rotem/publication/51784250_Res… "Effects of structured vocational services on job-search success in ex-offender veterans with mental illness: 3-month follow-up","LePage, J. P., Washington, E. L., Lewis, A. A., Johnson, K. E., & Garcia-Rea, E. (2011). Effects of structured vocational services on job-search success in ex-offender veterans with mental illness: 3-month follow-up. Journal of Rehabilitation Research & Development, 48(3), 277-286. [Full About Face vs VERC]","Reentry, Veterans","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study examined the impact of About Face (AF) vocational classes on competitive employment. In this nonexperimental study, the authors used statistical analyses to compare the employment outcomes of two groups of justice-involved veterans: (1) those who participated in the AF classes (full AF program) and (2) those who only had access to the Veterans Employment Resource Center (VERC). The authors collected biweekly data from participants in person or over the phone. The study revealed significantly higher competitive employment among justice-involved veterans in the full AF program (23.8 percent hired) than in the VERC condition (0 percent hired). The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the AF program; other factors likely contributed to the findings.","About Face","Job search assistance and supportive services Veterans' reemployment","Veteran or military",,"Urban, United States",2011,https://www.rehab.research.va.gov/jour/11/483/pdf/page277.pdf "Effects of structured vocational services on job-search success in ex-offender veterans with mental illness: 3-month follow-up","LePage, J. P., Washington, E. L., Lewis, A. A., Johnson, K. E., & Garcia-Rea, E. (2011). Effects of structured vocational services on job-search success in ex-offender veterans with mental illness: 3-month follow-up. Journal of Rehabilitation Research & Development, 48(3), 277-286. [Full About Face vs. self-study]","Reentry, Veterans","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: This study examined the impact of About Face (AF) vocational classes on competitive employment. In this nonexperimental study, the authors used statistical analyses to compare the employment outcomes of two groups of veterans: (1) those who took the AF classes (full AF program) and (2) those who did not take the classes but had access to the manual to study on their own (self-study program). The authors collected biweekly data from participants in person or over the phone. The study revealed significantly higher competitive employment among veterans in the full AF program (23.8 percent hired) than in the self-study condition (3 percent hired). The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the AF program; other factors likely contributed to the findings.","About Face","Job search assistance and supportive services Veterans' reemployment","Veteran or military",,"United States",2011,https://www.rehab.research.va.gov/jour/11/483/pdf/page277.pdf "Effects of structured vocational services on job-search success in ex-offender veterans with mental illness: 3-month follow-up","LePage, J. P., Washington, E. L., Lewis, A. A., Johnson, K. E., & Garcia-Rea, E. (2011). Effects of structured vocational services on job-search success in ex-offender veterans with mental illness: 3-month follow-up. Journal of Rehabilitation Research & Development, 48(3), 277-286. [Self-study vs. VERC]","Reentry, Veterans","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-No impacts Employment","Summary: The study examined the impact of self-studying the About Face (AF) manual on competitive employment. In this nonexperimental study, the authors used statistical analyses to compare the employment outcomes of two groups of justice-involved veterans: (1) those who had access to the AF manual to study on their own (self-study program) and (2) those who only had access to the Veterans Employment Resource Center (VERC). The authors collected biweekly data from participants in person or over the phone. The study showed no significant differences in competitive employment between the self-study condition (3 percent hired) and the VERC-only condition (0 percent hired). The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the AF manual; other factors likely contributed to the findings.","About Face","Job search assistance and supportive services Veterans' reemployment","Veteran or military",,"United States",2011,https://www.rehab.research.va.gov/jour/11/483/pdf/page277.pdf "National evaluation of Youth Corps: Findings at follow-Up","Price, C., Williams, J., Simpson, L., Jastrzab, J., & Markovitz, C. (2011). National evaluation of Youth Corps: Findings at follow-up. Cambridge, MA: Abt Associates, Inc.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-No impacts Education and skills gains Employment-Mod/high-No impacts Employment Training-Mod/high-No impacts Training","Summary: The study’s objective was to examine the impact of Youth Corps, a diverse set of programs that offer educational services, employment and training, and community service activities to young adults. The programs’ effectiveness was evaluated using a randomized controlled trial conducted at 21 Youth Corps program sites. The study found a statistically significant positive impact on participants’ annual income 18 months after random assignment. There was no evidence of statistically significant impacts on employment, education, or training 30 months after random assignment, which was the primary follow-up period examined in the study. The quality of causal evidence presented in this study is moderate because, although it was based on a randomized controlled trial with high attrition, the authors demonstrated that the treatment and control groups were similar before the intervention. This means we have confidence that the estimated effects are attributable at least in part to Youth Corps, although other factors could also have contributed.","Youth Corps Programs","Job search assistance and supportive services Other training and education Youth programs",Youth,,"United States",2011,http://www.nationalservice.gov/pdf/nat_eval_youthcorps_impactreport.pdf "Schooling and the Vietnam-era GI bill: Evidence from the draft lottery","Angrist, J. D., & Chen, S. H. (2011). Schooling and the Vietnam-era GI bill: Evidence from the draft lottery. American Economic Journal: Applied Economics, 3(2), 96-118.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine the impact of the G.I. Bill on education, employment, earnings. The authors used a nonexperimental comparison group analysis to estimate the impact of the Vietnam-era G.I. Bill on outcomes. The approach compared the outcomes of Vietnam-era veterans and non-veterans in 1999 using the 1-in-6 long form sample of the 2000 U.S. Census. The authors found that, compared with White male non-veterans, Vietnam-era White male veterans eligible for the draft and the G.I. Bill had significantly more years of schooling and were significantly more likely to have earned secondary and postsecondary degrees. The study found no statistically significant relationships between veteran status and employment or earnings. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the G.I. Bill and not to other factors.","the WWII G.I. Bill","Veterans' reemployment Community college education and other classroom training","Veteran or military",,"United States",2011,https://www.aeaweb.org/articles?id=10.1257/app.3.2.96 "The effect of continuing education participation on agricultural worker outcomes","Pena, A. A. (2011). The effect of continuing education participation on agricultural worker outcomes. Washington, DC: United States Department of Labor, Employment and Training Administration.",Literacy,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of continuing education programs on agricultural worker earnings and employment outcomes. The author used a nonexperimental design to compare the outcomes of agricultural workers who participated in continuing education to a matched comparison group who did not. Using data from the United States Department of Labor’s National Agricultural Workers Survey, the author conducted statistical models to examine differences between the groups. The study found a statistically significant relationship between continuing education programs and increased wages, additional weeks worked, and agricultural workers living above the poverty threshold. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention or include sufficient control variables. This means we are not confident that the estimated effects are attributable to the continuing education programs; other factors are likely to have contributed.",,"Basic skills Other training and education",Adult,,"United States",2011,https://ageconsearch.umn.edu/record/61587/?ln=en "Program Keluarga Harapan: Main findings from the impact evaluation of Indonesia’s pilot household conditional cash transfer program","World Bank. (2011). Program Keluarga Harapan: Main findings from the impact evaluation of Indonesia’s pilot household conditional cash transfer program. Retrieved from http://documents.worldbank.org/curated/en/589171468266179965/Program-Keluarga-Harapan-impact-evaluation-of-Indonesias-Pilot-Household-Conditional-Cash-Transfer-Program","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Child labor-Mod/high-Unfavorable impacts Child labor Education and skills gains-Mod/high-Mixed impacts Education and skills gains","Summary: The study’s objective was to examine the impact of a conditional cash transfer program, Program Keluarga Harapan (PKH), on child school and work participation. The study was a randomized controlled trial (RCT) that compared outcomes between the treatment and control groups using household surveys conducted before and two years after initial program implementation. The study found a significant increase in time spent working in family enterprises for children 13-15 and children 7-12 in the treatment group compared to the control group. The study found that relative to the control group, children aged 13-15 who participated in the program had significantly larger increases in the hours attending school two years after program implementation began. However, school enrollment rates significantly decreased for children aged 7-12 who participated in the program. The quality of causal evidence presented in this report is moderate because randomization was compromised but the authors ensured that the groups being compared were similar before the intervention. This means we are somewhat confident that the estimated effects are attributable to Program Keluarga Harapan, but other factors might also have contributed.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2011,http://documents.worldbank.org/curated/en/589171468266179965/Program-Keluarga-H… "Youth Corps emerging practices for education and employment. Prepared for the Corporation for National and Community Service","Gan, K., Jastrzab, J., Jefferson, A., Schneider, G., & Schlager, C. (2011). Youth Corps emerging practices for education and employment. Prepared for the Corporation for National and Community Service. Cambridge, MA: Abt Associates Inc.","Opportunities for Youth","Study Type: Descriptive Analysis",,,"Summary: This study examined emerging practices used by Youth Corps sites to enhance their participants’ educational and employment opportunities. Youth Corps is a program that engages youth ages 16 to 25 in a combination of community service, workforce development, and education. It is designed to have a positive impact on both its participants and their communities. The authors gathered and analyzed data from interviews with the executive directors of four Youth Corps sites, along with site visits to those sites. Although the studied sites varied, the authors found that all shared a set of common principles that led to increased educational and employment opportunities for its members. These included an understanding of the local labor market in which the corps operated, in order to enhance employment opportunities, and building partnerships with outside community resources. The authors provided a tool kit for youth education and employment service providers that highlights lessons learned; other practitioners can use this information, as can those interested in developing similar initiatives.","Youth Corps Programs","Community college education and other classroom training Job search assistance and supportive services Other training and education Youth programs","Youth, Low-skilled, Low income",,"United States",2011,http://www.nationalservice.gov/pdf/emerging_practices_youthcorps.pdf "Increasing saving behavior through age-progressed renderings of the future self","Hershfield, H., Goldstein, D., Sharpe, W., Fox, J., Yeykelis, L., Carstensen, L., & Bailenson, J. (2011). Increasing saving behavior through age-progressed renderings of the future self. Journal of Marketing Research, 48(SPL), S23–S37.","Behavioral Finance: Retirement","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Attitudes-Mod/high-Favorable impacts Attitudes","Summary: The study’s objective was to determine whether contact with an age-progressed visual representation of the self led participants to allocate more money to savings for retirement. The authors presented four random assignment studies relying on varying degrees of contact with these age-progressed visual representations in an attempt to pinpoint their effect on retirement savings behavior and the mechanism through which such representations alter savings attitudes. In the four experiments discussed here, the authors collected data directly from participants by administering post-intervention surveys or collecting hypothetical asset allocation information. The study found that participants who saw age-progressed pictures of themselves chose to allocate a significantly higher proportion of hypothetical income to retirement compared to a control group; the participants in this study were drawn from a group of adults ages 18 to 35. Results were similar in three other experiments using undergraduate students. The quality of the causal evidence presented in this study is high. This means we are confident the differences in outcomes observed between treated and control groups resulted from the interventions tested, and not other factors.","Interactions with Age-Processed Visual Representation of the Self","Employer provided retirement benefits",Youth,,"United States",2011, "The Accelerated Benefits Demonstration and Evaluation Project: Impacts on health and employment at twelve months","Michalopoulos, C., Wittenburg, D., Israel, D., Schore, J., Warren, A., Zutshi, A., Freedman, S., & Schwartz, L. (2011). The Accelerated Benefits Demonstration and Evaluation Project: Impacts on health and employment at twelve months. New York: MDRC.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-No impacts Employment Health and safety-Mod/high-Favorable impacts Health and safety Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: This is the 12-month survey impact report of the Accelerated Benefits Demonstration (ABD), an effort to provide immediate health insurance and employment and benefits counseling to new, uninsured Social Security Disability Insurance (SSDI) recipients during the 24 month Medicare eligibility waiting period.  About 2,000 volunteers were randomly assigned as part of the demonstration; this report focuses on approximately 1,500 of them. Study data sources included Social Security Administration (SSA) administrative records, a baseline telephone survey, a follow-up 12-month survey, health claims data, and a case management information system. ABD health insurance increased health care utilization, reduced unmet medical care needs, and improved self-reported health. However, ABD employment supports did not increase employment in the first 12 months of follow-up. The quality of the causal evidence presented in this report is high because the study is a well-implemented randomized controlled trial. This means we can be confident that the outcome differences between research groups are attributable to ABD, and not other factors.","Accelerated Benefits Demonstration","Disability insurance Health insurance Supplemental security income (SSI) Job search assistance and supportive services",Disability,,"United States",2011,http://www.mdrc.org/sites/default/files/full_528.pdf "The Social Security Administration’s Youth Transition Demonstration projects: Interim report on Colorado Youth WINS","Fraker, T., Baird, P., Black, A., Mamun, A., Manno, M., Martinez, J., Rangarajan, A., & Reed, D. (2011). The Social Security Administration’s Youth Transition Demonstration projects: Interim report on Colorado Youth WINS. Princeton, NJ: Mathematica Policy Research.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-No impacts Education and skills gains Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: This study’s objective was to measure 12-month impacts of the Colorado Youth Work Incentive Network of Supports (WINS) project, sponsored by the Social Security Administration (SSA), one of six project sites of the larger Youth Transition Demonstration (YTD) projects that used a randomized evaluation. Youth WINS provided services to help youth with disabilities improve their education and employment outcomes and become more economically self-sufficient and less reliant on disability benefits. Data were collected from a baseline survey and 12-month follow-up survey, the Ticket Research File (TRF), and the Master Earnings File (MEF). The authors estimated program impacts on measures of paid employment, educational attainment, and Social Security disability benefit receipt. The study found that Youth WINS did not achieve any statistically significant impacts on the outcomes examined during the 12-month follow-up period. The quality of causal evidence in this study is high because it was a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to Colorado Youth WINS and not to other factors.","the Youth Transition Demonstration Projects, Colorado Youth WINS Program","Disability insurance Supplemental security income (SSI) Youth programs","Youth, Disability",,"United States",2011,https://www.socialsecurity.gov/disabilityresearch/documents/CO%20Final%20Interi… "The Social Security Administration’s Youth Transition Demonstration Projects: Interim report on the City University of New York’s project","Fraker, T., Black, A., Broadus, J., Mamun, A., Manno, M., Martinez, J., McRoberts, R., Rangarajan, A., & Reed, D. (2011). The Social Security Administration’s Youth Transition Demonstration Projects: Interim report on the City University of New York’s project. Princeton, NJ: Mathematica Policy Research.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Mod/high-No impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: This study’s objective was to measure 12-month impacts of the City University of New York (CUNY) Youth Transition Demonstration Project (YTDP) in the Bronx, one of six project sites of the larger Social Security Administration (SSA)-sponsored YTD projects that used a randomized evaluation.  CUNY YTDP provided services to help youth with severe disabilities improve their employment outcomes and become more economically self-sufficient. Data were collected from a baseline survey and 12-month follow-up survey, the Ticket Research File (TRF), and the Master Earnings File (MEF). The authors estimated program impacts on measures of paid employment, educational attainment, and Social Security disability benefit receipt. The study found that CUNY YTDP had positive and statistically significant impacts on employment during the 12-month follow-up period. The study found no statistically significant impacts on earnings, educational attainment, total income, or Social Security disability benefit receipt. The quality of causal evidence presented in this report is high because it is based on a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to CUNY YTDP, and not to other factors.","the Youth Transition Demonstration Projects, The City University of New York","Disability insurance Supplemental security income (SSI) Youth programs","Youth, Disability",,"United States",2011,http://www.ssa.gov/disabilityresearch/documents/CUNY%20Final%20Interim%20Report… "The Social Security Administration’s Youth Transition Demonstration Projects: Interim report on Transition WORKS","Fraker, T., Black, A., Mamun, A., Manno, M., Martinez, J., O’Day, B., O’Toole, M., Rangarajan, A., & Reed, D. (2011). The Social Security Administration’s Youth Transition Demonstration Projects: Interim report on Transition WORKS. Princeton, NJ: Mathematica Policy Research.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-No impacts Education and skills gains Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: This study’s objective was to measure 12-month impacts of the Transition WORKS, one of six project sites of the larger Social Security Administration (SSA)–sponsored Youth Transition Demonstration (YTD) projects that used a randomized evaluation.  Transition WORKS provided services to help youth with severe disabilities improve their education and employment outcomes and become more economically self-sufficient. Data were collected from a baseline survey and 12-month follow-up survey, the Ticket Research File (TRF), and Master Earnings File (MEF). The authors estimated program impacts on measures of paid employment, educational attainment, and Social Security disability benefit receipt.  The study found that Transition WORKS did not achieve any statistically significant impacts on paid employment, educational attainment, or Social Security disability benefit during the 12-month follow-up period. The quality of causal evidence presented in this report is high because it is based on a well-conducted randomized controlled trial. This means we are confident that the effects estimated in the study would be attributable solely to Transition WORKS, and not to other factors.","the Youth Transition Demonstration Projects, Transition WORKS","Disability insurance Supplemental security income (SSI) Youth programs","Youth, Disability",,"United States",2011,http://www.ssa.gov/disabilityresearch/documents/Erie%20Final%20Interim%20Report… "The Impact of Changing Financial Work Incentives on the Earnings of Social Security Disability Insurance (SSDI) Beneficiaries","Weathers, R., & Hemmeter, J. (2011). The impact of changing financial work incentives on the earnings of Social Security Disability Insurance (SSDI) beneficiaries. Journal of Policy Analysis and Management, 30(4), 708-728.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-Unfavorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Benefit Offset Pilot Demonstration (BOPD), which provided a more-generous work incentive for Social Security Disability Insurance (SSDI) recipients, on recipients’ employment status, earnings, and reliance on benefits.  The analysis used data from the Master Earnings File (MEF) and Master Beneficiary Record (MBR). The authors reported unadjusted and regression-adjusted program impacts. The study found that the BOPD had no earnings impacts but increased the probability of earning above the annualized SGA amount one and two years after baseline. The intervention also increased the average SSDI benefit payment to participants. The quality of the evidence presented in this study is high because it is based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the BOPD, and not to other factors.","the Benefit Offset Pilot Demonstration","Disability insurance Other wages and benefits Supplemental security income (SSI)",Disability,,"United States",2011, "Person-centered planning in a transition program for Bronx youth with disabilities","Croke, Erin E., & Thompson, Ashleigh B. (2011). Person-centered planning in a transition program for Bronx youth with disabilities. Children and Youth Services Review. DOI:10.1016/j.childyouth.2010.11.025.","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: This report used qualitative and quantitative methods to explore findings of a 2003–2010 Youth Transition Demonstration (YTD) project. YTD offered a series of interventions, including Social Security Administration benefits counseling, education and employment assistance, and person-centered planning (PCP) to transition-age youth with disabilities. The study found that the PCP component was linked to improved educational and employment outcomes for youth. The study also found that although 65 percent of youth enrolled in the project participated in at least one PCP session, youth from lower-income families were less likely to participate in PCP, as were youth with mood disorders. Youth focused on relationships, personal strengths, and goals during these sessions, which proved an important part of their transition process. The study also described the intervention and made recommendations for the future use of PCP.",,"Disability insurance Supplemental security income (SSI) Youth programs","Youth, Disability",,"United States",2011, "Gender Equity in Science and Engineering: Advancing Change in Higher Education","Bilimoria, D., & Liang, X. (2011). Gender Equity in Science and Engineering: Advancing Change in Higher Education. New York: Routledge.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to evaluate the effectiveness of the ADVANCE institutional transformation program (ADVANCE-IT) sponsored by the National Science Foundation (NSF) in advancing women’s representation among science, technology, engineering, and mathematics (STEM) faculty in U.S. colleges and universities. The authors used program implementation and outcome data obtained from 19 participating colleges and universities to examine program initiatives, actions, and outcomes of ADVANCE-IT institutions. The analysis of interest in this review compared the changes in proportions of female STEM faculty in institutions that were implementing ADVANCE-IT programs to national reference groups over the course of the program period, by faculty rank and by type of institution. The study found that the ADVANCE-IT program was effective in increasing the number of female STEM faculty at all ranks in four-year colleges and research universities. The quality of causal evidence presented in this study is low. This means we are not confident that the estimated effects are attributable to the ADVANCE-IT program. Other factors are likely to have contributed.","the ADVANCE Program","Other disparities or discrimination in employment and earnings Science, Technology, Engineering, and Math (STEM) programs","Female, STEM professional",,"United States",2011, "Longitudinal Statistics on Work Activity and Use of Employment Supports for New Social Security Disability Insurance Beneficiaries","Liu, Su, & Stapleton, David C. (2011). Longitudinal Statistics on Work Activity and Use of Employment Supports for New Social Security Disability Insurance Beneficiaries. Social Security Bulletin, 71(3).","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: This study used administrative data files constructed for the Ticket to Work (TTW) evaluation. These files contained extensive information on the more than 20 million Disability Insurance or Supplemental Security Income recipients who received a benefit in at least one month from January 1996 through December 2007. They included data on benefits, earnings, and enrollment in vocational rehabilitation services for 100 percent of the Disability Insurance population, with a few exceptions, over this time period. For the first (1996) cohort, the study documented the different pathways that led recipients to benefit termination. It presented longitudinal statistics on employment, earnings, and use of work incentives, and showed variation in work incentive statistics by state. It then compared selected statistics for more recent cohorts, and considered policy implications of all findings, including implications for TTW and other employment initiatives. These longitudinal statistics painted a somewhat more optimistic picture of the efforts of recipients to find work compared with the Social Security Administration’s then-published cross-sectional statistics. The authors also concluded that changing the Disability Insurance program to help recipients increase earnings might not produce program savings even if the changes increased exits from Disability Insurance, because the program might have provided additional support to those who would exit anyway.",,"Disability insurance Supplemental security income (SSI) Supported employment or other employment supports",Disability,,"United States",2011, "Longitudinal Outcomes of an Early Cohort of Ticket to Work Participants","Livermore, Gina A., & Roche, Allison. (2011). Longitudinal Outcomes of an Early Cohort of Ticket to Work Participants. Social Security Bulletin, 71(3).","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: This study followed a cohort of working-age Supplemental Security Income and Social Security Disability Insurance recipients participating in the Ticket to Work (TTW) program for several years to assess their service use, health status, employment, and income. The study used a longitudinal sample of 767 TTW participants who were followed in each of the 2004, 2005, and 2006 rounds of the National Beneficiary Survey, conducted as part of the TTW evaluation. The sample was representative of TTW participants who were enrolled in the program at some point from January to June 2003 and resided in the 13 states where TTW was first implemented in 2002. The findings showed that about 20 percent of TTW participants achieved employment at levels that would significantly reduce their disability benefits. Another 40 percent achieved some employment success, but the remaining 40 percent reported no earnings during 2003–2005. Many participants experienced significant changes in their health status across survey rounds, which might have affected their ability to actively participate in TTW and to become employed. Many also experienced significant employment and income instability. The findings suggested that employment among TTW participants was associated with reduced poverty.",,"Health Disability insurance Supplemental security income (SSI) Supported employment or other employment supports",Disability,,"United States",2011,http://www.ssa.gov/policy/docs/ssb/v71n3/v71n3p105.html "Employment Among Social Security Disability Program Beneficiaries, 1996–2007","Mamun, Arif, O’Leary, Paul, Wittenburg, David C., & Gregory, Jesse. (2011). Employment Among Social Security Disability Program Beneficiaries, 1996–2007. Social Security Bulletin, 71(3).","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: This article described the variation in employment rates of Social Security Disability Insurance (DI) and Supplemental Security Income recipients over time and across states using a consistent measure of earnings from administrative data. It also examined the extent to which observable demographic and disability characteristics of recipients could explain the variation in employment rates. One purpose of the analysis was to assess then-current policies and provide benchmarks for ongoing demonstration projects and future return-to-work initiatives. The study characterized more than 10 million working-age adult disability recipients. Authors found that the overall employment rate—defined for the study as annual earnings over $1,000—was 12 percent in 2007. Substantial variation existed within the population. DI recipients and those younger than 40 were much more likely to work relative to other Social Security recipients. Additionally, substantial regional variation existed across states; employment rates ranged from 7 percent (West Virginia) to 23 percent (North Dakota). The analysis also found that the employment rates among recipients were sensitive to the business cycle and persistent over time.",,"Disability insurance Supplemental security income (SSI)",Disability,,"United States",2011,http://www.ssa.gov/policy/docs/ssb/v71n3/v71n3p11.html "Employment of Individuals in the Social Security Disability Programs","O’Leary, Paul, Livermore, Gina A., & Stapleton, David C. (2011). Employment of Individuals in the Social Security Disability Programs. Social Security Bulletin, 71(3).","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: This article introduced an issue of the Social Security Bulletin that featured articles drawn from the 2010 Ticket to Work (TTW) evaluation report and provided more expansive information than that report. As background, this article described both work incentive programs offered to Social Security disability recipients. It used longitudinal and cross-sectional data to provide Supplemental Security Income and Social Security Disability Income program statistics. It described the variation in employment outcomes across states and over time, the occurrence and duration of employment of disability recipients, and factors affecting recipients’ ability to sustain high earnings.",,"Disability insurance Supplemental security income (SSI) Supported employment or other employment supports",Disability,,"United States",2011,http://www.ssa.gov/policy/docs/ssb/v71n3/v71n3p1.html "Disability Benefits Suspended or Terminated Because of Work","Schimmel, Jody, & Stapleton, David C. (2011). Disability Benefits Suspended or Terminated Because of Work. Social Security Bulletin, 71(3).","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: This study produced statistics on the first month of suspension or termination for work for Social Security Disability Insurance (DI) and Supplemental Security Income (SSI)-only recipients. It also estimated the number of months people spent in nonpayment status following suspension or termination for work (NSTW) before their return to the rolls, attainment of the full retirement age, or death—in each year from 2002 through 2006. Data came from a compilation of multiple administrative data sources containing information on all DI and adult SSI disability recipients with at least one month in current pay status from 1996 onward, created for the Ticket to Work (TTW) evaluation. The study found that less than 1 percent of all recipients, or about 70,000 each year, experienced their first month of benefit suspension or termination for work in each year from 2002 through 2006. However, the cumulative effect was much more substantial because many recipients remained in NSTW for a sustained period. Slightly more than 400,000 recipients or former recipients had at least one NSTW month in 2006. TTW participants were more likely to have a first STW than nonparticipants, but most of those who had an STW were not TTW participants, reflecting low use of TTW.",,"Disability insurance Supplemental security income (SSI)",Disability,,"United States",2011,http://www.ssa.gov/policy/docs/ssb/v71n3/v71n3p83.html "Misunderstanding savings growth: Implications for retirement savings behavior","McKenzie, C., & Liersch, M. (2011). Misunderstanding savings growth: Implications for retirement savings behavior. Journal of Marketing Research, 68, S1–S13.","Behavioral Finance: Retirement","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Attitudes-Mod/high-Favorable impacts Attitudes","Summary: Experiments Using Undergraduate Students This study used three experiments in a controlled setting to examine undergraduate students’ intuitions of retirement savings growth, understanding of investment concepts, and motivation to invest toward their retirement after entering the workforce.1 The authors administered three surveys consisting of hypothetical situations followed by exercises asking respondents to compute an omitted element of the savings function (for example, the monthly deposit amount or rate of return required to accumulate a given amount of savings at retirement). Each experiment randomly assigned participants to receive or not receive some form of aid (for example, a calculator) or additional information (for example, savings growth charts) to complete the exercises. The first study found that participants tended to severely underestimate projected savings account balances at retirement and overestimate the rates of return and monthly deposit amounts required to ensure such balances. The second study found that when provided with information on exponential growth, participants were more motivated to save for retirement; however, in the third study there was no statistically significant relationship between information on exponential growth and motivation to save for retirement. The quality of the causal evidence presented in this portion of the study is high. This means we are confident that any differences in responses were a result of the various treatment conditions of the three experiments. Analysis of Employees’ Survey Data The study further aimed to determine whether showing employees how much money they would have at retirement—based on current annual contributions, the current account balance, and return rates—can motivate them to increase savings, compared with showing employees current account balances only. The authors analyzed differences in employees’ interest in changing current levels of retirement savings, measured on a seven-point Likert scale, comparing those who were provided only their estimated 401(k) account balance at retirement and those who were shown only their current balance. The analysis demonstrated that showing workers actual account projections (in addition to the current balance) motivated them to save more. The quality of causal evidence presented in this portion of the study is also high. This means we are confident that showing employees their estimated 401(k) account balances at retirement increased the percentage of employees who wanted to save more each month.","Informational Interventions for Undergraduates and Workers","Employer provided retirement benefits","Adult, Employed",,"United States",2011, "Boon or bane?: 401(k) loans and loan provisions","Wenger, J., & Weller, C. (2011). Boon or bane?: 401(k) loans and loan provisions. Available at http://ssrn.com/abstract=1941411.","Behavioral Finance: Retirement","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employer benefits receipt-Low-Favorable impacts Employer benefits receipt","Summary: The study’s objective was to examine the impact of having a borrowing option in a defined contribution (DC) pension plan on contribution rates and total debt. The authors used data from the United States Federal Reserve’s triennial Survey of Consumer Finance to estimate ordinary least squares (OLS) and instrumental variable (IV) regression models. Both models control for demographic characteristics and financial situation. The authors found that having a borrowing option significantly increased both contribution rates and debt. The quality of causal evidence presented in this report is low. This means we are not confident that the estimated effects are attributable to the borrowing option in DC pension plans. Other factors are likely to have contributed.","Borrowing Options in Defined Contribution Pension Plans","Employer provided retirement benefits",Employed,,"United States",2011,http://ssrn.com/abstract=1941411 "Breaking new ground: An impact study of career-focused learning communities at Kingsborough Community Colleges","Visher, M., & Teres, J. (2011). Breaking new ground: An impact study of career-focused learning communities at Kingsborough Community Colleges. New York: National Center for Postsecondary Research.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of career-focused learning communities at Kingsborough Community College in New York on progress toward and completing a degree. Students with eight declared majors could participate in a career-focused learning community, which involved enrolling in three linked courses during a semester: two required courses for the student’s major and an integrative seminar designed to reinforce the two required courses and raise awareness of career options.  The study was a randomized controlled trial. Eligible students were randomly assigned to either the treatment group, which was offered the opportunity to participate in one of the learning communities, or the control group, which was not allowed to enroll in a learning community. The primary data sources were a baseline survey on background characteristics of students and student transcripts. The study found no significant impacts on registration in any course, number of semesters registered, credits earned or attempted, the proportion of students who passed or withdrew from all classes, grade point average (GPA), or graduation rate in either the semester of program implementation or the first post-program semester. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects would be attributable to the learning communities, and not to other factors.","Career-Focused Learning Communities at Kingsborough Community College","Community college education and other classroom training",Adult,,"United States",2011,http://www.mdrc.org/sites/default/files/full_30.pdf "Serving community college students on probation: Four-year findings from Chaffey College’s Opening Doors Program","Weiss, M., Brock, T., Sommo, C., Rudd, T., & Turner, M.C. (2011). Serving community college students on probation: Four-year findings from Chaffey College’s Opening Doors Program. New York: MDRC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the two-semester Enhanced Opening Doors program at Chaffey Community College near Los Angeles, California. Students in the Enhanced Opening Doors program took a college success course that covered personal goals, study skills, and college rules; students also had to attend a student success center for tutoring sessions. The study was a randomized controlled trial. Eligible students were randomly assigned to either the treatment group, which was required to participate in the Enhanced Opening Doors program, or the control group, which was not required to participate in the program. The primary data sources were a baseline survey on the background characteristics of students, students’ transcripts, and degree-attainment information from the National Student Clearinghouse. The study reported outcomes for the four years following random assignment. The study found that in any of the follow-up years and cumulatively from the first through fourth follow-up years, the program did not have a significant impact on the number of semesters enrolled in college, the number of cumulative credits earned, enrollment in a four-year college, or earning a degree or certificate. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects would be attributable to the Enhanced Opening Doors program, and not to other factors.","the Enhanced Opening Doors Program at Chaffey Community College","Community college education and other classroom training","Adult, Other barriers",,"United States",2011,http://www.mdrc.org/sites/default/files/full_506.pdf "Working Well—the Texas Demonstration to Maintain Independence and Employment: 18-month outcomes","Bohman, T.M., Wallisch, L., Christensen, K., Stoner, D., Pittman, A., Reed, B., & Ostermeyer, B. (2011). Working Well—the Texas Demonstration to Maintain Independence and Employment: 18-month outcomes. Journal of Vocational Rehabilitation, 34, 97–106.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The report’s objective was to examine the impacts of the Demonstration to Maintain Independence and Employment (DMIE) in the Texas site. The DMIE was designed to prevent or delay people with disabilities from leaving the workforce and applying for Social Security Disability Insurance (SSDI) and Supplemental Security Income (SSI) benefits. The study was a randomized controlled trial examining DMIE’s impacts on employment, earnings, Social Security disability benefit receipt, and health status and access. Impacts were evaluated 18 months after sample members’ enrollment. The study found no statistically significant impacts on employment or earnings. However, there was evidence of modest reductions in SSDI and SSI receipt among treatment group members, as well as improvements in health care access, utilization, and satisfaction with health care. The quality of the causal evidence presented in this report is high because it was a well-implemented randomized controlled trial. This means we can be confident that the estimated impacts are attributable to Texas’s DMIE, and not other factors.","Demonstration to Maintain Independence and Employment (DMIE) in Texas","Health Disability insurance Supplemental security income (SSI) Vocational rehabilitation",Disability,,"United States",2011, "Influencing the disability trajectory for workers with serious mental illness: Lessons from Minnesota’s Demonstration to Maintain Independence and Employment","Linkins, K. W., Brya, J. J., Oelschlaeger, A., Simonson, B., Lahiri, S., McFeeters, J., Schutze, M., Jonas, J., & Mowry, M. A. (2011). Influencing the disability trajectory for workers with serious mental illness: Lessons from Minnesota’s Demonstration to Maintain Independence and Employment. Journal of Vocational Rehabilitation, 34(2), 107-118.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-No impacts Employment Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The report’s objective was to examine the impacts of the Demonstration to Maintain Independence and Employment (DMIE) in the Minnesota site. The DMIE was designed to prevent or delay people with disabilities from leaving the workforce and applying for Social Security Disability Insurance (SSDI) and Supplemental Security Income (SSI) benefits. The study was a randomized controlled trial examining DMIE’s impacts on earnings, benefits applications, and activities of daily living (ADLs). Data sources included participant surveys and health care and employment service utilization information. Impacts were evaluated 12 months after sample members’ enrollment. The study found that program participants did not work more hours per month or earn more over the follow-up period than control group members, but were less likely to apply for SSDI or SSI benefits. The program also decreased the number of ADL limitations. The quality of causal evidence provided in this study is low. This means that we cannot be confident that the estimated effects are attributable to Minnesota’s DMIE; other factors are likely to have contributed.","Demonstration to Maintain Independence and Employment (DMIE) in Minnesota","Health Disability insurance Supplemental security income (SSI) Vocational rehabilitation",Disability,,"United States",2011, "Impact of early intervention programs for working adults with potentially disabling conditions: evidence from the national DMIE evaluation","Gimm, G., Ireys, H., Gillman, B., & Croake, S. (2011). Impact of early intervention programs for working adults with potentially disabling conditions: evidence from the national DMIE evaluation. Journal of Vocational Rehabilitation, 34, 71–81.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-No impacts Employment Earnings and wages-Mod/high-No impacts Earnings and wages Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: This study’s objective was to examine short-term (that is, 6- to 12-month) impacts of the Demonstration to Maintain Independence and Employment (DMIE). DMIE was implemented in Hawaii, Kansas, Minnesota, and Texas with the aim of preventing or delaying people with disabilities from leaving the workforce and applying for Social Security Disability Insurance (SSDI) and Supplemental Security Income (SSI) benefits. The study was a randomized controlled trial examining DMIE’s impact on employment, hours worked, and benefits applications. Study data sources included the Ticket Research File (TRF), 831 File, and Uniform Data Set (UDS). Because DMIE recruitment methods, participant populations, and services offered varied substantially across states, the authors reported impacts separately for each state and for Minnesota and Texas pooled together. With few exceptions, DMIE did not achieve statistically significant impacts on employment, hours worked, or disability benefit applications. The quality of causal evidence is high for most outcomes, which means that we are confident that the estimated impacts are attributable solely to the DMIE. However, for some outcomes including employment in Kansas and Hawaii, the quality of the causal evidence is moderate, which means that we have confidence that the estimated effects are attributable at least in part to the DMIE, though other factors might also have contributed.","Demonstration to Maintain Independence and Employment (DMIE)","Health Disability insurance Supplemental security income (SSI) Vocational rehabilitation",Disability,,"United States",2011, "Mental Health Treatment Study: Final Report","Frey, W., Drake, R., Bond, G., Miller, A., Goldman, H., Salkever, D., & Holsenbeck, S. (2011). Mental Health Treatment Study: Final Report. Baltimore, MD: Westat.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Health and safety-Low-Favorable impacts Health and safety Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Mental Health Treatment Study (MHTS), which provided supported employment services to Social Security Disability Insurance (SSDI) recipients with psychiatric disabilities. The study was a randomized controlled trial with 2,238 participants. The analysis used data from nine surveys administered over the two-year intervention period. The study found that MHTS had positive impacts on earnings measured 12 and 24 months after random assignment and on health outcomes 24 months after random assignment. There were no statistically significant impacts on disability benefits receipt. The quality of the evidence presented in this study is moderate for earnings and SSDI benefit receipt outcomes. This means we are somewhat confident that the estimated effects are attributable to the MHTS, but other factors might also have contributed. For the health outcomes, the quality of evidence presented in this study is low. This means we are not confident that the estimated effects are attributable to MHTS; other factors are likely to have contributed.","the Mental Health Treatment Study (MHTS)","Health Disability insurance Job search assistance and supportive services Vocational rehabilitation",Disability,,"United States",2011,http://socialsecurity.gov/disabilityresearch/documents/MHTS_Final_Report_508.pdf "$100 bills on the sidewalk: Suboptimal investment in 401(K) plans","Choi, J., Laibson, D., & Madrian, B. (2011). $100 bills on the sidewalk: Suboptimal investment in 401(K) plans. The Review of Economics and Statistics, 93(3), 748-763.","Behavioral Finance: Retirement","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employer benefits receipt-Mod/high-No impacts Employer benefits receipt","Summary: The study examined the impact of providing information about employer contribution matches and penalty-free withdrawal rules on 401(k) contribution rates. These features created an opportunity for certain employees to increase their retirement savings without decreasing take-home pay. Even though this enabled employees to make a profit at very little cost, many eligible employees did not choose to exploit this opportunity. Employees were randomly assigned to receive a survey embedded with explicit information on the opportunity or a control survey without the information. The authors used survey data linked to administrative data obtained from Hewitt Associates, a large benefits administration and consulting firm. The study found no statistically significant relationship between the treatment condition and future 401(k) contribution rates. The quality of the causal evidence presented in this study is high. This means we are confident that any estimated effects of the intervention would be attributable to the intervention itself, and not some other factor.","the Provision of Information on a Missed ""Free Lunch""","Employer provided retirement benefits",Employed,,"United States",2011, "The Social Security Administration’s Youth Transition Demonstration Projects: Interim report on the City University of New York’s Project","Fraker, T., Black, A., Broadus, J., Mamun, A., Manno, M., Martinez, J., McRoberts, R., Rangarajan, A., & Reed, D. (2011). The Social Security Administration’s Youth Transition Demonstration Projects: Interim report on the City University of New York’s Project. Report submitted to the Social Security Administration. Washington, DC: Mathematica Policy Research.","Disability Employment Policy","Study Type: Implementation Analysis",,,"Summary: This report presents an interim implementation and impact analysis on the City University of New York (CUNY) Youth Transition Demonstration Project (YTDP). The program sought to maximize economic self-sufficiency and independence for youth disability insurance beneficiaries by improving their employment and educational opportunities. The program targeted youth ages 14 through 18 who received Supplemental Security Income (SSI) and resided in Bronx County. The study examined implementation of YTDP at two CUNY campuses, focusing on major aspects of service delivery, including the background, local context, and service environment of YTDP. It also provided information on beneficiaries’ characteristics and satisfaction with the program. The study used qualitative analysis of staff and beneficiary interviews, including data collected from site visits; and descriptive quantitative analysis of beneficiaries’ baseline and follow-up survey data and service utilization data from a management information system. The study found that youth beneficiaries had access to all of the services in the conceptual framework. Many began receiving individualized services before participating in structured workshops. However, education-related and person-centered services were among the less-intensive service offerings. Study findings related to implementation challenges and solutions are potentially applicable to other current or future projects that provide employment-related services to youth with disabilities.","the Youth Transition Demonstration Projects, The City University of New York","Supplemental security income (SSI) Youth programs Vocational rehabilitation","Youth, Disability",,"United States",2011,http://www.mdrc.org/sites/default/files/full_579.pdf "Affirmative action bans and minority employment: Washington State’s Initiative 200","Colello, A. (2011). Affirmative action bans and minority employment: Washington State’s Initiative 200. Washington, DC: Georgetown University.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Unfavorable impacts Employment","Summary: The study’s objective was to assess the effect of Washington State’s Initiative 200 (I-200), which repealed affirmative action statewide, on racial and ethnic minority employment and wages. Using the Current Population Survey (CPS) outgoing rotation groups from 1993 to 1996 and 2000 to 2003, the author compared changes in racial and ethnic minority employment and wages relative to white employment and wages in Washington State to the corresponding changes in the rest of the United States. After the state’s affirmative action repeal, Washington State residency was associated with a 4.1 percentage point increase in unemployment for African Americans relative to whites. The quality of causal evidence provided in this study is low. This means that we are not confident that the estimated effects were attributable to I-200; other factors are likely to have contributed.","Washington State's I-200","Affirmative action","Black or African American",,"United States",2011,http://hdl.handle.net/10822/553693 "Supporting work effort of SSDI beneficiaries: Implementation of Benefit Offset Pilot Demonstration.","Chambless, C., Julnes, G., McCormick, S., & Reither, A. (2011). Supporting work effort of SSDI beneficiaries: Implementation of Benefit Offset Pilot Demonstration. Journal of Disability Policy Studies, 22(3), 179-188.","Disability Employment Policy","Study Type: Implementation Analysis",,,"Summary: This report presented an implementation and impact analysis of the Utah Benefits Offset Pilot Demonstration Project (BOPD). The study examined pilot procedures and potential challenges for national implementation of the Benefit Offset National Demonstration (BOND), which intended to reduce barriers confronting SSDI recipients wishing to increase their earnings by offering a benefit offset. The study focused on how to effectively implement and administer the benefit offset and whether work incentives counseling and other employment supports would encourage beneficiaries to take advantage of the offset program. The authors used administrative data about recruitment and service use, focus groups, and surveys. The study found that recruitment for the demonstration was challenging because of perceived threats to benefits status from participating. Effective communication through multiple modes was crucial to successful recruitment. In addition, staff found the start and end dates of benefits changes difficult to communicate to participants, and so developed tools, including time lines, to do so. Due to limitations in the study’s discussions of its research methods, it is unclear whether findings are potentially applicable to other projects for SSDI beneficiaries.","the Utah Benefits Offset Pilot Demonstration Project","Disability insurance Vocational rehabilitation",Disability,,"United States",2011, "Mental Health Treatment Study: Final report. Report submitted to the Social Security Administration.","Frey, W., Drake, R., Bond, G., Miller, A., Goldman, H., Salkever, D., & Holsenbeck, S. (2011) Mental Health Treatment Study: Final report. Report submitted to the Social Security Administration. Rockville, MD: Westat.","Disability Employment Policy","Study Type: Implementation Analysis",,,"Summary: The study’s objective was to examine the implementation and impact of the Mental Health Treatment Study, which provided individual placement and support (IPS, an evidence-based model of supported employment services) and systematic medication management to Social Security Disability Insurance (SSDI) recipients with psychiatric disabilities. This profile focuses on the implementation study; see CLEAR’s profile of the impact study here. The implementation study focused on fidelity to the program model, consistency in service delivery, where services occurred, and the relationship between fidelity and employment rates. The authors collected data from regular telephone calls with program staff, site visits, participants’ medical records, follow-up interviews, and service use data. To measure fidelity, the study used a 15-point IPS fidelity scale; each scale item reflected a specific element in the IPS practice. Overall, the study found that 77 percent of sites achieved high fidelity in the first year of implementation and 86 percent of sites achieved high fidelity in the second and third years. More than 90 percent of participants engaged in some type of supported employment service in the first reporting period and almost 90 percent did so in the second reporting period. Study findings related to implementation challenges and solutions are potentially applicable to other current or future projects that provide employment-related services to people with psychiatric disabilities.","the Mental Health Treatment Study (MHTS)","Disability insurance Health",Disability,,"United States",2011,http://www.ssa.gov/disabilityresearch/documents/MHTS_Final_Report_508.pdf "The Accelerated Benefits Demonstration and Evaluation project: Impacts on health and employment at twelve months","Michalopoulos, C., Wittenburg, D., Israel, D., Schore, J., Warren, A., Zutshi, A., Freedman, S., & Schwartz, L. (2011). The Accelerated Benefits Demonstration and Evaluation project: Impacts on health and employment at twelve months, volume 1. New York: MDRC.","Disability Employment Policy","Study Type: Implementation Analysis",,,"Summary: This report presented an interim implementation and impact analysis on the Accelerated Benefits Demonstration (ABD), an effort to provide immediate health insurance and employment and benefits counseling to new, uninsured Social Security Disability Insurance (SSDI) recipients during the 24-month Medicare eligibility waiting period. This profile focused on the implementation analysis. The study examined implementation of ABD in 53 qualifying U.S. metropolitan areas, focusing on service delivery and use, and challenges and solutions to implementation. The authors conducted qualitative analysis of interviews with program staff, discussions from regular team meetings, and a document review, along with quantitative analysis of health plan claims and service use data from the AB Plus management information system. Overall, the study found that almost all program group members used the AB health plan. Most members of the AB Plus group, which had access to additional programming, completed intake and a substantial proportion used services. Under the AB Plus plan, the behavioral motivational coaching and employment and benefits counseling were largely implemented as designed, but the intake process and medical case management were refined over time. Because of limitations in the study’s discussion of its research methods, it is unclear whether findings are potentially applicable to other projects that provide employment-related services to people with disabilities.","Accelerated Benefits Demonstration","Disability insurance Health insurance",Disability,,"United States",2011, "Do female and male role models who embody STEM stereotypes hinder women’s anticipated success in STEM?","Cheryan, S., Siy, J., Vichayapai, M., Drury, B. & Kim, S. (2011). Do female and male role models who embody STEM stereotypes hinder women’s anticipated success in STEM? Social Psychological and Personality Science, 2(6), 656-664.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Attitudes-Low-Favorable impacts Attitudes","Summary: The study’s objective was to examine the impact of interacting with an upper-level college role model on female students’ beliefs that they could succeed as a computer science major. The study used a randomized controlled trial to assign female students majoring in a discipline other than computer science to meet with one of four different types of upper-level students who varied by gender and whether they embodied perceived stereotypes of computer science majors. The authors administered a questionnaire to estimate impacts of the different intervention conditions. The study found that women who interacted with a stereotypical computer science role model believed they would be less successful as a computer science major compared with women who interacted with a nonstereotypical computer science role model and with women who did not interact with a role model. The quality of causal evidence provided in this study is low because the study had high attrition and the authors did not demonstrate baseline equivalence between the samples or include adequate controls to ensure the resulting groups were similar on all relevant characteristics. This means we are not confident that the effects estimated in this study are attributable to role model interaction; other factors are likely to have contributed.",,"Mentoring Science, Technology, Engineering, and Math (STEM) programs Youth programs","Youth, Female",,"United States",2011, "Programs for undergraduate women in science and engineering: Issues, problems, and solutions","Fox, M., Sonnert, G., & Nikiforova, I. (2011). Programs for undergraduate women in science and engineering: Issues, problems, and solutions. Gender & Society, 25(5), 589-615.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The authors summarized the goals, concerns, and activities of undergraduate programs for women in science and engineering. They focused on whether the programs considered individual-level concerns, such as self-esteem and academic ability, or structural barriers, such as faculty, campus, and administrative attitudes toward women, as the primary obstacles facing women in these fields. In 2002, the authors surveyed the directors of undergraduate programs for women in science and engineering, obtaining 38 responses out of 48 programs nationwide. They analyzed the survey responses by translating rating scales into mean scores and comparing those means using paired sample t-tests. The study found that directors of undergraduate programs for women in science and engineering generally conceived of the central problem facing their students as structural rather than individual. The activities these programs provided, however, focused predominantly on shoring up individual skills and self-confidence—for instance through social gatherings and links to support services—rather than addressing the structural issues they viewed as paramount.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Female",,"United States",2011, "Professional role confidence and gendered persistence in engineering","Cech, E., Rubineau, B., Silbey, S., & Seron, C. (2011). Professional role confidence and gendered persistence in engineering. American Sociological Review, 76(5), 641-666.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study examined the actual and intended persistence in the engineering field of 288 students entering engineering programs in 2003 at the Massachusetts Institute of Technology, the University of Massachusetts at Amherst, the Franklin W. Olin College of Engineering, and Smith College. The authors estimated regression models using data from a longitudinal survey conducted online, which followed the same students from freshman to senior year, to analyze factors significantly associated with (1) the students’ intentions to stay in the engineering field in five years and (2) the students’ actual persistence in the field over the course of the survey period. The study found that male students were more likely to stay in their engineering major over the course of the study, as well as to stay in the engineering field at higher rates than the female students. However, the study found no significant association between plans for a family and women leaving the engineering major. Likewise, the study did not find a significant association between self-assessment of math skills and persistence in the engineering field for women. The authors generated a measure of professional role confidence, which included both an assessment of one’s own expertise and skills needed for engineering jobs and a self-assessment of how well the engineering field fits the individual’s career plans. The study found that the professional role confidence measure was significantly associated with persistence in the engineering field. The professional role confidence measure varied significantly by gender, however, with men having higher confidence measures; the authors suggested that professional role confidence might help explain the differing persistence levels between men and women in engineering.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs",Youth,,"United States",2011, "What predicts middle school girls’ interest in computing?","Denner, J. (2011). What predicts middle school girls’ interest in computing? International Journal of Gender, Science and Technology, 3(1), 54-69.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: This paper analyzed white and Latina middle school girls’ interest in and knowledge of careers in computer science following their participation in a voluntary after-school and summer school program in central California. The author administered a survey to 140 program participants and conducted stepwise multiple regressions to identify factors that significantly affected the girls’ interest in computing classes and careers. The author also ran secondary analyses to address possible indirect or mediating influences on the girls’ interest in computing classes and careers. The study found that three factors significantly predicted girls’ interest in computing classes and careers: (1) a youth’s level of technological curiosity, (2) perceived support from school peers and teachers to pursue computing classes and degrees, and (3) feelings that computers were relevant to her life. The study also found that although perceived parental support and gender stereotypes did not directly predict the girls’ interest in computing classes and careers, these factors did indirectly predict girls’ interest in computing.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Female, White, Hispanic of any race",,"United States",2011, "Statistics anxiety and science attitudes: Age, gender, and ethnicity factors","Bui, N.H., & Alfaro, M.A. (2011). Statistics anxiety and science attitudes: Age, gender, and ethnicity factors. College Student Journal, 45(3), 573-585.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study examined relationships between statistics anxiety and attitudes about science in an introductory psychology statistics course in a small private Western university. Authors administered a demographic questionnaire (10 items), the Statistics Anxiety Rating Scale (STARS; 51 items), and the Test of Science-Related Attitudes measure (TOSRA; 70 items). They also ran t-tests and analyses of variance to assess differences across gender or ethnic groups and used Pearson’s correlation to examine relationships between statistics anxiety scales and science attitudes. The study found that younger students (ages 18 to 24 versus those 25 and older) had more negative attitudes about the social implications and enjoyment of science; there were no differences across gender or ethnic groups in the STARS or TOSRA measures. Six of seven scales of the TOSRA were negatively correlated with at least one STARS scale, suggesting that more positive science attitudes are associated with lower statistics anxiety.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs",Youth,,"United States",2011, "Understanding the factors affecting degree completion of doctoral women in the science and engineering fields","Ampaw, F., & Jaeger, A. (2011). Understanding the factors affecting degree completion of doctoral women in the science and engineering fields. New Directions for Institutional Research, 152, 59-73.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: This study aimed to determine if student characteristics; financial aid receipt; and labor market conditions (such as unemployment, weekly wages, and professors’ salary) predicted doctoral degree completion in science, engineering, or math differently for men and women. Following students enrolled in a doctoral program at an academic institution in the southeastern United States, the study used data from the institution in which study participants were enrolled, Bureau of Labor Statistics data on unemployment and weekly earnings, and expected earnings information from the National Faculty Salary Survey by Discipline and Rank in Four Year Colleges and Universities. Nonlinear regression models were used to estimate the effects on doctoral degree completion. The study found that 9 percent more males than females in the study completed their doctoral degree, although women tended to be younger at the start of their degree. International students, but not minority students overall, were more likely to complete their degree than white domestic students. Regarding financial aid, students who held research assistantships were 67 percent more likely to finish their degree than students without an assistantship, but males were much more likely to acquire an assistantship than females. Regarding labor market conditions, students were more likely to complete a degree in fields with high unemployment and higher expected earnings.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs Preventing discrimination","Youth, Female, Male",,"United States",2011, "Arguing separate but equal: A study of argumentation in public single-sex science classes in the United States","Glasser, H. (2011). Arguing separate but equal: A study of argumentation in public single-sex science classes in the United States. International Journal of Gender, Science and Technology, 3(1), 70-92.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: In a study performed at a public coeducational middle school during the 2007–2008 school year, the author sought to determine whether students in single-sex science classes learned “the same science” by experiencing the same instructional approaches and earning the same grades as those in mixed-gender classes. The author attended both the boys’ and girls’ science classes, and collected data from audio and video recordings, reviews of students’ work, and interviews with students and teachers. He analyzed these data using a variety of coding schemes, with particular emphasis on argumentation, defined for the purpose of the study as a whole-class scientific discussion involving the teacher that contained both a challenge and a defense. He also examined more than seven hours of video recordings from each class section and counted the instances of argumentation occurring in each class. Finally, the author reviewed students’ grades in the course. Although argumentation was not a primary feature of either boys’ or girls’ science classes, with no more than five instances of argumentation per hour of instruction in either case, the author found that boys’ science classes contained more than three times as many instances of argumentation than did girls’ classes. Over the sample lessons considered in this study, the boys produced 22 instances of argumentation, compared with only 7 in the girls’ class. There were no differences in students’ grades by gender.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Female, Male",,"United States",2011, "Evolution of a faculty mentoring program for STEM women","Nemiro, J., Hacker, B., Tucker, S., Ferrel, M., Prall, D., & Dejonghe, E. (2011). Evolution of a faculty mentoring program for STEM women. International Journal of Gender, Science and Technology, 3(3), 644-658.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: This case study described implementation of a STEM mentoring program for female faculty at a polytechnic institution, including sucesses, challenges, and lessons learned. After each of three phases of program implementation, study authors administered participant surveys to capture satisfaction and usefulness of the program. They also accessed administrative data on current employment status of female STEM faculty at the institution. The surveys reflected that 80 percent of participants were satisfied with the program, finding it valuable for networking with colleagues, accessing department or college resources, and gaining advice on teaching strategies and achieving a work/life balance. A preliminary look at teacher retention showed program participants staying at the college at a higher rate than female STEM faculty who did not participate in the mentoring program.",,"Mentoring Science, Technology, Engineering, and Math (STEM) programs","Female, STEM professional",,"United States",2011, "WomenLEAD: Leadership development for female faculty in business and engineering","Hodges, J., Pearson, A., & Reese, D. (2011). WomenLEAD: Leadership development for female faculty in business and engineering. International Journal of Gender, Science and Technology, 3(2), 331-337.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study’s main objective was to describe and promote the implementation of WomenLEAD, a program offered at a business and engineering college to foster leadership development in female faculty by providing advice and support. WomenLEAD consisted of eight sessions focused on challenges faced by female faculty for advancement, such as work-life balance, gender biases, and communication differences. At the end of the program, the authors, who created and implemented the WomenLEAD program, administered a participant survey to elicit participants’ feedback on the degree to which each of the sessions influenced participants’ awareness and understanding of issues relevant to their leadership development. The participants’ survey suggested that WomenLEAD increased women’s awareness and understanding of issues covered in each session, such as communicating with power, career challenges, and leadership qualities. Comments on the survey indicated appreciation for the support network of women the program created. The program intends to continue this networking through continued formal and informal gatherings and to expand it to female faculty at other colleges.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Female",,"United States",2011, "Underneath it all: Gender role identification and women chemists’ career choices","Grunert, M., & Bodner, G. (2011). Underneath it all: Gender role identification and women chemists’ career choices. Science Education International, 22(4), 292-301.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: This study examined the career perspectives and decisions of women earning doctorates in chemistry in the United States. Specifically, the study looked at the factors women considered when making career decisions, their perceptions of different careers, and the factors that motivated their career choices. The researchers conducted three interviews with each of 10 participants at two large research universities in the Midwest. All participants were one or two years away from completing their doctorate in chemistry. The study analyzed the data collected to develop a career decision-making model for women in chemistry doctorate programs. The study found that most participants made career decisions based on their perceptions of the lifestyle required to be successful. Most participants believed that a tenure-track position in a chemistry department was at odds with the traditional female role of primary caretaker in the home. Both single and married women believed that pursuing a research-intensive career would require sacrificing time with family and delaying having children, whereas the sole lesbian participant stated that she did not feel confined to a traditional female family role and was not opposed to the heavy work requirement of a tenure-track university position. The study also found that women perceived female faculty in their departments to exhibit masculine traits, and believed that it would be necessary to adopt a more masculine personality to be respected and successful in a chemistry department.",,"Science, Technology, Engineering, and Math (STEM) programs","Female, STEM professional",,"United States",2011, "Inquiry-based science and technology enrichment program: Green earth enhanced with inquiry and technology","Kim, H. (2011). Inquiry-based science and technology enrichment program: Green earth enhanced with inquiry and technology. Journal of Science Education & Technology, 20(6), 803-814.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Attitudes-Low-Favorable impacts Attitudes","Summary: The study’s objective was to examine the impact of the Inquiry-based Science and Technology Enrichment Program (InSTEP)—a week-long, half-day summer science curriculum for female 8th-grade students—on participants’ interest and confidence in studying science. The author used a survey to compare students’ attitudes about science before and after participating in InSTEP. The author found that among the female 8th-grade students who chose to enroll in InSTEP, interest in science increased, gender stereotypes about science and scientists were undermined, and overall attitudes toward science improved by the end of the program. There were no significant differences in students’ anxiety about taking science courses. The quality of causal evidence presented in this report is low. This means we are not confident that the estimated effects are attributable to InSTEP; other factors are likely to have contributed.","Inquiry-based Science and Technology Enrichment Program (InSTEP)","Science, Technology, Engineering, and Math (STEM) programs Youth programs","Youth, Female",,"United States",2011, "Stemming inequality? Employment and pay of female and minority scientists and engineers in the federal and private sectors","Oh, S., & Lewis, G. (2011). Stemming inequality? Employment and pay of female and minority scientists and engineers in the federal and private sectors. Social Science Journal, 48(2), 397-403.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study investigated the relationships among sector (federal or private); science, technology, engineering, and mathematics (STEM) occupation; gender or racial minority status; and earnings to determine whether federal- or private-sector STEM positions offer the greatest financial opportunities for female and racial minority STEM professionals. The authors compared the earnings of male and female STEM and non-STEM public sector employees in 1983 and 2003 using a 1 percent sample of the Office of Personnel Management’s Central Personnel Data File. To compare public- and private-sector outcomes, the authors also analyzed a 5 percent sample of the 2000 U.S. Census, examining differences in STEM and non-STEM public and private employees’ salaries by gender and race. The study found that women in public sector STEM positions earned 7.2 percent less than men in comparable public sector positions in 1983 even after controlling for education, STEM field, tenure, age, and race. This gender pay gap disappeared in the 2003 sample. Race and gender pay disparities, measured as the average difference in pay between racial minorities or women and white men, are smaller in the federal than the private sector and for STEM relative to non-STEM occupations. For example, in 1999, black male federal STEM employees earned 8.3 percent less than white men, compared to a pay gap of 10.9 percent for black male private sector STEM employees. For black men in non-STEM occupations, the pay gap relative to white men was 11.1 percent in the public sector and 20.6 percent in the private sector.",,"Science, Technology, Engineering, and Math (STEM) programs Other disparities or discrimination in employment and earnings","Other barriers, Female, STEM professional","Professional, scientific, and technical services","United States",2011, "Who wants to have a career in science or math? Exploring adolescents’ future aspirations by gender and race/ethnicity","Riegle-Crumb, C., Moore, C., & Ramos-Wada, A. (2011). Who wants to have a career in science or math? Exploring adolescents’ future aspirations by gender and race/ethnicity. Science Education, 95(3), 458-476.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study's objective was to examine whether different gender and racial/ethnic subgroups of 8th-grade students in the United States varied in their aspirations of pursuing a career in science or math. The study further sought to observe how students’ attitudes toward and achievement in science and math helped explain any disparities in career aspirations by gender and race/ethnicity. The authors conducted a regression analysis that estimated the likelihood of different gender and race/ethnicity subgroups stating that they “would like a job that involves using science/math,” controlling for their attitudes toward and achievement in science/math. Career aspirations for groups traditionally underrepresented in science, technology, engineering, and mathematics—including white, black, and Hispanic girls and black and Hispanic boys—were compared to those of white boys. The study used data from the 2003 Trends in International Mathematics and Science Study, specifically looking at a nationally representative sample of 8th-grade students in the United States. In the primary analysis of science aspirations, no female and/or racial minorities had a statistically different likelihood of aspiring to a career in science than white boys. Black boys had comparable career aspirations to white boys even before controlling for any other factors, and Hispanic and white boys were similar after controlling for socioeconomic factors. Both white and Hispanic girls had similar career aspirations to white boys after controlling for enjoyment of science. In the primary analysis of math aspirations, all female subgroups were significantly less likely to aspire to a math career than white boys, even after controlling for general school attitudes, test scores, enjoyment in the subject, and belief in their own math ability. Black and Hispanic boys were as likely as white boys to be interested in pursuing a career in math before controlling for any of those factors.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs Other disparities or discrimination in employment and earnings","Youth, Other barriers, Female, Male",,"United States",2011, "STEM learning in afterschool: An analysis of impact and outcomes","Afterschool Alliance. (2011). STEM learning in afterschool: An analysis of impact and outcomes. Washington, DC.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study presented findings from a review of after-school programs in the United States focused on improving science, technology, engineering, and mathematics (STEM) skills and increasing access to STEM careers for youth in grades K–12. The study’s objective was to identify common strategies that STEM-focused after-school programs used and summarize the programs’ results. The authors collected evaluation reports of STEM-focused after-school programs through evaluation database searches and direct requests to the programs. The programs reviewed served K–12 students and implemented a wide range of programming, including robotics competitions, mentoring, internships, science experiments, and design projects. The evaluations of these programs used a variety of analytic methods, including comparison of pre- and post-program surveys, focus groups discussions, and tests; tracking of program alumni; and surveys of parents and program staff. The study found that all STEM after-school programs studied reportedly had some benefit for program participants. The authors classified the observed benefits into three categories: improved attitudes toward STEM fields and careers, increased STEM knowledge and skills, and higher likelihood of graduation and pursuing a STEM career. The authors described the programs that had a positive outcome in each of those categories along with the specific results described in the program’s evaluation report.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs",Youth,,"United States",2011,http://www.afterschoolalliance.org/STEM-Afterschool-Outcomes.pdf "Inside the double bind: A synthesis of empirical research on undergraduate and graduate women of color in science, technology, engineering, and mathematics","Ong, M., Wright, C., Espinosa, L., & Orfield, G. (2011). Inside the double bind: A synthesis of empirical research on undergraduate and graduate women of color in science, technology, engineering, and mathematics. Harvard Educational Review, 81(2), 172-208.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study examined existing empirical research on the challenges that minority women have faced in science, technology, engineering, and mathematics (STEM) disciplines at the undergraduate and graduate levels, emphasizing factors that promote or discourage retention and transition to employment or further study. The authors analyzed 116 empirical studies conducted from 1970 to 2008 that examine aspects of the academic and career experiences of minority women in STEM disciplines, identifying the findings of each study and synthesizing these features to pinpoint trends and opportunities for further investigation. The authors summarized the studies’ conclusions regarding the effects of academic climate, enrichment programs, self-confidence, and relationships with faculty, peers, and family on minority women’s persistence in undergraduate STEM majors, highlighting lack of recognition from peers and faculty members and complex family expectations and dynamics as factors that hinder them from completing STEM degrees. At the graduate level, many of the same influences, particularly family expectations and fraught relationships with peers and professors, present challenges for minority women in STEM disciplines. Academic and social transitions from minority-serving institutions to predominantly white institutions and the financial demands of graduate study also represent cross-cutting obstacles.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Other barriers, Female",,"United States",2011, "Sex differences in application, success, and funding rates for NIH extramural programs","Pohlhaus, J.R., Jiang, H., Wagner, R.M., Schaffer, W.T., & Pinn, V.W. (2011). Sex differences in application, success, and funding rates for NIH extramural programs. Academic Medicine, 86(6), 759-767.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study's objective was to analyze gender differences in the award of National Institutes of Health (NIH) extramural grants in the 2008 fiscal year. This research was intended to inform efforts to improve diversity in award funding. Using data from the NIH Information for Management, Planning, Analysis, and Coordination electronic Research Administration database, the authors conducted cross-sectional analyses of funding rates (the percentage of applicants who received funding) and success rates (the percentage of reviewed grant applications that received funding), by career stage (early, mid, and senior) and by gender. The authors also conducted analyses specific to the prestigious R01 award—the only award not intended for a specific career stage—including a longitudinal analysis of researchers transitioning to R01 awards or applying for renewal of R01 awards. Overall, women tended to be as likely as men to receive NIH research and training awards in 2008, and applied for and received similar award amounts. In the R01 program, women had a similar success rate as men but a lower funding rate, which seemed to be caused by a lower rate of award among experienced applicants submitting proposals for award renewal. The longitudinal analysis confirmed that women were less likely than men to apply and receive funding for new or renewal R01 awards. Finally, fewer older women applied for and received funding, and recipients of multiple awards were more likely to be men. The authors suggest that these findings are consistent with national data showing fewer older women work in the field and are employed in senior positions.",,"Science, Technology, Engineering, and Math (STEM) programs Other disparities or discrimination in employment and earnings","STEM professional",,"United States",2011, "Learning communities for students in developmental math: Impact studies at Queensborough and Houston Community Colleges","Weissman, E., Butcher, K. Schneider, E., Teres, J., Collado, H., Greenberg, D., & Welbeck, R. (2011). Learning communities for students in developmental math: Impact studies at Queensborough and Houston Community Colleges. New York: National Center for Postsecondary Research.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of learning communities on academic progression, persistence, and credit accumulation among students in need of developmental math courses at Queensborough and Houston Community Colleges. This study was a randomized controlled trial that compared the course passage rates, registration rates, and number of credits earned for the treatment and control groups during the program semester and one (Houston) or two (Queensborough) post-program semesters. The primary data source was transcript data from the colleges. The study found that at Queensborough, learning community students were significantly more likely than control group students to pass developmental math in the program semester and the second math class in their sequence during the next semester. At Houston, students in the treatment group were significantly more likely than control group students to pass any developmental math course in the program or first post-program semester.  The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Learning Communities Demonstration at Queensborough Community College and at Houston Community College, and not to other factors.","the Learning Communities Demonstration","Basic skills Community college education and other classroom training","Adult, Other barriers",,"United States",2011,http://files.eric.ed.gov/fulltext/ED516646.pdf "Recruitment strategies for gender equity: Lessons from cohort 1 and cohort 2 advance institutions","Zajicek, A., Morimoto, S., Terdalkar, A., Hunt, V., Rencis, J., & Lisnic, R. (2011). Recruitment strategies for gender equity: Lessons from cohort 1 and cohort 2 advance institutions. Washington, DC: American Society for Engineering Education.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-No impacts Employment","Summary: The study’s objective was to evaluate the effectiveness of the ADVANCE institutional transformation program (ADVANCE-IT), sponsored by the National Science Foundation (NSF), on the recruitment of female engineering faculty at participating U.S. colleges and universities. The authors used program implementation and outcome data obtained from seven participating colleges and universities to compare the number of female engineering faculty before and after institutions participated in the intervention. The study found no statistically significant relationships between participation in the ADVANCE-IT program and the number of female assistant professors at those institutions. The quality of causal evidence presented in this study is low because the authors conducted no tests of statistical significance and did not observe outcomes for multiple periods before the intervention. This means we are not confident that the estimated effects would have been attributable to the ADVANCE-IT program; other factors are likely to have contributed.","NSF’s ADVANCE-IT Program","Science, Technology, Engineering, and Math (STEM) programs Other disparities or discrimination in employment and earnings","Female, STEM professional",,"United States",2011,http://www.asee.org/file_server/papers/attachment/file/0001/1532/Recruitment_St… "Are the predictors of women’s persistence in STEM painting the full picture? A series of comparative case studies","Hughes, R. (2011). Are the predictors of women’s persistence in STEM painting the full picture? A series of comparative case studies. International Journal of Gender, Science and Technology, 3(3), 548-570.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study's objective was to examine the experiences of several female science and engineering majors within the literature context on predictive factors of persistence in STEM majors and careers. The study focused on the roles of parental support and education level, academic preparation, and perceptions of the STEM culture in influencing the career trajectories of female undergraduates at a United States university in 2009–2010. The author conducted two interviews each with five women in their fourth year of college who had chosen to major in a STEM field. The first interview collected the participant’s life history, with a focus on factors and moments leading to the decision to pursue a STEM major. The second interview, conducted several months later, recorded whether the participant’s career plans had changed. The study found that the participants’ experiences did not always align with what the literature predicted, and that complex factors contributed to a woman’s decision to stay in or leave a STEM major. Although all the women who stayed in a STEM field described the use of coping strategies for persisting in a male-dominated field, these strategies differed among participants. Those who chose to leave their STEM major did not necessarily do so because of a lack of academic preparation, parental support, or competence, but rather seemed to share a feeling that they did not identify with the peers in their STEM field, who they described as “uptight,” “nerdy,” and lacking a life outside of the classroom.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Female",,"United States",2011, "Questioning a white male advantage in STEM: Examining disparities in college major by gender and race/ethnicity","Riegle-Crumb, C., & King, B. (2011). Questioning a white male advantage in STEM: Examining disparities in college major by gender and race/ethnicity. Educational Researcher, 39(9), 656-664.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study's objective was to examine differences in students’ likelihood of majoring in a science, technology, engineering, and mathematics (STEM) field, based on gender and ethnicity. The study used statistical methods to estimate the likelihood of majoring in the physical sciences or engineering, or in the biological sciences, versus non-STEM fields. The authors also examined this likelihood for traditionally underrepresented groups (white, black, and Hispanic women and black and Hispanic men) compared to white men. The analyses controlled for student socioeconomic factors, delayed college entry, academic preparation, and attitudes toward math. Data sources included students’ high school transcripts and surveys conducted through the Educational Longitudinal Study of 2002. The study found that white and Hispanic women were less likely to major in the physical sciences or engineering, versus a non-STEM major, than white men. Black women were also less likely to major in a physical science or engineering field than white men, but the gap was slightly smaller. In contrast to the large gender gaps evident in the choice of physical science and engineering majors, there were no differences between the gender/ethnicity groups in the likelihood of majoring in a biological sciences field compared to a non-STEM field. The study found that academic preparation and attitudes toward math rarely explained why men were more likely to choose a STEM major than women.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Female, Male, White, Black or African American, Hispanic of any race",,"United States",2011, "Mothers of invention: Gender, motherhood, and new dimensions of productivity in the science profession","Whittington, K. (2011). Mothers of invention: Gender, motherhood, and new dimensions of productivity in the science profession. Work and Occupations, 38(3), 417-456.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study's objective was to determine whether women, specifically mothers, in STEM academic or industry jobs were less likely to participate in the patenting process than fathers and childless men in the same field. In addition, the study sought to examine whether previous experience with patenting reduced gender or motherhood inequalities in patenting participation. The study analyzed survey data from the April 1995 and April 2001 waves of the Survey of Doctorate Recipients, a longitudinal study of research doctorates conducted by the National Science Foundation. The author restricted the sample to scientists in four-year colleges and in business or industry who worked in computer and mathematical sciences, life sciences, physical sciences, and engineering; were active in applied and basic research, development, or design; and worked full time. Respondents were asked if they had been named as an inventor on a U.S. patent application in the past five or six years. The author estimated logistic regression models to determine whether females, and specifically mothers, were less likely to have received a patent in the past five or six years. The author also conducted additional analyses to determine if previous experience with patenting affected patenting participation. The study found that in academia, among those surveyed at both rounds, mothers were no less likely to patent than males, including fathers, or childless females after controlling for prior patenting experience. In industry, among those surveyed in both rounds, married, childless women were less likely to patent than childless women, even after controlling for prior patenting experience. The authors estimated numerous other models that found mixed effects of gender, marital status, and parenthood on the likelihood of scientists participating in patenting activities.",,"Science, Technology, Engineering, and Math (STEM) programs Other disparities or discrimination in employment and earnings","Female, STEM professional, Parent",,"United States",2011, "Establishing the foundation for future organizational reform and transformation at a large private university to expand the representation of women faculty","Bailey, M., Marchetti, C., DeBartolo, E., Mozrall, J., Williams, G., Baum, S., & LaLonde, S. (2011). Establishing the foundation for future organizational reform and transformation at a large private university to expand the representation of women faculty. Proceedings of the 2011 American Society for Engineering Education Annual Conference & Exposition, Washington, DC.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: This paper described the ADVANCE IT-Catalyst study that examined the barriers facing female STEM faculty members at six Rochester Institute of Technology (RIT) colleges, compared with men at RIT and women at similar universities. The research examined faculty rank, tenure, career track, leadership opportunities, and salary, and aimed to inform RIT’s efforts to recruit, retain, and advance female STEM faculty. The authors used institutional records from 2004 to 2010 to measure trends in recruitment, retention, advancement, and compensation, by faculty gender. A career-life survey administered to gather information on STEM faculty’s teaching and research experiences, including career satisfaction and work-life balance, complemented the institutional data. The authors tested for statistically significant differences in responses between men and women. Finally, the study benchmarked university policies and survey results against policies and survey results at other similar universities. In terms of retention, the study found that female faculty hired from 2002 to 2009 were twice as likely to have left RIT by 2010 than male faculty and, overall, the institution had a significantly lower percentage of female science and engineering tenured and tenure-track faculty in 2010 than the national average. In terms of leadership advancement and salary, the percentage of STEM leadership positions held by women in 2010 was proportional to the percentage of STEM faculty who were women. The study found that salary adjustments made by the university during the study period reduced the salary gap for female assistant and associate professors, but actually increased the gap for full professors. In the survey, women reported having to exert more effort and make more personal sacrifices to advance their careers than men, though most women felt that the tenure process was fair. Finally, the benchmarking study of policies and benefits found that RIT lagged behind other universities in terms of tenure clock extension, mentoring, and maternity leave.",,"Science, Technology, Engineering, and Math (STEM) programs Other disparities or discrimination in employment and earnings","Female, STEM professional",,"United States",2011,http://www.asee.org/public/conferences/1/papers/2271/download "Removing the barriers to full professor: A mentoring program for associate professors","Buch, K., Huet, Y., Rorrer, A., & Roberson, L. (2011). Removing the barriers to full professor: A mentoring program for associate professors. Change: The Magazine of Higher Learning, 43(6), 38-45.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The objective of the study was to develop and assess a program to facilitate associate professors’ promotion to full professor, paying particular attention to female associate professors in STEM disciplines. The authors initiated the study in 2008 with a comprehensive needs assessment of University of North Carolina-Charlotte associate professors’ attitudes toward and perceptions of the promotion process. Based on the responses, they developed a series of peer and vertical mentoring programs, including a program focused on female associate professors in STEM disciplines. Two years after launching the needs assessment, the authors administered a follow-up survey to gauge the program’s progress. The initial needs assessment found substantial gender differences in associate professors’ perceptions of the promotion process. Women were significantly more likely than men to believe that departmental standards for promotion were unclear, that their department chair did not provide career support or guidance, and that factors such as race and gender would influence the promotion process. Responses to the follow-up survey marked a significant increase in the proportion of associate professors reporting having a mentor and lessening of gender disparities regarding perceptions of the promotion process. Those who indicated that they had a mentor were significantly more likely than those who did not to perceive incentives for promotion and to believe that promotion criteria were clear.",,"Mentoring Science, Technology, Engineering, and Math (STEM) programs Other disparities or discrimination in employment and earnings","Female, STEM professional",,"United States",2011, "Pipelines and pathways: Women of color in undergraduate STEM majors and the college experiences that contribute to persistence","Espinosa, L. (2011). Pipelines and pathways: Women of color in undergraduate STEM majors and the college experiences that contribute to persistence. Harvard Educational Review, 81(2), 209-240.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study's objective was to examine how undergraduate women of color’s precollege characteristics and college experiences and the characteristics of their undergraduate institutions affected their persistence in STEM majors throughout college compared with white women. The author used data from the Higher Education Research Institute Cooperative Institutional Research Program at the University of California, Los Angeles, to model whether college experiences mediated some of the effect of precollege characteristics and institutional settings on persistence in STEM majors, as hypothesized. Survey data were collected when students entered college in 2004 and again in the spring of 2008, during students’ fourth year of college. The study included a sample of 1,250 women of color and 891 white women at four-year colleges and universities across the United States who were first-time, full-time students. Results were estimated separately for women of color and white women. The study found that both white women and women of color persisted in STEM at a rate of 57 percent from the time they stated an intent to major in STEM at college entrance to the spring semester of their fourth year, and that high school grade point average was a significant predictor of persistence for both groups. As hypothesized, college experiences had a significant effect on the persistence of women of color in STEM: those who found satisfaction with their curriculum, engaged in peer discussion on course content outside the classroom, joined a major-related club, tutored another student, participated in research programs, and intended to major in engineering were more likely to persist in a STEM major; the same factors were significant for white women, with the exception of joining a major-related club. In addition, women of color who attended a private college and an institution with a higher percentage of students majoring in STEM were more likely to stay in a STEM major; the opposite was true for women of color who attended a highly selective institution. For white women, these institutional factors were not significant predictors of persistence in STEM.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Other barriers, Female",,"United States",2011, "Surprising possibilities imagined and realized through information technology: Encouraging high school girls’ interests in information technology","Forssen, A., Lauriski-Karriker, T., Harriger, A., & Moskal, B. (2011). Surprising possibilities imagined and realized through information technology: Encouraging high school girls’ interests in information technology. Journal of STEM Education: Innovations and Research, 12(5-6), 46-57.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study examined the overall and gender-specific impact of the Surprising Possibilities Imagined and Realized through Information Technology (SPIRIT) program on high school students’ attitudes toward information technology (IT), with special focus on increasing female students’ confidence and abilities in using technology. The SPIRIT program, which took place during two weeks in summer 2009 at a large Midwestern university, had female and male students use a three-dimensional programming environment called Alice to create animations for storytelling. Participants also completed other hands-on activities and heard presentations from professionals on the use of IT in their jobs. The authors administered 20-item baseline and follow-up surveys to students on general attitudes toward and gender stereotypes in IT and compared responses before and after the SPIRIT program. Of the76 students who attended the program, 74 participated in the study. Because the program aimed to increase girls’ interests in IT, the study sample was 70 percent female. The study found that, after attending the SPIRIT program, female students demonstrated no change in general attitudes toward IT, but showed a significant reduction in believing the gender stereotype that women do not perform as well as men in IT. In looking at emergent themes of open-ended survey responses, the authors found that women’s attitudes toward the characteristics of a person with a career in IT changed from a focus on the person’s skills or intelligence before participation in SPIRIT to a more diverse description of characteristics after participation in the program. Similarly, female students provided a more expansive set of example IT careers after participation in SPIRIT. The authors did not conduct statistical tests on these differences.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Female",,"United States",2011, "STEM development: A study of 6th-12th grade girls’ interest and confidence in mathematics and science (Doctoral dissertation, Iowa State University)","Heaverlo, C. (2011). STEM development: A study of 6th-12th grade girls’ interest and confidence in mathematics and science (Doctoral dissertation, Iowa State University). Retrieved from http://lib.dr.iastate.edu/cgi/viewcontent.cgi?article=1035&context=etd","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study’s objective was to determine whether middle and high school girls’ levels of interest and confidence in science and mathematics differed and to identify factors that promote their interest and confidence in these subjects. The author administered a survey to the 6th–12th grade attendees of the three April 2009 sessions of Iowa State University’s Taking the Road Less Traveled Career Conference. The author performed descriptive statistical analyses. The study found that middle and high school girls’ interest and confidence in science and mathematics did not differ. Teacher influence was a statistically significant predictor of all four outcomes examined—math interest, science interest, math confidence, and science confidence. In particular, math teacher influence predicted math interest and confidence, and science teacher influence predicted science interest and confidence. The availability of extracurricular science, technology, engineering, and mathematics activities also predicted math interest and confidence.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Female",,"United States",2011,http://lib.dr.iastate.edu/cgi/viewcontent.cgi?article=1035&context=etd "Middle school girls’ perceptions of engineers before and after a female only summer enrichment program","Hirsch, L., Berliner-Heyman, S., Cano, R., Kimmel, H., & Carpinelli, J. (2011). Middle school girls’ perceptions of engineers before and after a female only summer enrichment program. Paper presented at the 2011 IEEE Frontiers in Education Conference.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: In a study performed over the course of a summer engineering program for 4th- through 8th-grade girls, the authors sought to determine whether participants’ attitudes toward engineering changed from the beginning to end of the program and whether traditional surveys fully captured participants’ growth over the course of such an experience. The authors administered two tests, the Middle School Attitude to Mathematics, Science and Engineering Survey (MATE) and the Draw an Engineer Test (DAET), to about 100 participants in a summer 2009 New Jersey Institute of Technology engineering program for 4th- to 8th-grade girls. The MATE comprises seven psychological subscales focused on students’ interest in various aspects of engineering, attitudes toward mathematics and science, problem-solving, knowledge of engineering, and perceptions of males’ and females’ relative competence in mathematics and science; the DAET prompts respondents to draw an engineer at work and summarize their drawing in a sentence. Participants took both tests before beginning and after completing the program. The study found that girls’ knowledge of engineering increased significantly; at the beginning of the study, fewer than half of the participants could name one or more kinds of engineers, but by the end of the program more than 85 percent of participants correctly identified at least one kind of engineer. Differences in pre- and post-program engineer drawings and descriptions suggested more nuanced changes in girls’ understanding of engineering. For example, the proportion of responses depicting engineers communicating with others more than doubled, from only 12 percent before the program to 30 percent afterward. The authors concluded that the DAET complements the MATE and warranted further study as a measure of children’s changing perceptions of science and scientists.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Female",,"United States",2011,http://fie-conference.org/fie2011/papers/1471.pdf "Living-learning programs for women in STEM","Inkelas, K. (2011). Living-learning programs for women in STEM. New Directions for Institutional Research 152, 27-37.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study’s objective was to review the evidence of the effects of living-learning programs (LLPs)—shared residences at postsecondary institutions designed to bridge in- and out-of-class learning and establish tight-knit communities—on academic and other outcomes for women in STEM disciplines. The author reviewed studies that compared the short- and long-term academic outcomes of female STEM majors who participated in LLPs, particularly women-only STEM LLPs, to male and female STEM majors who did not participate in such programs. Many of these studies relied on the 2007 National Study of Living-Learning Programs, which encompassed programs at more than 50 U.S. colleges and universities and represented the responses of 22,519 students; other university-specific studies from Michigan State University, the University of Wisconsin-Madison, and the University of Michigan were included. The study found that participants in a women-only STEM LLPs were more likely to attend graduate school in a STEM field than were female STEM majors who participated in coeducational STEM LLPs, non-STEM LLPs, or no LLP, by 35, 31, and 29 percent, respectively. Participants in a women-only STEM LLP at the University of Michigan were more likely to persist in STEM majors than were male or female nonparticipants with similar academic interests and achievement.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Female",,"United States",2011, "How to recruit women and girls to the science, technology, engineering, and math (STEM) classroom","Milgram, D. (2011). How to recruit women and girls to the science, technology, engineering, and math (STEM) classroom. Technology and Engineering Teacher, 71(3), 4-11.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study's objective was to suggest successful strategies for increasing the number of women and girls in STEM classes. The author used studies of other programs and lessons learned from personal experience to inform a set of suggested strategies for improving the recruitment of women and girls into STEM classes. The author suggested that women and girls benefit from seeing female role models in STEM, receiving positive encouraging messages, and being assured that women in STEM can maintain a work/life balance. The author also described specific strategies that schools and programs should implement to improve recruitment of females, including reaching out to counselors and communicating the program’s emphasis on recruiting females, personally encouraging female students, developing outreach materials that display females and that incorporate the color pink, and taking into account how females’ perceptions of and motivations toward STEM differ from those of males.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Female",,"United States",2011, "Women in STEM: A gender gap to innovation","Beede, D., Julian, T., Langdon, D., McKittrick, G., Khan, B., & Doms, M. (2011). Women in STEM: A gender gap to innovation. Washington, DC: Economics and Statistics Administration, U.S. Department of Commerce.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: This issue brief highlighted the 2009 gender gap in STEM degrees, jobs, and earnings in the United States. The authors used data from the 2009 U.S. Census Bureau’s American Community Survey to examine how educational attainment, wages, and participation in STEM occupations differed by gender. Regression analyses that controlled for factors such as age, educational attainment, and region, were used to compare differences in STEM earnings and wage gaps. The authors found that women continued to be underrepresented in STEM degrees and jobs, but there were reasons to encourage women to pursue STEM: the gap in STEM jobs between women and men decreased as educational attainment increased; there was a 7 percent smaller gender gap in hourly earnings for STEM jobs over non-STEM jobs (14 percent smaller in engineering jobs); women held a disproportionally small number of STEM degrees compared with men; and 14 percent fewer women than men with STEM undergraduate degrees ended up in STEM jobs.",,"Science, Technology, Engineering, and Math (STEM) programs Other disparities or discrimination in employment and earnings","STEM professional",,"United States",2011,http://templatelab.com/women-in-stem-a-gap-to-innovation/ "Evaluation of the Massachusetts Adolescent Outreach Program for Youths in Intensive Foster Care: Final Report","Courtney, M., Zinn, A., Johnson, H., and Malm, K. (2011). Evaluation of the Massachusetts Adolescent Outreach Program for Youths in Intensive Foster Care: Final Report. OPRE Report #2011-14. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Massachusetts Adolescent Outreach Program for Youths in Intensive Foster Care (Outreach) on youths’ education, employment, earnings, and public benefit receipt. Using a randomized controlled trial design, the authors estimated the program’s impact by comparing survey responses and college records for youth randomly selected to receive the Outreach program with those of youth randomly assigned to the control group. The study found that the Outreach program significantly increased college enrollment and persistence. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Massachusetts Adolescent Outreach Program for Youths in Intensive Foster Care, and not to other factors.","the Massachusetts Adolescent Outreach Program for Youths in Intensive Foster Care","Job search assistance and supportive services Other training and education Youth programs Behavioral Interventions","Youth, Disconnected youth",,"United States",2011,http://www.acf.hhs.gov/sites/default/files/opre/eval_mass.pdf "The role of living–learning programs in women’s plans to attend graduate school in STEM fields","Szelényi, K., & Inkelas, K. (2011). The role of living–learning programs in women’s plans to attend graduate school in STEM fields. Research in Higher Education, 52(4), 349-369.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Attitudes-Low-Favorable impacts Attitudes","Summary: The study’s objective was to assess the impact of participating in a female-only STEM living-learning program on undergraduate female STEM majors’ intentions to pursue graduate studies in a STEM field. The authors conducted regression analysis using data from the 2004–2007 National Study of Living Learning Programs (NSLLP) to determine if women who participated in female-only STEM living-learning programs were more likely than women in other living arrangements to express plans to attend graduate school in a STEM field. The study found that the female undergraduate STEM majors living in a female-only STEM living-learning community were more likely to have plans to attend graduate school in a STEM field than female STEM majors living in coeducational STEM living-learning communities, non-STEM living-learning communities, or traditional residence halls. The quality of causal evidence presented in this report is low because the authors’ analysis did not account for important individual characteristics related to the outcome that could differ across groups. This means we are not confident that the estimated effects are attributable to female-only STEM living-learning programs. Other factors are likely to have contributed.","STEM Living-Learning Programs","Science, Technology, Engineering, and Math (STEM) programs Youth programs","Youth, Female",,"United States",2011, "STEMing the tide: Using in-group experts to inoculate women’s self-concept in science, technology, engineering, and mathematics (STEM)","Stout, J., Dasgupta, N., Hunsinger, M., & McManus, M. (2011). STEMing the tide: Using in-group experts to inoculate women’s self-concept in science, technology, engineering, and mathematics (STEM). Journal of Personality and Social Psychology, 100, 255-270. [one of three studies described in a single report]","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Attitudes-Mod/high-Favorable impacts Attitudes","Summary: The study’s objective was to examine the impact of interacting with a male or female upperclass student majoring in math and psychology (hereafter referred to as a male or female peer expert) on female undergraduate STEM majors’ attitudes toward math and performance on a math test. The study used computerized tasks and students’ self-reported attitudes to compare performance in and attitudes toward math of female undergraduate students who interacted with a female peer expert and those who interacted with a male peer expert. The study found that female students who interacted with a male peer expert exhibited negative implicit attitudes toward math compared with English, whereas female students who interacted with a female peer expert had the same attitudes toward math and English. Female students who interacted with a female peer expert attempted more problems on the math test than those who interacted with a male peer expert. The quality of causal evidence presented in this report is high, as it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to interacting with a female peer expert, and not to other factors.",,"Science, Technology, Engineering, and Math (STEM) programs Science, Technology, Engineering, and Math (STEM) programs Youth programs",Youth,,"United States",2011, "STEMing the tide: Using in-group experts to inoculate women’s self-concept in science, technology, engineering, and mathematics (STEM)","Stout, J., Dasgupta, N., Hunsinger, M., & McManus, M. (2011). STEMing the tide: Using in-group experts to inoculate women’s self-concept in science, technology, engineering, and mathematics (STEM). Journal of Personality and Social Psychology, 100, 255-270. [one of three studies described in a single report]","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Attitudes-Low-Favorable impacts Attitudes","Summary: The study’s objective was to examine the impact of having a professor and teaching assistant (TA) of the same gender on introductory calculus students’ attitudes toward math, compared with English. The study used computerized tasks to measure attitudes toward math and collected the expected course grade and actual course performance of female students with a female professor and TA pair (a female teaching pair), compared with those of female students with a male professor and TA pair (a male teaching pair) at both the start and end of the semester. The study found that female students with a female teaching pair identified more with math and expected a higher course grade than those with a male teaching pair. Female students with a male teaching pair had more negative attitudes toward math, compared with English, than female students with a female teaching pair. The quality of causal evidence presented in this report is low because the authors did not demonstrate comparability of treatment and control groups before the intervention. This means we are not confident that the estimated effects are attributable to having a female teaching pair; other factors are likely to have contributed.",,"Science, Technology, Engineering, and Math (STEM) programs Youth programs",Youth,,"United States",2011, "The effects of student coaching in college: An evaluation of a randomized experiment in student mentoring","Bettinger, E., & Baker, R., (2011). The effects of student coaching in college: An evaluation of a randomized experiment in student mentoring. Stanford, CA: Stanford University School of Education.",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-No impacts Education and skills gains","Summary: The study’s objective was to evaluate the impact of InsideTrack student coaching on students’ persistence in college and degree completion. The study was a randomized controlled trial carried out with 17 different student cohorts from eight participating colleges, universities, and technical schools. For this review, CLEAR distinguished between sites with a 50/50 probability of assignment to coaching and sites with other probabilities of assignment. The authors assessed the program’s impact on retention rates using academic records for all students who participated in the study. The study found that on average, both in sites with a 50/50 probability of assignment and all sites combined, students participating in InsideTrack demonstrated increased persistence compared with control group students receiving only the regular suite of career or academic support services. The quality of causal evidence presented in this report for sites with a 50/50 probability of assignment is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects for these sites are attributable to InsideTrack and not to other factors. The quality of causal evidence presented in this report for all sites combined is low because randomization was compromised and the analysis did not include sufficient controls. This means we are not confident that the estimated effects for the full sample are attributable to InsideTrack. Other factors are likely to have contributed.","InsideTrack Student Coaching","Other training and education",Adult,,"United States",2011,https://cepa.stanford.edu/sites/default/files/bettinger_baker_030711.pdf "STEMing the tide: Using in-group experts to inoculate women’s self-concept in science, technology, engineering, and mathematics (STEM)","Stout, J., Dasgupta, N., Hunsinger, M., & McManus, M. (2011). STEMing the tide: Using in-group experts to inoculate women’s self-concept in science, technology, engineering, and mathematics (STEM). Journal of Personality and Social Psychology, 100, 255-270. [one of three studies described in a single report]","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Attitudes-Low-Unfavorable impacts Attitudes","Summary: The study’s objective was to examine the impact of reading a paragraph-long biography of a female engineer on female engineering majors’ implicit and explicit attitudes toward math and English, their self-efficacy in engineering, their identification with the engineers in the assigned text, and their intention to pursue a career in engineering. The study used computerized tasks to measure outcomes for female students who read a paragraph-long biography of a female engineer compared with those of female students who read either (1) biographies of male engineers or (2) a description of engineering innovations with no mention of the engineer’s gender. The study found that attitudes of female students who read the female biography did not favor math over English or vice versa, whereas those who read the male biography or the description of engineering innovations demonstrated negative implicit attitudes toward math and a preference for English over math. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to reading a paragraph-long biography about female engineers, and not to other factors.",,"Science, Technology, Engineering, and Math (STEM) programs Youth programs","Youth, Female",,"United States",2011, "Working toward Wellness: Telephone care management for Medicaid recipients with depression, thirty-six months after random assignment","Kim, S., LeBlanc, A., Morris, P., Simon, G., & Walter, J. (2011). Working toward Wellness: Telephone care management for Medicaid recipients with depression, thirty-six months after random assignment. OPRE report 2011-21. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.  ","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine the impacts of a telephone care management program, Working toward Wellness (WtW), on low-income depressed parents’ employment and earnings. The study used a randomized controlled trial design, assigning eligible parents to either the WtW program or existing services. The authors used data from a 36-month follow-up survey to estimate program impacts, adjusting for sample members’ characteristics before random assignment. The study did not find any statistically significant effects of the WtW program on employment or earnings. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects would be attributable to WtW and not to other factors. However, the study did not find statistically significant effects.","Working toward Wellness (WtW)","Health Behavioral Interventions","Other barriers",,"United States",2011,http://www.acf.hhs.gov/sites/default/files/opre/medicaid_depression.pdf "A two-generational child-focused program enhanced with employment services: Eighteen-month impacts from the Kansas and Missouri sites of the enhanced services for the Hard-to-Employ Demonstration and Evaluation project","Hsueh, J., Jacobs, E., & Farrell, M. (2011). A two-generational child-focused program enhanced with employment services: Eighteen-month impacts from the Kansas and Missouri sites of the enhanced services for the Hard-to-Employ Demonstration and Evaluation project. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Low-No impacts Education and skills gains Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of Enhanced Early Head Start (EHS) participation on employment, earnings, public assistance receipt, and education for low-income families with young children. The study used a randomized controlled trial design, assigning eligible families to either the Enhanced EHS program or existing services. To estimate the program’s impacts, the authors used administrative employment and earnings data, as well as an 18-month follow-up survey emphasizing respondents’ employment, income, and other outcomes. Outcomes were adjusted for characteristics before random assignment. The study did not find any statistically significant effects on employment, earnings, public assistance receipt, or education. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects would be attributable to Enhanced EHS services and not to other factors. However, the study did not find statistically significant effects.","Enhanced Early Head Start (EHS)","Other employment and reemployment Other training and education","Low income, Parent",,"United States",2011,http://www.acf.hhs.gov/sites/default/files/opre/two_generational.pdf "Long-term findings from an experimental evaluation of three service delivery models.","Perez-Johnson, I., Moore, Q., & Santillano, R. (2011). Long-term findings from an experimental evaluation of three service delivery models. Series: ETAOP 2012-06. Washington, DC: Employment and Training Administration, U.S. Department of Labor.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of individual training account (ITA) programs on employment, earnings, education and training, and benefit receipt. The authors conducted a randomized controlled trial. They used Unemployment Insurance (UI) records of the full sample and a follow-up survey conducted on average seven years after random assignment for a random subsample of the full sample (4,800 of 7,920) to determine education and training, employment, and earnings outcomes. The study found that a significantly higher percentage of the maximum customer choice group (59 percent) had earned a certificate or degree from a training program within 3 years of random assignment compared with the guided customer choice group (53 percent). The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the ITA models, and not to other factors.","The Individual Training Accounts (ITA) models","Other employment and reemployment Other training and education Unemployment Insurance","Low income, Dislocated or displaced worker",,"United States",2011,https://wdr.doleta.gov/research/FullText_Documents/ETAOP_2012_06.pdf "Earnings progression among workforce development participants: Evidence from Washington State.","Chrisinger, C.K. (2011). Earnings progression among workforce development participants: Evidence from Washington State. Washington, DC: U.S. Department of Labor, Employment and Training Administration.","Job Search Assistance, Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages","Summary: The study’s objective was to examine the impact of the Workforce Investment Act (WIA) Adult Program on the earnings of low-income adults ages 18 to 64 in Washington State. The author assigned workers to the treatment group if they received employment-related services through the WIA Adult Program from January 2002 to June 2008. Workers who participated in the Labor Exchange program during this time comprised the comparison group. The study found no statistically significant relationships between receiving services through the WIA Adult Program and quarterly earnings. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before program participation. This means we would not be confident that the estimated effects would be attributable to the WIA Adult Program; however, the study did not find statistically significant effects.","the Workforce Investment Act (WIA) Adult Program","Adult and Dislocated Worker programs Job search assistance and supportive services Labor Exchange Other employment and reemployment Other training and education Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA)","Unemployed, Low income",,"United States",2011,https://wdr.doleta.gov/research/FullText_Documents/ETAOP_2011-11.pdf "A pilot study connecting youth with emotional or behavioral difficulties to summer work experiences.","Carter, E.W., Trainor, A.A., Ditchman, N., & Owens, L. (2011). A pilot study connecting youth with emotional or behavioral difficulties to summer work experiences. Career Development for Exceptional Individuals, 34(2), 95-106. doi:10.1177/0885728810395745","Job Search Assistance, Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of providing summer employment support on the employment of youth with emotional and behavioral difficulties. The authors used a randomized controlled trial to assign eligible youth with emotional and behavioral difficulties (63 in total) to either the treatment group, which received additional support finding and retaining summer employment, or the control group, which did not receive any additional support. The authors used data from telephone interviews with youth or parents to measure outcomes. The study found that, compared with youth randomly assigned to the control group, youth offered support finding and retaining summer employment were 27 percentage points more likely to be employed at the end of the summer. The quality of causal evidence presented in this report is low because attrition was high and the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to summer employment support; other factors are likely to have contributed.","a Package of Employment Services for Youth","Job search assistance and supportive services Other employment and reemployment","Youth, Other barriers",,"United States",2011, "Do conditional cash transfers for schooling generate lasting benefits? A five-year followup of PROGRESA/Oportunidades","Behrman, J. R., Parker, S. W., & Todd, P. E. (2011). Do conditional cash transfers for schooling generate lasting benefits? A five-year followup of PROGRESA/Oportunidades. Journal of Human Resources, 46(1), 93-122. doi:10.3368/jhr.46.1.93","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor Child labor-Low-Favorable impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of Mexico’s conditional cash transfer program (PROGRESA/Oportunidades) on long-term schooling and work for children ages 9 to 15 (during the time of the intervention). Using survey data from a randomized controlled trial, the authors analyzed the impact of the PROGRESA/Oportunidades program on schooling and work 18-months after implementation. The authors also used a nonexperimental design to evaluate schooling and work outcomes five-and-a-half years post-implementation. The study found that 18 months of program exposure significantly increased the school grade completion by 2.4 percent for boys and 2.7 percent for girls. The 18-month program exposure significantly decreased participation in work by 4.1 percent for boys but had no significant effect for girls. The study found a statistically significant relationship between the program and increased school grade completion five-and-a-half years post-implementation for all groups except for girls aged 17-19. It also found a statistically significant relationship between the program and a reduction in child labor for boys aged 15-16 in 2003 but did not find a significant relationship between the program for girls or for any other age groups of boys. The quality of causal evidence presented in this report is high for short-term outcomes (18 months) because they are based on a well-implemented randomized controlled trial but low for longer-term outcomes (five-and-a-half years) because the authors did not account for the outcomes of schooling and work at baseline.",PROGRESA/Oportunidades,"Child labor","Other, Low income",,International,2011,https://www.mcgill.ca/isid/files/isid/behrman_et_al_2011.pdf "Same bureaucracy, different outcomes in human capital? How indigenous and rural non-indigenous areas in Panama responded to the CCT","Arriaz, I., & Rozo, S. (2011). Same bureaucracy, different outcomes in human capital? How indigenous and rural non-indigenous areas in Panama responded to the CCT. Inter-American Development Bank, Office of Evaluation & Oversight.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of Red de Oportunidades (RdO), a conditional cash transfer program in Panama, on child labor and school enrollment. The authors used cross-sectional data to compare the treatment group to the comparison group on several outcomes, including child labor (if the child worked in the previous week) and school enrollment (if the child was enrolled in formal schooling). In the analyses for rural areas, the study found that the receipt of the RdO was significantly associated with a decrease in child labor by 6.2 percentage points and an increase in school enrollment by 8.8 percentage points. In the analyses for the indigenous areas, the receipt of RdO was significantly associated with an increase in school enrollment by 6.3 percentage points, but not related to child labor. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Red de Oportunidades (RdO) program; other factors are likely to have contributed.","Red de Oportunidades (RdO)","Child labor","Other, Low income",,"International, Rural",2011,https://papers.ssrn.com/sol3/papers.cfm?abstract_id=1847124 "Three essays on investments in children's human capital","Bustelo, M. (2011). Three essays on investments in children's human capital (Doctoral dissertation). Retrieved from https://core.ac.uk/download/pdf/4837518.pdf","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Child labor-Mod/high-No impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of a Nicaraguan conditional cash transfer program, Red de Proteccion Social (RPS), on child work participation and school enrollment. The study was a randomized controlled trial that took place in Nicaragua. Data were obtained from a baseline and two follow-up surveys administered to treatment and control group households. The study found that the RPS program significantly increased school enrollment for targeted children by 18% in the first year post-intervention and 14% in the second year post-intervention. The study found no statistically significant relationships between RPS and work participation for targeted children. The quality of the causal evidence presented in this study is moderate because, although it was based on a randomized controlled trial with unknown attrition, the author demonstrated that the treatment and control groups were similar before the intervention. This means we have confidence that the estimated effects are attributable at least in part to Red de Proteccion Social, although other factors could also have contributed.","Red de Protección Social (RPS)","Child labor",Other,,International,2011,https://www.ideals.illinois.edu/bitstream/handle/2142/29654/Bustelo_Monserrat.p… "Workforce Investment Act training for older workers: Toward a better understanding of older worker needs during the economic recovery (ETA Occasional Paper 2011-10).","Zhang, T. (2011). Workforce Investment Act training for older workers: Toward a better understanding of older worker needs during the economic recovery (ETA Occasional Paper 2011-10). Washington, DC: U.S. Department of Labor, Employment and Training Administration.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Mixed impacts Employment","Summary: The study examined the impacts of various Workforce Investment Act (WIA) programs and services on the employment rates of older participants who exited these programs. The study used a statistical model (fixed and random effect) to estimate the correlation between WIA programs and services and the Entered Employment Rate one quarter after participants age 55 and older exited the programs. The study used the WIA Standardized Record Data from January 1, 2006, to September 30, 2007, and data on state-level unemployment rates and trends from a Bureau of Labor Statistics data set. The study found that some characteristics of the WIA training programs and services are associated with higher employment rates, while other characteristics are associated with lower employment rates. The quality of causal evidence presented in this report is low because the study did not demonstrate that participants across different training programs were similar before the study and did not account for possible differences in the groups. This means we are not confident that the estimated effects are attributable to the WIA programs and services; other factors are likely to have contributed.","the Workforce Investment Act (WIA) training for older workers","Adult and Dislocated Worker programs Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA)","Adult, Unemployed",,"United States",2011, "Labor market rigidities and the employment behavior of older workers.","Blau, D., & Shvydko, T. (2011). Labor market rigidities and the employment behavior of older workers. Industrial and Labor Relations Review, 64(3), 464-484.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of flexibility in hours of work on the likelihood that older workers separate from an employer. The study used a statistical model to compare the job exit behavior of older and younger workers in firms with different shares of women younger than age 30. The analysis used monthly data on workers ages 45 to 69 in the Survey of Income and Program Participation from 1990 to 2001 matched to employers in the Longitudinal Employment and Household Dynamics data. The study found that workers in their sixties who work for employers with a higher share of women younger than age 30 are less likely to experience job separations compared with workers in their late 40s to mid-50s. The quality of causal evidence presented in this report is low because the groups being compared might not be similar before leaving their employer. This means we are not confident that the estimated effects are attributable to employment flexibility, other factors are likely to have contributed.","Employment flexibility","Other employer services","Adult, Older worker",,"United States",2011,https://www.jstor.org/stable/41149475?seq=1#page_scan_tab_contents "What kinds of injuries do OSHA inspections prevent? ","Haviland, A., Burns, R., Gray, W., Ruder, T., & Mendeloff, J. (2010). What kinds of injuries do OSHA inspections prevent? Journal of Safety Research, 41(4), 339-345.","OSHA Enforcement","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Health and safety-Low-Favorable impacts Health and safety","Summary: The study’s objective was to determine whether OSHA inspections that resulted in penalties or citations prevented specific types of workplace injuries. The study used a regression model to compare the changes in the workplace injuries in single-facility manufacturing firms that had received an inspection that resulted in a penalty or citation to changes in firms that had not received a penalty or citation. The group of firms that had not received a penalty or citation combined two types of firms: firms that had not been inspected and firms that received inspections that did not result in a penalty or citation. The study found that inspections that imposed penalties were associated with statistically significant reductions in the rates of all types of injuries examined. Among the specific citations studied, only citations for violating the general standard for personal protective equipment were associated with reduced injury rates. The quality of the causal evidence presented in this study is low. This means we are not confident that OSHA inspections that resulted in penalties or citations caused the reductions in workplace injuries.","OSHA Enforcement Activities","Inspections Other health and safety Workplace injury",Employed,Manufacturing,"United States",2010, "Tuning in to local labor markets: Findings from the Sectoral Employment impact study","Maguire, S., Freely, J., Clymer, C., Conway, M. & Schwartz, D. (2010). Tuning in to local labor markets: Findings from the Sectoral Employment impact study. Philadelphia: Public/Private Ventures. [Wisconsin Regional Training Partnership]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence",,"Summary: The study’s objective was to examine the impact of the Wisconsin Regional Training Partnership’s (WRTP) sectoral employment program on earnings and employment. The study was based on a randomized controlled trial and it estimated the effect of offering eligible WRTP applicants the program by using survey data to compare average outcomes among those offered access to the program against the average outcomes of those excluded, after adjusting for differences between the groups. The study found that being offered access to the WRTP’s sectoral employment program increased earnings by $6,255, on average, over the two years after acceptance to the program. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the WRTP’s sectoral employment program, and not to other factors.","Wisconsin Regional Training Partnership’s (WRTP) Sectoral Employment Program","Job search assistance and supportive services Other employment and reemployment","Low income","Professional, scientific, and technical services","United States",2010,http://ppv.issuelab.org/resources/5101/5101.pdf "Tuning in to local labor markets: Findings from the Sectoral Employment impact study.","Maguire, S., J. Freely, C. Clymer, M. Conway, & D. Schwartz. (2010). Tuning in to local labor markets: Findings from the Sectoral Employment impact study. Philadelphia: Public/Private Ventures. [JVS-Boston]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: The study’s objective was to examine the impact of the Jewish Vocational Service (JVS)-Boston sectoral employment program on earnings and employment. The study was based on a randomized controlled trial and used survey data to estimate the effect of offering eligible JVS-Boston applicants the program by comparing average outcomes among those offered access to the program with the average outcomes of those excluded from the program, after adjusting for differences between the groups. This review was conducted in collaboration with the Employment Strategies for Low-Income Adults Evidence Review (ESER). Because ESER did not report findings for studies that received a low causal evidence rating, the CLEAR profile does not report the findings either. The quality of causal evidence presented in this report is low because it was based on a randomized controlled trial with high attrition and the authors did not demonstrate that the groups were similar at or account for differences between the two groups in the analyses. This means we are not confident that the estimated effects are attributable to the JVS-Boston program; other factors are likely to have contributed.","the Jewish Vocational Service (JVS)-Boston Sectoral Employment Program","Other employment and reemployment Other training and education","Low income","Health care and social assistance","United States",2010,http://www.aspenwsi.org/wordpress/wp-content/uploads/TuningIntoLocalLaborMarket… "Tuning in to local labor markets: Findings from the Sectoral Employment Impact Study. [Per Scholas]","Maguire, S., Freely, J., Clymer, C., Conway, M., & Schwartz, D. (2010). Tuning in to local labor markets: Findings from the Sectoral Employment Impact Study. Philadelphia, PA: Public/Private Ventures. [Per Scholas]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: The study’s objective was to examine the impact of the Per Scholas sectoral employment program on participants’ earnings and employment. The study was a randomized controlled trial and used survey data to estimate the effect of Per Scholas by comparing average outcomes among applicants offered access to the program with average outcomes of those excluded from the program, after adjusting for differences between the groups. This review was conducted in collaboration with the Employment Strategies for Low-Income Adults Evidence Review (ESER). Because ESER did not report findings for studies that received a low causal evidence rating, this CLEAR profile does not report the findings either. The quality of causal evidence presented in this report is low because the study was a randomized controlled trial with high attrition, and the authors did not demonstrate that the groups that remained in the study were similar before the intervention began. This means we would not be confident that the estimated effects would be attributable to Per Scholas; other factors are likely to have contributed. However, the study did not find statistically significant effects.","Per Scholas","Work based and other occupational training","Low income","Professional, scientific, and technical services","United States",2010,http://ppv.issuelab.org/resources/5101/5101.pdf "Making the transition: Interim results of the National Guard Youth ChalleNGe program evaluation","Millenky, M., Bloom, D., & Dillon, C. (2010). Making the transition: Interim results of the National Guard Youth ChalleNGe program evaluation. New York: MDRC.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Training-Mod/high-Favorable impacts Training","Summary: This report presents results from a 21-month follow-up study of the National Guard Youth ChalleNGe program, a disciplinary and educational intervention for unemployed youth ages 16 to 18 who are not in school. Related reports examine outcomes at 9 months and 3 years post-intervention. The program’s effectiveness was evaluated using a randomized controlled trial conducted in 10 states. This report examined the effects of the program on participants’ educational attainment, earnings, employment, and other outcomes measured through a survey conducted about 21 months after participants entered the study. The study found statistically significant, positive impacts of the ChalleNGe program on earnings, education, and training outcomes measured after 21 months. The quality of causal evidence presented in this study is high because it is a well-implemented randomized controlled trial. This means we are confident that the effects estimated in this study are attributable to the National Guard Youth ChalleNGe program, and not to other factors.","the National Guard Youth ChalleNGe Program","Basic skills Community college education and other classroom training Mentoring Other training and education Youth programs",Youth,,"United States",2010,http://www.mdrc.org/sites/default/files/full_434.pdf "Longer-term impacts of mentoring, educational services, and learning incentives: Evidence from a randomized trial in the United States","Rodríguez-Planas, N. (2012). Longer-term impacts of mentoring, educational services, and learning incentives: Evidence from a randomized trial in the United States. American Economic Journal: Applied Economics, 4(4):121–139.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains Training-Mod/high-No impacts Training","Summary: The report’s objective was to evaluate the long-term impacts of the Quantum Opportunity Program (QOP)—which included case management and mentoring, education, developmental activities, community service, supportive services, and financial incentives—on high school completion and postsecondary education. About 1,100 9th-grade students from 11 high schools were randomly assigned to the treatment group, which could enroll in QOP, or the control group, which could not participate in QOP activities. The study team administered a survey to treatment and control group members at three follow-up periods to collect information on postsecondary educational attainment and labor market outcomes. The report found few statistically significant impacts on the educational and employment-related outcomes examined. The quality of the causal evidence presented in this report for the analysis of the third follow-up period is high because it is based on a well-conducted randomized controlled trial. This means we are confident that any impacts observed would be attributable to the QOP, not to other factors. However, the quality of causal evidence for the analyses of the other two follow-up periods is low.","Quantum Opportunities Program (QOP)","Mentoring Other training and education Youth programs",Youth,,"United States",2010, "Reinvesting in America’s youth: Lessons from the 2009 Recovery Act Summer Youth Employment Initiative.","Bellotti, J., Rosenberg, L., Sattar, S., Esposito, A., & Ziegler, J. (2010). Reinvesting in America’s youth: Lessons from the 2009 Recovery Act Summer Youth Employment Initiative. Princeton, NJ: Mathematica Policy Research.","Opportunities for Youth","Study Type: Implementation Analysis",,,"Summary: The research examines the implementation of the Summer Youth Employment Initiative (SYEI). Funded by the American Recovery and Reinvestment Act of 2009, SYEI aimed to reverse the steep decline in youth employment during the recession by providing employment opportunities for youth in the summer of 2009. Through the initiative, youth were placed in summer work experiences with local employers and their wages were paid with Recovery Act funds. The work experiences were fairly flexible, but had to be age appropriate and lead to youth meeting work readiness goals. The authors analyzed state performance data through December 31, 2009, and data from in-depth site visits to 20 selected sites during July and August 2009. The authors reported that it took a large effort to get the program up and running in such a short amount of time (about four months). Some sites reported having to make compromises along the way, given the quick time frame, but all reported satisfaction with their accomplishments. The initiative was implemented successfully in all the studied sites, with all sites able to recruit a sufficient number of participants and place them in employment. Youth participants and the employers interviewed were very positive about the initative. Although the implementation of SYEI was considered a success, it was not without some initial challenges, including handling the large volume of applicants and determining their eligibility, reaching older youth ages 22 to 24 and veterans and their spouses, and appropriately matching youth to employers.","Summer Youth Employment Initiative (SYEI)","Basic skills Job search assistance and supportive services Work based and other occupational training Youth programs","Youth, Disconnected youth, Low-skilled, Low income",,"United States",2010,http://files.eric.ed.gov/fulltext/ED510398.pdf "Employment services utilization and outcomes among substance abusing offenders participating in California’s Proposition 36 drug treatment initiative","Evans E., Hser Y.-I., Huang D. (2010). Employment services utilization and outcomes among substance abusing offenders participating in California's proposition 36 drug treatment initiative. Journal of Behavioral Health Services and Research, 37 (4), 461-476.",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-Favorable impacts Employment Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the effect of California’s Proposition 36 employment services on employment, earnings, receipt of public benefits, and recidivism. The authors used a nonexperimental design to compare outcomes of people in drug treatment programs who have a criminal conviction and who received Proposition 36-funded employment services with outcomes of people in the same programs who did not receive proposition-funded employment services. The authors found that receipt of Proposition 36 employment services was associated with an increase in employment in the year after program participation. The authors also found that Proposition 36 was positively associated with the receipt of certain public benefits (public assistance and the Supplemental Nutrition Assistance Program) at three months and negatively associated with the receipt of Supplemental Security Income at three months. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to receipt of Proposition 36 employment services; other factors are likely to have contributed.","California’s Proposition 36 employment services","Substance abuse recovery Other employment and reemployment Reentry",Justice-involved,,"United States",2010,https://doi.org/10.1007/s11414-009-9185-z "Prisoner reentry experiences of adult females: Characteristics, Service Receipt, and Outcomes of Participants in the SVORI multi-site evaluation.","Lindquist, C. H., Lattimore, K. B., & Visher C. A. (2009) Prisoner reentry experiences of adult females: Characteristics, Service Receipt, and Outcomes of Participants in the SVORI multi-site evaluation. Research Triangle Park, NC: RTI International.",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Low-Favorable impacts Employment Public benefits receipt-Low-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of a violent prisoner reentry program, the Serious and Violent Offender Reentry Initiative (SVORI), on several outcomes of female prisoners reentering society, including employment, public benefit receipt, and recidivism. The authors used a matched comparison group design, using propensity-score weights, to analyze impacts of the SVORI program for females released from prison. The authors collected four waves of survey data to analyze impacts from before release up to 15 months after release. In addition, the authors obtained state administrative data describing recidivism at 24 months after release. The study found that people in the SVORI group were more likely to be employed after release than those in the comparison group, but it found no significant differences between the groups in public benefit receipt or recidivism outcomes. The quality of causal evidence presented in this report for the recidivism outcomes based on survey data is moderate because it was based on a well-implemented nonexperimental design. This means we are confident that any estimated effects would have been attributable to SVORI and not to other factors had the study found statistically significant effects. The quality of causal evidence presented in this report for the recidivism outcomes based on administrative data and for the employment and public benefit receipt outcomes is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects on employment are attributable to SVORI; other factors are likely to have contributed.","the Serious and Violent Offender Reentry Initiative (SVORI)",Reentry,"Justice-involved, Female",,"United States",2010,https://www.ncjrs.gov/App/AbstractDB/AbstractDBDetails.aspx?id=252453 "The impact of culinary student extracurricular work experience on graduate persistence in the foodservice industry","Mesch, B. D. (2010). The impact of culinary student extracurricular work experience on graduate persistence in the foodservice industry. (Doctoral dissertation). Retrieved from ProQuest. Accession No. 872556263. [Current student sample]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains","Summary: The study examined the relationship between participation in extracurricular food service employment during culinary arts training and the proportion of culinary arts courses students successfully completed. The author investigated similar research questions in another study of culinary arts graduates, the profile of which is available [here]. The study used a nonexperimental design to compare culinary arts students at one school who took part in extracurricular food service employment during their program with culinary arts students at the school who did not. Data for the study came from a survey of current students administered by the author and student records maintained by the school. The study did not find a statistically significant relationship between a students’ participation in extracurricular food service employment during culinary school and the percentage of culinary arts courses successfully completed. The quality of causal evidence presented in this study is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to food service work experience; other factors are likely to have contributed.","the voluntary extracurricular employment in food service","Other training and education",Youth,"Accommodation and food services","United States",2010,https://search.proquest.com/openview/2bcb106f1d3cc1b9ccb7ffbe42547a1a/1?pq-orig… "The impact of culinary student extracurricular work experience on graduate persistence in the foodservice industry","Mesch, B. D. (2010). The impact of culinary student extracurricular work experience on graduate persistence in the foodservice industry. (Doctoral dissertation). Retrieved from ProQuest. Accession No. 872556263. [Graduate sample]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains Employment-Low-Favorable impacts Employment","Summary: The study examined the relationship between participation in extracurricular food service employment during culinary arts training and two eligible outcomes: students’ post-graduation employment in food service and the proportion of culinary arts courses students successfully completed. The author investigated similar research questions in another study of current culinary arts students, the profile of which is available [here]. The study used a nonexperimental design to compare the employment and educational outcomes of culinary arts graduates of one school who took part in extracurricular foodservice employment during their degree program with culinary arts graduates from the school who did not. Data for the study came from a survey of program graduates administered by the author and student records maintained by the school. The study found a statistically significant relationship between students’ participation in extracurricular food service employment during culinary school and postgraduation employment in the foodservice industry. The quality of causal evidence presented in this study is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to food service work experience; other factors are likely to have contributed.","the voluntary extracurricular employment in food service","Other training and education",Youth,"Accommodation and food services","United States",2010,https://search.proquest.com/openview/2bcb106f1d3cc1b9ccb7ffbe42547a1a/1?pq-orig… "The impact of training on the frequency of internal promotion of employees and managers","West, L. S. (2010). The impact of training on the frequency of internal promotion of employees and managers. (Doctoral dissertation). University of North Texas Digital Library. https://digital.library.unt.edu/ark:/67531/metadc30526/m2/1/high_res_d/dissertation.pdf [Employee sample]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the relationship between formal training and promotion for employees who were not managers. The author investigated similar research questions in another study, the profile of which is available [here]. The other study examined the relationship between formal training and promotion for managers. The author used statistical methods in a nonexperimental analysis to estimate impacts of hours of formal training, drawing on archival survey data from the 1996–1997 National Organizations Survey. The study found a statistically significant and positive relationship between typical hours of formal training and the frequency of promotions for employees. The quality of causal evidence presented in this report is low because the author did not account for existing differences of employees in organizations that offered various hours of formal training. This means we are not confident that the estimated effects are attributable to formal training; other factors are likely to have contributed.","the formal training","Other training and education",Employed,,"United States",2010,https://digital.library.unt.edu/ark:/67531/metadc30526/m2/1/high_res_d/disserta… "The impact of training on the frequency of internal promotion of employees and managers","West, L. S. (2010). The impact of training on the frequency of internal promotion of employees and managers. (Doctoral dissertation). University of North Texas Digital Library. https://digital.library.unt.edu/ark:/67531/metadc30526/m2/1/high_res_d/dissertation.pdf [Manager sample]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the relationship between formal training and promotion for managers. The author investigated similar research questions in another study, the profile of which is available [here]. The other study examined the relationship between formal training and promotion for employees who were not managers. The author used statistical methods in a nonexperimental analysis to estimate impacts of hours of formal training, drawing on archival survey data from the 1996–1997 the National Organizations Survey. The study found no statistically significant relationships between formal training and managers’ promotions. The quality of causal evidence presented in this report is low because the author did not account for existing differences of managers in organizations that offered various hours of formal training. This means we would not be confident that the estimated effects would be attributable to formal training; other factors would have been likely to have contributed. The study did not, however, find statistically significant relationships.","the formal training","Other training and education",Employed,,"United States",2010,https://digital.library.unt.edu/ark:/67531/metadc30526/m2/1/high_res_d/disserta… "Tuning in to local labor markets: Findings from the Sectoral Employment impact study","Maguire, S., Freely, J., Clymer, C., Conway, M., & Schwartz, D. (2010). Tuning in to local labor markets: Findings from the Sectoral Employment impact study. Philadelphia, PA: Public/Private Ventures. [JVS-Boston]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: The study’s objective was to examine the impact of the Jewish Vocational Service (JVS)-Boston sectoral employment program on earnings and employment. The authors investigated similar research questions with two other programs, the profiles of which are available through the study search. The study was based on a randomized controlled trial, with the authors using survey data to estimate the effect of offering eligible JVS-Boston applicants the program by comparing average outcomes among those offered access to the program with the average outcomes of those not offered access to the program, after adjusting for differences between the groups. This review was conducted in collaboration with the Employment Strategies for Low-Income Adults Evidence Review (ESER). Because ESER did not report findings for studies that received a low causal evidence rating, the CLEAR profile does not report the findings either. The quality of causal evidence presented in this report is low because it was based on a randomized controlled trial with high attrition, and the authors did not demonstrate that the groups were similar at or account for differences between the two groups in the analyses. This means we are not confident that the estimated effects are attributable to the JVS-Boston sectoral employment program; other factors are likely to have contributed.","JVS-Boston Sectoral Employment","Job search assistance and supportive services Other training and education",Adult,"Finance and insurance","Urban, United States",2010,https://www.explorevr.org/sites/explorevr.org/files/files/Tuning%20In%20to%20Lo… "Tuning in to local labor markets: Findings from the Sectoral Employment Impact Study","Maguire, S., Freely, J., Clymer, C., Conway, M., & Schwartz, D. (2010). Tuning in to local labor markets: Findings from the Sectoral Employment Impact Study. Philadelphia, PA: Public/Private Ventures. [Per Scholas]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: The study’s objective was to examine the impact of the Per Scholas sectoral employment program on participants’ earnings and employment. The authors investigated similar research questions with two other programs, the profiles of which are available through the study search. The study was a randomized controlled trial, with the authors using survey data to estimate the effect of Per Scholas by comparing average outcomes among applicants offered access to the program with average outcomes of those not offered access to the program, after adjusting for differences between the groups. This review was conducted in collaboration with the Employment Strategies for Low-Income Adults Evidence Review (ESER). Because ESER did not report findings for studies that received a low causal evidence rating, this CLEAR profile does not report the findings either. The quality of causal evidence presented in this report is low because the study was a randomized controlled trial with high attrition, and the authors did not demonstrate that the groups that remained in the study were similar before the intervention began. This means we would not be confident that the estimated effects would be attributable to the Per Scholas sectoral employment program; other factors are likely to have contributed. The study did not, however, find statistically significant effects.","Per Scholas","Job search assistance and supportive services Other training and education",Adult,"Professional, scientific, and technical services","United States",2010,https://www.explorevr.org/sites/explorevr.org/files/files/Tuning%20In%20to%20Lo… "Tuning in to local labor markets: Findings from the Sectoral Employment impact study","Maguire, S., Freely, J., Clymer, C., Conway, M. & Schwartz, D. (2010). Tuning in to local labor markets: Findings from the Sectoral Employment impact study. Philadelphia: Public/Private Ventures. [Wisconsin Regional Training Partnership]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine the impact of the Wisconsin Regional Training Partnership’s (WRTP) sectoral employment program on earnings and employment. The authors investigated similar research questions with two other programs, the profiles of which are available through the study search. The study was based on a randomized controlled trial, with the authors estimating the effect of offering eligible WRTP applicants the program by using survey data to compare average outcomes among those offered access to the program against the average outcomes of those not offered access, after adjusting for differences between the groups. The study found that being offered access to the WRTP’s sectoral employment program increased earnings by $6,255, on average, over the two years after acceptance to the program. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the WRTP’s sectoral employment program, and not to other factors.","the WRTP Sectoral Employment Program","Job search assistance and supportive services Other training and education","Low income","Construction, Manufacturing, Health care and social assistance","United States",2010,https://www.explorevr.org/sites/explorevr.org/files/files/Tuning%20In%20to%20Lo… "Washington State’s Integrated Basic Education and Skills Training Program (I-BEST): New evidence of effectiveness","Zeidenberg, M., Cho, S., & Jenkins, D. (2010). Washington State’s Integrated Basic Education and Skills Training Program (I-BEST): New evidence of effectiveness. New York: Community College Research Center, Columbia University.","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impacts of the Integrated Basic Education and Skills Training (I-BEST) program on educational attainment and wage outcomes. The authors used statistical methods to compare students in the treatment group with students in the comparison group who had attended basic skills courses other than I-BEST, using data from the 2006–2007 and 2007–2008 school years. The study found that I-BEST students were more likely to earn an educational award (that is, a certificate or degree). The authors noted that most awards earned by basic skills students are certificates. The study found no statistically significant differences between I-BEST students and the comparison students on wages earned. The quality of causal evidence presented in this report for educational attainment is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that any estimated effects are attributable to I-BEST, but other factors might also have contributed. For wage outcomes, the quality of casual evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to I-BEST; other factors are likely to have contributed.","Integrated Basic Education and Skills Training (I-BEST)","Community college education and other classroom training",Low-skilled,,"United States",2010,https://ccrc.tc.columbia.edu/publications/i-best-new-evidence.html "The role of inspection sequence in compliance with the US Occupational Safety and Health Administration’s (OSHA) standards: Interpretations and implications","Ko, K., Mendeloff, J., & Gray, W. (2010). The role of inspection sequence in compliance with the US Occupational Safety and Health Administration's (OSHA) standards: Interpretations and implications. Regulation and Governance, 4(1), 48-70.","OSHA Enforcement","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Compliance-Low-Mixed impacts Compliance","Summary: The study’s objective was to examine the effect of the sequence and timing of OSHA inspections on compliance with OSHA standards, as measured by the number of violations cited during an inspection. The study used a regression model to compare the number of OSHA violations cited during inspections based on their order during the sample period—for example, during the second compared with the first inspection during the sample period—and for which different lengths of time had passed since the previous inspection. Examining firms inspected multiple times, the study reported that the total number of violations cited in the second inspection was lower than the number of violations cited in the first. In these firms, the number of violations cited was larger for every additional year elapsed since the previous inspection. The quality of causal evidence presented in this study is low. Although it provides interesting descriptive information, the study does not provide evidence of a causal effect of inspections, or their timing, on violations.","OSHA Enforcement Activities",Inspections,Employed,,"United States",2010, "An impact evaluation of a federal mine safety training regulation on injury rates among US stone, sand, and gravel mine workers: An interrupted time-series analysis","Monforton, C., & Windsor, R. (2010). An impact evaluation of a federal mine safety training regulation on injury rates among US stone, sand, and gravel mine workers: An interrupted time-series analysis. American Journal of Public Health, 100(7), 1334-1340. https://dx.doi.org/10.2105%2FAJPH.2009.178301","Mine Workers and Mine Health and Safety","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Health and safety-Low-Favorable impacts Health and safety","Summary: The study’s objective was to examine the impact of the Mine Safety and Health Administration (MSHA) Policy Part 46 on mine workers’ injury rates. The study used an interrupted time series design to compare injury rates before and after the policy implementation using injury rate data that is reported to MSHA by individual mining companies. The study found that policy implementation was associated with a significant decrease in mine workers’ likelihood of permanent disabling injuries. The quality of causal evidence presented in this report is low because the authors did not account for anticipation of the policy before it was implemented. This means we are not confident that the estimated effects are attributable to MSHA Policy Part 46; other factors are likely to have contributed.","Mine Safety and Health Administration (MSHA) Policy Part 46","Mine safety and health Workplace injury",,,"United States",2010,https://dx.doi.org/10.2105%2FAJPH.2009.178301 "Implementation and early training outcomes of the High Growth Job Training Initiative: Final report","Eyster, L., Nightingale, D.S., Barnow, B., O'Brien, C., Trutko, J. & Kuehn, D. (2010) Implementation and early training outcomes of the High Growth Job Training Initiative: Final report. Washington, D.C.: Urban Institute Center on Labor, Human Services, and Population","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages","Summary: The study’s objective was to examine the impact of the High Growth Job Training Initiative (HGJTI) grant on earnings. This summary focuses on the Certified Nursing Assistant (CNA) program at Columbia Gorge Community College (CGCC) in Oregon. This nonexperimental study used propensity score matching and difference-in-differences models to compare the earnings outcomes of women who participated in the CNA program to those who did not. The study found that women who participated in the CGCC CNA program earned significantly less than women in the comparison group. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design; this is the highest causal evidence rating possible for a nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the CGCC CNA program, but other factors might also have contributed.","Columbia Gorge Community College’s (CGCC) Certified Nursing Assistant (CNA) program","Employment and Training Services Employer Services Employer partnerships Training and Education Capacity building programs Community college education and other classroom training Work based and other occupational training","Adult, Dislocated or displaced worker",,"Rural, United States",2010,https://www.urban.org/research/publication/implementation-and-early-training-ou… "Implementation and early training outcomes of the High Growth Job Training Initiative: Final report.","Eyster, L., Nightingale, D.S., Barnow, B., O'Brien, C., Trutko, J. & Kuehn, D. (2010) Implementation and early training outcomes of the High Growth Job Training Initiative: Final report. Washington, D.C.: Urban Institute Center on Labor, Human Services, and Population.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages","Summary: The study’s objective was to examine the impact of the High Growth Job Training Initiative (HGJTI) grant on earnings. This summary focuses on the apprenticeship program at South Texas College (STC). This nonexperimental study used propensity score matching and difference-in-differences models to compare the earnings outcomes of workers who participated in the apprenticeship program to those who did not. The study found that participation in the apprenticeship program was significantly related to higher earnings. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the South Texas College (STC) apprenticeship program; other factors are likely to have contributed.","South Texas College (STC) Advanced Manufacturing Apprenticeship Program","Employment and Training Services Employer Services Employer partnerships Training and Education Capacity building programs Community college education and other classroom training Registered apprenticeship Work based and other occupational training","Adult, Dislocated or displaced worker",,"United States",2010,https://www.urban.org/research/publication/implementation-and-early-training-ou… "Leveling the intra-household playing field: Compensation and specialization in child labor allocation","Del Carpio, X. V., & Macours, K. (2010). Leveling the intra-household playing field: Compensation and specialization in child labor allocation. In R. K. Akee, E. V. Edmonds, & K. Tatsiramos (Eds.), Child Labor and the Transition Between School and Work (pp. 259-295). Bingley, UK: Emerald Publishing Limited.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor","Summary: The study’s objective was to examine the impact of Atención a Crisis (""Attention to the Crisis”), a conditional cash transfer (CCT) program, on the allocation of child labor within poor households with two or more children. This summary focuses on the comparison between the treatment group receiving the basic CCT and the control group. The study was a randomized controlled trial (RCT) in northwest Nicaragua. The authors analyzed data from a household survey given at baseline and nine months into the program. The authors compared household allocation of child labor by age and gender of children in households with two or more children. The study found that in households receiving the basic CCT, economic labor significantly decreased for boys but not girls. Boys decreased their hours per week in economic work (including agricultural, livestock, and non-agricultural economic activity) by 1.1 hours compared to girls. Older boys aged, 10-15, also showed a larger, significant reduction in economic work of 3.0 hours a week compared to their siblings. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial with low attrition. This means we are confident that the estimated effects are attributable to Atención a Crisis, and not to other factors.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2010,https://openknowledge.worldbank.org/bitstream/handle/10986/4020/WPS4822.pdf?seq… "Leveling the intra-household playing field: Compensation and specialization in child labor allocation","Del Carpio, X. V., & Macours, K. (2010). Leveling the intra-household playing field: Compensation and specialization in child labor allocation. In R. K. Akee, E. V. Edmonds, & K. Tatsiramos (Eds.), Child Labor and the Transition Between School and Work (pp. 259-295). Bingley, UK: Emerald Publishing Limited.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Mixed impacts Child labor","Summary: The study’s objective was to examine the impact of Atención a Crisis (""Attention to the Crisis”), a conditional cash transfer (CCT) program, on the allocation of child labor within poor households with two or more children. This summary focuses on the comparison between the treatment group receiving the basic CCT plus the business grant and the control group. The study was a randomized controlled trial (RCT) in northwest Nicaragua. The authors analyzed data from a household survey given at baseline and nine months into the program. The authors compared household allocation of child labor by age and gender of children in households with two or more children. The study found that in households receiving the basic CCT plus the business grant, economic labor significantly decreased for boys but not girls. Boys decreased their hours per week in economic work (including agricultural, livestock, and non-agricultural economic activity) by 1.8 hours compared to girls. Older boys, aged 10-15, showed a larger reduction in economic work by 3.3 hours a week compared to their siblings. However, older girls, aged 10-15, showed an increase in economic work by 1.5 hours a week and domestic work of an hour a week compared to their siblings. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial with low attrition. This means we are confident that the estimated effects are attributable to Atención a Crisis, and not to other factors.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2010,https://openknowledge.worldbank.org/bitstream/handle/10986/4020/WPS4822.pdf?seq… "Leveling the intra-household playing field: Compensation and specialization in child labor allocation","Del Carpio, X. V., & Macours, K. (2010). Leveling the intra-household playing field: Compensation and specialization in child labor allocation. In R. K. Akee, E. V. Edmonds, & K. Tatsiramos (Eds.), Child Labor and the Transition Between School and Work (pp. 259-295). Bingley, UK: Emerald Publishing Limited.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor","Summary: The study’s objective was to examine the impact of Atención a Crisis (""Attention to the Crisis”), a conditional cash transfer program, on the allocation of child labor within poor households with two or more children. This summary focuses on the comparison between all treatment groups and the control group. The study was a randomized controlled trial (RCT) in northwest Nicaragua. The authors analyzed data from a household survey given at baseline and nine months into the program. The authors compared household allocation of child labor by age and gender of children in households with two or more children. The study found that in treatment households, economic labor significantly decreased for boys but not girls. Boys significantly decreased their hours per week in economic work (including agricultural, livestock, and non-agricultural economic activity) by 1.3 hours compared to girls. Older boys aged, 10-15, showed a larger, significant reduction in economic work by 2.8 hours a week compared to their siblings. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial with low attrition. This means we are confident that the estimated effects are attributable to Atención a Crisis, and not to other factors.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2010,https://openknowledge.worldbank.org/bitstream/handle/10986/4020/WPS4822.pdf?seq… "Productive safety net program and children’s time use between work and schooling in Ethiopia","Woldehanna T. (2010). Productive safety net program and children’s time use between work and schooling in Ethiopia. In J. Cockburn & J. Kabubo-Mariara (Eds.). Child Welfare in Developing Countries (pp. 157-209). New York, NY: Springer.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Agricultural Extension Support Program (AEP) on child labor and schooling outcomes in rural Ethiopia. The study used a matched-comparison group design. Using data from a household survey, the author compared time spent in child labor and schooling among AEP participants and non-participants. The study found that AEP participation was significantly related to lower amounts of time spent in paid work and in a combined measure of all work, as well as greater amounts of time spent in school. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Agricultural Extension Support Program; other factors are likely to have contributed.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2010,https://rd.springer.com/chapter/10.1007/978-1-4419-6275-1_6 "Productive safety net program and children’s time use between work and schooling in Ethiopia","Woldehanna T. (2010). Productive safety net program and children’s time use between work and schooling in Ethiopia. In J. Cockburn & J. Kabubo-Mariara (Eds.). Child Welfare in Developing Countries (pp. 157-209). New York, NY: Springer.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Direct Support Program (DSP) on child labor and schooling outcomes in Ethiopia. The study used a matched-comparison group design. Using data from a household survey, the author compared time spent in child labor and schooling among DSP participants and non-participants. The study found that participation in the DSP was significantly associated with a lower amount of total time spent in work outside home, time spent in unpaid work outside the home and a composite measure of total work (paid and unpaid outside the home plus child care and household chores). The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Direct Support Program; other factors are likely to have contributed.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2010,https://rd.springer.com/chapter/10.1007/978-1-4419-6275-1_6 "Productive safety net program and children’s time use between work and schooling in Ethiopia","Woldehanna T. (2010). Productive safety net program and children’s time use between work and schooling in Ethiopia. In J. Cockburn & J. Kabubo-Mariara (Eds.). Child Welfare in Developing Countries (pp. 157-209). New York, NY: Springer.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Public Work Program (PWP) on child labor and schooling outcomes in rural Ethiopia. The study used a matched-comparison group design. Using data from a household survey, the author compared time spent in child labor and schooling among PWP participants and non-participants. The study found that participation in PWP was significantly associated with a lower amount of time spent on child care and household chores. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Public Work Program; other factors are likely to have contributed.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2010,https://rd.springer.com/chapter/10.1007/978-1-4419-6275-1_6 "Choice proliferation, simplicity seeking, and asset allocation","Iyengar, S., & Kamenica, E. (2010). Choice proliferation, simplicity seeking, and asset allocation. Journal of Public Economics, 94, 530-539.","Behavioral Finance: Retirement","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Attitudes-Mod/high-Favorable impacts Attitudes","Summary: Laboratory experiments This study used two laboratory experiments to examine the relationship between the number of choices offered and decision making.  Individuals were asked to choose between risky gambles and sure payoffs, with the number of choices randomly determined. The authors found that when individuals were presented with a larger number of choices, they tended to choose simpler payoff options. The quality of the causal evidence presented in this portion of the study is high. This means we are confident that an increase in the number of choices an individual is given causes him or her to choose a less complex payoff option. Analysis of 401(k) data  The study further aimed to determine whether the number of fund options offered by a 401(k) plan influenced the share of assets allocated to a given class of funds (for example, equities or bonds) by plan members. The authors analyzed differences in portfolio allocations based on the number of funds available using regression analysis, controlling for other 401(k), firm, and employee characteristics. The analysis demonstrated that as the number of investment options increased, people tended to allocate more of their 401(k) savings to money market and bond funds at the expense of equity funds. The quality of causal evidence presented in this portion of the study is low. This means we cannot be confident that an increase in the number of funds offered in a retirement plan causes an increase in the share of funds allocated to money market and bond funds and a concurrent decrease in the share of funds allocated to equities.","Changing the Number of Risky Choices","Employer provided retirement benefits",Employed,,"United States",2010, "Testing a SSDI Benefit Offset: Evaluations of the Wisconsin SSDI Employment Pilot","Delin, B., Hartman, E., Sell, C., & Brown-Reither, A. (2010). Testing a SSDI Benefit Offset: Evaluations of the Wisconsin SSDI Employment Pilot. Menomonie, WI: University of Wisconsin-Stout.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of Wisconsin’s Benefit Offset Pilot Demonstration (BOPD), which provided a more-generous work incentive for Social Security Disability Insurance (SSDI) recipients, on recipients’ employment status, earnings, and reliance on benefits. The study was a randomized controlled trial; eligible volunteers were randomly assigned to either a treatment group, which was eligible for the more-generous work incentive, or a control group that was not. Data sources included state and federal administrative data on Wisconsin SSDI recipients who were enrolled in BOPD. The study found no statistically significant differences between treatment and control group members on employment status, earnings, or reliance on benefits in the eight quarters of follow-up. The quality of the causal evidence presented in this study is high for results through the fifth quarter of follow-up, but moderate for subsequent periods because of high attrition in those periods. This means we would be confident that estimated impacts through the fifth quarter of follow-up were attributable to the BOPD and not other factors. However, the study found no such statistically significant impacts.","the Benefit Offset Pilot Demonstration","Disability insurance Other wages and benefits Supplemental security income (SSI)",Disability,,"United States",2010,http://www.ssa.gov/disabilityresearch/documents/WI%20SSDI-EP%20EVAL%20Final%207… "Employment and Earnings Growth Among Transition-Age Supplemental Security Income Program Participants","Berry, Hugh G., & Caplan, Leslie J. (2010). Employment and Earnings Growth Among Transition-Age Supplemental Security Income Program Participants. Journal of Disability Policy Studies, 21(152). Originally published online October 7, 2010.","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: The purpose of this study was to examine individual demographic, disability, and vocational rehabilitation (VR) service factors related to (1) employment status and (2) earnings growth for Supplemental Security Income (SSI) recipients who have participated in the VR program.  The VR program offered eligible people with disabilities services such as assessment, counseling and guidance, restoration, training, job development, and job placement to prepare for and obtain employment. The study merged administrative data from the Ticket Research File maintained by the Social Security Administration with data from the Case Service Report (RSA-911) database maintained by the U.S. Department of Education. Findings showed that SSI participants with mental retardation exhibited the highest odds of employment among other disability groups two years after exiting the VR program. College or university training and job placement services decreased the odds of employment, whereas supported employment demonstrated increased odds. For SSI participants with sustained employment, African American VR consumers showed higher earnings compared with other race groups. Among selected VR services, only college or university training was positively associated with earnings growth over time.","the Vocational Rehabilitation (VOC) Programs","Disability insurance Supplemental security income (SSI) Vocational rehabilitation",Disability,,"United States",2010, "A Scholarship Model for Student Recruitment and Retention in STEM Disciplines","Yelamarthi, K., & Mawasha, R. (2010). A Scholarship Model for Student Recruitment and Retention in STEM Disciplines. Journal of STEM Education, 11(5 & 6), 25–32.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: This paper evaluated the effects of the Computer Science, Engineering, and Mathematics Scholarship (CSEMS) program at Wright State University (WSU) on educational outcomes. The study used academic records from the university to compare educational outcomes of CSEMS participants and nonparticipants of similar background at the undergraduate and graduate levels. The study found that undergraduate program participants were more likely than traditional undergraduate students to secure a grade point average higher than 2.7. The quality of causal evidence presented in this study is low. This means we are not confident that the estimated effects are attributable to the CSEMS program. Other factors are likely to have contributed.","the Computer Science, Engineering, and Mathematics Scholarship (CSEMS) Program","Science, Technology, Engineering, and Math (STEM) programs Youth programs",Youth,,"United States",2010, "The Effectiveness of Institutional Intervention on Minimizing Demographic Inertia and Improving the Representation of Women Faculty in Higher Education","Bakian, A.V., & Sullivan, K.A. (2010). The Effectiveness of Institutional Intervention on Minimizing Demographic Inertia and Improving the Representation of Women Faculty in Higher Education. International Journal of Gender, Science and Technology, 2(2), 207-234.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: This study’s objective was to examine the effect of the ADVANCE program sponsored by the National Science Foundation (NSF) on women’s representation among tenured and tenure-track faculty. The study took place at one unnamed research university. The authors compared the transition probabilities (that is, the probabilities of being hired, retained, or promoted) for men and women, before and during the period ADVANCE was in effect. The study found that the ADVANCE program enhanced women’s representation among faculty in science and engineering departments. The quality of causal evidence presented in this study is low. This means we are not confident that the estimated effects are attributable to the ADVANCE program. Other factors are likely to have contributed.","the ADVANCE Program","Other disparities or discrimination in employment and earnings Science, Technology, Engineering, and Math (STEM) programs","Female, STEM professional",,"United States",2010, "Youth Transition Demonstration Project, City University of New York, Bronx, NY, Final Report.","The City University of New York. (2010). Youth Transition Demonstration Project, City University of New York, Bronx, NY, Final Report. New York: City University of New York.","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: This report described the Youth Transition Demonstration project implemented by the City University of New York. The project enrolled 400 youth ages 15 to 18 in the Bronx who had disabilities and were receiving Social Security Administration (SSA) benefits. The main components of the project were (1) a Saturday college program for youth and their parents, (2) provision of counseling on SSA benefits, (3) person-centered life and employment planning, (4) summer and after-school jobs, and (5) referrals to other services. The report described participants’ receipt of SSA benefits, employment and education outcomes, participants’ use of benefit advisement, and agency partnerships formed to implement the project.",,"Disability insurance Supplemental security income (SSI) Youth programs","Youth, Disability",,"United States",2010,http://www.google.com/url?sa=t&rct=j&q=&esrc=s&frm=1&source=web&cd=1&cad=rja&ua… "Simplification and saving","Beshears, J., Choi, J., Laibson, D., & Madrian, B. (2010). Simplification and saving. Cambridge, MA: National Bureau of Economic Research.","Behavioral Finance: Retirement","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employer benefits receipt-Low-Favorable impacts Employer benefits receipt","Summary: The study’s key objective was to examine the impact of Quick Enrollment, an option enabling individuals to more quickly and easily enroll in a retirement savings plan, on plan enrollment rates and contribution levels at two firms in the United States (companies A and B). The study also examined the impact of Easy Escalation, an option enabling individuals to quickly increase their retirement-plan contribution levels to a predetermined percentage of pay, on contribution rates. The analysis was based on data on enrollment in and contributions to retirement plans from Hewitt Associates, a benefits administration and consulting firm. The study used an interrupted time series (ITS) design, analyzing changes in outcomes before and after the implementation of Quick Enrollment or Easy Escalation. The study found that Quick Enrollment increased enrollment rates by 10 to 20 percentage points and that Easy Escalation increased the percentage of employees contributing to their savings plans at the higher, predetermined rate specified by Easy Escalation.  The quality of causal evidence presented in this report is low. This means we are not confident that the estimated effects are attributable to Quick Enrollment or Easy Escalation. Other factors are likely to have contributed to the changes in enrollment and contribution rates.","the Quick Enrollment and Easy Escalation","Employer provided retirement benefits",Employed,"Health care and social assistance, Manufacturing","United States",2010, "Client Predictors of Employment Outcomes in High-Fidelity Supported Employment: A Regression Analysis","Campbell, K., Bond, G. R., Drake, R. E., McHugo, G. J., & Xie, H. X. (2010, August). Client Predictors of Employment Outcomes in High-Fidelity Supported Employment: A Regression Analysis. Journal of Nervous and Mental Disease, 198(8).","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: In 15 rigorous evaluations, Individual Placement and Supprt (IPS) has demonstrated better competitive employment outcomes for people with severe mental illness (SMI) than day treatment or other traditional vocational rehabilitation approaches. Yet many clients do not obtain competitive employment, job tenure is usually short, and studies have provided little evidence for better targeting IPS. This study used in-group analysis of a large sample of IPS recipients to help predict competitive employment outcomes in these types of programs. The study combined data from four recent randomized controlled trials (all of which found IPS more effective than alternative approaches) to estimate the relationship between baseline characteristics and job acquisition and retention. Work history was the only statistically significant predictor of employment—a finding the authors said challenged the practice of labeling clients with certain clinical and background attributes as “high risk,” perhaps because IPS is designed to address such attributes. Among those who obtained employment, only receipt of Supplemental Security Income and Social Security Disability Insurance were associated with fewer total weeks worked. Based on this result and other recent studies, the authors suggest that, although IPS is the current best practice for helping people with SMI return to work, fear of losing disability payments and health care benefits are powerful disincentives to sustaining competitive employment. They conclude that helping people with SMI leave the disability roles would require changes in federal disability income support policies and insurance regulations.",,"Disability insurance Supplemental security income (SSI) Vocational rehabilitation",,,"United States",2010, "Do disability laws impair firm performance?","Bird, R., & Knopf, J. (2010). Do disability laws impair firm performance? American Business Law Journal, 47(1), 145-190.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Unfavorable impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the effect of state disability laws—those related to antidiscrimination and reasonable accommodation for employees with disabilities—on commercial banks’ number of full-time equivalent employees and their average salary. The authors estimated the impact of antidiscrimination and reasonable accommodation laws using a differences-in-differences regression model with state- and year-fixed effects. Data were obtained from the Federal Reserve Bank of Chicago’s Commercial Bank Database and from Global Insight. The study found that neither antidiscrimination nor reasonable accommodation laws had a statistically significant effect on bank employment levels during the year the law went into effect or during the subsequent three years. Antidiscrimination laws led to a statistically significant 1.3 percent decline in bank employees’ average salary in the third year after enactment, but not in any other time period. The quality of causal evidence presented in this report is low. This means we are not confident that the estimated effects are attributable to state disability laws. Other factors are likely to have contributed.","State Disability Laws","Americans with Disabilities Act (ADA)",Disability,"Finance and insurance","United States",2010, "A model for accelerating academic success of community college remedial English students: Is the Accelerated Learning Program (ALP) effective and affordable?","Jenkins, D., Speroni, C., Belfield, C., Jaggars, S., & Edgecombe, N. (2010). A model for accelerating academic success of community college remedial English students: Is the Accelerated Learning Program (ALP) effective and affordable? (CCRC Working Paper No. 21). New York: Columbia University, Community College Research Center.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Accelerated Learning Program (ALP) at the Community College of Baltimore County (CCBC) on success in college-level English courses (ENGL 101 and 102). In this program, students who otherwise would have taken a developmental English course instead took ENGL 101, as well as an eight-person companion course designed to help the students pass ENGL 101. This nonexperimental study used college administrative data to measure impacts on courses attempted and passed, student persistence, and credits accrued. Multivariate linear regressions were used to measure impacts. The study found that ALP students were significantly more likely to pass ENGL 101 and 102. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the ALP, but other factors might also have contributed.","the Accelerated Learning Program","Basic skills Community college education and other classroom training","Adult, Other barriers",,"United States",2010,http://files.eric.ed.gov/fulltext/ED512398.pdf "Learning communities for students in developmental reading: An impact study at Hillsborough Community College","Weiss, M., Visher, M., & Wathington, M. (2010). Learning communities for students in developmental reading: An impact study at Hillsborough Community College. New York: MDRC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of learning communities on credits earned, persistence, and course completion among students in need of developmental reading courses at Hillsborough Community College. This study was a randomized controlled trial that used student transcript data to compare the outcomes of treatment and control groups in the program semester and two subsequent semesters. The study found that students assigned to the learning community treatment group were more likely to enroll in and complete a college success course in the program semester than those in the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Learning Communities Demonstration at Hillsborough Community College, and not to other factors.","the Learning Communities Demonstration","Basic skills Community college education and other classroom training","Adult, Other barriers",,"United States",2010,http://files.eric.ed.gov/fulltext/ED510961.pdf "The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. [Texas ERA—Corpus Christi]","Hendra, R., Dillman, K-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [Texas ERA—Corpus Christi]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on welfare recipients’ employment and benefits receipt outcomes after four years. The Corpus Christi site was one of three in Texas that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,727 unemployed single-parent participants in Corpus Christi’s Temporary Assistance for Needy Families (TANF) program to either a treatment group that received ERA services or a control group that received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records and a survey administered 12 months after random assignment. The study found that, compared with the control group, those in the Corpus Christi ERA group were more likely to be employed at all or for four consecutive quarters in the fourth year after random assignment. Corpus Christi ERA group members also had higher earnings and received lower Food Stamps benefits. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to the ERA program and not to other factors.","the Employment Retention and Advancement project, Corpus Christi","Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States, Urban",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf "The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. [Texas ERA—Forth Worth]","Hendra, R., Dillman, K.-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [Texas ERA—Forth Worth]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on welfare recipients’ employment and benefits receipt outcomes after four years. The Fort Worth site was one of three in Texas that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,572 unemployed single-parent participants in Fort Worth’s Temporary Assistance for Needy Families (TANF) program to either a treatment group that received ERA services or a control group that received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records and a survey administered 12 months after random assignment. The study found that, compared with the control group, those in the Fort Worth ERA group received on average $162 more per year in Food Stamps across the first four years after random assignment. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to the ERA program and not to other factors.","the Employment Retention and Advancement project, Fort Worth","Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States, Urban",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf "The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. [Texas ERA—Houston]","Hendra, R., Dillman, K.-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [Texas ERA—Houston]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-Unfavorable impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on welfare recipients’ employment and benefits receipt outcomes after four years. The Houston site was one of three in Texas that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 2,032 unemployed single-parent participants in Houston’s Temporary Assistance for Needy Families (TANF) program to either a treatment group that received ERA services or a control group that received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records and a survey administered 12 months after random assignment. The study found that those in the Houston ERA group received on average $56 more per year in TANF benefits across the first four years after random assignment, compared with the control group. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to the ERA program and not to other factors.","the Employment Retention and Advancement project, Houston","Other employment and reemployment Unemployment Insurance","Parent, Low income",,"Urban, United States",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf "Reducing the gender achievement gap in college science: A classroom study of values affirmation","Miyake, A., Kost-Smith, L., Finkelstein, N., Pollock, S., Cohen, G., & Ito, T. (2010). Reducing the gender achievement gap in college science: A classroom study of values affirmation. Science, 330 (6008), 1234–1237.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to assess the effect of values affirmation on female students’ performance in an introductory college physics course. Students in the course were randomly assigned to either a treatment group, in which they completed a writing exercise affirming their personal values, or a control group, in which they described values that might be important to others. The authors collected exam scores and course grades for students in both study groups. The study found that, although male students’ exam scores remained higher than female students’ scores, the gender gap was significantly smaller for students in the values affirmation group than for students in the control group. The quality of causal evidence presented in this report is low because it was a randomized controlled trial with high attrition that did not control for background characteristics likely to have affected the outcomes of interest. This means we are not confident that the estimated effects are attributable to values affirmation; other factors are likely to have contributed.","Values Affirmation","Science, Technology, Engineering, and Math (STEM) programs Youth programs","Youth, Female",,"United States",2010, "The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models [Achieve—Cleveland]","Hendra, R., Dillman, K.-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [Achieve—Cleveland]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to determine the impact of a Cleveland, Ohio, program designed to increase employment retention among low-wage workers in the long-term nursing care industry. Cleveland was one of 16 sites nationwide to participate in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 44 firms to either a treatment group, whose employees could receive employment retention services through Cleveland Achieve, or a control group. The authors collected employment and earnings data from state Unemployment Insurance (UI) records. Three years after random assignment, the study found no statistically significant differences between the earnings and employment outcomes of employees in Achieve firms compared with employees in firms that did not have access to Achieve services. The quality of causal evidence provided in this study is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects would be attributable to the Achieve program, and not to other factors. However, the study found no statistically significant impacts.","the Employment Retention and Advancement project, Cleveland","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income",,"United States, Urban",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf "The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models [Chicago ERA]","Hendra, R., Dillman, K-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [Chicago ERA]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Unfavorable impacts Public benefit receipt","Summary: The study’s objective was to determine the effectiveness of a Chicago program to increase the earnings of Temporary Assistance for Needy Families (TANF) recipients. The Chicago site was one of 16 nationwide to participate in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,728 TANF recipients to either a treatment group, which received enhanced employment services, or a control group, which received benefits as usual. The authors collected employment and earnings data from Illinois Unemployment Insurance (UI) records over four follow-up years and Food Stamps and TANF receipt data from administrative records over three follow-up years. The study found that members of the treatment group received significantly less in average annual TANF benefits ($778 compared with $1,010 among control group members) but more in average annual Food Stamps ($4,111 compared with $3,959 among control group members). People in the ERA group were also more likely to be employed in the first year (69.7 percent) than people in the control group (66.2 percent). The quality of causal evidence provided in this study is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated impacts are attributable to the Chicago ERA program, and not to other factors.","the Employment Retention and Advancement project, Chicago","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income",,"United States, Urban",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf "The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models [Los Angeles EJC]","Hendra, R., Dillman, K.-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [Los Angeles EJC]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to gauge how a Los Angeles job club focused on participants’ career interests affected employment, earnings, and benefits receipt outcomes after about 36 months. The Los Angeles site was one of 16 nationwide to participate in the Employment Retention and Advancement (ERA) project. (See the CLEAR review of the interim report here.) The authors randomly assigned nearly 1,200 single-parent recipients of Temporary Assistance for Needy Families (TANF) to either a treatment group, which received Enhanced Job Club (EJC) services, or a control group, which received traditional job club (TJC) services. The authors collected employment and earnings data from Unemployment Insurance (UI) records and used automated TANF and food stamp databases to obtain benefits receipt information. Thirty-six months after random assignment, the study found no statistically significant differences between treatment and control group members’ employment, earnings, or benefits receipt. The quality of causal evidence provided in this study is high because it is based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects would be attributable to the EJC and not to other factors. However, the study found no statistically significant impacts.","the Employment Retention and Advancement project, Los Angeles’s Enhanced Job Club","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States, Urban",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf "Impact of learning communities in developmental English on community college student retention and persistence","Barnes, R., & Piland, W. (2010). Impact of learning communities in developmental English on community college student retention and persistence. Journal of College Student Retention: Research, Theory, & Practice, 12(1), 7-24.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: This study’s objective was to evaluate the effectiveness of learning communities as an alternative pedagogical format for students enrolled in developmental reading and English composition courses at an urban community college. The authors employed a quasi-experimental design to compare average retention and persistence rates of students enrolled in learning community developmental English courses with those of students enrolled in traditional developmental English courses in the same semester. The study found that retention rates were higher for students who enrolled in learning community developmental courses compared with their counterparts who took the same courses but in the traditional format. Furthermore, for the four semesters studied, learning community students were more likely to enroll in courses the following semester than were students who were not enrolled in learning communities.  The quality of causal evidence provided in this study is low because authors did not use sufficient controls in the analysis. This means we are not confident that the estimated effects are attributable to the learning communities. Other factors are likely to have contributed.","Learning Communities","Basic skills Community college education and other classroom training","Adult, Other barriers",,"United States, Urban",2010, "The impact of course delivery systems on student achievement and sense of community: A comparison of learning community versus stand-alone classroom settings in an open-enrollment inner city public community college","Bandyopadhyay, P. (2010). The impact of course delivery systems on student achievement and sense of community: A comparison of learning community versus stand-alone classroom settings in an open-enrollment inner city public community college (Doctoral dissertation). Retrieved from ProQuest Dissertations and Theses database. (UMI No. 3390450)","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Education and skills gains-Mod/high-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of a learning community on the retention of community college students enrolled in developmental reading and writing and a social science course at an open-enrollment inner city public community college in the United States. The author used a nonexperimental study design, analyzing school records of students enrolled in the highest level of developmental reading and writing and either a learning community or stand-alone version of one of two social science courses (Introduction to Psychology or Principles of Sociology). The study found no statistically significant difference in the fall 2008 to spring 2009 retention rates between the students in the learning community and the students in stand-alone courses. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we would be somewhat confident that any estimated effects would be attributable to the learning community. However, the study did not find statistically significant effects.","Learning Communities","Basic skills Community college education and other classroom training","Adult, Other barriers",,"United States, Urban",2010, "Persistence of women and minorities in STEM field majors: Is it the school that matters?","Griffith, A. (2010). Persistence of women and minorities in STEM field majors: Is it the school that matters? Economics of Education Review, 29, 911-922.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study examined institutional and student factors that had the greatest effect on students’ decisions to persist in STEM majors, emphasizing factors promoting STEM degree completion for female and minority students. The author analyzed STEM persistence to the fourth year of undergraduate study in two data sets: the 1988 National Education Longitudinal Study and the 1999 National Longitudinal Survey of Freshmen (NLSF). In each data set, the author separately examined factors that predicted STEM degree completion for male, female, minority, and nonminority students who indicated at matriculation that they intended to pursue STEM majors. Students’ academic backgrounds were most likely to predict persistence in STEM. For both women and minorities in both data sets, a higher ratio of first-year STEM grade point average to total first-year grade point average was associated with a statistically significantly higher probability of completing a STEM degree. For minority students in the NLSF sample, taking more STEM Advanced Placement courses in high school also promoted persistence in postsecondary STEM study. No institutional factors were statistically significant predictors of STEM degree completion for either women or minorities.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Other barriers, Female",,"United States",2010, "Gender differences in elements of the undergraduate experience that influence satisfaction with the engineering major and the intent to pursue engineering as a career","Amelink, C., & Creamer, E. (2010). Gender differences in elements of the undergraduate experience that influence satisfaction with the engineering major and the intent to pursue engineering as a career. Journal of Engineering Education, 99(1), 81-92.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The authors investigated aspects of the undergraduate college environment associated with satisfaction with engineering as a major and students’ intent to pursue a career in engineering in the next 10 years, emphasizing gender differences. The authors designed a comprehensive survey comprising sections on demographic information, factors affecting career choice, self-reported scientific ability, classroom experience, academic community, curricular and extracurricular engagement, and family and academic background. Participating institutions administered the survey to undergraduate engineering majors. After collecting the data, the authors examined correlations between a set of student, faculty, and general factors and satisfaction with the decision to major in engineering or intent to work as an engineer in 10 years. Although male and female students were equally likely to express satisfaction with their decision to major in engineering, significantly and substantially fewer female students expected to work in an engineering career in 10 years than male students. Similar factors were associated with male and female students’ intent to pursue a career in engineering. Perceptions of faculty engagement with students struck a notable contrast; higher levels of agreement with the statement “in general, engineering professors care about student learning” were significantly and positively correlated with female students’ interest in long-term engineering careers, but the correlation with male students’ career intent was not significant.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs",Youth,,"United States",2010, "Change the gender composition of high school computing courses (case study 2): Attracting females and minority students through targeted recruiting","Cohoon, J.M. (2010). Change the gender composition of high school computing courses (case study 2): Attracting females and minority students through targeted recruiting. Boulder, CO: National Center for Women & Information Technology.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study's objective was to describe several critical components to targeted recruitment for information technology courses, with a particular focus on the recruitment of girls and women. The author described the strategies used by one high school computer science teacher to increase the enrollment of girls in his Advanced Placement Computer Science course. The author then suggested several components that are necessary for any targeted recruitment strategy to be successful. The study recommended having a strategic recruiting plan that outlined the goal, partners, evaluation plan, and materials of the recruiting effort. The goal should be specific and quantifiable, and partnerships should be based on existing contacts who work with the target audience. The recruitment message should focus on the interests and concerns of the target audience, and should be conveyed in multiple ways and delivered through a credible source. The study summarized these recommendations in a recruiting quick list.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Female",,"United States",2010,http://www.ncwit.org/sites/default/files/resources/changegendercompositionhighs… "Climate for retention to graduation: A mixed methods investigation of student perceptions of engineering departments and programs","Wao, H., Lee, R., & Borman, K. (2010). Climate for retention to graduation: A mixed methods investigation of student perceptions of engineering departments and programs. Journal of Women and Minorities in Science and Engineering, 16(4), 293-317.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study's objective was to determine what characteristics of a college department (referred to as the climate) were conducive to retaining women and underrepresented minorities enrolled in an engineering program through graduation. The study took place at four engineering programs in Florida universities during the 2007–2008 academic year. The authors administered a Likert scale survey to a convenience sample of undergraduate students enrolled in engineering programs that measured nine aspects of the department’s climate (for example, faculty involvement or support, diversity, and student integration with department) as well as the student’s intent to leave the program. The authors then used regression analysis to determine which of the nine aspects of climate predicted a student’s intent to leave the program. In-person interviews and six focus groups supplemented survey findings. The study found that the aspects of college department climate predictive of a student’s intent to leave the program were institutional support (or the level of support and services provided by the institution to help students succeed), social and academic fit (or how well the student felt he or she was a part of the department), and personal agency and peer support (or one’s own involvement in the learning process and a peer atmosphere that encouraged success). There were no statistically significant differences in findings by gender or ethnicity, although interview and focus group data point toward complexities in how women and minorities experienced climate, suggesting that they might be more inclined than majority groups to rely on social support and fit than institutional support.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Other barriers, Female",,"United States",2010, "Why so few? Women in science, technology, engineering, and mathematics","Hill, C., Corbett, C., & St. Rose, A. (2010). Why so few? Women in science, technology, engineering, and mathematics. Washington, D.C.: American Association of University Women.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: This publication summarized the obstacles facing girls and women who wish to pursue academic or professional careers in STEM fields and highlighted solutions to these challenges at the secondary, postsecondary, and professional levels. The authors presented scholars’ investigations into issues surrounding gender differences in interest, retention, or careers in STEM, drawing on both interviews with the profiled scholars and their published studies. The paper concluded that bias and stereotypes, whether implicit or explicit, hindered girls’ development in STEM. According to the paper, promoting the idea that intelligence is not fixed and innate but can expand through hard work, dubbed the growth mindset, combats the notion that boys are inherently better at math and science than girls and encourages girls to persevere. Further, women in academic and industry STEM positions continued to suffer from bias and stereotypes, which can manifest themselves through unsupportive atmospheres or distorted perceptions of female employees’ competence. Clear standards for advancement can counteract some of these tendencies.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs Other disparities or discrimination in employment and earnings","Youth, Female",,"United States",2010,http://www.aauw.org/files/2013/02/Why-So-Few-Women-in-Science-Technology-Engine… "Women in the academy: Female leadership in STEM education and the evolution of a mentoring web","Gorman, S., Durmowicz, M., Roskes, E., & Slattery, S. (2010). Women in the academy: Female leadership in STEM education and the evolution of a mentoring web. Forum on Public Policy Online, 2010(2), 1-21.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The authors described the Stevenson University School of the Sciences in Maryland as an example of an academic institution that deviated widely from the norm of female under-representation in STEM departments, not only among enrolled students but among faculty members and departmental leadership. They proposed several institutional mechanisms for this unusual success, including mentoring programs for several groups: academic leadership, faculty seeking promotion, new faculty, and students. At the time of publication, two School of the Sciences faculty members had applied for promotion under the Faculty Mentoring and Evaluation Committee system, a formalized mentoring structure through which each faculty member received support and professional guidance from a mentor group comprising the mentee’s department chair and at least two faculty peers, one from outside the department. Both faculty members were successful. Preliminary assessments of student mentoring programs that paired freshman biology or chemistry majors with upper-class students in their department suggest that participation augmented both mentors’ and mentees’ sense of community, support, and encouragement. In some cases, the program also promoted retention in the discipline.",,"Youth programs Mentoring Science, Technology, Engineering, and Math (STEM) programs","Youth, Female",,"United States",2010, "The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models [VISION—Salem, OR]","Hendra, R., Dillman, K.-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [VISION—Salem, OR]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on Temporary Assistance for Needy Families (TANF) recipients’ employment and benefits receipt outcomes after three years. The Salem site was one of several across the United States that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,504 single parents eligible for welfare-to-work programs to either a treatment group that received Valuing Individual Success and Increasing Opportunities Now (VISION) services or to a control group that received the state’s typical welfare-to-work program. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records and a survey administered 12 months after random assignment. The study found that those in the VISION group were 6.7 percentage points more likely than those in the control group to have received TANF benefits at any point during the first follow-up year. The VISION group also received, on average, $298 more in annual TANF benefits during the first three follow-up years, compared with the control group. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to the Salem ERA program and not to other factors.","the Salem Valuing Individual Success and Increasing Opportunities Now (VISION) Program","Other employment and reemployment Unemployment Insurance Job search assistance and supportive services","Low income, Parent",,"United States",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf "The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models [RFS-Los Angeles]","Hendra, R., Dillman, K.-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [RFS-Los Angeles]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of individualized and flexible post-employment job supports on employed welfare recipients’ employment and benefits receipt outcomes after three years. The Los Angeles Reach for Success (RFS) site was one of two in Los Angeles that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 5,700 employed single-parent participants in Los Angeles’s Temporary Assistance for Needy Families (TANF) program who were working full-time to either a treatment group that received RFS services or to a control group that received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records and surveys administered 12 and 42 months after random assignment. The study found that, 12 to 42 months after random assignment, RFS group members’ employment, earnings, and benefits receipt did not differ significantly from those of control group members. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we are confident that any estimated effects would be attributable to Los Angeles’ RFS and not to other factors. However, the study did not find statistically significant effects.","Reach for Success (RFS)","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States, Urban",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf "The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models [Training Focused and Work Plus—Riverside, California]","Hendra, R., Dillman, K.-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [Training Focused and Work Plus—Riverside, California]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of post-employment job supports and intensive case management on welfare recipients’ employment and benefits receipt outcomes after four years. The Riverside Phase 2 site was one of two in Riverside, California, that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 3,029 employed single-parent participants in Riverside’s Temporary Assistance for Needy Families (TANF) program to one of two treatment groups (Work Plus and Training Focused) that received differing ERA services or to a control group that received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records and a survey administered 12 months after random assignment. The study found that, compared with the control group, those in the Riverside Work Plus group were 3.2 percentage points more likely to have received Food Stamps in the first year after random assignment. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to the Riverside Work Plus program and not to other factors.","the Employment Retention and Advancement Project—Work Plus and Training Focused (Phase 2), Riverside","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income",,"United States",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf "Anne Arundel County juvenile treatment court outcome and cost evaluation","Mackin, J., Lucas, L., Waller, M., Carey, S., & Finigan, M. (2010). Anne Arundel County juvenile treatment court outcome and cost evaluation. Portland OR: NPC Research.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence",,"Summary: The study’s objective was to examine the impact of a juvenile treatment court in Anne Arundel County, Maryland, on recidivism. The authors used a nonexperimental design, matching youth who participated in the juvenile treatment court with similar court-involved youth who did not participate in the juvenile treatment court. The authors used administrative data to compare the mean number of juvenile rearrests for the study groups over a two-year follow-up period. The study found that 53 percent of the treatment court group, compared with 73 percent of the comparison group, had a juvenile rearrest within 24 months. The study also found differences of a similar magnitude at three intermediate follow-ups (6-, 12-, and 18-month follow-ups). The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the juvenile treatment court, but other factors might also have contributed.","Anne Arundel Juvenile Treatment Court","Other training and education Substance abuse recovery Youth programs Behavioral Interventions","Youth, Justice-involved, Disconnected youth",,"United States",2010,http://www.courts.state.md.us/opsc/dtc/pdfs/evaluationsreports/annearundelcount… "Baltimore County Juvenile Drug Court outcome and cost evaluation","Mackin, J., Lucas, L., Lambarth, C., Herrera, T., Waller, M., Carey, S., & Finigan, M. (2010). Baltimore County Juvenile Drug Court outcome and cost evaluation. Portland, OR: NPC Research.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence",,"Summary: The study examined the impact of participation in the Baltimore County Juvenile Drug Court on drug use and recidivism. The authors used a nonexperimental design, matching youth who participated in the juvenile drug court with a comparison group of similar youth who were eligible to participate in juvenile drug court, but instead participated in the traditional juvenile justice system. The authors used administrative data to compare the mean number of juvenile rearrests over a two-year follow-up period. The study found that drug court participants had significantly fewer juvenile rearrests, both overall and specifically for drug charges, than comparison youth. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the Baltimore County Juvenile Drug Court, but other factors might also have contributed.","the Baltimore County Juvenile Drug Court","Substance abuse recovery Youth programs","Youth, Disability, Disconnected youth",,"United States",2010,http://www.ndcrc.org/sites/default/files/baltimore_co_juv_dc_outcome-cost_0110… "Veterans Health Administration transitional work experience vs. job placement in veterans with co-morbid substance use and non-psychotic psychiatric disorders","Penk, W., Drebing, C. E., Rosenheck, R, A., Krebs, C., Van Ormer, A., & Mueller, L. (2010). Veterans Health Administration transitional work experience vs. job placement in veterans with co-morbid substance use and non-psychotic psychiatric disorders. Psychiatric Rehabilitation Journal, 33(4), 297-307.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Veterans Health Administration (VHA) Transitional Work Experience (TWE) program on employment and income for veterans with substance abuse and non-psychotic psychiatric disorders, compared with job placement (JP) services only. The study was a randomized controlled trial carried out at one VHA medical center site over four years. Eligible veterans were randomly assigned to either the treatment group, which could participate in the TWE program, or to the control group, which could not participate in TWE but could receive JP services. The authors used data from participant surveys to measure impacts. The study found that members of the treatment group worked significantly more hours in paid employment (including employment sponsored by the TWE program itself) and significantly more total weeks in paid employment, compared with the control group. The study also found that the treatment group earned significantly higher total income for the year (including noncompetitive TWE employment income) than the control group. The quality of causal evidence presented in this report is low because the authors did not provide enough information to calculate attrition and did not include sufficient controls in their analysis to establish that treatment and control groups were similar on observable characteristics at baseline for the analytic sample. This means we are not confident that the estimated effects are attributable to TWE. Other factors are likely to have contributed.","the Transitional Work Experience (TWE) Program","Vocational rehabilitation Veterans' reemployment","Disability, Veteran or military",,"United States",2010, "The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models [PROGRESS—Eugene]","Hendra, R., Dillman, K-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [PROGRESS—Eugene]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of post-employment job supports on former welfare recipients’ employment and benefits receipt outcomes after three years. The Eugene site was one of four in Oregon that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,179 employed single parents who were former Temporary Assistance for Needy Families (TANF) program participants to either a treatment group that received employment retention services from Eugene’s Progress Towards Retention, Opportunities, Growth, Enhancement and Self-Sufficiency (PROGRESS) program or a control group that could participate in other employment-related programs in the community. The authors analyzed data from Unemployment Insurance (UI), Temporary Assistance for Needy Families (TANF), and Food Stamps administrative records and a survey administered 12 months after random assignment. The study found that those in the PROGRESS group were 7 percentage points less likely than control group members to be employed in the third year after random assignment and 6.6 percentage points less likely to have been employed in every quarter of that year. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to the Eugene ERA program and not to other factors.","the Employment Retention and Advancement Project, Eugene","Other employment and reemployment Unemployment Insurance","Employed, Low income, Parent",,"United States",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf "The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models [TAAG—Medford]","Hendra, R., Dillman, K-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [TAAG—Medford]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of post-employment job supports on former and current public assistance recipients’ employment and benefits receipt outcomes after three years. The Medford site was one of four in Oregon that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,164 employed single parents who were former or current public assistance recipients to either a treatment group that received services from Medford’s ERA project (Transition, Advancement, and Growth, or TAAG), or a control group that could participate in other programs in the community. The authors analyzed data from Unemployment Insurance (UI), Temporary Assistance for Needy Families (TANF), and Food Stamps administrative records and a survey administered 12 months after random assignment. The study found that those assigned to the Medford ERA project earned, on average, $41 more per week when surveyed one year after random assignment than those in the control group. However, treatment group members were also 6.7 percentage points more likely to have ever received Food Stamps at the three-year follow-up than those in the control group. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to the Medford ERA project and not to other factors.","the Employment Retention and Advancement Project, Medford","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent, Employed",,"United States",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf "The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models [Moving Up—South Carolina]","Hendra, R., Dillman, K-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [Moving Up—South Carolina]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on former welfare recipients’ employment and benefits receipt outcomes after four years. The South Carolina site was one of 16 sites nationwide that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 2,776 single parents who had left the Temporary Assistance for Needy Families (TANF) program in the past three years to either a treatment group that received ERA services or a control group that could participate in other employment-related programs in the community. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records and a survey administered 12 months after random assignment. The study did not find any statistically significant effects on earnings, employment, or benefits receipt one to four years after random assignment. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we are confident that any estimated effects would be attributable to the South Carolina ERA project and not to other factors. However, the study did not find statistically significant effects.","the Employment Retention and Advancement Project, South Carolina","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf "Work after prison: One-year findings from the Transitional Jobs Reentry Demonstration","Redcross, C., Bloom, D., Jacobs, E., Manno, M., Muller-Ravett, S., Seefeldt, D., Yahner, J., Young Jr., A., & Zweig, J. (2010). Work after prison: One-year findings from the Transitional Jobs Reentry Demonstration. New York: MDRC.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Transitional Jobs Reentry Demonstration (TJRD) on ex-offenders’ employment and wages. The study used a randomized controlled trial to assign former prisoners to either the transitional jobs program or to a control group that was offered job search assistance. The authors compared the two groups’ employment and earnings outcomes one year after random assignment, controlling for participants’ characteristics before random assignment. The study found that members of the transitional jobs group were 8.6 percentage points more likely than control group members to be employed during all four quarters of the year after random assignment, but 8.9 percentage points less likely to have unsubsidized employment during the year after random assignment. Transitional jobs group members’ total earnings from all jobs were $1,419 higher, on average, than those of control group members during the year after random assignment, but their total earnings from unsubsidized jobs were $625 lower. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the TJRD, and not to other factors.","the Transitional Jobs Reentry Demonstration (TJRD)","Job search assistance and supportive services Other employment and reemployment Reentry","Justice-involved, Male, Low income",,"United States",2010,http://files.eric.ed.gov/fulltext/ED514698.pdf "St. Mary’s County juvenile drug court outcome and cost evaluation","Mackin, J., Lucas, L., Lambarth, C., Waller, M., Herrera, A., Carey, S., & Finigan, M. (2010). St. Mary’s County juvenile drug court outcome and cost evaluation. Portland, OR: NPC Research.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence",,"Summary: The study’s objective was to examine the impact of participation in a juvenile drug court program in St. Mary’s County, Oregon, on recidivism. The study used administrative data from the departments of Juvenile Services, Public Safety and Correctional Services, and Health and Mental Hygiene to compare outcomes of youth who participated in juvenile drug court with outcomes from a group of similar, drug court-eligible youth who did not participate. The study found no statistically significant effects on recidivism, including total number of rearrests, rearrests for drug charges, and rearrest rates over a two-year period. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we would be somewhat confident that any estimated effects would be attributable to participation in the juvenile drug court, but other factors might also have contributed. However, the study did not find any statistically significant effects.","St. Mary's County Juvenile Drug Court","Substance abuse recovery Youth programs Behavioral Interventions","Youth, Justice-involved, Disconnected youth",,"United States",2010,http://www.courts.state.md.us/opsc/dtc/pdfs/evaluationsreports/stmaryscountyjuv… "Reentry experiences of confined juvenile offenders: Characteristics, service receipt and outcomes of juvenile male participants in the SVORI multi-site evaluation. The multi-site evaluation of the Serious and Violent Offender Reentry Initiative.","Hawkins, S., Lattimore, P., Dawes, D., & Visher, C. (2010). Reentry experiences of confined juvenile offenders: Characteristics, service receipt and outcomes of juvenile male participants in the SVORI multi-site evaluation. The multi-site evaluation of the Serious and Violent Offender Reentry Initiative. NCJ 230423. Research Triangle Park, NC: RTI.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Education and skills gains-Mod/high-Mixed impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment","Summary: The study examined the impact of the Serious and Violent Offender Reentry Initiative (SVORI) on employment, education, and recidivism among juvenile incarcerated males. The study used propensity scores to match participants in SVORI to nonparticipants who were similar on observed characteristics. The study used data from interviews collected at multiple time points through 15 months after release. The study found that SVORI participants were more likely than nonparticipants to be enrolled in school 3 months post-release (68 and 52 percent, respectively) and were more likely than nonparticipants to have a job with benefits 15 months post-release (69 and 40 percent, respectively). The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the SVORI program, but other factors might also have contributed.","Serious and Violent Offender Reentry Initiative (SVORI)","Other employment and reemployment Other health and safety Reentry Substance abuse recovery Youth programs","Youth, Justice-involved, Disconnected youth, Male",,"United States",2010,https://www.ncjrs.gov/pdffiles1/nij/grants/230423.pdf "Toward reduced poverty across generations: Early findings from New York City’s conditional cash transfer program","Riccio, J., Dechausay, N., Greenberg, D., Miller, C., Rucks, Z., and Verma, N. (2010). Toward reduced poverty across generations: Early findings from New York City’s conditional cash transfer program. New York: MDRC.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of Family Rewards, an experimental privately funded conditional cash transfer program in New York City, on earnings, employment, public benefits receipt, and education. The study was based on a randomized controlled trial and estimated the effect of the Family Rewards program on low-income families. The authors used New York City and New York State administrative data to compare average outcomes among those offered access to the program against the average outcomes of those excluded, after adjusting for chance initial differences between the groups. The study found that, on average, the Family Rewards program decreased the likelihood of ever being employed at a job covered by unemployment insurance (UI) in the first year. However, the Family Rewards program increased the likelihood of being employed at a job not covered by UI after 18 months, total monthly income after 18 months, and the likelihood that adult recipients had received an associate’s degree after 18 months. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Family Rewards program, and not to other factors.","the Family Rewards Program","Other employment and reemployment Other training and education Unemployment Insurance","Unemployed, Low income, Parent",,"United States",2010,http://www.mdrc.org/sites/default/files/FamRewards2010ONYC%20FULL%20Report%20RE… "Microenterprise options for people with intellectual and developmental disabilities: An outcome evaluation.","Conroy, J., Ferris, C., & Irvine, R. (2010). Microenterprise options for people with intellectual and developmental disabilities: An outcome evaluation. Journal of Policy and Practice in Intellectual Disabilities, 7(4), 269-277.","Entrepreneurship and Self-Employment","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Mixed impacts Earnings and wages Education and skills gains-Low-No impacts Education and skills gains Employment-Low-Mixed impacts Employment","Summary: The study’s objective was to examine the impact of a microenterprise intervention from Network180, an agency serving people with intellectual and developmental disabilities, on employment, earnings, and education of 27 people with disabilities. The study defined microenterprise as a very small business, employing 10 or fewer people, with start-up costs less than $500. As part of the intervention, vocational staff at Network180 provided information about microenterprises to people already receiving services at Network180. Staff supported those interested in microenterprises with tasks such as small business loans and talking to community stakeholders. The authors used a pre-post design, collecting survey data measuring hours worked and earnings from several types of employment, as well as the number of hours spent on educational activities, before and after participation in the intervention. Data were collected at one point in time; respondents were asked to estimate pre-intervention data from memory. The authors summed the reported outcomes for all 27 participants and performed statistical tests on the totals rather than the means of each outcome. The study found that hours spent per week engaged in self-employment, as well as earnings from self-employment, were significantly higher after the intervention than before it. In contrast, earnings and weekly hours spent in sheltered or workshop employment decreased significantly after the intervention, compared with before it. There were no significant differences before or after the intervention on hours spent on educational activities.","Network180 microenterprise intervention","Other training and education",Disability,"Small business","United States",2010, "The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. [PASS - Riverside]","Hendra, R., Dillman, K.-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [PASS - Riverside]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of post-employment job supports and supportive services on recent welfare recipients’ employment and benefits receipt outcomes after four years. The Riverside Post-Assistance Self-Sufficiency (PASS) site was one of two in Riverside, California, that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 2,770 employed single parents who had recently left the Temporary Assistance for Needy Families (TANF) program to either a treatment group that received ERA services or a control group that could participate in other employment-related programs in the community. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records and surveys administered 12 and 42 months after random assignment. The study found that individuals assigned to the Riverside PASS ERA program had significantly higher earnings in the first and fourth years after random assignment and were more likely to be employed in every quarter of the fourth year, compared with those in the control group. The quality of causal evidence provided in this study is high for most outcomes because it was based on a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to the Riverside PASS ERA program and not to other factors. However, the study receives a moderate causal evidence rating for outcomes from the 12-month survey because that data source had high attrition, yet the analysis included adequate statistical controls to correct for resulting imbalance.","the Employment Retention and Advancement Project, Riverside Post-Assistance Self-Sufficiency (PASS) Program","Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States",2010,http://www.acf.hhs.gov/sites/default/files/opre/era_core.pdf "Working toward Wellness: Telephone care management for Medicaid recipients with depression, eighteen months after random assignment.","Kim, S., LeBlanc, A., Morris, P., Simon, G., & Walter, J. (2010). Working toward Wellness: Telephone care management for Medicaid recipients with depression, eighteen months after random assignment. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine the impacts of a telephone care management program, Working toward Wellness (WtW), on low-income depressed parents’ employment and earnings. The study used a randomized controlled trial design, assigning eligible parents to either the WtW program or existing services. Authors used data from an 18-month follow-up survey to estimate program impacts, adjusting for sample members’ characteristics before random assignment. The study did not find any statistically significant effects of the WtW program on employment or earnings. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects would be attributable to WtW and not to other factors. However, the study did not find statistically significant effects.","Working toward Wellness (WtW)","Other employment and reemployment","Low income, Parent",,"United States",2010,http://www.acf.hhs.gov/sites/default/files/opre/telephone_care.pdf "Sustained earnings gains for residents in a public housing jobs program: Seven-year findings from the Jobs-Plus demonstration.","Riccio, J. (2010). Sustained earnings gains for residents in a public housing jobs program: Seven-year findings from the Jobs-Plus demonstration. MDRC policy brief. New York: MDRC.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages","Summary: The study’s objective was to examine the impact of the Jobs-Plus program on the long-term earnings of residents in housing developments in three cities in the United States. The study was a randomized controlled trial that used data from administrative records to compare outcomes between treatment and control group members seven years after random assignment. The study did not find any statistically significant effects of Jobs-Plus on earnings. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects would be attributable to Jobs-Plus and not to other factors. However, the study did not find statistically significant effects.","the Jobs-Plus Community Revitalization Initiative for Public Housing Families (Jobs-Plus) Program","Other employment and reemployment","Low income",,"United States",2010,http://www.mdrc.org/sites/default/files/policybrief_33.pdf "Rapid employment model evaluation: Update #2","Smith, T. C., King, C. T., & Schroeder, D. G. (2010). Rapid employment model evaluation: Update #2. Austin, TX: Ray Marshall Center for the Study of Human Resources.",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Unfavorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Unfavorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Rapid Employment Model (REM) program on participants’ employment, earnings, and Unemployment Insurance (UI) benefit claims. (See the CLEAR review of the 2008 report here.) Using program data and state UI records, the authors matched treatment to comparison group cases and conducted regression analyses to estimate the effect of the intervention. The study found that participation in the REM program was associated with an increase in the likelihood that jobseekers were employed in the 10 quarters following program participation among the 2006 cohort. Participation in the REM program was also associated with an increase in the likelihood that jobseekers were employed, a decrease in quarterly earnings, and an increase in the likelihood jobseekers filed UI claims in the six quarters following program participation among the 2007 cohort. The quality of causal evidence presented in this report is moderate for earnings outcomes in both cohorts and for employment outcomes for the 2006 cohort because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects on employment and earnings are attributable to the REM program, but other factors might also have contributed. The quality of causal evidence presented for the UI benefit claiming outcome for both cohorts and the employment outcome for the 2007 cohort is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects on UI benefit claiming outcome are attributable to the REM program; other factors are likely to have contributed.","Rapid Employment Model (REM) Program","Job search assistance and supportive services Other training and education Unemployment Insurance","Justice-involved, Low-skilled, Low income",,"United States",2010,http://raymarshallcenter.org/files/2006/01/REM_eval_update_Jan2010.pdf "Effect of job skills training on employment and job seeking behaviors in an American Indian substance abuse treatment sample.","Foley, K., Pallas, D., Forcehimes, A., Houck, J., Bogenschutz, M., Keyser-Marcus, L., & Svikis, D. (2010). Effect of job skills training on employment and job seeking behaviors in an American Indian substance abuse treatment sample. Journal of Vocational Rehabilitation, 33(2010), 181-192.","Job Search Assistance","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Unfavorable impacts Education and skills gains Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine the impact of workshops for job seekers on employment and training outcomes. The study used a randomized controlled trial (RCT) design, in which eligible participants were randomly assigned to the treatment group, which could participate in the job seeker workshops, or the control group, which could not participate. The authors used follow-up surveys three and six months after random assignment to measure self-reported employment and training outcomes. The study found that three months after workshop participation, the treatment group spent fewer hours on training activities than the control group; the study did not find any significant impacts of the job seekers’ workshop on the number of hours spent on work or percentage of each group who were employed at the three-month follow-up. The quality of causal evidence presented in this report is high for the percentage employed and hours spent on work and training outcomes collected at the three-month follow-up because those outcomes were based on a well-implemented RCT with low attrition. This means we are confident that the estimated effects are attributable to the job seekers’ workshop, and not to other factors. However, the quality of causal evidence presented in this report is low for the days to employment outcomes at the three-month follow-up and all outcomes at the six-month follow-up. This means we are not confident that the estimated effects are attributable to the job seekers’ workshop; other factors are likely to have contributed.","Job Seekers’ Workshop","Job search assistance and supportive services","Other barriers, Unemployed, American Indian or Alaska Native",,"United States",2010, "Do temporary-help jobs improve labor market outcomes for low-skilled workers? Evidence from “Work First”.","Autor, D. H., & Houseman, S. N. (2010). Do temporary-help jobs improve labor market outcomes for low-skilled workers? Evidence from “Work First”. American Economic Journal: Applied Economics, 2(3), 96–128.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of temporary-help and direct-hire jobs through the Work First program (a welfare-to-work program) on the earnings and employment of low-skilled workers in Detroit. The authors use a nonexperimental design that uses key features of the Work First program to compare the employment and earnings of participants placed in temporary- or permanent-hire positions. Work First program participants are assigned to different local contractors in their district on a rotating basis. The contractors assist participants with job placement, but vary the emphasis they place on temporary-hire or direct-hire positions; the authors use this variation across contractors to compare the employment and earnings of participants in different types of job placement. The study found that the average employment probability and quarterly earnings of those who found a direct-hire job increased significantly in the eight quarters following program participation compared with that of those who found a temporary-help job. The quality of causal evidence presented in this report is moderate because it is based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to temporary-hire and direct-hire job placements, but other factors might also have contributed.","the Work First Program","Job search assistance and supportive services Unemployment Insurance","Low income",,"United States",2010, "Child education and work choices in the presence of a conditional cash transfer programme in rural Colombia","Attanasio, O., Fitzsimons, E., Gomez, A., Gutierrez, M. I., Meghir, C., & Mesnard, A. (2010). Child education and work choices in the presence of a conditional cash transfer programme in rural Colombia. Economic Development and Cultural Change, 58(2), 181-210. doi:10.1086/648188.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The objective of this study was to examine the impact of the conditional cash transfer program, Familias en Acción, on children’s work and school participation in Columbia. The study used a nonexperimental design to compare labor and schooling outcomes of children who received the conditional cash transfer with a comparison group of children who did not, based on data from a survey. The study found that receipt of the cash transfer was significantly associated with a decrease in the likelihood of participating in domestic work for urban children aged 10 to 17, a decrease in the hours spent in income-generating work for urban children aged 14 to 17, and a decrease in the hours spent in domestic work for all but rural children aged 14 to 17. Receipt of the cash transfer was also significantly related to an increase in the hours spent in school for all children in urban and rural areas. The quality of causal evidence presented in the study is low because the authors did not control for pre-intervention outcomes. This means we are not confident that the estimated effects are attributable to the Familias en Acción program; other factors are likely to have contributed.","Familias en Acción","Child labor","Other, Low income",,"International, Rural",2010,http://openaccess.city.ac.uk/5381/1/Child_Education.pdf "Reducing child labour through conditional cash transfers: Evidence from Nicaragua's Red de Protección Social","Gee, K.A. (2010). Reducing child labour through conditional cash transfers: Evidence from Nicaragua's Red de Protección Social. Development Policy Review, 28(6), 711-732.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor","Summary: The study’s objective was to examine the impact of a conditional cash transfer program, Red de Protección Social (RPS), in Nicaragua on child labor outcomes for children who are working. The study was an expansion of an earlier randomized controlled trial (RCT). The author used survey data from the RCT taken before the program started (2000) and two years after (2002) to examine the probability and duration of child work. The study found that the receipt of the cash transfer significantly reduced the probability that a child would work by approximately 10.6 percent and, for a child that was working, significantly reduced the hours worked per week by approximately 3.65 hours, on average. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Red de Protección Social program, and not to other factors.","Red de Protección Social (RPS)","Child labor","Other, Low income",,"International, Rural",2010, "The impact of conditional cash transfer program on human capital formation in Brazil","Helfand, S.M., & Souza, A.P. (2010). The impact of conditional cash transfer program on human capital formation in Brazil. University of California, Riverside, CA: Sao Paulo School of Economics.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-No impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to analyze the impact of Brazil’s Bolsa Escola program on school enrollment, school progression, and child labor for children ages 6 to 15 in rural areas. Using data from the 2001 and 2003 Brazilian Census, the authors used a structural model to examine the average program impact of the Bolsa Escola program. The study found that the Bolsa Escola program was significantly associated with an increase in school enrollment and school progression. However, the study did not find a statistically significant relationship between program participation and child labor. The quality of causal evidence presented in the study is low because the authors did not control for pre-intervention outcomes. This means we are not confident that the estimated effects are attributable to the Bolsa Escola program; other factors are likely to have contributed.","Bolsa Escola","Child labor","Other, Low income",,International,2010, "The impact of conditional cash transfer programs on household work decisions in Brazil","Ferro, A. R., Lúcia Kassouf, A., & Levison, D. (2010). The impact of conditional cash transfer programs on household work decisions in Brazil. In R. K. Akee, E. V. Edmonds, & K. Tatsiramos (Eds.), Child Labor and the Transition between School and Work (pp. 193-218). Bingley, UK: Emerald Publishing Limited.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The purpose of the study was to examine the impact of the Bolsa Escola program, which provided conditional cash transfers to families in Brazil, on child labor and school enrollment. The authors used a nonexperimental matched comparison group design to compare the outcomes of children ages 6-15 that received the conditional cash transfers with those who had applied but who had not received it (waitlisted families), based on data from Brazil’s national household survey. The study found that receipt of the Bolsa Escola benefit was significantly related to higher rates of school enrollment and lower rates of child labor. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Bolsa Escola program; other factors are likely to have contributed.","Bolsa Escola","Child labor","Other, Low income",,International,2010,http://www.anpec.org.br/encontro2009/inscricao.on/arquivos/000-dde4869521f17def… "Does prison-based adult basic education improve postrelease outcomes for male prisoners in Florida?","Cho, R. M., & Tyler, J. H. (2010). Does prison-based adult basic education improve postrelease outcomes for male prisoners in Florida? Crime & Delinquency, 59(7), 975-1005. [Comparison 1: completion of adult basic education course vs. involuntary dropout of adult basic education course.]",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study examined the impact of prison-based adult basic education courses on post-release employment and earnings for incarcerated people who read below the 9th-grade level. The authors also investigated similar research questions for other contrasts, the profiles of which are available here. The authors used a statistical model to compare outcomes for treatment and comparison group members, drawing on data from the Florida Department of Corrections, the Florida Department of Law Enforcement, and the Florida Education and Training Placement Information Program. The study found statistically significant relationships between completing an adult basic education course and post-release employment, where those who completed an adult basic education course tended to have higher employment rates after release from incarceration than did those who dropped out of adult basic education. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the completion of an adult basic education course; other factors are likely to have contributed.","Adult basic education","Basic skills Reentry","Justice-involved, Male",,"United States",2010,https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4288462/ "Does prison-based adult basic education improve postrelease outcomes for male prisoners in Florida?","Cho, R. M., & Tyler, J. H. (2010). Does prison-based adult basic education improve postrelease outcomes for male prisoners in Florida? Crime & Delinquency, 59(7), 975-1005. [Comparison #2: completion of adult basic education vs. no participation in adult basic education.]",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Unfavorable impacts Earnings and wages Employment-Low-Mixed impacts Employment","Summary: The study examined the impact of prison-based adult basic education courses on post-release employment, earnings, and recidivism for incarcerated people who read below the 9th-grade level. The authors also investigated similar research questions for other contrasts, the profiles of which are available here. The authors used a statistical model to compare outcomes for treatment and comparison group members, drawing on data from the Florida Department of Corrections, The Florida Department of Law Enforcement, and the Florida Education and Training Placement Information Program. The study found statistically significant relationships between completing an adult basic education course and post-release earnings and employment, where those who completed adult basic education tended to have lower earnings and lower employment over the full study period, but higher employment in the first year after release compared than did those who did not participate in adult basic education while incarcerated. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups compared were similar before the intervention. This means we are not confident that the estimated relationships are attributable to the completion of an adult basic education course; other factors are likely to have contributed.","Adult basic education","Basic skills Reentry","Justice-involved, Male",,"United States",2010,https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4288462/ "Does prison-based adult basic education improve postrelease outcomes for male prisoners in Florida?","Cho, R. M., & Tyler, J. H. (2010). Does prison-based adult basic education improve postrelease outcomes for male prisoners in Florida? Crime & Delinquency, 59(7), 975-1005. [Comparison 3: participation in adult basic education vs. involuntary dropout of adult basic education.]",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study examined the impact of prison-based adult basic education courses on post-release employment and earnings for incarcerated people who read below the 9th-grade level. The authors also investigated similar research questions for other contrasts, the profiles of which are available here. The authors used a statistical model to compare outcomes for treatment and comparison group members, drawing on data from the Florida Department of Corrections, The Florida Department of Law Enforcement, and the Florida Education and Training Placement Information Program. The study found statistically significant, positive relationships between participation in an adult basic education course and post-release employment and earnings. Those who participated in adult basic education tended to have higher employment rates and earnings than did those who involuntarily dropped out of adult basic education. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to adult basic education; other factors are likely to have contributed.","Adult basic education","Basic skills Reentry","Justice-involved, Male",,"United States",2010,https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4288462/ "Does prison-based adult basic education improve postrelease outcomes for male prisoners in Florida?","Cho, R. M., & Tyler, J. H. (2010). Does prison-based adult basic education improve postrelease outcomes for male prisoners in Florida? Crime & Delinquency, 59(7), 975-1005. [Study 1, Contrast 4: participation in adult basic education vs. no participation in adult basic education.]",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Unfavorable impacts Earnings and wages Employment-Low-Mixed impacts Employment","Summary: The study examined the impact of participation in prison-based adult basic education on post-release employment, earnings, and recidivism for incarcerated people who read below the 9th-grade level. The authors also investigated similar research questions for other contrasts, the profiles of which are available here. The authors used a statistical model to compare outcomes for treatment and comparison group members, drawing on data from the Florida Department of Corrections, The Florida Department of Law Enforcement, and the Florida Education and Training Placement Information Program. The study found statistically significant relationships between participation in an adult basic education course and post-release employment and earnings. Compared with people who did not participate in adult basic education, those who did had lower earnings and both lower and higher employment depending on the statistical model used. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups compared were similar before the intervention. This means we are not confident that the estimated relationships are attributable to participated in an adult basic education program; other factors are likely to have contributed.","Adult basic education","Basic skills Reentry","Justice-involved, Male",,"United States",2010,https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4288462/ "Workforce development program: A pilot study of its impact in the U.S. Probation Office, District of Delaware.","Visher, C. A., Smolter, N., & O’Connell, D. (2010). Workforce development program: A pilot study of its impact in the U.S. Probation Office, District of Delaware. Federal Probation, 74(3), 16-21.",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The authors examined the impact of the U.S. Probation Office, District of Delaware’s pilot workforce development program on employment, earnings, and recidivism outcomes for adult offendprobationers. The authors used a nonexperimental design to create a matched comparison group of nonparticipants who were similar to program participants. The authors’ estimated the program’s effects by comparing these groups’ employment, earnings, and recidivism outcomes one year after the program. Data were collected from probationer case files;, the Probation and Pretrial Services Automated Case Tracking System (PACTS) database;, and, for the treatment group, program records. The authors found that individuals people who participated in vocational training were employed for more months in the first year after program enrollment than were participants who received no vocational training. The authors found that individuals people in the program group were less likely to be rearrested or have their probation revoked than were members of the matched comparison group. The quality of causal evidence presented in this study is low. The authors did not account adequately for potential differences between the program and comparison groups before implementing the intervention was implemented. This means we are not confident that the estimated effects are attributable to the workforce development program; other factors are likely to have contributed.","the U.S. Probation Office, District of Delaware’s workforce development program","Job search assistance and supportive services Reentry",Justice-involved,,"United States",2010,https://www.uscourts.gov/sites/default/files/74_3_4_0.pdf "The influences on bridge employment decisions.","Pengcharoen, C., & Shultz, K. S. (2010). The influences on bridge employment decisions. International Journal of Manpower, 31(3), 322-336. doi:10.1108/01437721011050602","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Unfavorable impacts Employment","Summary: The study examined the impact of work schedule flexibility on retirement outcomes among older workers, where work schedule flexibility was measured as the ability to reduce hours from one’s regular work schedule. The study used a statistical model (multinomial logit regression) and the longitudinal data from the Health and Retirement Study (HRS) from 1992 and 2002 to examine the relationship between reporting work schedule flexibility or inflexibility during the baseline survey and reporting complete retirement, partial retirement, or continued employment at the follow-up survey 10 years later among older workers. The study found that individuals who reported work schedule inflexibility in the 1992 were more likely to report completely retired than partially retired in 2002, but when comparing the likelihood of reporting continued employment to complete or partial retirement, there was no difference between older workers reported work schedule flexibility and those who reported inflexibility in 1992. The quality of causal evidence presented in this study is low because the authors did not demonstrate that the participants reporting work schedule flexibility were similar to the participants reporting work schedule inflexibility in 1992. This means we are not confident that the estimated effects are attributable to work schedule flexibility; other factors are likely to have contributed.",,"Other wages and benefits","Adult, Older worker",,"United States",2010,https://www.researchgate.net/publication/46545640_The_influences_on_bridge_empl… "Elderly immigrants’ labor supply response to supplemental security income.","Kaushal, N. (2010). Elderly immigrants’ labor supply response to supplemental security income. Journal of Policy Analysis and Management, 29(1), 137-162.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study objective is to examine the impact of the Personal Responsibility and Work Opportunity Reconciliation Act (PRWORA) of 1996 on employment outcomes of foreign-born people and noncitizens ages 60 to 74 The study used a statistical model and the data from the Current Population Survey’s monthly outgoing rotation group and the March Current Population Survey from 1994 to 2005 to estimate the impact. The study found that the PRWORA is associated with increased employment and decreased retirement for foreign-born men compared with U.S.-born men, but it found no statistically significant association with the employment for foreign-born women. The quality of the causal evidence presented in this report is low because the study is a nonexperimental analysis that does not demonstrate that the groups were similar before the policy change. This means we are not confident that the estimated effects are attributable to PRWORA; other factors are likely to have contributed.","Personal Responsibility and Work Opportunity Reconciliation Act of 1996","Federal retirement benefits Foreign and temporary workers","Adult, Older worker, Immigrant",,"United States",2010,https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4222576/ "Can Social Security explain trends in labor force participation of older men in the United States?","Blau, D. M., & Goodstein, R. M. (2010). Can Social Security explain trends in labor force participation of older men in the United States? Journal of Human Resources, 45(2), 328-363.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The study examined the impact of changes in Social Security Administration (SSA) retirement rules on men’s labor force participation rates in the 1960s–1980s and 1990s–2000s. The study used regression analyses to predicted labor force participation rates using actual and counterfactual SSA retirement rules. These analyses use data from the Current Population Survey (CPS) and the Survey of Income and Program Participation (SIPP) for the period from 1962 to 2005 merged with data from SSA on taxable earnings. The study found that changes in the delayed retirement credit and full retirement age in 1983 could explain one-quarter to one-half of the increase in labor force participation in the early 2000s. The quality of causal evidence presented in this report is moderate, because it is a well-implemented nonexperimental study. This means we are somewhat confident that the estimated effects are attributable to SSA reforms, but other factors might also have contributed.","Social Security Administration Reforms","Federal retirement benefits Older workers' programs","Adult, Older worker, Male",,"United States",2010,http://jhr.uwpress.org/content/45/2/328.abstract "Evaluation of the Ridge House residential program: Final report.","Willison, J. B., Roman, C. G., Wolff, A., Correa, V., & Knight, C. R. (2010). Evaluation of the Ridge House residential program: Final report. Washington, DC: Urban Institute",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence",,"Summary: The study’s objective was to examine the impact of Ridge House, a faith-based halfway house program, on recidivism outcomes. The authors used a nonexperimental design (propensity-score matching) to create a comparison group of nonparticipants who were similar to program participants. The authors estimated the program’s effects by comparing these groups’ post-release recidivism outcomes using administrative data from the National Crime Information Center at the Federal Bureau of Investigation. The authors found that the odds of rearrest or reconviction were 75 percent higher for those who participated in the Ridge House program than those in the comparison group. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the Ridge House program, but other factors might also have contributed.","Ridge House program","Substance abuse recovery Other employment and reemployment Reentry",Justice-involved,,"United States",2010,https://www.ncjrs.gov/pdffiles1/nij/grants/230741.pdf "Framing Social Security Reform: Behavioral responses to changes in the full retirement age","Behaghel, L., & Blau, D. M. (2010) Framing Social Security Reform: Behavioral responses to changes in the full retirement age. (IZA Discussion Paper No. 5310). Bonn, Germany: IZA.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The study examined the impact of changes to the Full Retirement Age (FRA) on labor force exit, Old Age and Survivor’s Insurance (OASI) claims, and retirement. The study uses a statistical model and the data from the Health and Retirement Study (HRS) to compare outcomes of people in birth cohorts who were affected by the change in FRA with those of a comparison group of people who were not. The study found that the change in the FRA was associated with significant increases in the likelihood of claiming OASI and exiting the labor force at the new, later full retirement age. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the change in FRA, but other factors might also have contributed.","changes to the Full Retirement Age (FRA)","Older workers' programs Other employment and reemployment","Older worker",,"United States",2010,https://www.aeaweb.org/articles?id=10.1257/pol.4.4.41 "Retiree health insurance and disengagement from a career job.","Robinson, C., & Clark, R. (2010). Retiree health insurance and disengagement from a career job. Journal of Labor Research, 31(3), 247-262.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-No impacts Employment","Summary: The study examined the effect of availability of retiree health insurance (RHI) on a person’s decision to leave a career job (a measure of retirement). Using data from the Health and Retirement Study (HRS), the authors used a nonexperimental approach to estimate the likelihood of retirement for those who worked at firms with RHI compared with those who worked at firms without RHI. The study found that workers at firms that offer RHI are more likely to retire than those at firms that do not offer RHI. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we would be somewhat confident that any estimated effects would be attributable to the availability at RHI, but other factors might also have contributed.","Retiree Health Insurance","Other health and safety Older workers' programs","Adult, Older worker",,"United States",2010,https://link.springer.com/article/10.1007/s12122-010-9091-4 "The effects of changes in state SSI supplements on preretirement labor supply","Neumark, D., & Powers, E. T. (2005). The effects of changes in state SSI supplements on preretirement labor supply. Public Finance Review, 33(1), 3-35.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study examined the impact of a theoretical increase in Supplemental Security Income (SSI) benefits on the preretirement employment outcomes for likely SSI participants ages 60 to 64. Using data from the annual Current Population Survey from 1979 to 2001 and state-level SSI receipt data, the authors used regression methods in a nonexperimental analysis of likely SSI participants to compare the outcomes of workers ages 62 to 64 with those of workers ages 60 to 61. The study found that an increase in monthly SSI benefits was associated with a statistically significant decrease in the employment rate and number of hours worked for likely SSI recipients ages 62 to 64 compared with those ages 60 to 61. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to changes in SSI benefits; other factors are likely to have contributed.","Supplemental Security Income (SSI) benefits","Older workers' programs Other employment and reemployment","Adult, Older worker",,"United States",2010,https://journals.sagepub.com/doi/pdf/10.1177/1091142104270655 "Veterans Health Administration transitional work experience vs. job placement in veterans with co-morbid substance use and non-psychotic psychiatric disorders","Penk, W., Drebing, C.E., Rosenheck, R.A., Krebs, C., Van Ormer, A., & Mueller, L. (2010). Veterans Health Administration transitional work experience vs. job placement in veterans with co-morbid substance use and non-psychotic psychiatric disorders. Psychiatric Rehabilitation Journal, 33(4), 297-307.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study ’s objective was to examine the impact of a transitional work experience (TWE) program, within the Veterans Health Administration’s (VHA’s) Compensated Work Therapy (CWT) program, on outcomes related to employment and earnings for veterans with certain psychiatric diagnoses and substance use disorders. The study used a randomized controlled trial design and compared treatment and control groups on self-reported employment and earnings outcomes, which were collected 6 and 12 months after enrollment in the study. The study found that those who participated in TWE (the treatment group) worked more total hours and more weeks, and earned more income, over the 12-month period than the control group. The quality of causal evidence presented in this report is low for employment and earnings outcomes because the randomized controlled trial design was compromised and authors did not account for existing differences between the treatment and control groups. This means we are not confident that the estimated effects are attributable to the transitional work experience program; other factors are likely to have contributed.","the Compensated Work Therapy transitional work experience program","Other health and safety Substance abuse recovery Veterans' reemployment","Other barriers, Veteran or military",,"United States",2010,https://psycnet.apa.org/record/2010-08280-008 "Assessment of the impact of WorkSource job search services","Lee, K., Weeks, G., Bodeutsch, G., Clay-Poole, S., Garoflo, T., Petritz, M., Stromsdorfer, E., Field, J., Paterson, T., & Jennings, K. (2009). Assessment of the impact of WorkSource job search services. Washington: Washington State Employment Security Department Labor Market and Economic Analysis.",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study’s objective was to assess the effectiveness of Washington State WorkSource job search services. WorkSource services included staff-assisted job matching, provision of labor market information, job search and placement assistance, and initial assessments. Using a nonexperimental design, the authors compared the employment and earnings of Unemployment Insurance (UI) claimants who received at least one WorkSource service with those of UI claimants who did not receive any WorkSource services using state UI administrative records for more than 64,000 Washington State UI claimants with no UI-reported wage earnings in the third quarter of 2007. The study found that WorkSource services were associated with a higher probability of employment and higher earnings growth for men and women who were intermittently (rather than continuously) employed in the baseline period. The quality of causal evidence presented in this report is low. This means we are not confident that the estimated effects are attributable to WorkSource services. Other factors are likely to have contributed.","JSA services","RESEA Job search assistance and supportive services","Unemployed, Female, Male",,"United States",2009,https://esdorchardstorage.blob.core.windows.net/esdwa/Default/ESDWAGOV/labor-ma… "Details matter: The impact of presentation and information on the take-up of financial incentives for retirement saving","Saez, E. (2009). Details matter: The impact of presentation and information on the take-up of financial incentives for retirement saving. American Economic Journal: Economic Policy, 1(1), 204-228.","Behavioral Finance: Retirement, Behavioral Insights","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence",,"Summary: The study’s objective was to examine the impact of contribution matches, credit rebates, and advance notification on tax filers’ decisions about opening an individual retirement account (IRA) during the tax preparation process and the amount they contributed to the IRA. The authors randomly assigned tax filers at 60 H&R Block locations in St. Louis, Missouri, to treatment conditions, defined by whether the filers were offered a 50 percent one-time match on IRA contributions, a 33 percent credit rebate on IRA contributions, or a 50 percent match on one-time and monthly IRA contributions. H&R Block provided tax filing information from the 2005 and 2006 tax years as well as background information on the filers. The study found that offering a 50 percent match on one-time IRA contributions and offering a 33 percent credit rebate increased the likelihood of opening an IRA and the amount contributed, but the effect on the likelihood of opening an IRA was larger for the 50 percent match treatment group. The quality of causal evidence is high for some outcomes because they were based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the treatment under study, and not to other factors. However, the quality of causal evidence for other outcomes is low because the analyses were based on a nonrandom subset of the randomized sample, and the author did not use sufficient controls when estimating impacts.",,,Adult,,,2009, "Reengaging high school dropouts: Early results of the National Guard Youth ChalleNGe program evaluation.","Bloom, D., Gardenhire-Crooks, A., & Mandsager, C. (2009). Reengaging high school dropouts: Early results of the National Guard Youth ChalleNGe program evaluation. New York: MDRC.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment Training-Mod/high-Favorable impacts Training","Summary: This report presents results from a 9-month follow-up study of the National Guard Youth ChalleNGe program, a disciplinary and educational intervention for unemployed youth ages 16 to 18 who are not in school. Related reports examine outcomes at 21 months and 3 years post-intervention. The program’s effectiveness was evaluated using a randomized controlled trial conducted in 10 states. This report examined the effects of the program on participants’ educational attainment, earnings, employment, and other outcomes measured through a survey conducted about 9 months after participants entered the study. The study found statistically significant, positive impacts of the ChalleNGe program on employment, education, and training outcomes measured after 9 months. The quality of causal evidence presented in this study is high because it is a well-implemented randomized controlled trial. This means we are confident that the effects estimated in this study are attributable to the National Guard Youth ChalleNGe program, and not to other factors.","the National Guard Youth ChalleNGe Program","Basic skills Community college education and other classroom training Mentoring Other training and education Youth programs",Youth,,"United States",2009,http://www.mdrc.org/publication/reengaging-high-school-dropouts/file-full "Youth work and learn at Our Piece of the Pie (OPP): Findings of the formative evaluation of Connecticut's youth development model","Britner, P., Buch, R., Colon, R., Milan, S., Singer, M., & Snow, S. (2009). Youth work and learn at Our Piece of the Pie (OPP): Findings of the formative evaluation of Connecticut's youth development model. Storrs, CT: Center for Health, Intervention and Prevention, University of Connecticut.","Opportunities for Youth","Study Type: Descriptive Analysis",,,"Summary: This report describes the work of Our Piece of the Pie (OPP), an organization that gives young people in Hartford, CT, access to a range of services, including academic assistance, vocational training, and guidance from caring adults trained to provide mentorship and other support. The study aimed to gather information on the characteristics of the youth served by OPP, their participation in program activities, and the progress they made in reaching academic and employment goals. The evaluation team conducted direct observations of intervention activities, interviews with program staff and participants, and surveys of participating youth. It also drew on program data collected by OPP. The study found that most participants spent a considerable amount of time with their mentors each week, with some also taking advantage of career advancement and educational preparation services. Although participating youth were making progress on their goals at the time of the evaluation, particularly in achieving educational milestones, the authors suggested that the program could benefit by strengthening participant-mentor relationships, adapting programming for special populations, and improving the quality of program data.","Our Piece of the Pie (OPP)","Job search assistance and supportive services Youth programs Mentoring Other training and education Work based and other occupational training","Youth, Disconnected youth",,"United States",2009, "An Evaluation of the Latino Coalition’s Reclamando Nuestro Futuro (Reclaiming our Future) Program","Monsma, S., & Smidt, C. (2009). An Evaluation of the Latino Coalition’s Reclamando Nuestro Futuro (Reclaiming our Future) Program. Paul Henry Institute for the Study of Christianity and Politics,","Opportunities for Youth","Study Type: Implementation Analysis",,,"Summary: This report presents an implementation analysis of the Latino Coalition’s Reclamando Nuestro Futuro (RNF) program. The program provided skills training, case management, and follow-up services to at risk youth and those with previous criminal justice experience between the ages of 14 and 21. The study examined RNF programs in 19 sites, focusing on program organization, sub-grantee characteristics, and participant characteristics and outcomes. The study utilized management information system (MIS) data, staff interviews, site visits, participant focus groups, and interviews with community partners. The program was successful in reaching and retaining minority youth and those with previous criminal justice experience, largely because program subgrantees were located in and matched the neighborhoods they served, and had staff members who seemed similar to, and accessible to, their target population. The Latino Coalition, the intermediary organization, played a critical role in the program’s success by establishing a robust organizational and oversight structure and providing capacity-building assistance to the relatively new and small faith-based and community organizations delivering program services.","Reclamando Nuestro Futuro (Reclaiming Our Future)","Basic skills Community college education and other classroom training Job search assistance and supportive services Mentoring Substance abuse recovery Work based and other occupational training Youth programs","Youth, Justice-involved, Hispanic of any race",,"United States",2009,http://wdr.doleta.gov/research/FullText_Documents/An%20Evaluation%20of%20the%20… "The relative importance of selected variables on the employment consistency of Virginia ex-offenders","Onyewu, C. C. (2009). The relative importance of selected variables on the employment consistency of Virginia ex-offenders. (Doctoral dissertation). Retrieved from VTechWorks: http://hdl.handle.net/10919/26264.",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: This study examines the effectiveness of prison-based career and technical education (CTE) on post-incarceration employment among males released from Virginia prisons from July 2000 to June 2001. The author used a nonexperimental design to estimate the employment impacts of prison-based CTE four years after people were released from prison. The author used administrative data from the Virginia Employment Commission and the Virginia Department of Corrections. The study found that participation in CTE was associated with greater employment after release from prison than nonparticipation in CTE. The quality of causal evidence presented in this report is low because the author did not ensure that the groups compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the CTE; other factors are likely to have contributed.","Career and Technical Education (CTE)","Reentry Work based and other occupational training",Justice-involved,,"United States",2009,http://hdl.handle.net/10919/26264 "Evaluation of the YouthBuild Youth Offender Grants","Abrazaldo, W., Adefuin, J., Henderson-Frakes, J., Lea, C., Leufgen, J., Lewis-Charp, H., … Wiegand, A. (2009). Evaluation of the YouthBuild Youth Offender Grants. Oakland, CA: SPR Associates.","Opportunities for Youth","Study Type: Implementation Analysis",,,"Summary: This report summarizes the findings of an implementation and outcomes analysis of Young Offender grants. These grants, which were awarded to 30 YouthBuild USA sites in 2004 and 2005, were to provide academic instruction, vocational training, leadership opportunities, and counseling and other support services to young offenders. The objective was to understand how YouthBuild programming for young offenders was designed and implemented; identify the strategies and approaches associated with positive outcomes; and gain insight into the contextual factors influencing program implementation and participant performance. The authors collected and analyzed qualitative information gathered during two rounds of site visits—which included interviews with program staff, instructors and trainers, grantee partners, employers, and program participants—and quantitative management information systems data.  The implementation analysis found that the extent to which Young Offender grantees implemented the YouthBuild model varied, though all attempted to adhere to the model. In general, grantees had mature organizational structures and were able to form partnerships with workforce development agencies and the juvenile justice system. Young offenders tended to have better educational, employment, and social outcomes in grantee sites where teachers invested time in getting to know them on a personal level, the teacher-to-student ratio was low, academic work and vocational training were linked, and leadership opportunities were available.",Youthbuild,"Youth programs Other training and education Work based and other occupational training","Youth, Justice-involved, Low-skilled, Low income",,"United States",2009,http://wdr.doleta.gov/research/FullText_Documents/Evaluation%20of%20the%20Youth… "The impact of Ethiopia’s Productive Safety Net Program on schooling and child labor","Hoddinott, J., Gilligan, D. O., & Taffesse, A. S. (2009). The impact of Ethiopia’s Productive Safety Net Program on schooling and child labor. Retrieved from http://ssrn.com/abstract=1412291","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-No impacts Child labor Education and skills gains-Low-No impacts Education and skills gains","Summary: The purpose of the study was to assess the impact of Ethiopia’s Productive Safety Net Program (PSNP) on child labor and school attendance, along with the potential added benefit of participation in the Other Food Security Program (OFSP). This summary focuses on the comparison between the group receiving the PSNP benefit and the comparison group. The study used a nonexperimental design to compare the outcomes of children ages 6-16 that received the cash transfers with those who did not, based on data from the Food Security Program Survey. Using several demographic characteristics, the authors created a matched comparison group of households who did not receive the benefit to assess the effectiveness of the cash transfer program. The study did not find a significant relationship between receipt of benefits from PSNP and the number of hours worked (in domestic labor, agricultural labor, or total labor hours) or school attendance rates. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention.This means we are not confident that the estimated effects are attributable to the Productive Safety Net Program; other factors are likely to have contributed.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2009,http://ssrn.com/abstract=1412291 "The impact of Ethiopia’s Productive Safety Net Program on schooling and child labor","Hoddinott, J., Gilligan, D. O., & Taffesse, A. S. (2009). The impact of Ethiopia’s Productive Safety Net Program on schooling and child labor. Retrieved from http://ssrn.com/abstract=1412291","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-No impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The purpose of the study was to assess the impact of Ethiopia’s Productive Safety Net Program (PSNP) on child labor and school attendance, along with the potential added benefit of participation in the Other Food Security Program (OFSP). This summary focuses on the comparison between the group receiving a certain amount of the PSNP benefit and the comparison group. The study used a nonexperimental design to compare the outcomes of children ages 6-16 that received the cash transfers with those who did not, based on data from the Food Security Program Survey. Using several demographic characteristics, the authors created a matched comparison group of households who did not receive the benefit to assess the effectiveness of the cash transfer program. The study found that for boys ages 6-16, there was a significant relationship between households receiving a certain amount of cash transfer and increased school attendance rates. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Productive Safety Net Program; other factors are likely to have contributed.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2009,http://ssrn.com/abstract=1412291 "The impact of Ethiopia’s Productive Safety Net Program on schooling and child labor","Hoddinott, J., Gilligan, D. O., & Taffesse, A. S. (2009). The impact of Ethiopia’s Productive Safety Net Program on schooling and child labor. Retrieved from http://ssrn.com/abstract=1412291","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Unfavorable impacts Child labor Education and skills gains-Low-No impacts Education and skills gains","Summary: The purpose of the study was to assess the impact of Ethiopia’s Productive Safety Net Program (PSNP) on child labor and school attendance, along with the potential added benefit of participation in the Other Food Security Program (OFSP). This summary focuses on the comparison between the group receiving both the PSNP and OFSP benefit and the comparison group. The study used a nonexperimental design to compare the outcomes of children ages 6-16 that received the cash transfers with those who did not, based on data from the Food Security Program Survey. Using several demographic characteristics, the authors created a matched comparison group of households who did not receive the benefit to assess the effectiveness of the cash transfer program. The study found a significant relationship between receipt of benefits from both PSNP and OFSP and an increase in domestic chores for girls. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention.This means we are not confident that the estimated effects are attributable to the Productive Safety Net Program or the Other Food Security Program; other factors are likely to have contributed.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2009,http://ssrn.com/abstract=1412291 "Benefit Offset Pilot Demonstration: Connecticut final report","State of Connecticut (2009). Benefit Offset Pilot Demonstration: Connecticut final report.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: This study’s objective was to examine 24-month impacts for Connecticut’s Benefit Offset Pilot Demonstration (BOPD), which provided a more-generous work incentive for Social Security Disability Insurance (SSDI) recipients, on recipients’ employment status, earnings, and reliance on benefits. Participants were randomly assigned to a treatment group, which was eligible for the more generous work incentive, or a control group that was not. The authors examined impacts on employment and earnings using state unemployment insurance (UI) wage records. The study found that, although BOPD achieved no statistically significant impacts on being employed, it did generate some positive impacts on earnings at the first year after random assignment. The quality of the causal evidence presented in this report is high for the year two impacts. This means we are confident that those estimated effects are attributable to the BOPD. However, the quality of the causal evidence for the year one impacts is moderate. This means we have confidence that the effects are attributable at least in part to the BOPD, but other factors might also have contributed.","the Benefit Offset Pilot Demonstration","Disability insurance Supplemental security income (SSI)",Disability,,"United States",2009,http://www.google.com/url?sa=t&rct=j&q=&esrc=s&frm=1&source=web&cd=1&cad=rja&ua… "Work Activity and Use of Em-ployment Supports Under the Original Ticket to Work Regulations: Characteristics, Employment, and Sources of Support Among Working-Age SSI and DI Beneficiaries","Livermore, Gina, Stapleton, David, & Roche, Allison. (2009). Work Activity and Use of Em-ployment Supports Under the Original Ticket to Work Regulations: Characteristics, Employment, and Sources of Support Among Working-Age SSI and DI Beneficiaries. Washington, DC: Mathematica Policy Research.","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: This report presented a profile of all working-age (ages 18 to 64) Supplemental Security Income (SSI) and Disability Income (DI) recipients, using data from the 2004, 2005, and 2006 rounds of the National Beneficiary Survey. Findings indicated that many SSI and DI recipients were working and engaging in work preparation activities, or saw themselves working in the future. But their jobs did not pay well in general, or offer much in the way of benefits. Although many recipients were working, there was a high prevalence of characteristics, circumstances, and experiences making employment difficult. Few were aware of work incentive provisions then available in SSI and DI, and many relied on means-tested public programs for which earnings could jeopardize eligibility. In addition to activity limitations and poor health associated with their disabling health conditions, many recipients had limited education and experienced obstacles to employment, such as a lack of reliable transportation and inaccessible workplaces. Findings indicated that only changing economic incentives inherent in the disability programs would be insufficient to bring about a successful return to work for many recipients; other supports would be needed as well.",,"Disability insurance Supplemental security income (SSI) Supported employment or other employment supports",Disability,,"United States",2009,http://www.ssa.gov/disabilityresearch/documents/TTW5_2_BeneChar.pdf "MS Model Youth Transition Innovation; Youth Transition Process Demonstration Grant Final Summary","Doyle, Rebecca, Horton, Patty, Ladner, Lisa, & Mississippi Department of Rehabilitation Services (2009). MS Model Youth Transition Innovation; Youth Transition Process Demonstration Grant Final Summary.","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: The Mississippi Model Youth Transition Innovation (MYTI) project assisted young people with severe disabilities to become involved in the working community through targeted, school-to-work transition interventions. It exposed students and their families to the concept that all students were employable, then provided employment and benefits information, preparation, and support services tailored to four age ranges of (10–13, 14–18, 19–21, and 22–25 years of age). MYTI served 210 youths ages 10 to 25with significant disabilities, such as mental retardation, developmental disabilities, deafness, blindness, severe emotional disturbances, or multiple disabilities. There was no comparison group. Services included work experience, employment and job planning and support, One-Stop Career Center assistance, and individualized development accounts. Descriptive analyses suggested potential lessons from the project, such as the importance of helping students formulate a vision of work at a young age, and of helping students and their families understand whether and how work affects Social Security benefits.",,"Disability insurance Supplemental security income (SSI) Vocational rehabilitation Supported employment or other employment supports","Youth, Disability",,"United States",2009,http://www.google.com/url?sa=t&rct=j&q=&esrc=s&frm=1&source=web&cd=1&cad=rja&ua… "Opening Doors: More guidance, better results? Three-year effects of an enhanced student services program at two community colleges","Scrivener, S., & Weiss, M.J. (2009). Opening Doors: More guidance, better results? Three-year effects of an enhanced student services program at two community colleges. New York: MDRC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Opening Doors program at Lorain County Community College and Owens Community College in Ohio. The Opening Doors program at these schools provided students with enhanced counseling services and a modest stipend for two semesters. The study was a randomized controlled trial. Eligible students were randomly assigned to either the treatment group, which was eligible to receive Opening Doors counseling services and a stipend, or the control group, which was not offered these services. The primary data sources were a baseline survey on the background characteristics of students, students’ transcripts from the two colleges, and degree attainment information from the National Student Clearinghouse. The study reported outcomes for the two program semesters and four post-program follow-up semesters. The study found that cumulatively from the first program semester to the third follow-up semester, the treatment group registered for significantly more semesters and earned significantly more developmental credits than the control group. There was no significant difference in the proportion of treatment group students who completed a degree or certificate relative to the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects would be attributable to the Opening Doors program, and not to other factors.","Opening Doors Program at Lorain County Community College and Owens Community College","Community college education and other classroom training","Adult, Low income",,"United States",2009,http://www.mdrc.org/sites/default/files/More%20Guidance%20ES_1.pdf "Getting back on track: Effects of a community college program on probationary students","Scrivener, S., Sommo, C., & Collado, H. (2009). Getting back on track: Effects of a community college program on probationary students. New York: MDRC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Opening Doors and Enhanced Opening Doors programs at Chaffey Community College in California on progress toward completing a degree. Students in the Opening Doors and Enhanced Opening Doors programs took a college success course that covered topics such as personal goals, study skills, and college rules, and had to visit the college’s student success centers for tutoring sessions. The study was a randomized controlled trial. Eligible students were randomly assigned to either the treatment or control group. In the original Opening Doors program, students assigned to the treatment group were offered the opportunity to participate in the program. In the Enhanced Opening Doors program, students in the treatment group were required to participate in the program. The control groups for both the original and Enhanced Opening Doors programs were not required to participate in the program. The primary data sources were a baseline survey on the background characteristics of students, students’ transcripts, and degree attainment information from the National Student Clearinghouse. The study found no significant impacts on students’ course registration, the number of semesters enrolled, or regular credits accumulated for the original Opening Doors program. For the Enhanced Opening Doors program, the study found that the treatment group earned significantly more nondegree credits and developmental credits during each of the two program semesters and cumulatively across both program semesters, compared with the control group. Additionally, at the end of both program semesters, a higher proportion of students in the Enhanced Opening Doors program were in good academic standing (that is, earned a grade point average of 2.0 or higher and were not on probation due to attempting fewer than 12 credits or completing fewer than half of attempted credits) compared with students in the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Enhanced Opening Doors program, and not to other factors.","the Opening Doors and Enhanced Opening Doors Programs at Chaffey Community College","Community college education and other classroom training","Adult, Other barriers",,"United States",2009,http://www.mdrc.org/sites/default/files/full_379.pdf "Rewarding Persistence: Effects of a performance-based scholarship program for low-income parents","Richburg-Hayes, L., Brock, T., LeBlanc, A., Paxson, C., Rouse, C.E., & Barrow, L. (2009). Rewarding persistence: Effects of a performance-based scholarship program for low-income parents. New York: MDRC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Opening Doors program at Delgado Community College and Louisiana Technical College-West Jefferson in New Orleans, Louisiana, on progress toward completing a college degree. The Opening Doors program offered students with dependent children a performance-based $1,000 scholarship in each of two semesters. The study examined both the shorter- and longer-term impacts of the Opening Doors program using different cohorts of students. The study was a randomized controlled trial. Eligible students were randomly assigned to either the treatment group, which was offered the opportunity to receive the scholarship, or the control group, which was not eligible for the scholarship. The primary data sources were a baseline survey on the background characteristics of students, student transcripts, and degree attainment information from the National Student Clearinghouse. The study found that for all four cohorts of students, the treatment group was significantly more likely to have registered for any course and have enrolled full-time in college, and to have attempted and earned significantly more credits in both the first and second program semesters, compared with the control group. The study found that for the first two cohorts of students, the treatment group registered for classes at a higher rate, enrolled in more semesters of college, and earned more credits than the control group cumulatively through the fourth semester after random assignment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Opening Doors program, and not to other factors.","the Opening Doors Program at Delgado Community College and Louisiana Technical College-West Jefferson","Tuition assistance Community college education and other classroom training","Adult, Low income, Parent",,"United States",2009,http://www.mdrc.org/sites/default/files/rewarding_persistence_fr.pdf "Utah SSDI '1 for 2:' Benefit Offset Pilot Demonstration Final Report","Chambless, C., Julnes, G., McCormick, S., & Brown-Reither, A. (2009). Utah SSDI '1 for 2:' Benefit Offset Pilot Demonstration Final Report. Salt Lake City, UT: University of Utah Center for Public Policy & Administration.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment","Summary: This study’s objective was to examine 24-month impacts for Utah’s Benefit Offset Pilot Demonstration (BOPD), which provided a more-generous work incentive for Social Security Disability Insurance (SSDI) recipients, on recipients’ employment status and earnings. Participants were randomly assigned to a treatment group, which was eligible for the more generous work incentive, or a control group that was not. The authors examined impacts on employment and earnings using state unemployment insurance (UI) wage records. The study found that the BOPD in Utah did not have a statistically significant impact on employment or earnings. It did significantly increase the proportion of participants with earnings above the substantial gainful activity (SGA) amount by the end of the second year of follow-up. The quality of the causal evidence presented in this report is high because it was a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the BOPD, and not to other factors.","Benefit Offset Pilot Demonstration","Disability insurance Supplemental security income (SSI) Other employment and reemployment",Disability,,"United States",2009,http://www.ssa.gov/disabilityresearch/documents/Final-UBOPD-Master_5-13-10.doc "SSDI '1 for 2:' Benefit Offset Pilot Demonstration Vermont Pilot Final Report","Porter, A., Smith, J., Payette, A., Tremblay, T., & Burt, P. (2009). SSDI '1 for 2:' Benefit Offset Pilot Demonstration Vermont Pilot Final Report. Waterbury, VT: Vermont Division of Vocational Rehabilitation.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: This study’s objective was to examine 24-month impacts for Vermont’s Benefit Offset Pilot Demonstration (BOPD), which provided a more generous work incentive for Social Security Disability Insurance (SSDI) recipients, on recipients’ employment status and earnings. Participants were randomly assigned to a treatment group, which was eligible for the more generous work incentive, or a control group that was not. The authors examined impacts on employment and earnings using state unemployment insurance (UI) wage records. The study found that the BOPD in Vermont had statistically significant, positive impacts on treatment group members’ employment and earnings in the three quarters after random assignment. However, the effects generally did not persist over the full two-year follow-up period. The quality of the causal evidence presented in this report is high because it was a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the BOPD, and not to other factors.","Benefit Offset Pilot Demonstration","Disability insurance Supplemental security income (SSI) Other employment and reemployment",Disability,,"United States",2009,http://www.ssa.gov/disabilityresearch/documents/Vt1for2FinalReport091223.pdf "Reducing the complexity costs of 401(k) participation through Quick Enrollment","Laibson, D., Choi, J., & Madrian, B. (2009). Reducing the complexity costs of 401(k) participation through Quick Enrollment. Developments in the Economics of Aging, 57-82.","Behavioral Finance: Retirement","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employer benefits receipt-Low-Favorable impacts Employer benefits receipt","Summary: The study’s objective was to examine the effect of a simplified 401(k) enrollment procedure called Quick Enrollment on plan participation through three trials at two anonymous companies (two trials at company A and one at company B). Quick Enrollment offered employees the choice of joining a 401(k) plan at a fixed contribution rate, investing in prespecified funds. Hewitt Associates, a consultancy and benefits management company, provided data on 401(k) plan participation, compensation, and other demographic characteristics for employees at two anonymous firms. For company A, year-end cross-sectional data from 2002 and 2003 were available for all employees in addition to a September 1, 2004, snapshot. For company B, only year-end data for 2002 and 2003 were available. Plan enrollment rates for new employees rose after each Quick Enrollment implementation, with an enrollment increase of 14 percentage points at company A and 2 percentage points at company B. The quality of causal evidence provided in this study is low. This means that we are not confident that the estimated effects are attributable to Quick Enrollment; other factors are likely to have contributed.","Quick Enrollment","Employer provided retirement benefits",Employed,,"United States",2009, "New ways to make people sSave: A social marketing approach","Lusardi, A., Keller, P. A, & Keller, A. M. (2009). New ways to make people sSave: A social marketing approach. National Bureau of Economic Research Working Paper 14715. Cambridge, MA: NBER.","Behavioral Finance: Retirement","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employer benefits receipt-Low-Favorable impacts Employer benefits receipt","Summary: The study’s objective was to assess the effect of a retirement planning aid on encouraging new hires at a large institution to enroll in a supplemental retirement account (SRA). The authors presented results from both an initial pilot test and a full-scale implementation using a modified version of the planning aid. The authors compared the mean 30- and 60-day enrollment rates of cohorts of new hires using administrative data provided by the institution. The final version of the planning aid increased SRA enrollment considerably relative to the control group, with more than 27 percent of new hires enrolling within 30 days and more than 41 percent enrolling within 60 days, compared with 7 and 29 percent, respectively, in the control group. Results were similar during the pilot intervention phase. The quality of causal evidence provided in this study is low. This means that we are not confident that the estimated effects are attributable to the planning aid; other factors are likely to have contributed.","a Retirement Planning Tool","Employer provided retirement benefits",Employed,,"United States",2009,http://www.nber.org/papers/w14715 "Optimal defaults and active decisions","Carroll, G., Choi, J., Laibson, D., Madrian, B., & Metrick, A. (2009). Optimal defaults and active decisions. The Quarterly Journal of Economics, 124(4).","Behavioral Finance: Retirement","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employer benefits receipt-Low-Favorable impacts Employer benefits receipt","Summary: The study examined the impact of requiring employees to actively decide whether to enroll in a 401(k) plan, called active-decision enrollment, on newly hired employees’ 401(k) enrollment decisions and contribution rates at a large U.S.-based company. Active-decision enrollment was compared with standard enrollment, which required employees to opt in to a 401(k) plan. The analysis was based on administrative data on enrollment in and contributions to a retirement plan. The study analyzed changes in outcomes before and after the change from active-decision to standard enrollment. The study found that requiring employees to actively opt in or out of savings plans increased 401(k) participation and contribution rates, compared with standard enrollment. The study also found that employees who participated in the 401(k) plan under the active-decision enrollment policy contributed less, on average, than participants under standard enrollment.  The quality of causal evidence presented in this report is low. This means we are not confident that the estimated effects are attributable to the company’s active-decision enrollment policies. Other factors are likely to have contributed.","Active-Decision 401(k) Enrollment","Employer provided retirement benefits",Employed,,"United States",2009, "Mental accounting in portfolio choice: Evidence from a flypaper effect","Choi, J., Laibson, D., & Madrian, B. (2009). Mental accounting in portfolio choice: Evidence from a flypaper effect. American Economic Review, 99(5), 2085-2095.","Behavioral Finance: Retirement","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employer benefits receipt-Low-Unfavorable impacts Employer benefits receipt","Summary: The study examined the impact of requiring employees at a large, U.S.-based company to actively choose the asset allocation for an employer’s matching 401(k) contributions, rather than automatically allocating such funds to the employer’s stock. The analysis was based on administrative data on employees’ demographic characteristics and 401(k) contributions. The study analyzed changes in outcomes that occurred when a firm began requiring employees to choose the funds to which the employer’s 401(k) matching contributions would be allocated.  The study found that allowing employees to choose the asset allocation of their matched contributions reduced contributions to employer stock by 64 percentage points in the first year of the new policy. The study also found that employees’ own contribution allocations did not change significantly after the policy was enacted, suggesting that employees made their personal allocation decisions without considering the employer’s match allocation. The quality of causal evidence presented in this report is low. This means we are not confident that the estimated effects are attributable to the active-decision requirement for employer matched contributions. Other factors are likely to have contributed.","Active Portfolio Choice for Employer Matching Contributions","Employer provided retirement benefits",Employed,,"United States",2009, "Interim report on the Demonstration to Maintain Independence and Employment","Gimm, G., Denny-Brown, N., Gilman, B., Ireys, H.T., & Anderson, T. (2009). Interim report on the Demonstration to Maintain Independence and Employment. Washington, DC: Mathematica Policy Research.","Disability Employment Policy","Study Type: Implementation Analysis",,,"Summary: This report summarized the results of the first round of the evaluation of the Demonstration to Maintain Independence and Employment (DMIE), under which the Centers for Medicare & Medicaid Services (CMS) offered funding to four states and the District of Columbia to design, implement, and test health care coverage and employment support programs for workers with potentially disabling conditions. This CLEAR profile focuses on the process study component of the evaluation. Other components of the evaluation included an overview of beneficiaries’ characteristics and an impact analysis. This study sought to gain insight into successes, challenges, and lessons related to program outreach and recruitment—drawing relevant information on all five sites from interviews, program documents, state-level evaluation reports, and enrollment data. Key findings indicated that most state DMIE programs faced challenges in recruitment—given delays in designing program processes and obtaining approvals, low interest from eligible beneficiaries, and poor access to data needed for outreach and screening—but eventually met enrollment targets. The authors also found that state DMIE programs that were designed around existing health programs were most successful in implementing streamlined recruitment, strategically supplementing available health benefits, and conducting swift program roll-out through existing provider networks.","Demonstration to Maintain Independence and Employment (DMIE)",,Disability,,"United States",2009,http://www.mathematica-mpr.com/~/media/publications/PDFs/disability/dmie-es.pdf "Supporting young women to enter engineering: Long-term effects of a middle school engineering outreach program for girls","Demetry, C., Hubelbank, J., Blaisdell, S., Sontgerath, S., Nicholson, M.E., Rosenthal, E., & Quinn, P. (2009). Supporting young women to enter engineering: Long-term effects of a middle school engineering outreach program for girls. Journal of Women and Minorities in Science and Engineering 15, 119-142.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to assess the long-term impact of Camp Reach, a summer engineering enrichment program for middle school girls, on enrollment in STEM courses in high school and college. Admission to Camp Reach was determined through a lottery of girls who applied to the program and met eligibility requirements. Six to seven years later, the authors administered a survey to 109 girls who had been admitted to the program and 107 girls who had not. Many girls in the control group attended other, similar programs. The study found that members of the control group who had attended other summer science or engineering programs at Worcester Polytechnic Institute (WPI) were significantly more likely to have taken high school calculus than were members of the Camp Reach Partial group. There were no statistically significant differences on taking physics, computer science, other science and engineering courses, or planning to major in engineering in high school. The quality of causal evidence presented in this report is low because the authors adjusted the research sample after random assignment and did not include adequate controls to ensure that the resulting groups were similar on all relevant attributes. This means we are not confident that the estimated effects were attributable to Camp Reach; other factors are likely to have contributed.","Camp Reach","Science, Technology, Engineering, and Math (STEM) programs Youth programs","Youth, Female",,"United States",2009, "Using appreciative inquiry as a tool to instigate transformational change in recruiting and developing women faculty in STEM disciplines","Nemiro, J., Hacker, B., Ferrel, M., & Guthrie, R. (2009). Using appreciative inquiry as a tool to instigate transformational change in recruiting and developing women faculty in STEM disciplines. International Journal of Gender, Science and Technology, 1(1), 5-35.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The authors’ main objective was to develop recommendations for recruiting and developing female faculty in STEM disciplines. The authors conducted a series of eight focus groups with science and engineering faculty at a university in the United States to discuss what the organization currently did well and what it could do well in the future, and drew out common themes across the discussions. The authors recommended the following best practices for institutions to better recruit female faculty in STEM: (1) create clear and transparent job postings; (2) promote the benefits that the department, university, and community have to offer potential candidates; and (3) actively recruit candidates (for example, by developing relationships with universities and pursuing candidates before they apply for a position). The authors also suggested best practices for developing female faculty, including training staff at all levels on the cognitive biases against women, creating within-organization mentoring and networking opportunities for female faculty in STEM, developing family-friendly policies such as leave and flexible schedules, allotting time and funding for professional development, and actively developing women for leadership positions.",,"Science, Technology, Engineering, and Math (STEM) programs","Female, STEM professional",,"United States",2009, "Learning communities for university students at risk of school failure: Can they make a difference?","Tharp, T. (2009). Learning communities for university students at risk of school failure: Can they make a difference? (Doctoral dissertation). Retrieved from ProQuest Dissertations and Theses database. (UMI No. 3389640)","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Unfavorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of learning community developmental math courses on college retention and credit hours earned at Middle Tennessee State University. The study used school records from fall 2004 and fall 2005 cohorts to compare students who enrolled in learning community developmental math courses to students who enrolled in the standard math developmental courses and to a group of students in college-level courses who had similar placement exam scores. The study found that, for the fall 2004 cohort, the retention rate for the learning community group was significantly lower than the rate for the nondevelopmental group between the fourth and fifth years after enrollment. In addition, for the fall 2005 cohort, the learning community group earned significantly fewer credit hours than the nondevelopmental group in the first, second, and fourth years after enrollment, and fewer credit hours than the nonlearning community developmental group in the fourth year. The quality of causal evidence presented in this report is low because the author did not control for relevant student characteristics in the analysis. This means we are not confident that the estimated effects are attributable to learning communities. Other factors are likely to have contributed.","Learning Communities","Basic skills Community college education and other classroom training",Adult,,"United States",2009, "The strength of weak enforcement: The impact of discrimination charges, legal environments, and organizational conditions on workforce segregation","Hirsh, C. (2009). The strength of weak enforcement: The impact of discrimination charges, legal environments, and organizational conditions on workforce segregation. American Sociological Review, 74, 245-271.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Compliance-Low-Favorable impacts Compliance","Summary: The study’s objective was to assess two approaches to mitigating employment discrimination: direct Equal Employment Opportunity Commission (EEOC) enforcement and indirect, industry-level EEOC enforcement. The author applied a fixed-effects regression analysis to a national random sample of private U.S. employment establishments required to report race and gender data to the EEOC from 1990 to 2002. The study found that EEOC settlements mandating policy changes or monetary payouts within an industry were associated with statistically significant decreases in sex segregation within establishments in the industry, but had limited effects on race segregation. The quality of causal evidence presented in this report is low because the authors did not establish that firms subject to different levels of enforcement activities were similar before those activities. This means we are not confident that the estimated effects are attributable to either direct or indirect EEOC enforcement; other factors are likely to have contributed.","Equal Employment Opportunity Commission Enforcement","Civil Rights Act of 1964 Equal Employment Opportunity Act of 1972",Other,,"United States",2009, "The Employment Retention and Advancement project: Results from the Los Angeles Reach For Success program","Anderson, J., Freedman, S., and Hamilton, G. (2009). The Employment Retention and Advancement project: Results from the Los Angeles Reach For Success program. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-Mixed impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of an individualized case management program called Reach for Success (RFS) on employment, earnings, and public assistance receipt for recipients of Temporary Assistance for Needy Families (TANF) cash assistance benefits. The study used a randomized controlled trial design, assigning eligible people over a two-year period to either the RFS program or existing services. To estimate the program’s impacts, the authors used administrative employment, earnings, and public benefits data, as well as a 12-month follow-up survey emphasizing respondents’ employment, income, and other outcomes. Outcomes were adjusted for prerandom assignment characteristics. The study found that RFS participants were significantly more likely to receive TANF and Food Stamps benefits at the end of the two-year follow-up period. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the RFS program and not to other factors.","Reach for Success (RFS)","Other employment and reemployment","Parent, Low income",,"United States",2009,http://www.acf.hhs.gov/sites/default/files/opre/era_la_rfs_embed.pdf "Leading them to water: A study of the efficacy of a Mandatory Placement Project in first-year academic courses at a community college","Emmerson, J. (2009). Leading them to water: A study of the efficacy of a Mandatory Placement Project in first-year academic courses at a community college. Graduate Theses and Dissertations, paper 10661. Retrieved from http://lib.dr.iastate.edu/etd/10661","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: This study’s objective was to examine the effects of Des Moines Area Community College’s Mandatory Placement Project on credit completion and fall-to-spring semester persistence. The intervention included intensive counseling and developmental courses for first-time, full-time community college students whose late registration suggested a high risk of not persisting. The study used administrative records to compare outcomes of a group of 270 students who were required to meet with an advisor and strongly encouraged to participate in one of six developmental courses with those of a comparison group of 174 students who received no counseling and were not advised to take developmental courses. The study found that participation in one of the six developmental courses was significantly and positively associated with fall-to-spring semester persistence. The quality of causal evidence presented in this report is low because the author did not adequately account for existing differences between the treatment and comparison groups. This means we are not confident that the estimated effects are attributable to the Mandatory Placement Project. Other factors are likely to have contributed.","the Mandatory Placement Project","Basic skills Community college education and other classroom training","Adult, Other barriers",,"United States",2009,http://lib.dr.iastate.edu/cgi/viewcontent.cgi?article=1685&context=etd "The links between parent behaviors and boys’ and girls’ science achievement beliefs","Bhanot, R.T., & Jovanovic, J. (2009). The links between parent behaviors and boys’ and girls’ science achievement beliefs. Applied Developmental Science, 13(1), 42-59.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study's objective was to examine the relationship between parents’ and middle school students’ perceptions of science education and whether that relationship varied based on the gender of the parent or child. Specifically, the study looked at links between parents’ attitudes toward science and participation in their children’s science education and the child’s opinion of the utility of science (called science task-value) and perception of his or her own science ability. The study, conducted in four school districts in Illinois, used student survey data collected at the start and end of the school year and parent survey data collected in the middle of the school year. The authors analyzed changes in students’ perceptions from the beginning to end of the year, by gender, as well as differences in parents’ perceptions and behavior by the gender of the child and parent. The authors also conducted a series of regression analyses by gender to determine the relationship between parents’ involvement in their children’s science education and their children’s end-of-year perceptions. The study found that boys had higher perceptions of their own science ability at the end of the school year than girls, though there was no difference in actual performance. Compared with parents of girls, parents of boys also had higher perceptions of the child’s science ability and of the value of science and were more likely to encourage an interest in science. There were some positive correlations between parents’ beliefs and actions and girls’ perceptions of science; however, some actions taken by mothers were found to be negatively correlated with boys’ perceptions of their science ability and their task-value beliefs about science. Even after controlling for mothers’ behaviors, mothers’ perceptions of their children’s science ability was a significant predictor of the children’s perceptions of their own ability. The study found that the links between fathers’ actions and children’s perceptions did not vary by the child’s gender.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Parent",,"United States",2009, "Transitional jobs for ex-prisoners: Implementation, two-year impacts, and costs of the Center for Employment Opportunities (CEO) prisoner reentry program","Redcross, C., Bloom, D., Azurdia, G., Zweig, J., and Pindus, N. (2009). Transitional jobs for ex-prisoners: Implementation, two-year impacts, and costs of the Center for Employment Opportunities (CEO) prisoner reentry program. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine the impact of a comprehensive employment program on ex-offenders’ employment and wages. The authors randomly assigned former prisoners to an employment program offering transitional job placement and other services or to a control condition providing a more limited set of services. Employment and earnings data were collected quarterly for three years and compared between the two groups, controlling for characteristics before random assignment. The study did not find any statistically significant effects on employment in the sixth or eighth quarters after random assignment, nor on earnings in the sixth quarter or second year after random assignment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects would be attributable to the employment program and not to other factors. However, the study did not find statistically significant effects.","the Center for Employment Opportunities (CEO) Transitional Jobs Program","Job search assistance and supportive services Other employment and reemployment Reentry",Justice-involved,,"Urban, United States",2009,http://www.acf.hhs.gov/sites/default/files/opre/ex_prisoners.pdf "The effects of goal orientation on job search and reemployment: A field experiment among unemployed job seekers","van Hooft, E., & Noordzij, G. (2009). The effects of goal orientation on job search and reemployment: A field experiment among unemployed job seekers. Journal of Applied Psychology, 94(6), 1581-1590.","Behavioral Insights","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the effects of goal orientation—the way individuals frame their objectives in a given situation—on job search and reemployment among unemployed job seekers. The study was a randomized controlled trial (RCT) in which participants were assigned to one of three workshops: a learning goal-oriented (LGO) workshop, a performance goal-oriented (PGO) workshop, and a control workshop. The authors compared the job-search and reemployment outcomes of participants in the LGO or PGO workshops to the outcomes of those in the control workshop. The study found that participants in the LGO workshop were 22 percentage points more likely to be reemployed eight weeks after the workshop than were participants in the control workshop, a statistically significant difference. The quality of causal evidence presented in this report is high for the comparison of PGO versus control participants’ reemployment statuses because these outcomes derived from a well-conducted RCT with low attrition. This means we are confident that the estimated effects are attributable to workshop type and not to other factors. However, the quality of causal evidence presented in this report is low for the comparison of LGO and control participants’ job-search behaviors and reemployment statuses and the comparison of PGO and control participants’ job-search behaviors because these outcomes derived from an RCT with high attrition that did not control adequately for potential differences in the analytic samples. This means we are not confident that the estimated effects are attributable to workshop type; other factors are likely to have contributed.","the Workshops Studied","Behavioral Interventions","Unemployed, Adult",,International,2009, "How and to what extent does entrepreneurship education make students more entrepreneurial? A California case of the Technology Management Program","Tam, H. (2009). How and to what extent does entrepreneurship education make students more entrepreneurial? A California case of the Technology Management Program (Doctoral dissertation). Retrieved from ProQuest Dissertations and Theses database. (UMI No. 304852166).","Entrepreneurship and Self-Employment","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Attitudes-Low-Favorable impacts Attitudes","Summary: The study’s objective was to examine the impact of participation in the University of California, Santa Barbara’s Technology Management Program (TMP) on students’ entrepreneurial attitudes. The author compared the entrepreneurial attitudes of students at the beginning and the end of the spring 2008 academic term. The study found that the overall entrepreneurial attitudes of students participating in the TMP became stronger over the course of the term. The quality of causal evidence presented in this report is low because the author did not account for pre-intervention trends in participants’ entrepreneurial attitudes. This means we are not confident that the estimated effects are attributable to the TMP courses the students took; other factors are likely to have contributed.","the Technology Management Program (TMP)","Other training and education",Adult,,"United States",2009, "Improving 24-month abstinence and employment outcomes for substance-dependent women receiving Temporary Assistance for Needy Families with intensive case management.","Morgenstern, J., Neighbors, C., Kuerbis, A., Riordan, A., Blanchard, K., McVeigh, K., Morgan, T., & McCrady, B. (2009). Improving 24-month abstinence and employment outcomes for substance-dependent women receiving Temporary Assistance for Needy Families with intensive case management. American Journal of Public Health, 99(2), 328-333.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact on employment of an intensive case management (ICM) program for substance-dependent women receiving Temporary Assistance for Needy Families (TANF). Women identified as substance-dependent were randomly assigned to either the ICM or usual care treatment programs. The primary data sources were daily self-reports and follow-up interviews conducted 3, 9, 15, and 24 months after random assignment. The study found that women in the ICM group were generally significantly more likely than women in the usual care group to be employed full-time, particularly at the 24-month follow-up period. In addition, the study found a significantly higher rate of improvement in employment outcomes for the ICM group compared with the usual care group. The quality of causal evidence presented in this report is low because it was based on a randomized controlled trial with high attrition and the authors did not account for differences between the two groups in their analysis. This means we are not confident that the estimated effects are attributable to the ICM or usual care program; other factors are likely to have contributed.","Intensive Case Management (ICM) and Usual Care Programs","Other employment and reemployment Substance abuse recovery","Female, Low income",,"United States",2009, "The Employment Retention and Advancement project: Findings for the Eugene and Medford, Oregon, models: Implementation and early impacts for two programs that sought to encourage advancement among low-income workers.","Molina, F., van Dok, M., Hendra, R., Hamilton, G., and Cheng, W. (2009). The Employment Retention and Advancement project: Findings for the Eugene and Medford, Oregon, models: Implementation and early impacts for two programs that sought to encourage advancement among low-income workers. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. [TAAG - Medford]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of post-employment job supports on former and current welfare recipients’ employment and benefits receipt outcomes after 1.5 years. The Medford site was one of four in Oregon that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,164 single parents to either a treatment group that received ERA services or a control group that could participate in other programs in the community. People in the study were current or recent Temporary Assistance for Needy Families (TANF) program participants or people enrolled in other benefit programs that required clients to participate in employment or training. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records and a survey administered 12 months after random assignment. The study found that participants assigned to the Medford ERA program earned, on average, $40 more per week in the first year after random assignment than those in the control group. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to the Medford ERA program and not to other factors.","the Employment Retention and Advancement Project, Medford","Other employment and reemployment Other training and education Unemployment Insurance","Low income",,"United States",2009,http://www.mdrc.org/sites/default/files/full_367.pdf "Growing America through entrepreneurship: Final evaluation of Project GATE","Benus, J., Shen, T., Zhang, S., Chan, M., & Hansen, B. (2009). Growing America through entrepreneurship: Final evaluation of Project GATE. Washington, DC: IMPAQ International.","Entrepreneurship and Self-Employment","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Unfavorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Growing America Through Entrepreneurship (Project GATE) demonstration project, which offered entrepreneurship training and business counseling to low-income individuals, on participants’ employment and earnings. The authors randomly assigned study participants to a treatment group, which could participate in Project GATE, or a control group, which could not participate. The authors collected information from all participants through follow-up surveys 6, 18, and 60 months after random assignment. The study found that Project GATE increased the likelihood of business ownership in the second and third quarters after random assignment. The study found few statistically significant impacts on employment or earnings over the 60-month follow-up period, though generally the Project GATE participants were slightly less likely than the control group members to be employed in later follow-up periods. The quality of causal evidence presented in this report is high for outcomes measured in the first two quarters after assignment because these outcomes were based on a well-implemented randomized controlled trial. However, outcomes measured at other follow-up points present low causal evidence because of high attrition and insufficient adjustment for differences in previous employment and earnings history.","the Project Growing America Through Entrepreneurship (GATE) Demonstration","Job search assistance and supportive services Other training and education","Low income",,"United States",2009,https://www.impaqint.com/sites/default/files/project-reports/Project%20GATE%20F… "The Employment Retention and Advancement project: Findings for the Eugene and Medford, Oregon, models: Implementation and early impacts for two programs that sought to encourage advancement among low-income workers. [PROGRESS—Eugene]","Molina, F., van Dok, M., Hendra, R., Hamilton, G., & Cheng, W. (2009). The Employment Retention and Advancement project: Findings for the Eugene and Medford, Oregon, models: Implementation and early impacts for two programs that sought to encourage advancement among low-income workers. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. [PROGRESS—Eugene]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of post-employment job supports on former welfare recipients’ employment and benefits receipt outcomes after 1.5 years. The Eugene site was one of four in Oregon that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,137 employed people who were recent Temporary Assistance for Needy Families (TANF) program participants to either a treatment group that received ERA services or a control group that could participate in other employment-related programs in the community. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records and a survey administered 12 months after random assignment. The study did not find any statistically significant effects on earnings, employment, or benefits receipt 1.5 years after random assignment. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we would be confident that any estimated effects would be attributable to the Eugene ERA program and not to other factors. However, the study did not find statistically significant effects.","the Employment Retention and Advancement Project, Eugene","Other employment and reemployment Unemployment Insurance","Low income",,"United States",2009,http://www.acf.hhs.gov/sites/default/files/opre/era_eug_medi.pdf "The Employment Retention and Advancement project: Results from the Substance Abuse Case Management program in New York City.","Martinez, J., Azurdia, G., Bloom, D., and Miller, C. (2009). The Employment Retention and Advancement project: Results from the Substance Abuse Case Management program in New York City. New York: MDRC.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: The study’s objective was to examine the impact of the New York City Substance Abuse Case Management (SACM) program on employment, earnings, and public assistance receipt. The SACM program is part of the Employment Retention and Advancement (ERA) project. The authors assigned 8,831 low-income adults with substance abuse issues to either the SACM program or existing services. The authors analyzed data from Unemployment Insurance (UI), Temporary Assistance for Needy Families (TANF), and Food Stamps administrative records. This review was conducted in collaboration with the Employment Strategies for Low-Income Adults Evidence Review (ESER). Because ESER did not report findings for studies that received a low causal evidence rating, the CLEAR profile does not report the findings either. The quality of causal evidence presented in this report is low because assignment to the program was not random, the treatment and control groups differed at baseline, and the authors did not appropriately account for differences in pre-intervention measures. This means we are not confident that the estimated effects are attributable to the SACM program; other factors are likely to have contributed.","the Employment Retention and Advancement (ERA) Project, New York City","Other employment and reemployment Substance abuse recovery","Low income",,"United States, Urban",2009,http://www.mdrc.org/sites/default/files/full_551.pdf "Working toward Wellness: Early results from a telephone care management program for Medicaid recipients with depression.","Kim, S., LeBlanc, A. and Michalopoulos, C. (2009). Working toward Wellness: Early results from a telephone care management program for Medicaid recipients with depression. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impacts of a telephone care management program, Working toward Wellness (WtW), on low-income depressed parents’ employment and earnings. The study used a randomized controlled trial design, assigning eligible parents to either the WtW program or existing services. Authors used data from a six-month follow-up survey to estimate program impacts, accounting for parents’ characteristics before random assignment. The study did not find any statistically significant effects of the WtW program on employment or earnings. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects would be attributable to WtW and not to other factors. However, the study did not find statistically significant effects.","Working toward Wellness (WtW)","Other employment and reemployment","Low income, Parent",,"United States",2009,http://www.acf.hhs.gov/sites/default/files/opre/working_wellness.pdf "Essays on welfare, children, and families","Zhu, Yi. (2009.) Essays on welfare, children, and families. (Unpublished dissertation, Michigan State University.)","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the effect of child care subsidies through the Child Care and Development Fund (CCDF) program on the employment of low-income single mothers. The author used data from the 2001–2007 Current Population Survey (CPS). The treatment condition was defined as the amount of the state child care subsidy for single mothers with children younger than 13. The study found a statistically significant relationship between the amount of child care subsidies and single mothers’ full-time employment. The study did not find relationships between child care subsidies and other employment outcomes examined. The quality of causal evidence presented in this report is low because the author did not account for existing differences between the mothers who did and did not receive the child care assistance. This means we are not confident that the estimated effects are attributable to the child care subsidies; other factors are likely to have contributed.","Child Care Subsidies","Other employment and reemployment","Low income, Parent",,"United States",2009, "Strategies to help low-wage workers advance: Implementation and early impacts of the Work Advancement and Support Center (WASC) demonstration. [Dayton]","Miller, C., Tessler, B., & Van Dok, M. (2009). Strategies to help low-wage workers advance: Implementation and early impacts of the Work Advancement and Support Center (WASC) demonstration. New York City: MDRC. [Dayton]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the early impacts of participation in the Work Advancement and Support Center (WASC) demonstration on employment, earnings, education and training, and receipt of public benefits outcomes. The authors randomly assigned eligible individuals to either a treatment group that received WASC services or to a control group that received existing job placement services focused on employment. The authors analyzed data from Unemployment Insurance records, Ohio state administrative records, and a survey administered 12 months after random assignment. In the Dayton site’s first year, the study found that WASC increased participants’ receipt of Food Stamps by about 10 percent. The study also found that WASC participants were more likely to obtain a license or training certificate than control group members (18.1 percent compared with 11.3 percent, respectively). The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to WASC and not to other factors.","the Work Advancement and Support Center (WASC) Demonstration","Other employment and reemployment Other training and education","Low income",,"United States",2009,http://www.mdrc.org/sites/default/files/full_516.pdf "Strategies to help low-wage workers advance: Implementation and early impacts of the Work Advancement and Support Center (WASC) demonstration. [San Diego]","Miller, C., Tessler, B., & Van Dok, M. (2009). Strategies to help low-wage workers advance: Implementation and early impacts of the Work Advancement and Support Center (WASC) demonstration. New York City: MDRC. [San Diego]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the early impacts of participation in the Work Advancement and Support Center (WASC) demonstration on employment, earnings, education and training, and receipt of public benefits outcomes. The authors randomly assigned eligible individuals to either a treatment group that received WASC services or to a control group that received existing job placement services focused on employment. The authors analyzed data from Unemployment Insurance records, San Diego county administrative records, and a survey administered 12 months after random assignment In the San Diego site’s first year, the study found that WASC increased participant’s receipt of Food Stamps by about 23 percent. It also found that 63.2 percent of WASC participants were employed for four consecutive quarters compared with 69.7 percent of control group members For outcomes measured with administrative data, the quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects on those outcomes are attributable to WASC and not to other factors. For employment and earnings outcomes measured with survey data, the quality of evidence is low because the authors did not account for preexisting differences between the groups being compared in their analysis. This means we are not confident that the estimated effects on those outcomes are attributable to WASC; other factors are likely to have contributed.","the Work Advancement and Support Center (WASC) Demonstration","Job search assistance and supportive services Other employment and reemployment Other training and education","Low income",,"United States",2009,http://www.mdrc.org/sites/default/files/full_516.pdf "Return on investment analysis of a selected set of workforce system programs in Indiana. [WIA Adult]","Hollenbeck, K. (2009). Return on investment analysis of a selected set of workforce system programs in Indiana. Indianapolis, IN: Indiana Chamber of Commerce Foundation. [WIA Adult]",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Workforce Investment Act (WIA) Adult Program on the employment, earnings, and benefit receipt of low-income adults in Indiana. The author used a nonexperimental method to compare the short-term (three quarters after program exit) and long-term (seven quarters after program exit) employment, earnings, and Unemployment Insurance benefits between those who took part in the WIA Adult Program and those who participated in the WorkOne program. The study found that, compared with those who participated in the WorkOne program, WIA Adult Program participants had higher employment and earnings. The quality of causal evidence presented in this report is low because the author did not ensure that the groups compared were similar before program participation. This means we are not confident that the estimated effects are attributable to the WIA Adult Program; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Workforce Investment Act (WIA) Adult Program","Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) training programs","Adult, Low-skilled, Low income",,"United States",2009,http://www.indianachamber.com/images/media/studies/ROIanalysisWorkforceDevelopm… "Return on investment analysis of a selected set of workforce system programs in Indiana. [WIA Dislocated Worker]","Hollenbeck, K. (2009). Return on investment analysis of a selected set of workforce system programs in Indiana. Indianapolis, IN: Indiana Chamber of Commerce Foundation. [WIA Dislocated Worker]",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Workforce Investment Act (WIA) Dislocated Worker program on the employment rate, earnings, and benefit receipt of low-income adults who are dislocated workers. The author used a nonexperimental method to compare the short-term (three quarters after program exit) and long-term (seven quarters after program exit) employment, earnings, and Unemployment Insurance benefits between those who took part in the WIA Dislocated Worker Program relative to those who participated in the WorkOne program. The study found that, compared with those who participated in the WorkOne program, WIA Dislocated Worker Program participants had higher employment and earnings and lower benefit receipt. The quality of causal evidence presented in this report is low because the author did not ensure that the groups compared were similar before program participation. This means we are not confident that the estimated effects are attributable to the WIA Dislocated Worker program; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Workforce Investment Act (WIA) Dislocated Worker Program","Job search assistance and supportive services Other employment and reemployment Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) training programs","Dislocated or displaced worker, Low income",,"United States",2009,http://www.indianachamber.com/images/media/studies/ROIanalysisWorkforceDevelopm… "Return on investment analysis of a selected set of workforce system programs in Indiana. [WIA Youth]","Hollenbeck, K. (2009). Return on investment analysis of a selected set of workforce system programs in Indiana. Indianapolis, IN: Indiana Chamber of Commerce Foundation. [WIA Youth]",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the Workforce Investment Act (WIA) Youth Program on the employment and earnings of low-income youths in Indiana State. The author used a nonexperimental method to compare the short-term (three quarters after program exit) and long-term (seven quarters after program exit) employment and earnings between youth who took part in the WIA Youth Program relative to youth who participated in the WorkOne program. The study found no statistically significant relationships between WIA Youth Program participants and employment and earnings. The quality of causal evidence presented in this report is low because the author did not ensure that the groups compared were similar before program participation. This means we would not be confident that any estimated effects are attributable to the WIA Youth Program; however, the study did not find statistically significant effects. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Workforce Investment Act (WIA) Youth Program","Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) training programs Youth programs",Youth,,"United States",2009,http://www.indianachamber.com/images/media/studies/ROIanalysisWorkforceDevelopm… "Return on investment analysis of a selected set of workforce system programs in Indiana. [TAA]","Hollenbeck, K. (2009). Return on investment analysis of a selected set of workforce system programs in Indiana. Indianapolis, IN: Indiana Chamber of Commerce Foundation. [TAA]",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Trade Adjustment Assistance (TAA) Program on the employment, earnings, and benefit receipt of dislocated workers in Indiana. The author used a nonexperimental method to compare the short-term (three quarters after program exit) and long-term (seven quarters after program exit) employment and earnings between those who took part in the TAA Program relative to those who participated in the WorkOne program. The study found that, compared with those who participated in the WorkOne program, TAA Program participants had higher employment and lower benefit receipt. The quality of causal evidence presented in this report is low because the author did not ensure that the groups compared were similar before program participation. This means we are not confident that the estimated effects are attributable to the TAA Program; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Trade Adjustment Assistance (TAA) Program","Adult and Dislocated Worker programs Job search assistance and supportive services","Dislocated or displaced worker",,"United States",2009,http://www.indianachamber.com/images/media/studies/ROIanalysisWorkforceDevelopm… "Return on investment analysis of a selected set of workforce system programs in Indiana. [Sub-baccalaureate Postsecondary Education]","Hollenbeck, K. (2009). Return on investment analysis of a selected set of workforce system programs in Indiana. Indianapolis, IN: Indiana Chamber of Commerce Foundation. [Sub-baccalaureate Postsecondary Education]",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study objective was to examine the impact of the Sub-baccalaureate Postsecondary Education Program on the employment and earnings of adults with a high school education in Indiana. The author used a nonexperimental method to compare the short-term (three quarters after program exit) and long-term (seven quarters after program exit) employment and earnings between those who took part in the Sub-baccalaureate Postsecondary Education Program and those who participated in the WorkOne program. The study found that, compared with those who participated in the WorkOne program, Sub-baccalaureate Postsecondary Education Program participants had higher employment and earnings. The quality of causal evidence presented in this report is low because the author did not ensure that the groups compared were similar before program participation. This means we are not confident that the estimated effects are attributable to the Sub-baccalaureate Postsecondary Education Program; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","Sub-baccalaureate Postsecondary Education Program","Other training and education",Adult,,"United States",2009,http://www.indianachamber.com/images/media/studies/ROIanalysisWorkforceDevelopm… "Evaluating the direct and indirect effects of a conditional income support program: The case of Progresa","Badillo Bautista, C. (2009). Evaluating the direct and indirect effects of a conditional income support program: The case of Progresa (Doctoral dissertation). Retrieved from ProQuest Dissertations & Theses A&I. (Accession No. 1314572898)","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor","Summary: The objective of the study was to examine the impact of Mexico’s conditional cash transfer program (PROGRESA/Oportunidades) on child labor for children ages 8 to 17. Using survey data from a cluster randomized controlled trial, the authors analyzed the average program impact of the PROGRESA/Oportunidades program using a difference-in- differences (DID) regression model for the child labor outcome and cross-sectional models to estimate spillover effects on child labor. The study found the number of children aged 12-16 who worked significantly decreased in cash transfer participating households compared to control households. The quality of causal evidence presented in this study is high because it is based on a well-implemented, low attrition randomized controlled trial. This means we are confident that the estimated effects are attributable to PROGRESA/Oportunidades and not to other factors.",PROGRESA/Oportunidades,"Child labor","Other, Low income",,"Rural, International",2009, "The impact of cash transfers on child labor and school enrollment in Brazil","Cardoso, E., & de Souza, A. F. (2009). The impact of cash transfers on child labor and school enrollment in Brazil. In P. F. Orazem, G. Sedlacek, & Z. Tzannatos (Eds.), Child labor and education in Latin America: An Economic perspective. Houndmills, U.K. and New York: Palgrave Macmillan.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-No impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of two Brazilian income transfer programs (Minimum Income and Bolsa Escola) on child labor and school enrollment. The authors used a nonexperimental design to compare the outcomes of children ages 10 to 15 that received the conditional cash transfers with those who had not, based on data from the 2000 Brazilian Census. Using several demographic characteristics, they created a matched comparison group of families who had not received the transfers but who had similar characteristics to the treatment group to assess the effectiveness of the cash transfer program. The study found that the income transfer programs were significantly associated with an increase in school enrollment but not significantly associated with child labor. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the income transfer programs; other factors are likely to have contributed.","Income Transfer Programs (Minimum Income Program and Bolsa Escola)","Child labor","Other, Low income",,International,2009,https://ideas.repec.org/p/van/wpaper/0407.html "Education and child labor: Experimental evidence from a Nicaraguan conditional cash transfer program","Maluccio, J. A. (2009). Education and child labor: Experimental evidence from a Nicaraguan conditional cash transfer program. In P. F. Orazem, G. Sedlacek, & Z. Tzannatos (Eds.), Child labor and education in Latin America: An economic perspective (pp. 187-204). New York, NY: Palgrave Macmillan. doi.org/10.1057/9780230620100_12","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Red de Proteccion Social (RPS) cash transfer program on school attendance and enrollment and on child labor for children aged 7-13 in rural Nicaragua. Using panel survey data collected before and one year after program implementation, the author measured the impact of RPS using a randomized controlled trial (RCT). The study found that participation in RPS was significantly related to a reduction in child labor and a significant increase in school enrollment and attendance. The quality of the causal evidence presented in this report is low because, while it was based on an RCT, attrition was high and the authors did not demonstrate that the groups were similar at baseline. This means we are not confident that the estimated effects are attributable to the Red de Proteccion Social; other factors are likely to have contributed.","Red de Protección Social (RPS)","Child labor","Other, Low income",,"International, Rural",2009, "Impact of the Uruguayan conditional cash transfer program","Borraz, F., & González, N. (2009). Impact of the Uruguayan conditional cash transfer program. Cuadernos de economia, 46(134), 243-271. doi:10.4067/S0717-68212009000200006","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to analyze the impact of a conditional cash transfer program (Ingreso Ciudadano) on school attendance (ages 8 to 14) and child labor (ages 6 to 14) among children in Uruguay from 2005 to 2007. Using the annual Uruguayan National Household Survey with cross sectional data from 2006 and 2007, the authors compared school attendance and child labor for households who received the conditional cash transfer to a group of non-participating households who had similar characteristics. The study found no statistically significant relationship between the conditional cash transfer program and school attendance. However, the study found a statistically significant relationship between the program and a reduction in child labor for females in the Montevideo region, but not for males in any region or females in the rest of the country. The quality of causal evidence presented in this report is low because the authors did not demonstrate that groups were similar at baseline. This means we are not confident that the estimated effects are attributable to Ingreso Ciudadano; other factors are likely to have contributed.","Ingreso Ciudadano","Child labor","Other, Low income",,International,2009,https://scielo.conicyt.cl/pdf/cecon/v46n134/art06.pdf "Limiting child labor through behavior-based income transfers: An experimental evaluation of the PETI program in rural Brazil","Yap, Y. T., Sedlacek, G., & Orazem, P. F. (2009). Limiting child labor through behavior-based income transfers: An experimental evaluation of the PETI program in rural Brazil. In P. F. Orazem, G. Sedlacek, & Z. Tzannatos (Eds.), Child Labor and Education in Latin America (pp. 147-165). New York, NY: Palgrave Macmillan. doi.org/10.1057/9780230620100_10","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Programa de Erradicacao do Trabalho Infantil (PETI) or Program to Eradicate Child Labor on child labor and hours in school. The authors used an experimental design to compare the outcomes of children ages 7 to 14 residing in municipalities who received income transfers with those residing in municipalities who did not receive income transfers. Based on data from Brazil’s national household survey, the authors used statistical models to assess the impact of the program in each group. The PETI program was significantly associated with an increase in time in school and less time in work for participating children. The quality of causal evidence presented in this report is low because it is a randomized controlled trial with unknown attrition and the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the PETI program; other factors are likely to have contributed.","Programa de Erradicacao do Trabalho Infantil (PETI) or Program to Eradicate Child Labor","Child labor","Other, Low income",,"International, Rural",2009, "Own and sibling effects of contiditional cash transfer programs: Theory and evidence from Cambodia","Ferreira, F. H. G., Filmer, D., & Schady, N. (2009). Own and sibling effects of conditional cash transfer programs: Theory and evidence from Cambodia (Policy Research Working Paper 5001, Impact Evaluationo Series). Washington, DC: The World Bank.","Child Labor","Study Type: Descriptive Analysis",,,"Summary: The objective of this study was to examine the impact of the CESSP Scholarship Program (CSP), a conditional cash transfer valued at 2-3 percent of household expenditure, on children’s and their ineligible siblings’ school enrollment and work participation in Cambodia. This study is an intent-to-treat regression discontinuity design. Data were collected from applications at all 100 CSP schools, as well as from household surveys at five randomly selected schools and households in five provinces, eighteen months after application. The cutoff score that was used to decide who would receive the scholarship offer was based on the application forms; 26 questions correlated with how likely the child was to drop out of school. Enrollment and work outcomes were compared for students around the cutoff score who did, and did not, receive a scholarship offer and their siblings. The study found children who received the scholarships were significantly more likely to be enrolled in school and less likely to work for pay than those that did not receive the scholarship. However, girls that received the scholarships were significantly more likely to work without pay. This study uses a regression discontinuity design and therefore was reviewed using CLEAR’s descriptive study evidence review guidelines. As such it does not receive a causal rating.","CESSP Scholarship Program (CSP)","Child labor Tuition assistance","Other, Low income",,International,2009, "An empirical study of the effects of Social Security reforms on benefit claiming behavior and receipt using public-use administrative microdata.","Benítez-Silva, H., & Yin, N. (2009). An empirical study of the effects of Social Security reforms on benefit claiming behavior and receipt using public-use administrative microdata. Social Security Bulletin, 69(3), 77-95.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study examined the impact of three policy changes to the Social Security program that went into effect in 2000 on average monthly benefits and the proportion of new claimants by age. The study was a nonexperimental analysis that examined outcomes for older workers by age and year using data from the 2004 Old Age, Survivors, and Disability Insurance program public-use microdata files. The study found that the changes were associated with lower average monthly benefits for individuals ages 66 to 69 after the year 2000 relative to individuals of the same ages in 1994. The quality of the causal evidence presented in this report is low because the authors did not demonstrate that the groups were similar before the intervention. This means we are not confident that the estimated effects are attributable to the intervention program; other factors are likely to have contributed.","Policy Changes to the Social Security Program","Federal retirement benefits Older workers' programs","Adult, Older worker",,"United States",2009,https://papers.ssrn.com/sol3/papers.cfm?abstract_id=1480653 "The repeal of the retirement earnings test and the labor supply of older men.","Engelhardt, G. V., & Kumar, A. (2009). The repeal of the retirement earnings test and the labor supply of older men. Journal of Pension Economics & Finance, 8(4), 429-450.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study examined the impact of the repeal of the earnings test under the Senior Citizens Freedom to Work Act of 2000 on the labor supply and earnings of older men ages 62 to 72. The authors used a nonexperimental approach and data from the Health and Retirement Study to compare labor force participation, annual hours of work, retirement behavior, and earnings of men who were and were not subject to the repeal of the earnings test. The study found that the policy change was associated with a significant increase in older men’s average annual hours of work. The policy change was also associated with a change in the distribution of real earnings in that a smaller proportion of older men had earnings at or below the earnings test threshold. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Senior Citizens Freedom to Work Act of 2000; other factors are likely to have contributed.","Senior Citizens Freedom to Work Act of 2000","Older workers' programs Other disparities or discrimination in employment and earnings","Adult, Older worker, Male",,"United States",2009, "New evidence on the labor supply effects of the Social Security earnings test.","Friedberg, L., & Webb, A. (2009). New evidence on the labor supply effects of the Social Security earnings test. Tax Policy and the Economy, 23(1), 1-36.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study examined the impact of changes to the Social Security earnings test in 1996 and 2000 on employment outcomes. The authors used a nonexperimental design and the data from the Current Population Survey (CPS) and the Health and Retirement Study (HRS) to compare outcomes before and after the changes in earning test rules for those between the ages of 62 and 74 who faced different earnings test thresholds at different ages and years. The study found that upcoming anticipated earnings test between ages 62 to 69 was associated with a significantly lower likelihood of having a job last week. A higher present value of upcoming anticipated earnings threshold between ages 62 to 69 was associated with a significantly higher likelihood of having a job last week. The quality of causal evidence presented in this study is low because the study is a nonexperimental analysis that did not demonstrate that the groups being compared were similar and did not account for possible differences in the analysis. This means we are not confident that the estimated effects are attributable to the changes in the earnings test decision. Other factors are likely to have contributed.","Social Security Earnings Test","Older workers' programs Other employment and reemployment","Adult, Older worker",,"United States",2009, "Essays on incarceration and labor market outcomes.","Jung, H. (2009). Essays on incarceration and labor market outcomes. (Doctoral dissertation.) Retrieved from ProQuest. Accession No. 305059182.",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of participating in the Adult Transition Centers (ATC) work-release program on employment and earnings outcomes for ex-prisoners in Cook County, Illinois. Prisoners in minimum-security prisons who are nearing their release date and meet certain conditions of criminal history are eligible to apply to transfer to ATCs. The study used a nonexperimental design that compared changes in outcomes over time between the treatment group and a matched comparison group. The study used administrative data on prison admission and exit dates from the Illinois Department of Corrections and earnings data from the Illinois Department of Employment Security. The study found no statistically significant relationships between the ATC work-release program and employment or earnings. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we would not be confident that any estimated effects would have been attributable to the ATC work-release program; other factors would likely have contributed, though the study did not find statistically significant effects.","Adult Transition Center Program",Reentry,Justice-involved,,"United States",2009, "Mentoring formerly incarcerated adults: Insights from the Ready4Work reentry initiative.","Bauldry, S., Korom-Djakovic, D., McClanahan, W. S., McMaken, J., & Kotloff, L. J. (2009). Mentoring formerly incarcerated adults: Insights from the Ready4Work reentry initiative. New York, NY: Public Private Ventures.",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the relationships between the Ready4Work mentoring program and post-release employment and recidivism outcomes among previously incarcerated adults. The study uses a nonexperimental design to compare outcomes of Ready4Work participants who did and did not voluntarily participate in mentoring, based on data from states’ public incarceration records and a follow-up questionnaire given to study participants at their program site. The study found statistically significant favorable relationships between Ready4Work mentoring and employment and recidivism outcomes. The quality of causal evidence presented in this report is low because the authors did not account for the fact that study members in the intervention group chose to participate in mentoring and study members in the comparison group chose not to participate in mentoring. This means we are not confident that findings can be attributed to Ready4Work mentoring; other factors are likely to have contributed.","Ready4Work mentoring","Other employment and reemployment Reentry Mentoring",Justice-involved,,"United States",2009,https://www.issuelab.org/resource/mentoring-formerly-incarcerated-adults-insigh… "Pennsylvania Certified Peer Specialist Initiative: Training, employment and work satisfaction outcomes.","Salzer, M. S., Katz, J., Kidwell, B., Federici, M., & Ward-Colasante, C. (2009). Pennsylvania Certified Peer Specialist Initiative: Training, employment and work satisfaction outcomes. Psychiatric Rehabilitation Journal, 32(4), 301-305.","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study examined the relationship between Certified Peer Specialist training and employment for training participants. The authors compared employment rates for participants before and after the training program using training program records and data from a survey administered one year after the training program. The study found that a higher percentage of training participants were employed after the Certified Peer Specialist training than before the training. The quality of causal evidence presented in this report is low because the authors did not account for trends in outcomes before the intervention. This means we are not confident that the estimated effects are attributable to the Certified Peer Specialist training; other factors are likely to have contributed.","Certified Peer Specialist training","Substance abuse recovery Other training and education","Other barriers",,"United States",2009,https://psycnet.apa.org/doi/10.2975/32.4.2009.301.305 "Career Academies: Long-term impacts on labor market outcomes, educational attainment, and transitions to adulthood.","Kemple, J., & Willner, C. (2008). Career Academies: Long-term impacts on labor market outcomes, educational attainment, and transitions to adulthood. New York: MDRC.","Career Academies","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-No impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment","Summary: The report’s objective was to evaluate the impact of Career Academies on labor market participation and educational attainment over the eight years following scheduled high school graduation. Earlier reports presented impact findings over a shorter period. Career Academies are schools within schools that are organized around one occupation or industry. Employer partners help design the curriculum and provide work-based learning experiences for students. The effectiveness of Career Academies was evaluated using a randomized controlled trial conducted in nine high schools located in or near urban school districts. The evaluation included approximately 2,000 students. The study reported statistically significant, positive impacts on average monthly earnings, average hours worked per week, and average hourly wages over the eight years following scheduled high school graduation. However, there were no statistically significant differences in educational attainment of the two groups. The quality of the causal evidence presented in this report is high because it was a well-implemented randomized controlled trial. This means we are confident that the estimated impacts are attributable solely to Career Academies, not other factors.","Career Academies","Youth programs Community college education and other classroom training Work based and other occupational training",Youth,,"Urban, United States",2008,http://www.mdrc.org/sites/default/files/full_50.pdf "Reemployment and Eligibility Assessment (REA) Study: FY 2005 Initiative: final report","Benus, J., Poe-Yamagata, E., Wang, Y., & Blass, E. (2008). Reemployment and Eligibility Assessment (REA) Study: FY 2005 Initiative: final report. Columbia, MD: IMPAQ International. [Minnesota sample]",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: This study’s objective was to assess the effectiveness of the Reemployment and Eligibility Assessment (REA) initiative in Minnesota, a program that provided eligibility and reemployment case management services to Unemployment Insurance (UI) claimants, on UI benefits receipt, wages, and employment. The study randomly assigned 5,898 eligible claimants to one of two treatment groups, which received REA services of varying intensity, or the control group. Those in the treatment groups were required to participate in the services to retain their UI eligibility. The authors estimated the program’s effectiveness by analyzing state administrative records on UI payments and information from a follow-up survey of a subsample of study participants. The study found that UI claimants in the more-intensive treatment group claimed fewer weeks of UI benefits and were less likely to have an overpayment detected. There were no significant impacts on employment or earnings for either treatment group. The quality of causal evidence presented in this report is moderate because it is a randomized controlled trial with different selection processes for the treatment and control groups, but the authors controlled sufficiently for baseline characteristics in the analysis. This means we have some confidence that the estimated effects are attributable to REA, although other factors might also have contributed.","the Reemployment and Eligibility Assessment (REA) Initiative in Minnesota","Job search assistance and supportive services Other employment and reemployment","Dislocated or displaced worker, Unemployed",,"United States",2008,http://wdr.doleta.gov/research/FullText_Documents/Reemployment%20and%20Eligibil… "The return to firm investments in human capital","Almeida, R., & Carneiro, P. (2008). The return to firm investments in human capital. World Bank Social Protection and Labor Discussion Paper No. 0822.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Productivity-Low-Favorable impacts Productivity","Summary: The study’s objective was to examine the returns to firms’ investments in training for their workers. The authors used data from an annual survey conducted by the Portuguese Ministry of Employment, which is a mandatory survey for all Portuguese firms with at least 100 employees, to determine the internal rate of return to the firm of an additional hour of training per employee. The study found that increasing the amount of training per employee by 10 hours per year led to an increase in current productivity of 0.6 percent. The quality of causal evidence presented in this report is low because the instruments used in the estimation approach were weak, as described by the authors. This means we are not confident that the estimated effects are attributable to the training provided to the employees; other factors are likely to have contributed.",,"Work based and other occupational training",Employed,,International,2008,http://siteresources.worldbank.org/SOCIALPROTECTION/Resources/SP-Discussion-pap… "Bring them back, move them forward: Case studies of programs preparing out-of-school youths for further education and careers.","Buschmann, R., & Haimson, J. (2008). Bring them back, move them forward: Case studies of programs preparing out-of-school youths for further education and careers. Princeton, NJ: Mathematica Policy Research.","Opportunities for Youth","Study Type: Descriptive Analysis",,,"Summary: This study examined the work of six dropout recovery programs to explore how similar programs might more effectively prepare youth for postsecondary education and employment. It focused on the key services the programs provided to school dropouts, challenges related to implementing program activities, and strategies to address and resolve these challenges. The researchers conducted one- to two-day visits to each program site, during which they interviewed principals or program directors, instructors, counselors, records administrators, and participating students. They also gathered individual participants’ record data and aggregate reports of key outcomes. The study found that incoming participants’ academic ability varied greatly and that large class sizes sometimes limited the extent to which teachers could adapt their lessons to meet diverse needs. Program staff tried to develop relationships with participants and help them resolve personal problems, but found it difficult to address the most serious problems. Some participants had positive short-term outcomes such as enrolling in education or finding a job. The authors suggested that similar programs might want to consider collecting more cost data for planning purposes, track participants’ progress on educational and employment goals after program completion, and conduct rigorous impact studies to understand how individual program features influence their participants’ outcomes.","Dropout Programs","Job search assistance and supportive services Youth programs Community college education and other classroom training Other training and education",Youth,,"United States",2008,http://www.mathematica-mpr.com/publications/pdfs/bringback_moveforward.pdf "Workforce Investment Act non-experimental net impact evaluation. [Dislocated worker sample]","Heinrich, C., Mueser, P., & Troske, K. (2008). Workforce Investment Act non-experimental net impact evaluation. Columbia, MD: IMPAQ International. [Dislocated worker sample]","Apprenticeship and Work-Based Training, Job Search Assistance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the Workforce Investment Act (WIA) Dislocated Worker Program’s impact on workers’ employment and earnings in 12 states. The authors analyzed administrative data to compare the employment and earnings outcomes of people receiving different tiers of WIA Dislocated Worker Program services with two different matched comparison groups for 16 quarters after program entry. The study found that WIA Dislocated Worker Program services had positive impacts on earnings and employment in most quarters examined. However, those WIA Dislocated Worker Program participants who received core and/or intensive services had significantly better earnings and employment outcomes in the first seven quarters than those who also received training. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the WIA Dislocated Worker Program services, but other factors might also have contributed. The report also examined the impacts of WIA Adult Program services; that profile is available here.","the Workforce Investment Act (WIA) Dislocated Worker Program","Other employer services Adult and Dislocated Worker programs Job search assistance and supportive services Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) Other training and education","Dislocated or displaced worker, Unemployed",,"United States",2008,https://wdr.doleta.gov/research/FullText_Documents/Workforce%20Investment%20Act… "Workforce Investment Act non-experimental net impact evaluation. [Adult sample]","Heinrich, C., Mueser, P., & Troske, K. (2008). Workforce Investment Act non-experimental net impact evaluation. Columbia, MD: IMPAQ International. [Adult sample]","Apprenticeship and Work-Based Training, Job Search Assistance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the Workforce Investment Act (WIA) Adult Program’s impact on workers’ employment and earnings in 12 states. The authors analyzed administrative data to compare the employment and earnings outcomes of people receiving different tiers of WIA Adult Program services with two different matched comparison groups for 16 quarters after program entry. The study found that WIA Adult Program services had positive impacts on earnings and employment in most quarters examined. Those WIA Adult Program participants who received training earned more and were more likely to be employed than those who received only core and intensive services. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the WIA Adult Program services, but other factors might also have contributed. The report also examined the impacts of WIA Dislocated Worker services; that profile is available here.","the Workforce Investment Act (WIA) Adult Program","Adult and Dislocated Worker programs Job search assistance and supportive services Other employment and reemployment Wagner-Peyser Act Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) Other training and education","Unemployed, Low income",,"United States",2008,https://wdr.doleta.gov/research/FullText_Documents/Workforce%20Investment%20Act… "Evaluation of seven Second Chance Act Adult Demonstration Programs: Impact findings at 30 months","D'Amico, R., & Kim, H. (2008). Evaluation of seven Second Chance Act Adult Demonstration Programs: Impact findings at 30 months. Oakland, CA: Social Policy Research Associates. Retrieved from the National Criminal Justice Reference Service website: https://www.ncjrs.gov/pdffiles1/nij/grants/251702.pdf.",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine the impact of the Second Chance Act (SCA) Adult Demonstration Program on employment, earnings, and recidivism. The study was a randomized controlled trial involving a sample of people recently or soon to be released from incarceration. The primary data sources included administrative data on employment and earnings from the National Directory of New Hires, state and local corrections records of recidivism, and 18-month follow-up survey data on employment, earnings, and recidivism. The authors used a statistical model to compare the outcomes of treatment and control group members, both overall and among groups with higher and lower risk of recidivism. The study found that the SCA program had no impacts on earnings, employment, or recidivism. Further, several recidivism outcomes from the administrative data sources demonstrated an increase in crime or crime-related activities. Among those in the sample at lower risk for recidivism, the study found that the program was associated with a larger number of reconvictions 30 months after random assignment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects for the full sample would have been attributable to the SCA Adult Demonstration Program and not to other factors had the study found statistically significant effects. The quality of causal evidence of the analyses by risk-level is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects for the risk subgroups are attributable to the SCA Adult Demonstration Program; other factors are likely to have contributed.","the Second Chance Act (SCA) Adult Demonstration Program","Health Reentry Other training and education",Justice-involved,,"United States",2008,https://www.ncjrs.gov/pdffiles1/nij/grants/251702.pdf "Evaluation of customized employment in building the capacity of the workforce development system","Elinson, L., Frey, W. D., Li, T., Palan, M. A., & Horne, R. L. (2008). Evaluation of customized employment in building the capacity of the workforce development system. Journal of Vocational Rehabilitation, 28(3), 141-158.","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Unfavorable impacts Earnings and wages Employment-Low-Unfavorable impacts Employment","Summary: The study’s objective was to examine the impact of customized employment services for disabled adults on earnings and employment. Using administrative data, the authors compared employment and earnings outcomes of people who participated in a customized employment intervention with outcomes of people who participated in a Working for Freedom, Opportunity, and Real Choice through Community Employment (WorkForce) intervention. The study found that those in the customized employment intervention were more likely to be employed for at least 12 months and to earn at least $8.15 per hour after participating in the intervention compared with the WorkForce group. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the WorkForce intervention; other factors are likely to have contributed.","the customized employment services","Job search assistance and supportive services Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA)",Disability,,"United States",2008,https://content.iospress.com/articles/journal-of-vocational-rehabilitation/jvr0… "Workforce Investment Act non-experimental net impact evaluation final report","Heinrich, C., Mueser, P., Troske, K., & Benus, J. (2008). Workforce Investment Act non-experimental net impact evaluation final report. Columbia, MD: IMPAQ International, LLC.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages","Summary: The report’s objective was to examine the effects of participation in the Workforce Investment Act (WIA) Adult and Dislocated Worker programs on average earnings and employment. Results for earnings of participants ages 22 to 26 were presented separately and are the focus of this review. The effectiveness of the programs was evaluated using a matched comparison group design. Outcomes were examined up to 10 quarters after WIA participants entered the Adult or Dislocated Worker programs. The study found that participants in the WIA Adult Program under age 26 earned significantly more than those in the comparison group every quarter after program entry. In the WIA Dislocated Worker program, participants under age 26 began earning significantly more than those in the comparison group a year following program entry. The quality of the causal evidence presented in this study is moderate. This means we have confidence that the effects estimated in this study are attributable at least in part to WIA programs. However, as in any nonexperimental study, other factors not accounted for in the analysis might have contributed to the estimated effects.","the Workforce Investment Act (WIA)","Basic skills Community college education and other classroom training Job search assistance and supportive services Other training and education Work based and other occupational training","Adult, Youth, Dislocated or displaced worker, Female, Male",,"United States",2008,http://www.nawdp.org/Content/NavigationMenu/ResearchReports/2009-10-WIANon-Expe… "Cognitive and non-cognitive predictors of success in adult education programs: Evidence from experimental data with low-income welfare recipients","Leininger, L. J., & Kalil, A. (2008). Cognitive and non-cognitive predictors of success in adult education programs: Evidence from experimental data with low-income welfare recipients. Journal of Policy Analysis and Management, 27, 521-535. doi: 10.1002/pam.20357","Literacy, Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of an education-focused intervention and an employment-focused intervention on education outcomes. The authors used data from a randomized controlled trial, the National Evaluation of Welfare-to-Work Strategies (NEWWS). The NEWWS study randomly assigned individuals within seven geographic locations to one of three conditions: an education-focused intervention, an employment-focused intervention, or the control group. The current study used a subsample to examine participants’ completion of a high school diploma or equivalent two years after being assigned to one of the conditions. The study found that participation in the education-focused intervention was significantly associated with a higher likelihood of receiving a high school diploma or equivalent relative to the control group. The quality of the causal evidence presented in this study is moderate because, although it was based on a randomized controlled trial with unknown attrition, the authors demonstrated that the treatment and control groups were similar before the intervention. This means we have confidence that the estimated effects are attributable at least in part to the education-focused or employment-focused interventions, although other factors could also have contributed.","the Education-Focused and Employment-Focused Interventions","Basic skills Other training and education","Adult, Low income",,"United States",2008,https://onlinelibrary.wiley.com/doi/abs/10.1002/pam.20357 "Effects of public policies on the disposition of pre-retirement lump-sum distributions: Rational and behavioral influences","Burman, L., Coe, N., Dworsky, N., & Gale, W. (2008). Effects of public policies on the disposition of pre-retirement lump-sum distributions: Rational and behavioral influences. CentER Discussion Paper Series No. 2008-94.","Behavioral Finance: Retirement","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employer benefits receipt-Low-Favorable impacts Employer benefits receipt","Summary: The study’s objective was to determine whether tax policies that differently frame the rollover of lump-sum distributions (LSDs) from defined-contribution retirement plans into tax-preferred funds affected rollover behavior. The authors investigated two tax reforms, the first in 1986 and the second in 1993. The 1986 reform levied an additional tax of 10 percent on LSDs (framed as a penalty) that were not rolled over into tax-preferred funds. The 1993 reform required LSDs to provide an automatic rollover option and increased tax withholding rates on cash LSDs. The authors used data from the 1993 Current Population Survey Employee Benefit Supplement to analyze the effects of the 1986 tax reform and data from the 1992–2004 Health and Retirement Study to assess the effect of the 1993 tax reform. Treating the tax rate on LSDs as a penalty in the 1986 reform framework increased LSD rollovers by 16 to 32 percentage points for the average individual in the study. The 1993 reforms led to a 10 to 13 percentage point increase in rollovers for the average individual in the study. The quality of causal evidence provided in this study is low. This means that we are not confident that the estimated effects are attributable to the intervention alone; other factors are likely to have contributed.","the 1986 Tax Reform Act and 1993 Addendum","Federal retirement benefits",Employed,,"United States",2008, "Effectiveness of supported employment for individuals with schizophrenia: Results of a multi-site, randomized trial","Cook, J., Blyler, C., Burke-Miller, J., McFarlane, W., Leff, H., Mueser, K., Gold, P., Goldberg, R., Shafer, M., Onken, S., Donegan, K., Carey, M., Razzano, L., Grey, D., Pickett-Schenk, S., & Kaufmann, C. (2008). Effectiveness of supported employment for individuals with schizophrenia: Results of a multi-site, randomized trial. Clinical Schizophrenia & Related Psychoses, 37-46.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to estimate the 24-month employment effects of supported employment interventions on people with severe mental illness, focusing on those with schizophrenia. Supported employment interventions use a combination of employment and health services and supports to improve employment and other outcomes. The authors analyzed data from seven sites, each of which implemented a distinct supported employment intervention using a randomized controlled trial. At each site, researchers interviewed participants in person twice yearly and collected weekly employment data. The study found that the programs were effective at improving 24-month employment outcomes for people with severe mental illness. Relative to treatment group members with different severe mental illnesses, people with a diagnosis of schizophrenia who received supported employment services were more likely to be employed after receiving those services. The quality of causal evidence provided in this study is moderate. This means we are somewhat confident that the estimated effects are attributable to the supported employment interventions, but other factors might also have contributed.","Supported Employment Programs","Health Job search assistance and supportive services Supported employment or other employment supports",Disability,,"United States",2008, "Reemployment and Eligibility Assessment (REA) Study: FY 2005 Initiative: final report","Benus, J., Poe-Yamagata, E., Wang, Y., & Blass, E. (2008). Reemployment and Eligibility Assessment (REA) Study: FY 2005 Initiative: final report. Columbia, MD: IMPAQ International. [North Dakota sample]",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: This study’s objective was to assess the effectiveness of the Reemployment and Eligibility Assessment (REA) Initiative in North Dakota, a program that provided eligibility and reemployment case management services to Unemployment Insurance (UI) claimants, on UI benefits receipt, wages, and employment. The study randomly assigned nearly 2,000 eligible claimants to either the treatment group, which could receive REA services, or the control group, which could not access the same REA services. Those in the treatment group were required to participate in the services to retain their UI eligibility. The authors estimated the program’s effectiveness by analyzing state administrative records on UI payments and information from a follow-up survey of a subsample of study participants. The study found no statistically significant impacts of REA on UI benefits receipt, employment, or earnings. The quality of causal evidence presented in this report is high for the UI benefits receipt outcomes because it is based on a well-implemented randomized controlled trial. For the employment and wages outcomes, the quality of evidence presented in this report is moderate.","JSA services","RESEA Job search assistance and supportive services Other employment and reemployment","Dislocated or displaced worker, Unemployed",,"United States",2008,http://wdr.doleta.gov/research/FullText_Documents/Reemployment%20and%20Eligibil… "A good start: Two-year effects of a freshman learning community program at Kingsborough Community College","Scrivener, S., Bloom, D., LeBlanc, A., Paxson, C., Rouse, C.E., & Sommo, C. (2008). A good start: Two-year effects of a freshman learning community program at Kingsborough Community College. New York: MDRC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of Opening Doors learning communities at Kingsborough Community College in New York on progress toward completing a degree and enrollment in a four-year college in the program semester and three follow-up semesters. Students in the Opening Doors learning communities took three linked courses during one semester and were provided tutoring and case management services. The study was a randomized controlled trial. Eligible students were randomly assigned to either the treatment group, which was offered the opportunity to participate in a learning community, or the control group, which was not allowed to enroll in a learning community. The primary data sources were a baseline survey on the background characteristics of students, student transcripts, and degree attainment information from the National Student Clearinghouse. The study found that the treatment group earned significantly more credits than the control group, cumulatively across the program semester and the three follow-up semesters,. However, during that time, there were no significant cumulative differences between the two groups on registration for any courses, the number of semesters registered, or enrollment in either a two- or four-year college. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects would be attributable to the learning communities, and not to other factors.","Opening Doors Learning Communities at Kingsborough Community College","Community college education and other classroom training","Adult, Low income",,"United States",2008,http://www.mdrc.org/sites/default/files/A%20Good%20Start.pdf "Learning better together: The impact of learning communities on the persistence of low-income students","Engstrom, C., & Tinto, V. (2008). Learning better together: The impact of learning communities on the persistence of low-income students. Opportunity Matters: A Journal of Research Informing Educational Opportunity Practice and Programs, 1(1), 5-21.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of learning communities on community college students’ persistence from freshman to sophomore year, an outcome in the progress toward degree completion domain. The authors used a nonrandom approach to select treatment and comparison students to include in their analysis. To measure the relationship between participation in a learning community and persistence, the authors used survey and administrative data from 13 community colleges to estimate a logistic regression. The study found that 62 percent of learning community students persisted from freshman to sophomore year, compared with 57 percent of comparison group students. This difference was statistically significant. The quality of causal evidence presented in this report is low because the authors did not use sufficient controls in their analysis. This means we are not confident that the estimated effects are attributable to learning communities. Other factors are likely to have contributed.","Learning Communities","Community college education and other classroom training Basic skills","Adult, Other barriers, Low income",,"United States",2008, "Rehabilitation of traumatic brain injury in active duty military personnel and veterans: Defense and Veterans Brain Injury Center randomized controlled trial of two rehabilitation approaches","Vanderploeg, R., Schwab, K., Walker, W., Fraser, J., Sigford, B., Date, E., . . . Warden, D. (2008). Rehabilitation of traumatic brain injury in active duty military personnel and veterans: Defense and Veterans Brain Injury Center randomized controlled trial of two rehabilitation approaches. Archives of Physical Medicine and Rehabilitation, 89(12), 2227-2237.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-No impacts Employment Education and skills gains-Mod/high-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of two treatments—cognitive-didactic rehabilitation and functional-experiential rehabilitation—on return to work/school and functional independence among veterans and active military with traumatic brain injury (TBI). The study used a randomized controlled trial design in which 366 active duty military service members or veterans with moderate-to-severe TBI were randomly assigned to receive either cognitive-didactic rehabilitation, which focuses on addressing cognitive deficits, or functional-experiential rehabilitation, which emphasizes performance of real-life tasks. Primary outcomes were measured using in-person evaluations or structured telephone interviews. The study found no significant differences in return to work or school or functional independence between the two types of rehabilitation. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects would be attributable to the difference between the cognitive-didactic and functional-experiential treatments and not to other factors. However, the study did not find statistically significant effects between the two treatments.","Cognitive-Didactic and Functional-experiential rehabilitation","Vocational rehabilitation Veterans' reemployment","Disability, Veteran or military",,"United States",2008, "The outcomes of policies designed to eliminate discrimination","Choe, C. (2008). The outcomes of policies designed to eliminate discrimination (Doctoral dissertation). University of Arizona.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Unfavorable impacts Earnings and wages Employment-Low-Unfavorable impacts Employment","Summary: The study’s objective was to examine the impact of the Americans with Disabilities Act (ADA) of 1990 on the employment and wages of men with disabilities relative to men without disabilities. The study used data from the Survey of Income and Program Participation (SIPP) from 1984, 1990, 1996, and 2001. The analysis attempted to determine how much of the difference in wages between men with and without disabilities was explained by background characteristics and how much was not; the portion that was not was interpreted as the effect of discrimination. The study found that neither the employment nor wages of men with disabilities improved relative to men without disabilities following passage of the ADA. Instead, employment and wage differentials both increased. However, the unexplained portion of the wage gap narrowed significantly after the ADA, consistent with a decrease in discrimination, among other explanations. The quality of causal evidence presented in this report is low because the author did not establish the comparability of men with and without disabilities before passage of the ADA. This means we are not confident that the estimated effects are attributable to the ADA. Other factors are likely to have contributed.","the Americans with Disabilities Act of 1990","Americans with Disabilities Act (ADA)","Disability, Male",,"United States",2008, "The Employment Retention and Advancement project: Results from the Valuing Individual Success and Increasing Opportunities Now (VISION) program in Salem, Oregon","Molina, F., Cheng, W., and Hendra, R. (2008). The Employment Retention and Advancement project: Results from the Valuing Individual Success and Increasing Opportunities Now (VISION) program in Salem, Oregon. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Salem, Oregon, Valuing Individual Success and Increasing Opportunities Now (VISION) program on employment, earnings, and public benefits receipt among eligible single parents. VISION provided job search assistance and post-employment services to unemployed Temporary Assistance for Needy Families (TANF) applicants. The study used a randomized controlled trial to assign TANF applicants eligible for welfare-to-work programs to either VISION or the state’s typical welfare-to-work program, Job Opportunities and Basic Skills Training (JOBS), from May 2002 to May 2004. To estimate differences in outcomes between the two study groups, the authors retrieved data from unemployment insurance wage records, TANF and Food Stamps administrative records, and a 12-month follow-up survey. The study found that people in the VISION group received, on average, $365 more in TANF benefits and $160 more in Food Stamps than those in the JOBS group during the first year after random assignment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to VISION, and not to other factors.","the Salem Valuing Individual Success and Increasing Opportunities Now (VISION) Program","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States",2008,http://files.eric.ed.gov/fulltext/ED501587.pdf "The Employment Retention and Advancement project: A comparison of two job club strategies: The effects of enhanced versus traditional job clubs in Los Angeles","Navarro, D., Azurdia, G., & Hamilton, G. (2008). The Employment Retention and Advancement project: A comparison of two job club strategies: The effects of enhanced versus traditional job clubs in Los Angeles. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to gauge the effect of a Los Angeles job club focused on participants’ career interests on employment, earnings, and benefits receipt outcomes after about 18 months. The Los Angeles site was one of 16 nationwide to participate in the Employment Retention and Advancement (ERA) project. (See the CLEAR review of the final report here.) The authors randomly assigned almost 1,200 single-parent Temporary Assistance for Needy Families (TANF) recipients to either a treatment group, which received Enhanced Job Club (EJC) services, or a control group, which received Traditional Job Club (TJC) services. The authors collected employment and earnings data from Unemployment Insurance (UI) records and used automated TANF and Food Stamps databases to obtain benefits receipt information. The study found that, 18 months after random assignment, there were no statistically significant differences between EJC and control group members’ employment, earnings, or public benefits receipt. The quality of causal evidence provided in this study is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects would be attributable to the EJC and not to other factors. However, the study found no statistically significant impacts.","the Employment Retention and Advancement project, Los Angeles’s Enhanced Job Club","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States, Urban",2008,http://www.acf.hhs.gov/sites/default/files/opre/era_la.pdf "Evaluation of the Boys & Girls Clubs of America Targeted Re-Entry Initiative","Barton, W., Jarjoura, G., & Rosay, A. (2008). Evaluation of the Boys & Girls Clubs of America Targeted Re-Entry Initiative. Indianapolis: Indiana University School of Social Work, and Anchorage: Justice Center, University of Alaska Anchorage.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: The study’s objective was to examine the impact of the Boys & Girls Clubs of America’s Targeted Re-Entry Initiative on youth’s recidivism. The authors used administrative data to match Initiative participants to a comparison group of nonparticipants released from the same rehabilitation facilities. The authors compared recidivism rates among program participants and the comparison group. The authors reported a statistically significant relationship between participation in the Targeted Re-Entry Initiative and higher rates of re-arrest at one of the three sites studied, and no statistically significant correlations at the other two sites. The quality of causal evidence presented in this report is low because the authors did not include sufficient controls for pre-existing differences between the study groups in their analysis. This means we are not confident that the estimated effects are attributable to the Boys & Girls Clubs of America Targeted Re-Entry Initiative; other factors are likely to have contributed.","the Boys & Girls Clubs of America Targeted Re-Entry Initiative","Basic skills Health Job search assistance and supportive services Other training and education Reentry Substance abuse recovery Youth programs Behavioral Interventions","Youth, Justice-involved, Disconnected youth",,"United States",2008,http://justice.uaa.alaska.edu/research/2000/0411.targeted_reentry/0411.05.targe… "The impact of reentry services on juvenile offenders’ recidivism","Bouffard, J., & Bergseth, K. (2008). The impact of reentry services on juvenile offenders’ recidivism. Youth Violence and Juvenile Justice, 6(3), 295-318.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: The study examined the impact of structured after-care and reentry services for justice-involved youth on their recidivism rates. The study used a nonexperimental design to compare youth who received reentry services to a comparison group of youth who received traditional services in a neighboring county. Data came from the local juvenile court databases, probation and transitional coordinator files, and electronic records used by case managers to track client contacts. The study found that there were no statistically significant differences between study groups in time to first reoffense or in number of criminal contacts with the justice system. The quality of causal evidence presented in this report is low because all treated youth were in one county and all comparison youth were in another. This means we are not confident that the estimated effects are attributable to the after-care and reentry program; other factors are likely to have contributed.","After-care and Reentry Services","Mentoring Reentry Youth programs","Youth, Justice-involved, Disconnected youth",,"United States, Rural",2008, "The Employment Retention and Advancement project: Findings for the Cleveland Achieve model: Implementation and early impacts of an employer-based approach to encourage employment retention among low-wage workers","Miller, C., Martin, V., Hamilton, G., Cates, L., and Deitch, V. (2008). The Employment Retention and Advancement project: Findings for the Cleveland Achieve model: Implementation and early impacts of an employer-based approach to encourage employment retention among low-wage workers. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to determine the impact of a program designed to increase employment retention among low-wage workers in the long-term nursing care industry in Cleveland, Ohio. Cleveland was one of 16 sites nationwide to participate in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 44 firms to either a treatment group, whose employees could receive employment retention services through Cleveland Achieve, or a control group. The authors collected data on employee turnover directly from firms and employment and earnings data from state Unemployment Insurance (UI) records. Two years after random assignment, the study did not find statistically significant differences in the turnover rates, employment rates, or earnings of employees in Achieve firms compared with employees in firms that did not have access to Achieve services. The quality of causal evidence provided in this study is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects would be attributable to the Achieve program, and not to other factors. However, the study found no statistically significant impacts.","the Employment Retention and Advancement project, Cleveland","Other employment and reemployment Unemployment Insurance","Low income","Health care and social assistance","United States, Urban",2008,http://www.acf.hhs.gov/sites/default/files/opre/cleveland.pdf "Evaluation of the Suffolk County juvenile treatment court: Process and impact findings","Kralstein, D. (2008). Evaluation of the Suffolk County juvenile treatment court: Process and impact findings. New York: Center for Court Innovation.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: The study’s objective was to examine the impact of Suffolk County’s juvenile drug court on recidivism. The study used propensity scores based on state and county administrative records to match juveniles who participated in the drug court to similar juveniles in the year before the introduction of the drug court. The author used regression analysis to estimate the relationship between participation in the juvenile drug court and the number and rate of arrests 18 and 24 months following the initial petition. The study found no statistically significant relationship between the juvenile drug court and recidivism. The quality of causal evidence presented in this report is low because the study did not account for other changes that could have taken place at the same time as the introduction of the drug court and affected juvenile recidivism. This means we are not confident that any estimated effects would be attributable to the juvenile drug court, and not other factors. However, the study found no statistically significant effects.","Suffolk County’s Juvenile Drug Court","Reentry Substance abuse recovery Youth programs","Youth, Justice-involved, Disconnected youth",,"United States",2008,http://www.courtinnovation.org/sites/default/files/Suffolk_JTC.pdf "An experimental evaluation of teen courts","Stickle, W., Connell, N., Wilson, D., & Gottfredson, D. (2008). An experimental evaluation of teen courts. Journal of Experimental Criminology, 4(2), 137-163.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence",,"Summary: The study’s objective was to examine the impact of participation in a teen court on youth offenders’ rates of recidivism. The study was a randomized controlled trial in which eligible youth were randomly assigned to either the treatment group, which participated in a teen court, or to the control group, which participated in the traditional juvenile justice system. The authors compared outcomes for the two groups using administrative data. The study reported no differences in recidivism outcomes for teen court youth and those in the traditional juvenile justice system. The quality of causal evidence presented in this report is moderate for some outcomes and low for other outcomes. This means we have little confidence that any estimated effects would be attributable to the teen court program. However, the study did not find statistically significant effects.","Teen Court","Youth programs","Youth, Justice-involved, Disconnected youth",,"United States",2008, "Can students in technology entrepreneurship courses help foster start-ups by the unemployed?","Watkins, T., Russo, J., & Ochs, J. (2008). Can students in technology entrepreneurship courses help foster start-ups by the unemployed? Journal of Small Business and Enterprise Development, 15(2), 348-364.","Entrepreneurship and Self-Employment","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages","Summary: The study’s objective was to examine the impact of participating in the Integrated Product Development (IPD) program on dislocated workers’ entrepreneurial activities. The authors used data from a survey administered after one year of program participation to compare the prevalence of entrepreneurial activities among IPD participants compared with program applicants who were not selected to participate in IPD. The study found statistically significant positive relationships between participating in the IPD program and several business development activities and outcomes. The quality of causal evidence presented in this report is low because the authors did not demonstrate that the IPD and comparison groups were comparable before the program, nor did they control for potential differences in their analysis. This means we are not confident that the estimated effects are attributable to the IPD program; other factors are likely to have contributed.","the Integrated Product Development (IPD) Program","Mentoring Other training and education","Self-employed, Dislocated or displaced worker",,"United States",2008, "Examining the impact of small business institute participation on entrepreneurial attitudes","Harris, M., Gibson, S., & Taylor, S. (2008). Examining the impact of small business institute participation on entrepreneurial attitudes. Journal of Small Business Strategy, 18(2), 57-75.","Entrepreneurship and Self-Employment","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Attitudes-Low-Favorable impacts Attitudes","Summary: The study’s objective was to examine the impact of attending an undergraduate class as part of the Small Business Institute (SBI), an entrepreneurial program, on students’ entrepreneurial attitudes. The authors compared students’ entrepreneurial attitudes before and after taking an SBI class in one of six universities across the United States. Entrepreneurial attitudes were measured using the Entrepreneurial Attitudes Orientation survey. The study found a positive relationship between participation in an SBI class and students’ entrepreneurial attitudes. The quality of causal evidence presented in this report is low because the authors compared the attitudes of students measured at a single point before and after they participated in the class, but did not compare these changes in attitudes with those of a comparison group of students who did not take an SBI class. This means we are not confident that the estimated effects are attributable to the SBI class; other factors are likely to have contributed.","SBI Courses","Other training and education",Adult,"Small business","United States",2008, "McNeil Education, Training and Evaluation (2008). Process evaluation of the Demand-Side Youth Offender Demonstration Project (Phase II).","McNeil Education, Training and Evaluation (2008). Process evaluation of the Demand-Side Youth Offender Demonstration Project (Phase II). Chapel Hill, NC: McNeil Education.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of being matched to employment through the Demand-Side Youth Offender Demonstration Project (DSYODP) Phase I on youths’ average weekly earnings. The study compared the wages of employed youth who were matched to employment through DSYODP with the wages of employed youth who were eligible for the DSYODP but had secured employment through other means. The study found that average weekly wages of youth matched to employment through DSYODP were significantly higher than wages of youth who secured employment through other means. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the DSYODP; however, other factors might also have contributed.","Demand-Side Youth Offender Demonstration Project (DSYODP)","Job search assistance and supportive services Youth programs","Youth, Justice-involved, Disconnected youth",,"United States",2008,https://wdr.doleta.gov/research/FullText_Documents/Process%20Evaluation%20of%20… "The Employment Retention and Advancement project: Impacts for Portland’s Career Builders program.","Azurdia, G., & Barnes, Z. (2008). The Employment Retention and Advancement project: Impacts for Portland’s Career Builders program. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of the Portland Career Builders program on welfare recipients’ employment, earnings, and public benefits receipt outcomes after two years. The Portland site was one of four in Oregon that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 634 Temporary Assistance for Needy Families (TANF) applicants and recipients to either a treatment group that received Career Builder services or a control group that could participate in other employment-related programs in the community. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records. The study did not find any statistically significant effects on employment, earnings, and public benefits receipt outcomes one and two years after program entry. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that the estimated effects would be attributable to the Career Builders program, and not to other factors. However, the study did not find any statistically significant effects.","The Employment Retention and Advancement Project, Portland Career Builders Program","Other employment and reemployment Unemployment Insurance Other training and education","Low income",,"United States",2008,http://www.mdrc.org/sites/default/files/full_550.pdf "Temporary help service firms’ use of employer tax credits: Implications for disadvantaged workers’ labor market outcomes","Hamersma, S., & Heinrich, C. (2008). Temporary help service firms’ use of employer tax credits: Implications for disadvantaged workers’ labor market outcomes. Southern Economic Journal, 74(4), 1123-1148.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the effect of subsidies paid to employers for hiring disadvantaged workers—specifically, the Work Opportunity Tax Credit and Welfare-to-Work Tax Credit—on workers’ earnings and employment. It also examined the interaction of the employment subsidies and being employed through a temporary help service. The study compared total earnings and total quarters employed in the first and second years after starting a job for certified workers—those workers for whom employers could receive subsidies—with those of eligible but uncertified workers. In addition, the study compared outcomes of certified workers employed through temporary help services with those of certified workers hired directly by an employer. The authors matched the groups being compared on observable characteristics using administrative data. The study found no statistically significant relationships between employer subsidies and workers’ earnings or employment. The quality of causal evidence presented in this report is low because the study did not adequately account for existing differences between the study groups. This means we are not confident that any estimated effects would be attributable to employer subsidies.","the Work Opportunity Tax Credit and Welfare-to-Work Tax Credit","Other employment and reemployment","Low income",,"United States",2008, "Rapid employment model evaluation: Update","Smith, T. C., King, C. T., & Schroeder, D. G. (2008). Rapid employment model evaluation: Update. Austin, TX: Ray Marshall Center for the Study of Human Resources.",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Rapid Employment Model (REM) program on participants’ employment, earnings, and Unemployment Insurance (UI) benefit claims. (See the CLEAR review of the 2010 report here.) Using program data and state UI records, the authors matched treatment group cases to comparison group cases and conducted regression analyses to estimate the effect of the intervention. The study found that participation in the REM program was associated with an increase in the likelihood that jobseekers were employed in quarters following program participation. The quality of causal evidence presented in this report is moderate for employment and earnings outcomes because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects on employment and earnings are attributable to the REM program, but other factors might also have contributed. The quality of causal evidence presented for the UI benefit claiming outcome is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects on UI benefit claiming outcome are attributable to REM program; other factors are likely to have contributed.","Rapid Employment Model (REM) Program","Job search assistance and supportive services Other training and education Unemployment Insurance","Justice-involved, Low-skilled, Low income",,"United States",2008,http://sites.utexas.edu/raymarshallcenter/files/2008/12/REM_eval_update_01-28-0… "New Hope’s eight-year impacts on employment and family income.","Miller, C., Duncan, G., Classens, A., Engel, M., Hill, H., & Lindsay, C. (2008). New Hope’s eight-year impacts on employment and family income. New York: MDRC.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the New Hope program on employment, earnings, and public benefit receipt. The authors estimated the impact of the New Hope program by comparing average outcomes among a treatment group randomly selected to have access to the program with those of a randomly selected control group that did not have access to the program. The study found no statistically significant effects on employment, earnings, or public benefit receipt eight years after the program began. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects would be attributable to the New Hope program and not to other factors. However, the study did not find statistically significant effects.","The New Hope Program","Other employment and reemployment","Low income",,"United States",2008,http://www.mdrc.org/sites/default/files/full_458.pdf "Testing case management in a rural context: An impact analysis of the Illinois Future Steps program: Findings from the Rural Welfare-to-Work Strategies Demonstration evaluation.","Meckstroth, A., Person, A., Moore, Q., Burwick, A., McGuirk, A., Ponza, M., Marsh, S., Novak, T., Zhao, Z., & Wheeler, J. (2008). Testing case management in a rural context: An impact analysis of the Illinois Future Steps program: Findings from the Rural Welfare-to-Work Strategies Demonstration evaluation. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Future Steps rural welfare-to-work program on employment, earnings, and public benefit receipt. The authors randomly assigned Temporary Assistance for Needy Families (TANF) and Food Stamps recipients required to work to either a treatment group, which received job search and other services, or a control group, which did not. The authors evaluated the treatment’s impact using Illinois administrative data and follow-up surveys. The authors found that the Future Steps program increased the likelihood of being employed 30 months after enrollment by 8.6 percentage points. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Future Steps rural welfare-to-work program and not to other factors.","the Future Steps Rural Welfare-to-Work Program","Job search assistance and supportive services Other employment and reemployment","Low income",,"Rural, United States",2008,http://www.acf.hhs.gov/sites/default/files/opre/testing_case.pdf "Teaching self-sufficiency: An impact and benefit-cost analysis of a home visitation and life skills education program. Findings from the rural welfare-to-work strategies demonstration evaluation","Meckstroth, A., Burwick, A., & Moore, Q. (2008). Teaching self-sufficiency: An impact and benefit-cost analysis of a home visitation and life skills education program. Findings from the rural welfare-to-work strategies demonstration evaluation. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employer benefits receipt-Mod/high-Favorable impacts Employer benefits receipt Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Building Nebraska Families (BNF) rural welfare-to-work program on employment, earnings, and public benefit receipt. The authors randomly assigned Nebraska Temporary Assistance for Needy Families (TANF) recipients identified as hard-to-employ to either a treatment group, which received in-home life skills and family management training, or a control group, which did not. The authors evaluated the treatment’s impact using Nebraska state administrative data and follow-up surveys. The study found that BNF increased the average likelihood of ever being employed in the first year after enrollment by 10.8 percentage points and that of ever being employed in the first 30 months after enrollment by 6.3 percentage points. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the BNF rural welfare-to-work program and not to other factors.","Building Nebraska Families (BNF)","Other employment and reemployment","Low income",,"United States",2008,http://www.acf.hhs.gov/sites/default/files/opre/teaching_self.pdf "Workforce program performance indicators for the Commonwealth of Virginia. (Upjohn Institute Technical Report no. 08-024).","Hollenbeck, K. & Huang, W-J. (2008). Workforce program performance indicators for the Commonwealth of Virginia. (Upjohn Institute Technical Report no. 08-024). Kalamazoo, MI: W.E. Upjohn Institute for Employment Research.",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Unfavorable impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the Wagner-Peyser/Employment Service program on outcomes of employment, earnings, and credential completion. The study used an interrupted time series (ITS) design to compare the outcomes of participants before and after participating in the Wagner-Peyser program. • The study found that the median earnings of Wagner-Peyser participants were $250 lower in the second quarter after program exit compared to their median earnings before program participation. The quality of causal evidence presented in this report is low because the authors did not observe outcomes for multiple periods before the intervention. This means we are not confident that the estimated effects are attributable to the Wagner-Peyser program; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Wagner-Peyser Program","Job search assistance and supportive services",Adult,,"United States",2008,http://research.upjohn.org/cgi/viewcontent.cgi?article=1027&context=up_technica… "Workforce program performance indicators for the commonwealth of Virginia. Upjohn Institute technical report no. 08-024 [FSET]","Hollenbeck, K., Huang, W.-J., and WE Upjohn Institute for Employment Research. (2008). Workforce program performance indicators for the commonwealth of Virginia. Upjohn Institute technical report no. 08-024, Kalamazoo, MI: W. E. Upjohn Institute for Employment Research. [FSET]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Unfavorable impacts Education and skills gains Employment-Low-Unfavorable impacts Employment","Summary: The study’s objective was to examine the impact of the Food Stamp Employment and Training Program (FSET) on employment and credential completion rates. The authors used administrative records to compare outcomes for low-income adults who took part in the FSET program to a nonexperimental matched group of adults who did not take part in the program. The study found that, compared to those who did not take part in the program, the employment rate was significantly lower. The FSET group also earned significantly fewer educational or training credentials. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before program participation. This means we are not confident that the estimated effects are attributable to FSET; other factors are likely to have contributed.","the Food Stamp Employment and Training Program (FSET)","Job search assistance and supportive services Other employment and reemployment","Low income",,"United States",2008,http://research.upjohn.org/cgi/viewcontent.cgi?article=1027&context=up_technica… "Workforce program performance indicators for the Commonwealth of Virginia. Upjohn Institute technical report no. 08-024. [TANF/VIEW]","Hollenbeck, K., Huang, W.-J., and WE Upjohn Institute for Employment Research (2008). Workforce program performance indicators for the Commonwealth of Virginia. Upjohn Institute technical report no. 08-024. Kalamazoo, MI: W. E. Upjohn Institute for Employment Research. [TANF/VIEW]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Virginia Initiative for Employment Not Welfare (TANF/VIEW) program on employment and credential completion rates. The authors used administrative records to compare outcomes for low-income adults who took part in the TANF/VIEW program to a nonexperimental matched group of adults who did not take part in the program. The study found that, compared with those who did not take part in the program, the employment rate was significantly lower for those who took part in the TANF/VIEW program, but the TANF/VIEW group earned significantly more educational or training credentials. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before program participation. This means we are not confident that the estimated effects are attributable to the TANF/VIEW program; other factors are likely to have contributed.","the Virginia Initiative for Employment Not Welfare (TANF/VIEW) Program","Job search assistance and supportive services Other employment and reemployment Other training and education","Low income",,"United States",2008,http://research.upjohn.org/cgi/viewcontent.cgi?article=1027&context=up_technica… "Growing America Through Entrepreneurship: Findings from the evaluation of Project GATE","Benus, J., McConnell, S., Bellotti, J., Shen, T., Fortson, K., & Kahvecioglu, D. (2008). Growing America Through Entrepreneurship: Findings from the evaluation of Project GATE. Columbia, MD: IMPAQ International.","Entrepreneurship and Self-Employment","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impacts of the Growing America Through Entrepreneurship (Project GATE) demonstration project, which offered entrepreneurship training and business counseling to low-income individuals, on participants’ employment, earnings, and public assistance benefit receipt. The authors randomly assigned study participants to a treatment group, which could participate in Project GATE, or a control group, which could not participate. The authors used Unemployment Insurance (UI) wage records and survey data in their analyses. The study did not find any statistically significant effects of Project GATE on employment, earnings, or UI benefit receipt in any of the four quarters after random assignment, using UI wage record data. The quality of causal evidence presented in this report is high for outcomes measured using UI wage record data because they were based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects would be attributable to Project GATE and not to other factors. However, the study did not find statistically significant effects. Outcomes measured with survey data received a low evidence rating because there is high attrition and insufficient adjustment for differences in previous employment and earnings history.","the Project Growing America Through Entrepreneurship (GATE) Demonstration","Job search assistance and supportive services Other training and education Unemployment Insurance","Low income",,"United States",2008,https://wdr.doleta.gov/research/FullText_Documents/Findings%20from%20the%20Eval… "Workforce program performance indicators for the Commonwealth of Virginia. (Upjohn Institute Technical Report No. 08-024). [TAA]","Hollenbeck, K., & Huang, W.-J. (2008). Workforce program performance indicators for the Commonwealth of Virginia. (Upjohn Institute Technical Report No. 08-024). Kalamazoo, MI: W.E. Upjohn Institute for Employment Research. [TAA]",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Unfavorable impacts Employment","Summary: The study’s objective was to examine the impact of the Training Adjustment Assistance (TAA) program on employment and credential completion. The study used administrative records to compare outcomes of low-income adults who took part in the TAA program with outcomes of a nonexperimental matched group of adults who did not take part in the program. The study found that TAA participants had a lower employment rate but were more likely to have obtained a training certificate compared with those who did not participate in the program. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before program participation. This means we are not confident that the estimated effects are attributable to TAA; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Trade Adjustment Assistance (TAA) Program","Job search assistance and supportive services Other training and education","Low-skilled, Low income, Dislocated or displaced worker",,"United States",2008,http://research.upjohn.org/cgi/viewcontent.cgi?article=1027&context=up_technica… "Workforce program performance indicators for the Commonwealth of Virginia. (Upjohn Institute Technical Report No. 08-024). [WIA-Adult]","Hollenbeck, K., & Huang, W-J. (2008). Workforce program performance indicators for the Commonwealth of Virginia. (Upjohn Institute Technical Report No. 08-024). Kalamazoo, MI: W.E. Upjohn Institute for Employment Research. [WIA-Adult]","Job Search Assistance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Workforce Investment Act (WIA) Title I program for adults (including dislocated workers) on participants’ employment and credential completion rates. The study used administrative records to compare the outcomes for low-income adults who took part in the WIA program with a nonexperimental-matched group of adults who did not take part in the program. The study found that the WIA program participants had higher employment and credential completion rates than those of people who did not participate in the program. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups compared were similar before program participation. This means we are not confident that the estimated effects are attributable to the WIA Title I program for adults (including dislocated workers); other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Workforce Investment Act (WIA) Title I Program for Adults","Adult and Dislocated Worker programs Job search assistance and supportive services Other employment and reemployment Other training and education Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA)","Unemployed, Low income",,"United States",2008,http://research.upjohn.org/cgi/viewcontent.cgi?article=1027&context=up_technica… "Workforce program performance indicators for the Commonwealth of Virginia. (Upjohn Institute Technical Report No. 08-024). [AEL]","Hollenbeck, K., & Huang, W-J. (2008). Workforce program performance indicators for the Commonwealth of Virginia. (Upjohn Institute Technical Report No. 08-024). Kalamazoo, MI: W.E. Upjohn Institute for Employment Research. [AEL]",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Unfavorable impacts Employment","Summary: The study’s objective was to examine the impact of the Adult Education and Literacy (AEL) program on participants’ employment and credential completion. The study used administrative records to compare outcomes of low-income adults who took part in the AEL program with outcomes of a nonexperimental matched group of adults who did not take part in the program. The study found that AEL participants had a lower employment rate but were more likely to have earned a GED compared with those of people who did not participate in the program. The quality of causal evidence presented in this report is low because the author did not ensure that the groups compared were similar before program participation. This means we are not confident that the estimated effects are attributable to AEL; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Adult Education and Literacy (AEL) Program","Other training and education","Low-skilled, Low income",,"United States",2008,http://research.upjohn.org/cgi/viewcontent.cgi?article=1027&context=up_technica… "Workforce program performance indicators for the Commonwealth of Virginia. (Upjohn Institute Technical Report No. 08-024). [DRS]","Hollenbeck, K., & Huang, W-J. (2008). Workforce program performance indicators for the Commonwealth of Virginia. (Upjohn Institute Technical Report No. 08-024). Kalamazoo, MI: W.E. Upjohn Institute for Employment Research. [DRS]",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Vocational Rehabilitation program administered by Department of Rehabilitative Services (DRS) on participants’ employment and credential completion. The study used administrative records to compare the outcomes of low-income adults who took part in the DRS program with outcomes of a nonexperimental matched group of adults who did not take part in the program. The study found that DRS participants had higher employment and credential completion rates compared with those of people who did not participate in the program. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups compared were similar before program participation. This means we are not confident that the estimated effects are attributable to DRS; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies","the Vocational Rehabilitation (VOC) Programs","Job search assistance and supportive services Vocational rehabilitation","Disability, Low-skilled, Low income",,"United States",2008,http://research.upjohn.org/cgi/viewcontent.cgi?article=1027&context=up_technica… "Workforce program performance indicators for the Commonwealth of Virginia. (Upjohn Institute Technical Report No. 08-024). [DBVI]","Hollenbeck, K., & Huang, W-J. (2008). Workforce program performance indicators for the Commonwealth of Virginia. (Upjohn Institute Technical Report No. 08-024). Kalamazoo, MI: W.E. Upjohn Institute for Employment Research. [DBVI]",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Vocational Rehabilitation program administered by the Department for Blind and Vision Impaired (DBVI) on participants’ employment and credential completion. The study used administrative records to compare the outcomes of low-income adults who took part in the DBVI program with outcomes of a nonexperimental matched group of adults who did not take part in the program. The study found that DBVI participants had higher employment and credential completion rates compared with those of people who did not participate in the program. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups compared were similar before program participation. This means we are not confident that the estimated effects are attributable to DBVI; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Vocational Rehabilitation (VOC) Programs","Supported employment or other employment supports Vocational rehabilitation","Disability, Low income",,"United States",2008,http://research.upjohn.org/cgi/viewcontent.cgi?article=1027&context=up_technica… "Workforce program performance indicators for the Commonwealth of Virginia. (Upjohn Institute Technical Report No. 08-024). [CTE]","Hollenbeck, K., & Huang, W-J. (2008). Workforce program performance indicators for the Commonwealth of Virginia. (Upjohn Institute Technical Report No. 08-024). Kalamazoo, MI: W.E. Upjohn Institute for Employment Research. [CTE]",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Carl Perkins Postsecondary Career and Technical Education (CTE) program on employment and credential completion. The authors used administrative records to compare the outcomes of low-income adults who took part in the CTE program with the outcomes of a nonexperimental matched group of adults who did not take part in the program. The study found that CTE participants had higher employment and credential completion rates compared with those of people who did not participate in the program. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups compared were similar before program participation. This means we are not confident that the estimated effects are attributable to CTE; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Workforce Investment Act (WIA) Carl Perkins Postsecondary Career and Technical Education (CTE) Program","Other training and education Job search assistance and supportive services","Low income, Low-skilled",,"United States",2008,http://research.upjohn.org/cgi/viewcontent.cgi?article=1027&context=up_technica… "Conditional cash transfers in education: Design features, peer and sibling effects. Evidence from a randomized experiment in Columbia","Barrera-Osorio, F., Bertrand, M., Linden, L.L., & Perze-Calle, F. (2008). Conditional cash transfers in education: Design features, peer and sibling effects. Evidence from a randomized experiment in Columbia (World Bank Policy Research Working Paper 4580). Washington, DC: World Bank.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor Education and skills gains-Mod/high-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of Subsidios Condicionados a la Asistencia Escolar, a conditional cash transfer program (CCT), on school participation and child labor. This summary focuses on the comparison between the treatment group receiving the basic CCT and the control group in San Cristobal. The study was a randomized controlled trial in two districts in Columbia (San Cristobal and Suba). The authors compared the differential effects of receiving the cash transfer on outcomes for those in the treatment group versus those in the control group. The study found that students in grades 6-10 who received the basic treatment worked significantly fewer hours in the last week than students in the control group. The study did not find any significant differences in school attendance or school enrollment between students receiving the basic treatment and the control group. The quality of causal evidence presented in this report is moderate because there was compromised randomization but the authors ensured that the groups being compared were similar before the intervention. This means we are somewhat confident that the estimated effects are attributable to the Subsidios Condicionados a la Asistencia Escolar, but other factors might also have contributed.","Subsidios Condicionados a la Asistencia Escolar (Conditional Subsidies for School Attendance)","Child labor","Other, Low income",,International,2008,http://siteresources.worldbank.org/EDUCATION/Resources/278200-1099079877269/547… "Conditional cash transfers in education: Design features, peer and sibling effects. Evidence from a randomized experiment in Columbia","Barrera-Osorio, F., Bertrand, M., Linden, L.L., & Perze-Calle, F. (2008). Conditional cash transfers in education: Design features, peer and sibling effects. Evidence from a randomized experiment in Columbia (World Bank Policy Research Working Paper 4580). Washington, DC: World Bank.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Child labor-Mod/high-No impacts Child labor Education and skills gains-Mod/high-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of Subsidios Condicionados a la Asistencia Escolar, a conditional cash transfer program (CCT), on school participation and child labor. This summary focuses on the comparison between the savings treatment group and the control group in San Cristobal. The study was a randomized controlled trial in two districts in Columbia (San Cristobal and Suba). The authors compared the differential effects of receiving the cash transfer on outcomes for those in the treatment group versus those in the control group. The study did not find any significant differences in child labor, school attendance, or school enrollment between students receiving the savings treatment and the control group. The quality of causal evidence presented in this report is moderate because there was compromised randomization but the authors ensured that the groups being compared were similar before the intervention. This means we are somewhat confident that the estimated effects are attributable to the Subsidios Condicionados a la Asistencia Escolar, but other factors might also have contributed. However, the study did not find statistically significant effects.","Subsidios Condicionados a la Asistencia Escolar (Conditional Subsidies for School Attendance)","Child labor","Other, Low income",,International,2008,http://siteresources.worldbank.org/EDUCATION/Resources/278200-1099079877269/547… "Conditional cash transfers in education: Design features, peer and sibling effects. Evidence from a randomized experiment in Columbia","Barrera-Osorio, F., Bertrand, M., Linden, L.L., & Perze-Calle, F. (2008). Conditional cash transfers in education: Design features, peer and sibling effects. Evidence from a randomized experiment in Columbia (World Bank Policy Research Working Paper 4580). Washington, DC: World Bank.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Child labor-Mod/high-No impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of Subsidios Condicionados a la Asistencia Escolar, a conditional cash transfer program (CCT), on school participation and child labor. This summary focuses on the comparison between the treatment group receiving the basic CCT and the control group in Suba. The study was a randomized controlled trial in two districts in Columbia (San Cristobal and Suba). The authors compared the differential effects of receiving the cash transfer on outcomes for those in the treatment group versus those in the control group. The study found that students in the basic treatment group had a significant increase in self-reported school attendance compared to students in the control group. The study did not find any significant differences in child labor or school enrollment between students receiving the basic treatment and the control group. The quality of causal evidence presented in this report is moderate because there was compromised randomization but the authors ensured that the groups being compared were similar before the intervention. This means we are somewhat confident that the estimated effects are attributable to the Subsidios Condicionados a la Asistencia Escolar, but other factors might also have contributed.","Subsidios Condicionados a la Asistencia Escolar (Conditional Subsidies for School Attendance)","Child labor","Other, Low income",,International,2008,http://siteresources.worldbank.org/EDUCATION/Resources/278200-1099079877269/547… "Conditional cash transfers in education: Design features, peer and sibling effects. Evidence from a randomized experiment in Columbia","Barrera-Osorio, F., Bertrand, M., Linden, L.L., & Perze-Calle, F. (2008). Conditional cash transfers in education: Design features, peer and sibling effects. Evidence from a randomized experiment in Columbia (World Bank Policy Research Working Paper 4580). Washington, DC: World Bank.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor Education and skills gains-Mod/high-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of Subsidios Condicionados a la Asistencia Escolar, a conditional cash transfer program (CCT), on school participation and child labor. This summary focuses on the comparison between the tertiary treatment group and the control group in Suba. The study was a randomized controlled trial in two districts in Columbia (San Cristobal and Suba). The authors compared the differential effects of receiving the cash transfer on outcomes for those in the treatment group versus those in the control group. The study found that students in the tertiary treatment group worked significantly less in the past week than students in the control group. They were also significantly more likely to report their primary activity as studying and less likely to report their primary activity as work or home versus students in the control group. The study did not find any significant differences in school attendance or school enrollment between students receiving the tertiary treatment and the control group. The quality of causal evidence presented in this report is moderate because there was compromised randomization but the authors ensured that the groups being compared were similar before the intervention. This means we are somewhat confident that the estimated effects are attributable to the Subsidios Condicionados a la Asistencia Escolar, but other factors might also have contributed.","Subsidios Condicionados a la Asistencia Escolar (Conditional Subsidies for School Attendance)","Child labor","Other, Low income",,International,2008,http://siteresources.worldbank.org/EDUCATION/Resources/278200-1099079877269/547… "The heterogeneous impact of CCT programmes on child labor: The case of Tekoporã in Paraguay","Hirata, G. I. (2008). The heterogeneous impact of CCT programmes on child labor: The case of Tekoporã in Paraguay. Brazil: International Poverty Centre/UNDP.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Tekoporã conditional cash transfer program on children’s participation in non-domestic labor and school attendance. The author used a nonexperimental design to compare the outcomes of children ages 4 to 14 that received the conditional cash transfers with those who did not, based on data from a program eligibility questionnaire and a follow-up survey. The author used statistical models to estimate the effects of the program. The study found no significant relationship between the Tekoporã program and the number of children in the household who participated in non-domestic labor. However, the program was significantly related to decisions between school and work, with a decrease in the probability that children would “only work” or “neither work nor attend school.” The quality of causal evidence presented in this report is low because the author did not account for trends in outcomes before the intervention or adequately control for time-varying characteristics that might influence the outcome. This means we are not confident that the estimated effects are attributable to Tekoporã; other factors are likely to have contributed.",Tekoporã,"Child labor","Other, Low income",,International,2008,http://www.ucw-project.org/attachment/hirata.pdf "The effect of the social security earnings test on male labor supply: New evidence from survey and administrative data.","Haider, S. J., & Loughran, D. S. (2008). The effect of the social security earnings test on male labor supply: New evidence from survey and administrative data. Journal of Human Resources, 43(1), 57-87.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Mixed impacts Earnings and wages Employer benefits receipt-Low-Favorable impacts Employer benefits receipt","Summary: The study’s objective is to examine the impact of 1983 and 2000 policy changes that removed the Social Security earnings test for certain age groups on the earnings and employment outcomes of affected men The study is a nonexperimental analysis that examines the correlations between the 1983 and 2000 policy changes and earnings and employment status. The study compares the outcomes of men affected by the policy changes with the outcomes of men of similar ages not affected by the policy changes. The study finds that the 1983 policy change is associated with few changes to the observed outcomes and that the 2000 policy change is associated with higher earnings and hours worked per week for affected men. The quality of causal evidence presented in this report is low because the study does not demonstrate that men affected by the policy changes are similar to the men not affected by the policy change, nor does it control for possible differences. This means we are not confident that the estimated effects are attributable to the 1983 and 2000 policy changes; other factors are likely to have contributed.","Social Security Earnings Test","Federal retirement benefits Older workers' programs","Adult, Older worker, Male",,"United States",2008,http://jhr.uwpress.org/content/43/1/57.refs "How did the elimination of the US earnings test above the normal retirement age affect labour supply expectations?","Michaud, P., & Van Soest, A. (2008). How did the elimination of the US earnings test above the normal retirement age affect labour supply expectations? Fiscal Studies, 29(2), 197-231. doi:10.1111/j.1475-5890.2008.00073.x","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The authors used a nonexperimental approach and the data from Health and Retirement Study data from 1996 to 2002 and Social Security earnings history to estimate the impact. The study examined the impact of repealing the earnings test from Social Security recipients between full retirement age and age 70 on older workers’ subjective probability of retirement. The authors used a nonexperimental approach and the data from Health and Retirement Study data from 1996 to 2002 and Social Security earnings history to estimate the impact. The study found that after the repeal of the earnings test, the subjective probability of working of full-time past age 65 for older male workers who were likely to have most of their projected Social Security benefits reduced under the earnings test has increased their expected probability of working relative to those who were not likely to be affected. •The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design.This means we are somewhat confident that the estimated effects are attributable to the repeal of the earnings test, but other factors might also have contributed.","Social Security Earnings Test","Federal retirement benefits Older workers' programs","Adult, Older worker, Male",,"United States",2008, "Supported employment for middle-aged and older people with schizophrenia.","Twamley, E., Narvaez, J., Becker, D., Bartels, S., & Jeste, D. (2008). Supported employment for middle-aged and older people with schizophrenia. American Journal of Psychiatric Rehabilitation, 11(1), 76-89.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study examined the impact of Individual Placement and Support (IPS) on competitive employment for older people with schizophrenia The study was a randomized controlled trial (RCT) and used weekly work logs cross-referenced with pay stubs to measure employment outcomes over a 12-month period. The study found that IPS increased competitive employment and earnings compared with conventional services. The quality of causal evidence presented in this report is low because the RCT has a confounding factor. This means we are not confident that the estimated effects are attributable to the IPS program; other factors are likely to have contributed.","Individual Placement and Support and Vocational Rehabilitation Program","Health Individuals facing barriers to employment Job search assistance and supportive services","Adult, Older worker, Disability",,"United States",2008,https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2638571/ "State age protection laws and the Age Discrimination in Employment Act.","Lahey, J. State age protection laws and the Age Discrimination in Employment Act. (2008). The Journal of Law and Economics, 51(3), 433-460.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-Unfavorable impacts Employment","Summary: The study examined the impact of enforcement of age discrimination laws on the employment and earnings of older male workers The author used a nonexperimental regression model and data from the Current Population Survey to estimate the impact. The study found that males older than 50 in states with age discrimination laws were 0.2 percentage points less likely to be hired compared with those in states without their own age discrimination laws. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the state laws on age discrimination, but other factors might also have contributed.","Age Discrimination Employment Act (ADEA)","Older workers' programs Other disparities or discrimination in employment and earnings","Adult, Older worker, Male",,"United States",2008,https://www.jstor.org/stable/10.1086/589670?seq=1#page_scan_tab_contents "Improving employment outcomes of individuals with disabilities through short-term postsecondary training","Flannery, K. B., Yovanoff, P., Benz, M. R., & Kato, M. M. (2008). Improving employment outcomes of individuals with disabilities through short-term postsecondary training. Career Development for Exceptional Individuals, 31(1), 26-36.","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of an occupational skills training program on employment and earnings outcomes. The study used statistical methods to compare the outcomes of people who successfully completed the occupational skills training program with the outcomes of a comparison group of people who dropped out of the program during the same period. The authors used data from the Oregon State Employment Division, the Oregon Office of Vocational Rehabilitation Services, and a database housed at the occupational skills training site. The study found that participants who successfully completed the occupational skills training program had a higher employment rate, worked more hours, and had higher earnings than those who dropped out of the program. The quality of causal evidence provided in this study is low because the authors did not ensure that the groups being compared were similar before the intervention.","the occupational skills training program","Work based and other occupational training",Disability,,"United States",2008,https://doi.org/10.1177%2F0885728807313779 "Prison-based education and reentry into the mainstream labor market","Tyler, J. H., & Kling, J. R. (2007). Prison-based education and reentry into the mainstream labor market. In D. Weiman & S. D. Bushway (Eds.), Barriers to reentry?: The labor market for released prisoners in post-industrial America (pp. 227-256). New York: Russell Sage Foundation.",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of obtaining a general education diploma (GED) while in prison from 1994 to 2000 in Florida on male prisoners’ post-incarceration employment, earnings, and recidivism. The authors used a nonexperimental design to compare outcomes for those who obtained a prison-based GED (the treatment group) with those that did not (the comparison group). Drawing on administrative data from the state of Florida and Unemployment Insurance (UI) records, the authors estimated impacts on earnings and compared the means of the two groups for the employment and recidivism outcomes. The study reported no statistically significant findings on earnings in the first and third years after release or on recidivism or employment outcomes. The study found that, in the second year after release, people who obtained a GED in prison earned $114 more per quarter than those who did not; this was a significant difference. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the program and did not eliminate concerns about self-selection into the prison-based GED program. This means we are not confident that the estimated effects are attributable to the prison-based GED program; other factors are likely to have contributed.","Prison-based program to obtain general education diploma (GED)","Reentry Other training and education",Justice-involved,,"United States",2007,https://www.nber.org/papers/w12114 "Compensation of veterans with psychiatric or substance abuse disorders and employment and earnings","Greenberg, G. A., & Rosenheck, R. A. (2007). Compensation of veterans with psychiatric or substance abuse disorders and employment and earnings. Military Medicine, 172(2), 162-168.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Unfavorable impacts Employment","Summary: The study’s objective was to examine the impact of the Veterans Affairs (VA) Compensation Program on employment for veterans with service-connected disabilities. This study compared employment outcomes for two groups of veterans: (1) disabled veterans receiving VA compensation and (2) nondisabled veterans not receiving disability compensation. To do this, the study team combined data from two national surveys: the Survey of Disabled Veterans and the National Survey of Veterans. Veterans receiving benefits of more than $800 per month from the VA Compensation Program were significantly less likely to be employed than were nondisabled veterans. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the VA Compensation Program; other factors likely contributed to the findings.","the VA Compensation Program","Disability insurance Veterans' reemployment","Disability, Veteran or military",,"United States",2007,https://academic.oup.com/milmed/article/172/2/162/4578021 "Implementation of supported employment for homeless veterans with psychiatric or addiction disorders: Two-year outcomes","Rosenheck, R. A., & Mares, A. S. (2007). Implementation of supported employment for homeless veterans with psychiatric or addiction disorders: Two-year outcomes. Psychiatric Services, 58(3), 325-333.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study examined the impact a newly implemented Individual Placement and Support (IPS) program had on employment and earnings outcomes of homeless veterans who were diagnosed with a psychiatric or substance abuse problem. The study team compared raw and adjusted outcome data for veterans who received IPS services and veterans who did not. The team used study participant interviews, activity logs, and employer contacts as data sources. The study found a statistically significant relationship between participation in the IPS program and competitive employment. The quality of causal evidence presented in this report is low because the data on the two groups were not collected at the same time. This means we are not confident that the estimated effects are attributable to the IPS program; other factors are likely to have contributed.","Individual Placement and Support (IPS)","Substance abuse recovery Job search assistance and supportive services Veterans' reemployment","Other barriers, Veteran or military, Homeless",,"United States",2007,https://ps.psychiatryonline.org/doi/full/10.1176/ps.2007.58.3.325 "Youth Opportunity Grant Initiative: Impact and synthesis report","Jackson, R., Dixon, R., McCoy, A., Pistorino, C., Zador, P., Thomas, C., … Bruno, L. (2007). Youth Opportunity Grant Initiative: Impact and synthesis report. Houston, TX: Decision Information Resources, Inc.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Favorable impacts Employment","Summary: This report’s objective was to examine the effectiveness of the Youth Opportunity (YO) Grant Initiative, which sought to improve job prospects and education outcomes for youth in high-poverty areas by providing them with a mix of 15 youth development activities. Companion reports describe the initiative’s implementation. The initiative’s effectiveness was evaluated using two separate comparison group designs. In general, the study found positive and statistically significant relationships between the YO initiative and educational enrollment outcomes. However, there were few statistically significant effects on employment-related outcomes and educational attainment. The quality of the causal evidence presented in this study is low. This means we are not confident that the estimated impacts were caused by the YO Grant Initiative, and not other factors.","Youth Opportunity Grant Initiative","Basic skills Community college education and other classroom training Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",2007,http://wdr.doleta.gov/research/FullText_Documents/YO%20Impact%20and%20Synthesis… "YO! participants’ employment and earnings","Callahan Consultants, Inc. (n.d.). YO! participants’ employment and earnings. Ellicott City, MD: Author.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The study’s objective was to determine the effect of the YO! Baltimore initiative, which included a diverse set of programs offering comprehensive educational, employment preparation, support, and leadership development services to youth ages 14 to 21. The authors compared employment and earnings outcomes for participants and nonparticipants in YO! Baltimore. The study found that participants had increased earnings and employment after enrollment. The quality of the causal evidence presented in this study is low. This means we are not confident that the effects estimated in this study are attributable to the YO! Baltimore program.","YO! Baltimore","Basic skills Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs",Youth,,"United States, Urban",2007,http://www.yobaltimore.org/documents/Impact/impact_employment_earnings.pdf "Youth Opportunity grant initiative: process evaluation final report","Bruno, L., & Pistorino, C. (2007). Youth Opportunity grant initiative: process evaluation final report. Washington, DC: Decision Information Resources, Inc.","Opportunities for Youth","Study Type: Implementation Analysis",,,"Summary: This report summarized the results of the final round of the process evaluation of the Youth Opportunity (YO) grant initiative. The YO program offered educational, employment, leadership enhancement, and other support services to all youth ages 14 to 21 in targeted high-poverty areas across the country in order to boost their high school graduation, college enrollment, and employment rates. The study assessed program implementation and examined strengths and weaknesses of the YO model by gathering information on services provided, program outcomes, and implementation challenges and best practices at 25 sites. It drew on management information systems (MIS) data; group interviews with program administrators, line staff, and youth participants; and past process evaluation reports. Projects were successful in enrolling a large number of participants and nearly 40 percent of those enrolled received a long-term placement. Projects eventually succeeded in establishing YO centers but faced challenges in launching and running the centers, delivering comprehensive and integrated youth development services, sustaining long-term youth engagement, and developing partnerships for sustainability.","Youth Opportunity Grant Initiative","Basic skills Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",2007, "Initial impacts of the Ticket to Work program on Social Security disability beneficiary service enrollment, earnings, and bene","Wittenburg, D., Fraker, T., Stapleton, D., Thornton, C., Gregory, J., & Mamun, A. (2007). Initial impacts of the Ticket to Work program on Social Security disability beneficiary service enrollment, earnings, and benefits. Journal of Vocational Rehabilitation, 27, 129–140.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages","Summary: The study’s objective was to determine the effectiveness of Ticket to Work (TTW), a program designed to enhance the employment services available to Supplemental Security Income (SSI) and Social Security Disability Insurance (SSDI) recipients. The authors analyzed the outcomes of a nationwide sample of 4.7 million SSI and SSDI recipients ages 18 to 57 who would have been eligible for TTW in 2001. The authors used administrative records through 2004 from the Social Security Administration (SSA) and Rehabilitation Services Administration (RSA). The study found that enrollment in employment services increased 0.1 to 0.4 percent in states where TTW was in effect. However, the authors found no evidence of increased earnings as a result of TTW. The quality of the causal evidence presented in this study is moderate, the highest possible rating for nonexperimental designs. This means we have some confidence that the observed effects represent the impact of TTW, although other factors might also have contributed.","Ticket to Work","Disability insurance Supplemental security income (SSI) Vocational rehabilitation",Disability,,"United States",2007, "Individual account investment options and portfolio choice: Behavioral lessons from 401(K) plans","Brown, J., Lang, N., & Weisbenner, S. (2007). Individual account investment options and portfolio choice: Behavioral lessons from 401(K) plans. National Bureau of Economic Research working paper No. 13169. Cambridge, MA: NBER.","Behavioral Finance: Retirement","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employer benefits receipt-Low-Favorable impacts Employer benefits receipt","Summary: The study aimed to determine whether the number of fund options offered within a given asset class (for example, domestic equities) by a 401(k) plan influences the types of investments made by plan members. The authors analyzed differences in portfolio allocations based on the number of funds available in these asset classes using regression analysis, controlling for other 401(k) and firm characteristics. The analysis demonstrated that as the number of investment options within an asset class increase, individuals tend to allocate more of their 401(k) savings to funds within that class. The quality of causal evidence presented in this study is low. This low rating means that we are not confident that an increase in the number of funds offered within a class causes the increase in the share of funds allocated to assets in that class. We can only say that the two variables of interest are positively correlated.","Varying the Number of Risky Choices","Employer provided retirement benefits",Employed,,"United States",2007,http://www.nber.org/papers/w13169 "Can SSDI and SSI beneficiaries with mental illness benefit from evidence-based supported employment?","Bond, G., Xie, H., & Drake, R. (2007). Can SSDI and SSI beneficiaries with mental illness benefit from evidence-based supported employment? Psychiatric Services, 58(11), 1412-1420.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to determine whether supported employment programs improved employment outcomes for Social Security Disability Insurance (SSDI) and Supplemental Security Income (SSI) recipients with psychiatric disabilities. Supported employment interventions use a combination of employment and health services and supports to improve employment and other outcomes. This study aggregated data from randomized controlled trials in four sites: New Hampshire, Connecticut, Illinois, and Washington, D.C. Study data sources included baseline interviews and 18-month follow-up data from each site. The study found that, across all recipient types, the programs increased the probability of employment, the number of weeks worked, and the number of weeks worked at a single job by a statistically significant margin. The quality of causal evidence provided in this study is low. This means that we cannot be confident that the estimated effects are attributable to the support employment interventions; other factors are likely to have contributed.","Supported Employment Programs","Disability insurance Supplemental security income (SSI) Supported employment or other employment supports",Disability,,"United States",2007, "Long-Term Employment Trajectories Among Participants With Severe Mental Illness in Supported Employment","Becker, Deborah, Whitley, Rob, Bailey, Edward, & Drake, Robert. (2007). Long-Term Employment Trajectories Among Participants With Severe Mental Illness in Supported Employment. Psychiatric Services, 58, 922-928.","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: This exploratory study reinterviewed 38 participants in two supported employment studies 8 to 12 years later to examine their long-term employment trajectories. Both groups were adults with psychiatric disabilities who had participated in one of the earlier studies of individual placement and support services. Quantitative and qualitative analyses of data from the semistructured surveys were conducted, using a grounded theory approach. The study found positive employment trajectories; all 38 participants worked at least one job during the follow-up period, a great majority in competitive jobs, and 71 percent worked for more than half of the follow-up years. A great majority also continued to receive benefits at the time of the follow-up: 34 (89 percent) were receiving Social Security, 10 (26 percent) received Supplemental Security Insurance, and 28 (74 percent) received Social Security Disability Income. Three themes emerged from the qualitative analysis: (1) the persistent and pervasive nature of participants’ psychiatric problems, the importance of successful management of symptoms, and the deployment of appropriate coping skills in finding and maintaining work; (2) a strong preference by participants for part-time work because of the lesser demands and the ability to maintain Social Security and health care entitlements; and (3) the importance expressed by participants of ongoing individual placement and support services.",,"Disability insurance Supplemental security income (SSI) Supported employment or other employment supports",Disability,,"United States",2007, "Choice architecture and retirement savings plans","Benartzi, S., Peleg, E., & Thaler, R. (2007). Choice architecture and retirement savings plans. Los Angeles, Ca. SSRN working paper.","Behavioral Finance: Retirement","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employer benefits receipt-Mod/high-Favorable impacts Employer benefits receipt","Summary: The report’s objective was to examine the impact of choice architecture—that is, aspects of a savings plan’s structure and enrollment process—on 401(k) savings decisions. The authors discussed five original, observational studies. Two studies conducted regression analyses using survey data. One used an interrupted time series design and data from Vanguard on employees at 13 companies. Two additional studies conducted regression analyses using Vanguard data on 1.5 million participants in 1,830 of Vangaurd’s defined contribution retirement plans. The study receiving a moderate rating (study 5) found that members of retirement plans that offer retirement date funds, relative to members of retirement plans that offer risk-based funds or neither, held comparatively more equity when they were younger and comparatively less equity when they were older. The quality of causal evidence presented in this report is moderate because study 5 was a quasi-experimental design with adequate controls. We must note, however, that the remaining four studies provide causal evidence rated as low. The overall moderate evidence rating means we are somewhat confident that the estimated effects are attributable to the employees’ access to asset allocation funds, but other factors might also have contributed. In the case of the remaining four studies, however, we are not confident that the estimated effects are attributable to the interventions analyzed. Other factors are likely to have contributed.","the Choice Architecture of Retirement Savings Plans","Employer provided retirement benefits",Employed,,"United States",2007,http://164.67.163.139/Documents/areas/fac/accounting/Benartzi_ChoiceArchitectur… "Long-term effects of a middle school engineering outreach program for girls: A controlled study.","Hubelbank, J., Demetry, C., Nicholson, S., Blaisdell, S., Quinn, P., Rosenthal, E., & Sontgerath, S. (2007). Long-term effects of a middle school engineering outreach program for girls: A controlled study. In Proceedings, American Society for Engineering Education Annual Conference & Exhibition.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to assess the long-term impact of Camp Reach, a summer engineering enrichment program for middle school girls, on enrollment in STEM courses in high school and college. Admission to Camp Reach was determined through a lottery of girls who applied to the program and met eligibility requirements. Six to seven years later, the authors administered a survey to 88 girls who had been admitted to the program and 41 girls who had not. The study found that Camp Reach attendees were significantly more likely to have taken computer science and other science or engineering courses in high school than those who did not attend. The quality of causal evidence presented in this report is low because the authors adjusted the research sample after random assignment and did not include adequate controls to ensure that the resulting groups were similar on all relevant attributes. This means we are not confident that the estimated effects are attributable to Camp Reach; other factors are likely to have contributed.","Camp Reach","Science, Technology, Engineering, and Math (STEM) programs Youth programs","Youth, Female",,"United States",2007,https://www.wpi.edu/Images/CMS/News/1106_LONG_TERM_EFFECTS_OF_A_MIDDLE_SCHOOL_E… "Effects of learning about gender discrimination on adolescent girls’ attitudes toward and interest in science","Weisgram, E., & Bigler, R. (2007). Effects of learning about gender discrimination on adolescent girls’ attitudes toward and interest in science. Psychology of Women Quarterly, 31, 262-269.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Attitudes-Mod/high-Favorable impacts Attitudes","Summary: The study’s objective was to examine the impact of learning about gender discrimination in the sciences on girls’ attitudes toward and interest in science. The study included middle school girls who attended a conference designed to improve their attitudes toward and interest in science. Participants were randomly assigned to the treatment condition, which included standard conference sessions on science careers and a session on gender discrimination in the sciences, or to the control group that attended only the standard sessions. The authors administered pre- and post-conference surveys to measure the impact of the intervention. The study found significant increases in reported science self-efficacy and science utility value among the girls in the treatment condition, whereas girls in the control condition experienced a decrease in egalitarian attitudes toward science. The quality of causal evidence provided in this study is high because it was a well-implemented randomized controlled trial with low attrition. This means we are confident that the estimated effects are attributable to the intervention and not to other factors.",,"Preventing discrimination Science, Technology, Engineering, and Math (STEM) programs Youth programs","Youth, Female",,"United States",2007, "A cure for discrimination? Affirmative action and the case of California’s Proposition 209.","Myers, C. (2007). A cure for discrimination? Affirmative action and the case of California’s Proposition 209. Industrial and Labor Relations Review, 60(3), 379-396.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Unfavorable impacts Employment","Summary: The study’s objective was to gauge the impact of California’s Proposition 209, a 1996 repeal of affirmative action, on employment, unemployment, labor force participation, and wages among women and racial minorities. The author used a nonexperimental design and estimated a difference-in-difference-in-differences regression model on monthly Current Population Survey data from 1994 to 2001. The study found that the employment rate of all minorities in California relative to white men dropped 2.8 percentage points from 1995 to 1999, a statistically significant decrease. The quality of causal evidence presented in this report is low because the author did not control for pre-intervention minority employment trends in California relative to the rest of the United States or preemptive hiring decisions that might have anticipated the law’s passage. This means we are not confident that the estimated effects are attributable to California’s affirmative action repeal through Proposition 209. Other factors are likely to have contributed.","California's Proposition 209","Affirmative action",Other,,"United States",2007, "The Employment Retention and Advancement project: Results from the Personal Roads to Individual Development and Employment (PRIDE) program in New York City","Bloom, D., Miller, C., and Azurdia, G. (2007). The Employment Retention and Advancement project: Results from the Personal Roads to Individual Development and Employment (PRIDE) program in New York City. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Unfavorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Personal Roads to Individual Development and Employment (PRIDE) welfare-to-work program in New York City on the employment, earnings, and public benefits receipt of low-income single parents with physical or mental health problems that limited their ability to work. The study was a randomized controlled trial that used data from administrative records for the two years following assignment and a survey conducted with a random subset of the sample to assess outcomes one year after assignment. The study found that treatment group participants were significantly more likely than control group participants to have had a job and had higher average earnings. The treatment group was significantly less likely to receive cash assistance and received lower amounts of cash assistance benefits than the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to PRIDE and not to other factors.","Personal Roads to Individual Development and Employment (PRIDE)","Other employment and reemployment","Disability, Low income, Parent",,"United States, Urban",2007,http://www.acf.hhs.gov/sites/default/files/opre/era_pride.pdf "Developing core skills in the major","Arcario, P., Clark, J., & Klages, M. (2007). Developing core skills in the major. In M. Smith & B. Williams (Eds.), Learning communities and student affairs: Partnering for powerful learning. Olympia, WA: Washington Center for Improving the Quality of Undergraduate Education, Evergreen State College.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of participation in one of three first-year academies (Allied Health, Business/Technology, or Liberal Arts) on course failure rates and course attrition rates at LaGuardia Community College in New York City. The study design was unclear: the authors might have used a pre-post design or a simple mean comparison. The authors did not specify the data source.  The study found that failure rates in basic skills and discipline-area courses declined by 7.7 percent for academy students, and attrition in basic skills and discipline-area courses declined by 8 percent for academy students. The authors did not report information on the statistical significance of these findings. The quality of causal evidence presented in this report is low because the authors did not establish that there were no observable differences between the treatment and comparison groups at baseline nor did they adjust for any differences. This means we are not confident that the estimated effects are attributable to first-year academies. Other factors are likely to have contributed.","First-Year Academies","Basic skills Community college education and other classroom training","Adult, Other barriers",,"United States",2007, "Increasing retention of women engineering students","Sullivan, K., & Davis, R. (2007). Increasing retention of women engineering students. American Society for Engineering Education. Proceedings of the 2007 American Society for Engineering Education Annual Conference and Meeting. Washington, DC: American Society for Engineering Education.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Attitudes-Low-No impacts Attitudes Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine how participating in a study-designed program called the Jornada Intervention affected undergraduate female engineering students’ attitudes toward and persistence in studying engineering. Program activities included receiving a handheld computer and an invitation to participate in meetings to share experiences using the computer and suggestions for improving the user’s experience. The study used a comparison group design to compare outcomes for the treatment group with those of women who enrolled in engineering in adjacent years. Data sources included an attitudinal survey administered for the first analysis and administrative records to measure students’ graduation rates for the second analysis. In the first analysis, the study found no significant differences in attitudes toward engineering between the treatment and comparison groups. For the second analysis, though results were not presented and methods were not described, the authors reported that they uncovered significant differences in persistence between the treatment and comparison groups. They noted that program participants were significantly more likely to graduate in engineering than both (1) women from the same year who did not participate in the program and (2) women who enrolled in engineering in adjacent years. The quality of causal evidence presented in this report is low because it does not include control variables to adjust for differences between treatment and comparison groups. This means we are not confident that the estimated effects are attributable to the intervention; other factors are likely to have contributed.","Jornada Intervention","Science, Technology, Engineering, and Math (STEM) programs Youth programs","Youth, Female",,"United States",2007, "The effects of an experimental intensive juvenile probation program on self-reported delinquency and drug use","Lane, J., Turner, S., Fain, T., & Sehgal, A. (2007). The effects of an experimental intensive juvenile probation program on self-reported delinquency and drug use. Journal of Experimental Criminology, 3(3), 201-219.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence",,"Summary: The study’s objective was to examine the impact of the South Oxnard Challenge Project (SOCP), an alternative juvenile probation program, on delinquency and drug use. The study was a randomized controlled trial. Eligible youth were randomly assigned to either a treatment group, which could participate in SOCP, or a control group, which had routine juvenile probation. The study found that significantly more SOCP youth than youth in the control group reported committing a violent crime in the 12 months after starting probation (67.6 versus 55.6 percent). However, SOCP youth indicated they used ecstasy/MDMA less frequently than control youth in the past 30 days (1.8 versus 4.2 days). The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the SOCP, and not to other factors.","South Oxnard Challenge Project (SOCP)","Substance abuse recovery Youth programs Behavioral Interventions","Youth, Justice-involved, Disconnected youth",,"United States",2007, "The Employment Retention and Advancement project: Results from Minnesota’s Tier 2 program","LeBlanc, A., Miller, C., Martinson, K., & Azurdia, G. (2007). The Employment Retention and Advancement project: Results from Minnesota’s Tier 2 program. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to determine the 18-month impact of Minnesota’s Tier 2 welfare-to-work program compared with existing Tier 1 services. Minnesota’s Tier 2 program was part of the nationwide Employment Retention and Advancement (ERA) project. The authors randomly assigned approximately 1,700 long-term Temporary Assistance for Needy Families (TANF) recipients to either a treatment group, which received Tier 2 services including intensive assessments and case management, or a control group, which received Minnesota’s existing Tier 1 TANF services. The authors analyzed data from Minnesota Unemployment Insurance (UI), TANF, and Food Stamps administrative records. The study found that, 12 months after random assignment, more people in the Tier 2 group (79.2 percent) reported that they received Food Stamps than in the control group (70.0 percent). After 18 months however, there were no statistically significant differences between treatment and control group members’ employment, earnings, or benefits receipt. The quality of causal evidence provided in this study is high because it is based on a well-conducted randomized controlled trial. This means we are confident that any estimated effects are attributable to Minnesota’s Tier 2 program and not to other factors.","the Employment Retention and Advancement project, Minnesota’s Tier 2 Program","Job search assistance and supportive services Other employment and reemployment","Unemployed, Low income, Parent",,"United States",2007,http://www.acf.hhs.gov/sites/default/files/opre/minnesota_tier2.pdf "Reentry services: An evaluation of a pilot project in Clay County, MN","Bergseth, K., & McDonald, T. (2007). Reentry services: An evaluation of a pilot project in Clay County, MN. Fargo, ND: North Dakota State University, Department of Criminal Justice and Political Science.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: The study’s objective was to examine the impact of the Reentry Services Project (RSP) on juvenile recidivism. The authors estimated regression models comparing the number of criminal and official contacts with police or the courts, pulled from an electronic Court Services Tracking System, between RSP and comparison group members, controlling for differences in demographics and number of prior charges. The study found that RSP group members had significantly fewer official and criminal contacts than the comparison group one year after release from out-of-home placement. The quality of causal evidence presented in this report is low because the program was implemented in only one county and there was no variation in the implementation of the program over time. This means we are not confident that the estimated effects are attributable to the RSP; other factors are likely to have contributed.","the Reentry Services Project (RSP)","Health Job search assistance and supportive services Reentry Substance abuse recovery Youth programs Behavioral Interventions","Youth, Justice-involved, Disconnected youth",,"United States",2007,http://www.claycountycollaborative.org/projects/RSP%20Final%20Report%202007.pdf "The impact of supplemental instruction on students in STEM courses: Results from San Francisco State University","Peterfreund, A., Rath, K., Xenos, S., & Bayliss, F. (2007). The impact of supplemental instruction on students in STEM courses: Results from San Francisco State University. Journal of College Student Retention: Research, Theory & Practice, 9(4), 487-503.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of Supplemental Instruction in college science, technology, engineering, and mathematics (STEM) courses on the course grades earned at San Francisco State University. The study compares outcomes for students who enrolled in a Supplemental Instruction class paired with a STEM course to those who enrolled only in the STEM course. The study used administrative records for students who enrolled in at least one STEM course that offered optional Supplemental Instruction from fall 1992 to spring 2005. When analyzing outcomes within gender, the authors did not conduct any statistical testing to estimate differences in the STEM course grades of students who participated in Supplemental Instruction and those who did not. The quality of causal evidence presented in this study is low because the study does not adequately control for baseline measures. Although the study did not conduct statistical testing to estimate differences, the low evidence rating means that we would not be confident that any estimated effects would be attributable to Supplemental Instruction; other factors are likely to have contributed.","Supplemental Instruction","Science, Technology, Engineering, and Math (STEM) programs Youth programs",Youth,,"United States",2007, "The Employment Retention and Advancement project: Results from the Post-Assistance Self-Sufficiency (PASS) program in Riverside, California","Navarro, D., van Dok, M., & Hendra, R. (2007). The Employment Retention and Advancement project: Results from the Post-Assistance Self-Sufficiency (PASS) program in Riverside, California. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt Public benefits receipt-Low-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Riverside Post-Assistance Self-Sufficiency (PASS) program on employment, earnings, and public benefits receipt after two years. The Riverside PASS site was one of two in Riverside, California, that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 2,770 employed single-parent participants who had recently left the Temporary Assistance for Needy Families (TANF) program to a treatment group that received ERA services or to a control group that received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records and a survey administered 12 months after random assignment. The study found that Riverside PASS had positive impacts on earnings and employment in the first and second years after random assignment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to Riverside PASS, and not to other factors.","the Riverside Post-Assistance Self-Sufficiency (PASS) Program","Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States",2007,http://www.acf.hhs.gov/sites/default/files/opre/riverside_pass.pdf "Transitional jobs for ex-prisoners: Early impacts from a random assignment evaluation of the Center for Employment Opportunities (CEO) prisoner reentry program.","Bloom, D., Redcross, C., Zweig, J. & Azurdia, G. (2007). Transitional jobs for ex-prisoners: Early impacts from a random assignment evaluation of the Center for Employment Opportunities (CEO) prisoner reentry program. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the effect of the Neighborhood Work Project (NWP) sponsored by the Center for Employment Opportunities (CEO) on the employment outcomes of former prisoners. The study was a randomized controlled trial. The authors used administrative data from the program and state data systems to compare the outcomes of former prisoners who had been randomly assigned to the NWP with those of former prisoners who were randomly assigned to a control group that received basic employment services. The study found that those assigned to the NWP were more likely than the control group to be employed in all four quarters during the year after the program and were more likely to be employed in the program’s worksite project in the fourth quarter after the program. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the CEO NWP’s transitional job services and not to other factors.","the Center for Employment Opportunities’ Neighborhood Work Project (NWP)","Other employment and reemployment Reentry",Justice-involved,,"United States",2007,http://www.acf.hhs.gov/sites/default/files/opre/transitional_jobs.pdf "Evaluation of LA’s HOPE: Ending chronic homelessness through employment and housing—Final report.","Burt, M. (2007). Evaluation of LA’s HOPE: Ending chronic homelessness through employment and housing—Final report. Washington, DC: U.S. Department of Housing and Urban Development and U.S. Department of Labor.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: The study’s objective was to examine the impact of Los Angeles’ Homeless Opportunity Providing Employment (HOPE) program on employment, housing, and income. The study used a quasi-experimental design in which the authors compared participants in the HOPE program with participants in other programs that provided many of the same services but not its specialized housing and employment resources. The authors presented direct comparisons, as well as comparisons that adjusted for the groups’ differences in age, race, mental health diagnoses, and recent experience of homelessness and incarceration. This review was conducted in collaboration with the Employment Strategies for Low-Income Adults Evidence Review (ESER). Because ESER did not report findings for studies that received a low causal evidence rating, the CLEAR profile does not report the findings either. The quality of causal evidence presented in this report is low because the author did not account for differences between members of the program and comparisons groups or show that they were similar when they joined the study. This means we are not confident that the estimated effects are attributable to Los Angeles’ HOPE program; other factors are likely to have contributed.","Los Angeles’ Homeless Opportunity Providing Employment (HOPE)","Other employment and reemployment","Low income, Homeless, Disability",,"United States",2007,http://www.urban.org/sites/default/files/alfresco/publication-pdfs/411631-Evalu… "The Employment Retention and Advancement project: Results from two education and training models for employed welfare recipients in Riverside, California.","Navarro, D., Freedman, S., & Hamilton, G. (2007). The Employment Retention and Advancement project: Results from two education and training models for employed welfare recipients in Riverside, California. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-Unfavorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of post-employment job supports and intensive case management on welfare recipients’ employment, earnings, and benefit receipt outcomes after two years. The Riverside Phase 2 site was one of two in Riverside, California, that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 2,907 employed single-parent participants in Riverside’s Temporary Assistance for Needy Families (TANF) program to one of two treatment groups that received differing ERA services or to a control group that received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records and a survey administered 12 months after random assignment. The study found that the households of participants in the Work Plus program were 10.5 percentage points less likely to receive TANF benefits relative to those in the control group 12 months after random assignment. The study found no statistically significant effects associated with the Training Focused program. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to the Riverside Work Plus program and not to other factors. It also means that we would be confident that any estimated effects would be attributable to Riverside Training Focused program and not to other factors. However, the study did not find statistically significant effects of the Training Focused program.","the Employment Retention and Advancement Project—Work Plus and Training Focused (Phase 2), Riverside","Other employment and reemployment","Parent, Low income",,"United States",2007,http://www.acf.hhs.gov/sites/default/files/opre/riverside_phase2.pdf "Evaluating multi-treatment programs: Theory and evidence from the U.S. Job Training Partnership Act experiment.","Plesca, M., & Smith, J. (2007). Evaluating multi-treatment programs: Theory and evidence from the U.S. Job Training Partnership Act experiment. Empirical Economics, 32, 491-528.",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Job Training Partnership Act (JTPA) on earnings and employment for disadvantaged adults. The authors conducted a randomized controlled trial. They analyzed data from one baseline survey, two follow-up surveys, and earnings and employment records. The study found that men in the treatment group had earned more at the 30-month follow-up than men in the control group, and that women in the treatment group experienced significantly better earnings and employment outcomes at several points compared to the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to JTPA, and not to other factors.","Job Training Partnership Act","Other training and education Supported employment or other employment supports Job search assistance and supportive services","Adult, Female, Male, Low-skilled, Low income",,"United States",2007, "Evaluating the impacts of Washington State repeated job search services on the earnings of prime‐age female TANF recipients.","Hsiao, C., Shen, Y., Wang, B., & Weeks, G. (2007). Evaluating the impacts of Washington State repeated job search services on the earnings of prime‐age female TANF recipients. Journal of Applied Econometrics, 22(2), 453-475.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impacts of Job Search Services (JSS) on employment and earnings outcomes of women ages 25 to 35 who participated in the WorkFirst program in Washington State. The authors used a nonexperimental study design to examine the earnings and employment outcomes of women who took part in JSS. Women were categorized as being in the treatment group if they participated in JSS at least once from the second quarter of 1998 to the fourth quarter of 2000. Women who did not participate in JSS during this time made up the comparison group. The study found that the first instance of participation in JSS increased the likelihood of employment by 4 percent for women seeking employment. The study also found a positive and statistically significant relationship between quarterly earnings and participation in JSS one or more times for employed women. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups compared exhibited similar employment or earnings outcomes before the intervention. This means we are not confident that the estimated effects are attributable to JSS; other factors are likely to have contributed.","Job Search Services (JSS)","Community college education and other classroom training Job search assistance and supportive services Other training and education","Low income",,"United States",2007, "Labor market shocks and retirement: Do government programs matter?","Coile, C., & Levine, P. (2007). Labor market shocks and retirement: Do government programs matter? Journal of Public Economics, 91(10), 1902-1919.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-No impacts Employment Public benefits receipt-Low-No impacts Public benefit receipt","Summary: The study examined the impact of the generosity of unemployment insurance (UI) benefits on retirement decisions. The study used a statistical model and data from the March Current Population Survey for 1980–2004 to estimate impacts. The study found no relationship between the generosity of UI benefits and the likelihood of retirement or receipt of UI. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before changes in the generosity of UI benefits were observed. This means we are not confident that the estimated effects are attributable to changes in the generosity of UI benefits; other factors are likely to have contributed.","Unemployment Insurance (UI)","Unemployment Insurance","Adult, Older worker, Unemployed",,"United States",2007,http://academics.wellesley.edu/Economics/Coile/PDF%20files/coile-levine%20JPubE… "Adding contingency management intervention to vocational rehabilitation: Outcomes for dually diagnosed veterans","Drebing, C. E., Van Ormer, E. A., Mueller, L., Hebert, M., Penk, W. E., Petry, N. M., . . . Rounsaville, B. (2007). Adding contingency management intervention to vocational rehabilitation: Outcomes for dually diagnosed veterans. Journal of Rehabilitation Research & Development, 44(6), 851-865.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts Employment Health and safety-Mod/high-Favorable impacts Health and safety","Summary: The study examined the impact of contingency management (CM) on employment and health outcomes. The authors conducted a randomized controlled trial, using a work history form and drug and alcohol screenings to collect participant data. At nine months, 50 percent of the individuals in the treatment group had obtained competitive employment compared with only 28 percent of those in the control group. Treatment group participants remained abstinent from drugs and alcohol longer than control group participants (11.8 weeks versus 9.4 weeks). Treatment group participants were also less likely to relapse by week 16 (50 percent versus 72 percent). The quality of causal evidence presented in this report is high for employment outcomes because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the CM program, and not to other factors.","Contingency Management","Veterans' reemployment","Veteran or military",,"United States",2007,https://www.rehab.research.va.gov/jour/07/44/6/drebing.html "Protecting education for the poor in times of crisis: An evaluation of a scholarship programme in Indonesia","Sparrow, R. (2007). Protecting education for the poor in times of crisis: An evaluation of a scholarship programme in Indonesia. Oxford Bulletin of Economics and Statistics, 69, 99-122. doi: 10.1111/j.1468-0084.2006.00438.x","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of Jaring Prengaman Sosial (JPS), a scholarship program in Indonesia, on child labor and school enrollment. The author used data from an annual Indonesian national survey to estimate an instrumental variable (IV) regression model to examine if scholarship receipt affected school enrollment, and probit models to examine the effects on child labor and school attendance. The study found that the receipt of a scholarship was significantly associated with a decrease in child labor and an increase in school attendance. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before receiving the JPS in the probit model and no evidence was provided on the strength of the instrument used in the IV model. This means we are not confident that the estimated effects are attributable to the Jaring Pengaman Sosial (JPS) scholarship program; other factors are likely to have contributed.","Jaring Prengaman Sosial","Child labor Tuition assistance","Other, Low income",,International,2007,https://pdfs.semanticscholar.org/8f79/add16372936ea1e388e3a9c82e320435a87d.pdf "A tax on work for the elderly: Medicare as a secondary payer.","Goda, G. S., Shoven, J. B., & Slavov, S. N. (2007). A tax on work for the elderly: Medicare as a secondary payer. (NBER Working Paper No. 13383). Cambridge, MA: National Bureau of Economic Research.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of Medicare as a Secondary Payer (MSP) on older workers’ labor force participation and full-time employment The study used a nonexperimental regression design. The authors used data from the 1980 to 2006 March Supplement of the Current Population Survey. The study found that labor force participation for older males increased following the enforcement of the MSP policy, and that older males and females in the labor force were more likely to be employed full time after the policy was enforced. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention, and confounding factors could have impacted older workers differentially during the time periods examined. This means we are not confident that the estimated effects are attributable to MSP; other factors are likely to have contributed.","Medicare as a Secondary Payer","Federal retirement benefits Older workers' programs","Adult, Older worker",,"United States",2007,https://www.nber.org/papers/w13383 "Final evaluation report of the SSI Work Incentives Demonstration Project","Kregel, J. (2006). Final evaluation report of the SSI Work Incentives Demonstration Project. Richmond, VA: State Partnership Systems Change Initiative Project Office, Virginia Commonwealth University.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The study’s objective was to measure employment and earnings impacts for the four State Partnership Initiative (SPI) sites that implemented the Supplemental Security Income (SSI) Work Incentives Demonstration Project, also known as the SSI Waiver Demonstration Project. The author compared the outcomes of SSI Waiver Demonstration Project participants with those of nonparticipants using data from SPI project offices and Unemployment Insurance (UI) administrative records. The study found that during the intervention delivery period, SSI Waiver Demonstration Project participants’ earnings increased relative to (1) people at the same sites who chose not to participate in the demonstration and (2) people at other SPI sites that did not implement the demonstration. The quality of the causal evidence presented in this report is low because the study was a nonexperimental analysis that did not include adequate controls for underlying differences between the groups being compared. This means we are not confident that the estimated effects are attributable to the SSI Waiver Demonstration Project. Other factors are likely to have contributed.","the SSI Work Incentives Demonstration Project","Supplemental security income (SSI)",Disability,,"United States",2006,http://www.google.com/url?sa=t&rct=j&q=&esrc=s&frm=1&source=web&cd=1&cad=rja&ua… "A process and site-specific outcome evaluation of Maine’s adult drug treatment court programs","Ferguson, A., McCole, B., & Raio, J. (2006). A process and site-specific outcome evaluation of Maine’s adult drug treatment court programs. Portland, ME: University of Southern Maine. Retrieved from https://www1.maine.gov/dhhs/samhs/osa/pubs/correct/2006/adultdc06.pdf",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: The study’s objective was to examine the impact of participation in Maine’s adult drug treatment court programs on recidivism. The authors compared the recidivism rates of drug treatment court program participants in five Maine counties with those of adult offenders adjudicated through the traditional process in those same counties. The study generally found that rearrest rates for adults who were assigned to the drug court were lower than those for adults adjudicated through the traditional process. However, the study did not report any tests of the statistical significance of these differences. The quality of causal evidence presented in this report is low because the authors did not control for existing differences between the study groups. This means we are not confident that the estimated effects are attributable to Maine’s adult drug court programs; other factors are likely to have contributed.","Maine’s Adult Drug Treatment Court Programs","Substance abuse recovery",Justice-involved,,"United States",2006,https://www1.maine.gov/dhhs/samhs/osa/pubs/correct/2006/Mjv0306.pdf "An examination of the delivery of literacy services at Job Corps Centers.","KPMG (2006). An examination of the delivery of literacy services at Job Corps Centers. Washington, DC: U.S. Department of Labor, Office of Job Corps.","Opportunities for Youth","Study Type: Implementation Analysis",,,"Summary: The purpose of the study was to identify areas in which Job Corps can improve its delivery of literacy services. Job Corps is a national program that provides youth with job training skills while they pursue a high school diploma or general equivalency diploma (GED). It also provides career counseling and job placement services following completion of the job training component. The authors primarily analyzed qualitative data collected from site visits to six Job Corps sites across the United States. The visits included interviews with key staff and observations of Job Corps classes. The authors also conducted descriptive quantitative analyses of administrative participant and survey data. The authors made recommendations for improvements in the delivery of literacy services in the following areas: employing certified teaching staff on government pay scales so that they can compete with public school teachers in terms of compensation and benefits; providing additional resources, such as special education instructors, psychologists, and counselors, to allow instructors to devote more time to their classes; and building partnerships and relationships with other educational institutions and the community.","Job Corps","Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",2006,http://wdr.doleta.gov/research/FullText_Documents/Job%20Corps%20Literacy%20Repo… "Net impact and benefit-cost estimates of the workforce development system in Washington State. Upjohn Institute technical report no. TR06-020. [Dept. of Services for the Blind]","Hollenbeck, K., & Huang, W. (2006). Net impact and benefit-cost estimates of the workforce development system in Washington State. Upjohn Institute technical report no. TR06-020. Kalamazoo, MI: W. E. Upjohn Institute for Employment Research. [Dept. of Services for the Blind]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Department of Services for the Blind (DSB) program on the employment rate and earnings of low-income adults who are blind. The authors used a nonexperimental method to compare the short-term (3 quarters after program exit) and long-term (9 to 12 quarters after program exit) employment and earnings between those who took part in the DSB program relative to those who were eligible but did not receive these services. The study found that, compared with those who did not receive these services, DSB program participants had significantly higher employment and earnings. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups compared were similar before program participation. This means we are not confident that the estimated effects are attributable to the DSB program; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Department of Services for the Blind (DSB) Program","Unemployment Insurance Vocational rehabilitation",Disability,,"United States",2006,http://research.upjohn.org/cgi/viewcontent.cgi?article=1023&context=up_technica… "Net impact and benefit-cost estimates of the workforce development system in Washington State. Upjohn Institute technical report no. TR06-020. [Community and Technical College Job Prep Training]","Hollenbeck, K., & Huang, W-J. (2006). Net impact and benefit-cost estimates of the workforce development system in Washington State. Upjohn Institute technical report no. TR06-020. Kalamazoo, MI: W.E. Upjohn Institute for Employment Research. [Community and Technical College Job Prep Training]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Community and Technical College (CTC) Job Preparatory Training program on the employment rate, earnings, and public benefit receipt of adults in Washington State. The authors used a nonexperimental design to compare the short-term (3 quarters after program exit) and long-term (9 to 12 quarters after program exit) employment, earnings, and public benefit receipt between those who took part in the CTC training program and those who registered for employment services at the state Labor Exchange. The study found that, compared with those who registered for services at the Labor Exchange, participants in the CTC training program had higher employment and earnings, although findings for public benefit receipt were mixed. The quality of causal evidence presented in this report is low because the authors compared the treatment and comparison groups at different follow-up points and the groups were therefore not equivalent. This means we are not confident that the estimated effects are attributable to the CTC Job Preparatory Training program; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","Community and Technical College (CTC) Job Preparatory Training Program","Other training and education",Adult,,"United States",2006,http://research.upjohn.org/cgi/viewcontent.cgi?article=1023&context=up_technica… "Net impact and benefit-cost estimates of the workforce development system in Washington State. (Upjohn Institute technical report no. TR06-020). [Community and Technical College Worker Retraining Program]","Hollenbeck, K., & Huang, W-J. (2006). Net impact and benefit-cost estimates of the workforce development system in Washington State. (Upjohn Institute technical report no. TR06-020). Kalamazoo, MI: W.E. Upjohn Institute for Employment Research. [Community and Technical College Worker Retraining Program]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment Public benefits receipt-Low-Mixed impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Community and Technical College (CTC) Worker Retraining program on the employment rate, earnings, and public benefit receipt of long-term unemployed and dislocated workers in Washington State. The authors used a nonexperimental design to compare the short-term (3 quarters after program exit) and long-term (9 to 12 quarters after program exit) employment, earnings, and public benefit receipt between those who took part in the CTC Worker Retraining program and those who registered for employment services at the state Labor Exchange. The study found that, compared with those in the comparison group, participants in the CTC Worker Retraining program had higher employment and earnings, and lower public benefits receipt. The quality of causal evidence presented in this report is low because the authors compared the treatment and comparison groups at different follow-up points and the groups were therefore not equivalent. This means we are not confident that the estimated effects are attributable to CTC Worker Retraining program; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","Community and Technical College Worker Retraining (CTC WR) Program","Community college education and other classroom training Other training and education","Dislocated or displaced worker, Unemployed",,"United States",2006,http://research.upjohn.org/cgi/viewcontent.cgi?article=1023&context=up_technica… "Net impact and benefit-cost estimates of the workforce development system in Washington State. (Upjohn Institute technical report no. TR06-020). [Comm. and Tech. ABE]","Hollenbeck, K., & Huang, W-J. (2006). Net impact and benefit-cost estimates of the workforce development system in Washington State. (Upjohn Institute technical report no. TR06-020). Kalamazoo, MI: W.E. Upjohn Institute for Employment Research. [Comm. and Tech. ABE]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment Public benefits receipt-Low-Mixed impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Community and Technical Colleges Adult Basic Education (ABE) program on the employment, earnings, and public benefits receipt of low-income adults. The authors used a nonexperimental method to compare the short-term (3 quarters after program exit) and long-term (9 to 12 quarters after program exit) employment, earnings, and public benefits receipt between those who took part in the ABE program relative to those who registered for services at the Labor Exchange. The study found that, compared with those who registered for Labor Exchange services, ABE program participants had higher employment and earnings, and lower public benefits receipt. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups compared were similar before program participation. This means we are not confident that the estimated effects are attributable to the ABE program; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Community and Technical Colleges Adult Basic Education (ABE) Program","Other training and education","Adult, Unemployed",,"United States",2006,http://research.upjohn.org/cgi/viewcontent.cgi?article=1023&context=up_technica… "Net impact and benefit-cost estimates of the workforce development system in Washington State. Upjohn Institute technical report no. TR06-020). [Private career school programs]","Hollenbeck, K., & Huang, W-J. (2006). Net impact and benefit-cost estimates of the workforce development system in Washington State. Upjohn Institute technical report no. TR06-020). Kalamazoo, MI: W.E. Upjohn Institute for Employment Research. [Private career school programs]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Private Career School program on the employment rate, earnings, and public benefit receipt of adults with a high school education. The authors used a nonexperimental method to compare the short-term (3 quarters after program exit) and long-term (9 to 12 quarters after program exit) employment, earnings, and public benefits of those who took part in the Private Career School program relative to those who registered for services at the Labor Exchange. The study found that, compared with those who registered for Labor Exchange services, Private Career School program participants had higher employment and earnings, and lower receipt of several types of public benefits. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups compared were similar before program participation. This means we are not confident that the estimated effects are attributable to the Private Career School program; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Private Career School Programs","Other training and education","Adult, Unemployed","Other services, Transportation and warehousing","United States",2006,http://research.upjohn.org/cgi/viewcontent.cgi?article=1023&context=up_technica… "Net impact and benefit-cost estimates of the workforce development system in Washington State. (Upjohn Institute technical report no. TR06-020). [WIA Youth]","Hollenbeck, K., & Huang, W-J. (2006). Net impact and benefit-cost estimates of the workforce development system in Washington State. (Upjohn Institute technical report no. TR06-020). Kalamazoo, MI: W.E. Upjohn Institute for Employment Research. [WIA Youth]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Workforce Investment Act (WIA) Youth program on the employment rate and earnings of low-income youth. The authors used a nonexperimental method to compare the short-term (3 quarters after program exit) and long-term (9 to 12 quarters after program exit) employment, earnings, and public benefits receipt between those who took part in the WIA Youth program relative to those who registered for services at the Labor Exchange. The study found that, compared with those who registered for Labor Exchange services, WIA Youth program participants had lower employment, with mixed findings for earnings. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups compared were similar before program participation. This means we are not confident that the estimated effects are attributable to the WIA Youth program; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Workforce Investment Act (WIA) Youth Program","Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) Youth programs Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) training programs","Youth, Low income",,"United States",2006,http://research.upjohn.org/cgi/viewcontent.cgi?article=1023&context=up_technica… "Net impact and benefit-cost estimates of the workforce development system in Washington State. (Upjohn Institute technical report no. TR06-020). [WIA Adult]","Hollenbeck, K., & Huang, W-J. (2006). Net impact and benefit-cost estimates of the workforce development system in Washington State. (Upjohn Institute technical report no. TR06-020). Kalamazoo, MI: W.E. Upjohn Institute for Employment Research. [WIA Adult]","Apprenticeship and Work-Based Training, Job Search Assistance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment Public benefits receipt-Low-Unfavorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Workforce Investment Act (WIA) Adult Program on the employment rate, earnings, and public benefit receipt of low-income adults in Washington State. The authors used a nonexperimental design to compare the short-term (3 quarters after program exit) and long-term (9 to 12 quarters after program exit) employment, earnings, and public benefit receipt between those who took part in the WIA Adult Program and those who registered for employment services at the state Labor Exchange. The study found that, compared with those who registered for services at the Labor Exchange, participants in the WIA Adult Program had higher employment, earnings, and public benefit receipt. The quality of causal evidence presented in this report is low because the authors compared the treatment and comparison groups at different follow-up points and the groups were therefore not equivalent. This means we are not confident that the estimated effects are attributable to the WIA Adult Program; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Workforce Investment Act (WIA) Adult Program","Adult and Dislocated Worker programs Job search assistance and supportive services Labor Exchange Other employment and reemployment Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) Other training and education","Unemployed, Low income",,"United States",2006,http://research.upjohn.org/cgi/viewcontent.cgi?article=1023&context=up_technica… "Net impact and benefit-cost estimates of the workforce development system in Washington State. (Upjohn Institute technical report no. TR06-020). [WIA Dislocated Workers]","Hollenbeck, K., & Huang, W-J. (2006). Net impact and benefit-cost estimates of the workforce development system in Washington State. (Upjohn Institute technical report no. TR06-020). Kalamazoo, MI: W. E. Upjohn Institute for Employment Research. [WIA Dislocated Workers]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment Public benefits receipt-Low-Mixed impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Workforce Investment Act (WIA) Dislocated Worker Program on the employment rate, earnings, and public benefit receipt of dislocated workers in Washington State. The authors used a nonexperimental design to compare the short-term (3 quarters after program exit) and long-term (9 to 12 quarters after program exit) employment, earnings, and public benefit receipt between those who took part in the WIA Dislocated Worker Program and those who registered for employment services at the state Labor Exchange. The study found that, compared with those who registered for services at the Labor Exchange, participants in the WIA Dislocated Worker Program had higher employment and earnings, although the findings for public benefit receipt were mixed. The quality of causal evidence presented in this report is low because the authors compared the treatment and comparison groups at different follow-up points and the groups were therefore not equivalent. This means we are not confident that the estimated effects are attributable to WIA Dislocated Worker Program; other factors are likely to have contributed.","the Workforce Investment Act (WIA) Dislocated Worker Program","Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) training programs","Adult, Dislocated or displaced worker",,"United States",2006,http://research.upjohn.org/cgi/viewcontent.cgi?article=1023&context=up_technica… "The Quantum Opportunity Program demonstration: Final impacts","Schirm, A., Stuart, E., & McKie, A. (2006). The Quantum Opportunity Program demonstration: Final impacts. Washington, DC: Mathematica Policy Research.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Mod/high-No impacts Education and skills gains Employer benefits receipt-Mod/high-No impacts Employer benefits receipt","Summary: The report’s objective was to evaluate the impact of the Quantum Opportunity Program (QOP)—which included case management and mentoring, education, developmental activities, community service, supportive services, and financial incentives—on educational attainment and labor market participation nine years after program enrollment. Earlier reports presented impact findings over a shorter follow-up period.  About 1,100 9th-grade students from 11 high schools were randomly assigned to the treatment group, which could enroll in QOP, or the control group, which could not participate in QOP activities. The study team administered a survey to treatment and control group members about nine years after program enrollment (six years after their scheduled graduation from high school) to collect information on education and labor market outcomes. The study reported no statistically significant impacts of participation in QOP on postsecondary educational attainment, likelihood of employment, or earnings for the full sample. The quality of the causal evidence presented in this report is high because it was a well-implemented randomized controlled trial. This means we are confident that estimated impacts would be solely attributable to QOP, and not other factors.","Quantum Opportunities Program (QOP)","Mentoring Other training and education Youth programs",Youth,,"United States",2006,http://www.mathematica-mpr.com/~/media/publications/PDFs/QOPfinalimpacts.pdf "Learning from the Youth Opportunity experience: Building delivery capacity in distressed communities","Harris, L. (2006). Learning from the Youth Opportunity experience: Building delivery capacity in distressed communities. Washington, DC: Center for Law and Social Policy.","Opportunities for Youth","Study Type: Descriptive Analysis",,,"Summary: This study explored the successes and challenges of implementing Youth Opportunity grants, which were awarded to 36 low-income communities in May 2000 to address high unemployment, low graduation rates, and endemic violence and crime among youth ages 14 to 21. The authors administered to 22 Youth Opportunity grantees a survey that gathered information on how the program engaged community leaders, connected different systems providing youth services, rolled out comprehensive programming, and collaborated with businesses. The researchers also conducted focus groups at several sites. The study found that Youth Opportunity grants had a high level of success in recruiting disadvantaged and out-of-school youth, boosting their enrollment in educational support programs, and placing participants in jobs and internships. The grants also improved the long-term capacity of these communities to serve low-income youth by enhancing youth workers’ skills and expertise and encouraging collaboration across different systems involved in youth development. Grantees faced challenges in setting up large-scale, complex initiatives in the allotted time, locating local funding, and ensuring that employers had reasonable expectations of program participants. The study recommended a lengthier planning phase and more closely engaging local and state officials and business representatives in the program.","Youth Opportunity Grant Initiative","Youth programs Other training and education Work based and other occupational training","Youth, Low-skilled, Low income",,"United States",2006,http://files.eric.ed.gov/fulltext/ED490191.pdf "Correctional industries preparing inmates for re-entry: Recidivism & post-release employment","Smith, C. J., Bechtel, J., Patrick, A., Smith, R. R., & Wilson-Gentry, L. (2006). Correctional industries preparing inmates for re-entry: Recidivism & post-release employment. (Report No. 214608). Washington, DC: U.S. Department of Justice. [Comparison between PIECP and other-than-work activities]",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: This study examines the effectiveness of a specific prison work program called Prison Industry Enhancement Certification Program (PIECP) on employment, earnings, and recidivism after release. The authors investigated similar research questions for another contrast, the profile of which is available here. The authors used a nonexperimental study design and administrative data to compare employment, earnings, and recidivism outcomes of the PIECP group with those of a comparison group of similar people who did not participate in prison work activities. The study found that PIECP was associated with more employment, greater earnings, and less recidivism compared with the outcomes of those who did not participate in prison work activities. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the PIECP; other factors are likely to have contributed.","Prison Industry Enhancement Certification Program (PIECP)","Reentry Other training and education",Justice-involved,,"United States",2006,https://emoglen.law.columbia.edu/twiki/pub/AmLegalHist/SaarWarnerProject/214608… "Correctional industries preparing inmates for re-entry: Recidivism & post-release employment","Smith, C. J., Bechtel, J., Patrick, A., Smith, R. R., & Wilson-Gentry, L. (2006). Correctional industries preparing inmates for re-entry: Recidivism & post-release employment. (Report No. 214608). Washington, DC: U.S. Department of Justice. [Comparison between PIECP and traditional prison industries employment]",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: This study examines the effectiveness of a specific prison work program called Prison Industry Enhancement Certification Program (PIECP) on employment and recidivism after release. The authors investigated similar research questions for another contrast, the profile of which is available here. The authors used a nonexperimental study design and administrative data to compare employment and recidivism outcomes of the PIECP group with the outcomes of a comparison group of similar people who worked in traditional prison industries. The study found that PIECP was associated with more employment and less recidivism compared with the outcomes of people who worked in traditional prison industries. The quality of causal evidence presented in this report is low because the authors did not demonstrate that the groups being compared were similar before the program began. This means we are not confident that the estimated effects are attributable to PIECP; other factors are likely to have contributed.","Prison Industry Enhancement Certification Program (PIECP)","Reentry Other training and education",Justice-involved,,"United States",2006,https://emoglen.law.columbia.edu/twiki/pub/AmLegalHist/SaarWarnerProject/214608… "Workforce investment act services: Effect on dislocated worker reemployment (Doctoral Disertation)","Walker, M. A. (2006). Workforce investment act services: Effect on dislocated worker reemployment (Doctoral dissertation). Retrieved from ProQuest Dissertations & Theses. Accession No. UMI 3244857. [Study 1: Contrast: WIA employment services vs. no service]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-Unfavorable impacts Employment","Summary: The study’s objective was to examine the effects of employment services offered through the Workforce Investment Act of 1998 (WIA) on employment and earnings outcomes. The author investigated similar research questions in another study, whose profile can be found [here]. The other study examined the effects of WIA’s employment and training services on employment and earnings. The author used a statistical model in a nonexperimental analysis to compare the outcomes of workers who lost their jobs for reasons including being laid off and either did or did not receive WIA employment services. The author used data from the state Employment Commission’s dislocated worker database, Workforce Investment Act Title IB Standardized Record Data. The study found a statistically significant, negative relationship between the WIA employment services and employment. Those receiving employment services had longer durations of unemployment than those who did not, by about 21 weeks. There were no statistically significant relationships between the WIA employment services and earnings. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated relationships are attributable to the WIA employment services; other factors are likely to have contributed to those relationships.","the Workforce Investment Act (WIA)","Adult and Dislocated Worker programs Job search assistance and supportive services Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA)","Dislocated or displaced worker",,"United States",2006,https://digitalcommons.odu.edu/cgi/viewcontent.cgi?article=1196&context=efl_etds "Workforce investment act services: Effect on dislocated worker reemployment (Doctoral Disertation)","Walker, M. A. (2006). Workforce investment act services: Effect on dislocated worker reemployment (Doctoral dissertation). Available from ProQuest Dissertations & Theses. Accession No. UMI 3244857. [Study 2: Contrast: WIA employment and training services vs. no service]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-Unfavorable impacts Employment","Summary: The study’s objective was to examine the effects of employment and training services offered through the Workforce Investment Act of 1998 (WIA) on employment and earnings outcomes. The author investigated similar research questions in another study, the profile of which can be found [here]. The other study examined the effects of WIA’s employment services on the same employment and earnings outcomes when there were no training services. The author used a statistical model in a nonexperimental analysis to compare outcomes of workers who lost their jobs for reasons including being laid off and either did or did not receive WIA employment services. The author used data from the state Employment Commission dislocated worker database, Workforce Investment Act Title IB Standardized Record Data. The study found a statistically significant, negative relationship between the WIA employment and training services and employment. Those receiving employment and training services had longer durations of unemployment than those who did not, by about 23 weeks. There were no statistically significant relationships between the WIA employment and training services and earnings. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated relationships are attributable to the WIA employment and training services; other factors are likely to have contributed to those relationships.","the Workforce Investment Act (WIA)","Adult and Dislocated Worker programs Job search assistance and supportive services Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA)","Dislocated or displaced worker",,"United States",2006,https://digitalcommons.odu.edu/cgi/viewcontent.cgi?article=1196&context=efl_etds "Regulatory federalism and workplace safety: Evidence from OSHA enforcement, 1981–1995","Bradbury, J. (2006). Regulatory federalism and workplace safety: Evidence from OSHA enforcement, 1981–1995. Journal of Regulatory Economics, 29(2), 211–224.","OSHA Enforcement","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Health and safety-Low-Favorable impacts Health and safety","Summary: The study’s objective was to determine if workplace fatalities were lower in states with federal or state enforcement of Occupational Safety & Health Administration (OSHA) regulations. The study used a regression model to compare changes over time in the workplace fatalities of states with federal or state enforcement of OSHA regulations. The study found that states with self-enforcement of OSHA regulations had lower fatality rates relative to states with federal OSHA enforcement; this difference was statistically significant. The quality of evidence presented in this study is low. This means we are not confident that the differences in workplace fatalities between states with self-enforcement and those with federal enforcement of OSHA regulations are attributable to the method of enforcement.","OSHA Enforcement Activities","Other health and safety Workplace injury",Employed,,"United States",2006, "Effect of benefits counseling services on employment outcomes for people with psychiatric disabilities","Tremblay, T., Smith, J., Xie, H., & Drake, R. (2006). Effect of benefits counseling services on employment outcomes for people with psychiatric disabilities. Psychiatric Services, 57(6), 816-821.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages","Summary: The studies’ objective was to measure the earnings impacts of the Vermont Work Incentive Initiative (VWII), which provided customized benefits counseling to Social Security disability benefit recipients who were receiving vocational rehabilitation (VR) services. Services offered by the VWII participants varied, but could consist of benefits screening, explanations of work incentives, and case management. The studies used earnings data collected from the Vermont Department of Employment and Training. The treatment groups received VWII services and possibly other VR services, whereas the comparison groups received VR services excluding benefits counseling services. The quasi-experimental evaluation employed matched comparison groups and measured impacts using a mixed-effects linear model. VWII was correlated with significant increases in mean earnings for the treatment group—averaging about $1,250 per year among participants with psychiatric disabilities and about $760 to $900 per year among all participants. These studies receive a low causal evidence rating because they did not adequately demonstrate baseline equivalence between the treatment and comparison groups or control in the analysis for key factors. A low causal evidence rating means that we are not confident that the estimated effects are attributable to the VWII and other factors likely played a role.","the Vermont Work Incentive Initiative","Disability insurance Supplemental security income (SSI) Vocational rehabilitation",Disability,,"United States",2006, "The labor market effects of sex and race discrimination laws.","Neumark, D., & Stock, W. (2006). The labor market effects of sex and race discrimination laws. Economic Inquiry, 44(3), 385-419.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Unfavorable impacts Employment","Summary: The study’s objective was to examine the effect of state-level sex and race discrimination laws passed before 1960 on employment and earnings outcomes for women and African Americans. The authors used a triple difference estimator including state, year, and subgroup variables. The primary data source was U.S. Census data from 1940 to 1960. The study found that sex-related equal pay laws had negative, statistically significant effects on women’s employment relative to men and a growing positive effect on women’s earnings relative to men over time. Racial discrimination laws had no significant immediate effects on employment or earnings for African American men compared with white men in the short term, but there were positive effects after the laws were in effect for a number of years. The quality of causal evidence presented in this report is low. This means we are not confident that the estimated effects were attributable to the state sex and race discrimination laws; other factors are likely to have contributed.","State Sex and Race Discrimination Laws","Affirmative action","Female, Male, Black or African American",,"United States",2006, "Paying for persistence: Early results of a Louisiana scholarship program for low-income parents attending community college","Brock, T., & Richburg-Hayes, L. (2006). Paying for persistence: Early results of a Louisiana scholarship program for low-income parents attending community college. New York: MDRC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of Louisiana Opening Doors, a scholarship program, on semester-to-semester retention and course completion at two community colleges in Louisiana. The study was a randomized controlled trial that compared the outcomes of treatment and control groups over three semesters. The primary data sources were students’ transcripts from the colleges and a baseline survey on students’ background characteristics. The study found that students who participated in the Opening Doors program attempted and passed a greater number of courses, registered for and earned more credits, and were enrolled for more semesters than students in the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Louisiana Opening Doors program, and not to other factors.","Opening Doors in Louisiana","Community college education and other classroom training Tuition assistance","Adult, Low income, Parent",,"United States",2006,http://www.mdrc.org/sites/default/files/full_472.pdf "The effect of court-ordered hiring quotas on the composition and quality of police","McCrary, J. (2006). The effect of court-ordered hiring quotas on the composition and quality of police. National Bureau of Economic Research working paper no. 12368. Cambridge, MA: NBER.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the effect of litigation for claims of hiring discrimination on the representation gap of African Americans in U.S. police and fire departments. The author examined Equal Employment Opportunity (EEO-4) State and Local Government Report data from 1973 to 1999 for 314 major U.S. cities. The author also examined additional data covering 1960 to 1973 for 120 cities, collected from a variety of historical sources.  The study found that the difference in the African American representation gap between litigated and unlitigated cities diminished and almost completely disappeared by 1999. The quality of causal evidence provided in this study is low because the author did not control for pre-existing differences between unlitigated and litigated cities. This means that we are not confident that the estimated effects are attributable to hiring discrimination litigation. Other factors are likely to have contributed.","litigation related to hiring discrimination","Civil Rights Act of 1964 Equal Employment Opportunity Act of 1972","Black or African American","Other services","United States",2006,http://www.nber.org/papers/w12368.pdf "Effects of housing vouchers on welfare families: Final report","Mills, G., Gubits, D., Orr, L., Long, D., Feins, J., Kaul, B., Wood, M., Jones, A., Cloudburst Consulting Associates, & the QED Group. (2006). Effects of housing vouchers on welfare families: Final report. Prepared for the U.S. Department of Housing and Urban Development, Office of Policy Development and Research. Cambridge, MA: Abt Associates Inc.",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Mod/high-No impacts Education and skills gains Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-Unfavorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of providing low-income families with private market housing vouchers on employment, earnings, receipt of public assistance, and receipt of education and training. It also examined impacts on several measures of housing security, which are not included in this review. The authors implemented a randomized controlled trial and estimated regression models to compare outcomes of treatment and comparison families. The study found that treatment group members received more Temporary Assistance for Needy Families (TANF) cash benefits and food stamps than control group members. There were no statistically significant effects of the program on employment, earnings, or receiving education or training. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the housing voucher, and not to other factors.","the Welfare-to-Work Voucher Program","Other wages and benefits","Low-skilled, Low income",,"United States",2006,http://www.huduser.gov/publications/pdf/hsgvouchers_1_2011.pdf "Measuring recidivism in a juvenile drug court: Systematic outcome study of a juvenile drug court using historical information","Pitts, W. (2006). Measuring recidivism in a juvenile drug court: Systematic outcome study of a juvenile drug court using historical information. The Southwest Journal of Criminal Justice, 3(1), 17-34.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: The study’s objective was to evaluate the effect of participating in a juvenile drug court in Farmington, New Mexico, on recidivism. The author used historical data from official court records to compare the recidivism outcomes of youth who participated in the drug court with a comparison group of drug court-eligible youth who did not become drug court clients. The study found that participation in the juvenile drug court program was associated with lower overall recidivism 16 months or later after completion of the program. The quality of causal evidence presented in this report is low because the analysis did not include controls for existing differences between the study groups. This means we are not confident that the estimated effects are attributable to the drug court; other factors likely contributed.","the Juvenile Drug Court Program","Substance abuse recovery Youth programs","Youth, Justice-involved",,"United States",2006, "Enforcement of civil rights law in private workplaces: The effects of compliance reviews and lawsuits over time","Kalev, A., & Dobbin, F. (2006). Enforcement of civil rights law in private workplaces: The effects of compliance reviews and lawsuits over time. Law & Social Equity, 31(4), 855-903.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the effectiveness of compliance reviews by the Office of Federal Contract Compliance Programs (OFCCP) and lawsuits initiated by individuals or the Equal Employment Opportunity Commission (EEOC) in reducing discrimination against women and African Americans in management positions. The authors applied a fixed-effects regression model to workforce data in the EEO-1 Employer Information Reports. These data were supplemented by a survey of compliance enforcement activities administered to a random sample of establishments drawn from the EEO-1 reports. The study found that compliance reviews begun in the 1970s increased an establishment’s share of women and African Americans employed as managers, not only in the 1970s but also through the 1980s and 1990s. The quality of causal evidence presented in this report is low because the study did not adequately control for existing differences between the study groups. This means we are not confident that the estimated effects are attributable to OFCCP compliance reviews or to lawsuits. Other factors are likely to have contributed.","the Civil Rights Act of 1964 and Affirmative Action Executive Orders","Civil Rights Act of 1964 Equal Employment Opportunity Act of 1972 Executive Order 11246 (E.O. 11246)","Female, Black or African American",,"United States",2006, "College as a job advancement strategy: Final report on the New Visions Self-Sufficiency and Lifelong Learning Project","Fein, D., & Beecroft, E. (2006). College as a job advancement strategy: Final report on the New Visions Self-Sufficiency and Lifelong Learning Project. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Riverside Community College’s New Visions Self-Sufficiency and Lifelong Learning Project on welfare recipients’ employment, earnings, welfare receipt, and educational achievement. The study was based on a randomized controlled trial and estimated the effect of offering welfare recipients the New Visions Project services compared with encouraging recipients to participate in other employment services. The authors used California public benefits and community college administrative data to compare average outcomes among those offered access to New Visions with the average outcomes of those excluded, after adjusting for differences in demographic and pre-intervention characteristics between the groups. The study found that participants in the New Visions program received $456 more in Temporary Assistance for Needy Families (TANF) payments than control group participants in the third year after random assignment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the New Visions Project, and not to other factors.","the New Visions Self-Sufficiency and Lifelong Learning Project","Community college education and other classroom training Other employment and reemployment","Low income, Parent",,"United States",2006,http://www.acf.hhs.gov/sites/default/files/opre/nv_final_pdf.pdf "The Employment Retention and Advancement project: Results from the Chicago ERA site","Bloom, D., Hendra, R., & Page, J. (2006). The Employment Retention and Advancement project: Results from the Chicago ERA site. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to determine the effectiveness of a Chicago program to increase the earnings of Temporary Assistance for Needy Families (TANF) recipients after two years. The Chicago site was one of 16 nationwide to participate in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,615 TANF recipients to either a treatment group, which received enhanced employment services, or a control group, which received benefits as usual. The authors collected employment and earnings data from Illinois Unemployment Insurance (UI) records and Food Stamps and TANF receipt data from Illinois administrative records. The study found that members of the ERA group were more likely to be employed (70 versus 66 percent) in the first year after random assignment and received significantly less in TANF benefits ($1,307, compared with $1,586 among control group members). Effects on employment and benefits receipt persisted into the second year after random assignment. The quality of causal evidence provided in this study is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated impacts are attributable to the Chicago ERA program, and not to other factors.","the Employment Retention and Advancement project, Chicago","Other employment and reemployment Unemployment Insurance","Low income",,"United States, Urban",2006,http://www.acf.hhs.gov/sites/default/files/opre/chicago_era.pdf "Recidivism findings for the Juvenile Rehabilitation Administration’s mentoring program: Final report","Drake, E. (2006). Recidivism findings for the Juvenile Rehabilitation Administration’s mentoring program: Final report. Olympia, WA: Washington State Institute for Public Policy.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence",,"Summary: The study’s objective was to examine the impact of the Washington State Juvenile Rehabilitation Administration’s mentoring program on recidivism. The author estimated the effect of the mentoring program using administrative data to compare outcomes among youth released from a juvenile rehabilitation facility who applied to participate in the program with the outcomes of similar youth who did not apply. The study did not find any statistically significant effects of the mentoring program on recidivism. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that any estimated effects would be attributable to the Washington State Juvenile Rehabilitation Administration’s mentoring program, but other factors might also have contributed. However, the study did not find statistically significant effects.","the Juvenile Rehabilitation Administration’s Mentoring Program","Mentoring Youth programs","Youth, Justice-involved, Disconnected youth",,"United States",2006,http://www.wsipp.wa.gov/ReportFile/947/Wsipp_Recidivism-Findings-for-the-Juveni… "The Employment Retention and Advancement project: Results from the Texas ERA site [Texas ERA—Corpus Christi]","Martinson, K., & Hendra, R. (2006). The Employment Retention and Advancement project: Results from the Texas ERA site. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. [Texas ERA—Corpus Christi]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on welfare recipients’ employment and benefits receipt outcomes after 18 to 24 months. The Corpus Christi site was one of three in Texas that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned about 1,300 single-parent participants in Corpus Christi’s Temporary Assistance for Needy Families (TANF) program to either a treatment group, which received ERA services, or a control group, which received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Supplemental Nutrition Assistance Program (SNAP) administrative records. The study did not find statistically significant effects 18 to 24 months after random assignment on employment, earnings, and public benefit receipt. The quality of causal evidence provided in this study is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects would be attributable to the ERA program and not to other factors. However, the study found no statistically significant impacts.","the Employment Retention and Advancement project, Corpus Christi","Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States",2006,http://www.acf.hhs.gov/sites/default/files/opre/results_texas.pdf "The Employment Retention and Advancement project: Results from the Texas ERA site [Texas ERA—Forth Worth]","Martinson, K., & Hendra, R. (2006). The Employment Retention and Advancement project: Results from the Texas ERA site. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. [Texas ERA—Forth Worth]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on welfare recipients’ employment and benefits receipt outcomes after 18 to 24 months. The Fort Worth site was one of three in Texas that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned about 1,200 single-parent participants in Fort Worth’s Temporary Assistance for Needy Families (TANF) program to either a treatment group, which received ERA services, or a control group, which received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Supplemental Nutrition Assistance Program (SNAP) administrative records. The study found that treatment group members were 6.1 percentage points more likely to have been employed at any time in the second year after random assignment than those in the control group. Treatment group members were also 4.2 percentage points more likely to be employed during the last quarter of that second year. The quality of causal evidence provided in this study is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the ERA program, and not to other factors.","the Employment Retention and Advancement project, Fort Worth","Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States, Urban",2006,http://www.acf.hhs.gov/sites/default/files/opre/results_texas.pdf "The Employment Retention and Advancement project: Results from the Texas ERA site [Texas ERA—Houston]","Martinson, K., & Hendra, R. (2006). The Employment Retention and Advancement project: Results from the Texas ERA site. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. [Texas ERA—Houston]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on welfare recipients’ employment and benefits receipt outcomes after 18 to 24 months. The Houston site was one of three in Texas that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned about 1,800 single-parent participants in Houston’s Temporary Assistance for Needy Families (TANF) program to either a treatment group, which received ERA services, or a control group, which received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Supplemental Nutrition Assistance Program (SNAP) administrative records. The study did not find any statistically significant effects on employment or earnings. However, the study found that treatment group members received, on average, $33 more in TANF benefits in the ninth quarter after random assignment than those in the control group. The quality of causal evidence provided in this study is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the ERA program, and not to other factors.","the Employment Retention and Advancement project, Houston","Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States, Urban",2006,http://www.acf.hhs.gov/sites/default/files/opre/results_texas.pdf "National Job Corps study and longer-term follow-up study: Impact and benefit-cost findings using survey and summary earnings records data","Schochet, P., Burghardt, J., & McConnell, S. (2006). National Job Corps study and longer-term follow-up study: Impact and benefit-cost findings using survey and summary earnings records data. Washington, DC: Employment and Training Administration, U.S. Department of Labor.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-No impacts Education and skills gains","Summary: The National Job Corps Study included several reports, including this longer-term impact report. The report’s objective was to examine the impact of the Job Corps program on participants’ long-term earnings, employment, and other outcomes. Job Corps offered intensive academic classroom instruction and vocational skills training to economically disadvantaged youth. Its effectiveness was evaluated using a randomized controlled trial conducted in 48 states and the District of Columbia. The study found a number of statistically significant, positive impacts of Job Corps on earnings and employment in the first four follow-up years. However, there were no significant differences between the youth who were offered Job Corps and the control group on employment rate or earnings in the fifth through ninth follow-up years, as measured by administrative data. The quality of causal evidence presented in this report is high because it was based on a well-conducted randomized controlled trial. This means we are confident that the effects estimated in the study are solely attributable to Job Corps, and not to other factors.","Job Corps","Job search assistance and supportive services Work based and other occupational training","Youth, Low-skilled, Low income",,"United States",2006,https://www.mathematica-mpr.com/-/media/publications/pdfs/jobcorpimpactbenefit… "Assessing the impact of small business training on nascent entrepreneurs in Illinois","Harfst, K. (2006). Assessing the impact of small business training on nascent entrepreneurs in Illinois (Doctoral dissertation). Retrieved from ProQuest Dissertation and These database (UMI No. 3229827).","Entrepreneurship and Self-Employment","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Attitudes-Low-No impacts Attitudes","Summary: The study’s objective was to examine the impact of participation in a Small Business Development Center (SBDC) seminar on intentions to start a business. The author administered a survey of his own design before and after respondents participated in an SBDC seminar and compared the respondents’ pre- and post-seminar responses on a series of items measuring intentions to start a business. The study found no statistically significant relationships between participation in the SBDC seminar and intentions to start a business. The quality of causal evidence presented in this report is low because the author did not account for pre-intervention trends in participants’ entrepreneurial intentions. This means that we would not be confident that any estimated effects would be attributable to the SBDC seminar; however, the study found no effects.",,"Other training and education",Adult,"Small business","United States",2006,http://www.illinois.gov/dceo/SmallBizAssistance/CenterConnect/Strategic%20Plan/… "Entrepreneurial discovery by the working poor","Fiet, J., Nixon, R., Gupta, M., & Patel, P. (2006). Entrepreneurial discovery by the working poor. Journal of Developmental Entrepreneurship, 11(3), 255-273.","Entrepreneurship and Self-Employment","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: The study’s objective was to examine the impact of systematic search training on the number of business ideas participants generated, particularly business ideas inspired by occupational experience and ideas likely to create wealth. The authors randomly assigned sample members into a treatment group, which could participate in a series of training sessions on systematic search, and a control group, which could not participate in that training. They then compared the number of ideas each group produced, overall and in categories defined by type of idea. The study found that members of the treatment group produced significantly more wealth-creating ideas and developed more ideas based on occupational experience than members of the control group. The quality of causal evidence presented in this report is low because it was based on a randomized controlled trial with high attrition and the authors did not adequately control for differences in background characteristics between the groups. This means we are not confident that the estimated effects are attributable to systematic search training; other factors are likely to have contributed.",,"Other training and education","Low income",,"United States",2006, "Harford County juvenile drug court performance evaluation: Final report","Crumpton, D., Carey, S., Mackin, J., Finigan, M., Pukstas, K., Weller, J., and Brekhus, J. (2006). Harford County juvenile drug court performance evaluation: Final report. Portland, Oregon. NPC Research, 1-104.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence",,"Summary: The study’s objective was to examine the impact of the Harford County (Maryland) Juvenile Drug Court on recidivism. The authors used administrative records to estimate the impact of the drug court by comparing the outcomes of youth who participated in the drug court with those of similar youth who did not. The study found that drug court participants had significantly fewer rearrests (36 percent fewer) and fewer days (59 percent fewer) on probation than youth who were eligible for the program but did not participate. Participants spent fewer days in secure and community detention in the first year after program entry than youth in the comparison group. However, the study found no significant effects on the number of adjudication hearings, days in residential treatment, or days in a group home. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the Harford County Juvenile Drug Court, but other factors might also have contributed.","Harford County Juvenile Drug Court","Substance abuse recovery Youth programs Behavioral Interventions","Youth, Justice-involved, Disconnected youth",,"United States",2006,http://npcresearch.com/wp-content/uploads/HCJDC_Process_Outcome-Cost-FINAL-repo… "Juvenile drug court: Enhancing outcomes by integrating evidence-based treatments.","Henggeler, S., Halliday-Boykins, C., Cunningham, P., Randall, J., Shapiro, S., & Chapman, J. (2006). Juvenile drug court: Enhancing outcomes by integrating evidence-based treatments. Journal of Consulting and Clinical Psychology, 74(1), 42-54.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Health and safety-Mod/high-Favorable impacts Health and safety","Summary: The study’s objective was to examine the marginal impacts of three layered treatments—drug court hearings, substance abuse therapy, and contingency management counseling—on criminal justice outcomes and positive drug screens among youth in Charleston, South Carolina, diagnosed with substance abuse or dependence. The authors randomly assigned eligible youth to one of three treatment groups—drug court, drug court with multisystemic therapy, or drug court with multisystemic therapy enhanced by contingency management—or to a control group that received typical family court services. The study found no statistically significant differences between the groups on measures of recidivism after one year. However, the study found that participants in the treatment groups reported committing fewer delinquent acts than those in the control groups. Effects on drug screens were mixed. The quality of causal evidence presented in this report is high for recidivism outcomes because they are based on a well-implemented randomized controlled trial but moderate for self-reported delinquency and drug screen outcomes because they had high attrition and the authors demonstrated that the groups being compared had similar baseline characteristics.","the Treatments","Substance abuse recovery Youth programs Behavioral Interventions","Youth, Justice-involved, Disconnected youth",,"United States",2006, "Managing customers’ training choices: Findings from the Individual Training Account experiment","McConnell, S., Stuart, E., Fortson, K., Decker, P., Perez-Johnson, I., Harris, B., & Salzman, J. (2006). Managing customers’ training choices: Findings from the Individual Training Account experiment. Final report, Series: ETAOP 2007-01. Washington, DC: Employment and Training Administration, U.S. Department of Labor.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt Training-Mod/high-Favorable impacts Training","Summary: The study’s objective was to compare the impacts of individual training account (ITA) approaches on customers’ training completion, employment, earnings, and benefits receipt outcomes after 15 months. The authors randomly assigned about 8,000 adults and dislocated workers from eight workforce investment agencies across the United States to three ITA approaches: structured customer choice, maximum customer choice, or guided customer choice. The authors analyzed data from Unemployment Insurance (UI) records and from a survey conducted on a random subsample of study participants. The study found the customers in the structured customer choice approach received significantly higher amounts of public assistance benefits than did customers in the guided customer choice group. The study also found that the structured customer choice group had higher earnings and lower education and training compared with the maximum customer choice group, whereas the maximum customer choice group had lower earnings and higher public assistance benefits compared with the guided customer choice group. The quality of causal evidence provided in this study is high because it is based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to differences in the ITA approaches, and not to other factors.","the Individual Training Accounts (ITA) Approaches","Other employment and reemployment Other training and education","Dislocated or displaced worker, Low income",,"United States",2006,http://scholar.google.com/scholar_url?url=http%3A//cire.mathematica-mpr.com/~/m… "Paths to work in rural places: Key findings and lessons from the impact evaluation of the Future Steps rural welfare-to-work program.","Meckstroth, A., Burwick, A., Ponza, M., Marsh, S., Novak, T., Phillips, S., Diaz-Tena, N., & Ng, J. (2006). Paths to work in rural places: Key findings and lessons from the impact evaluation of the Future Steps rural welfare-to-work program. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Future Steps rural welfare-to-work program on earnings and public benefit receipt. The authors randomly assigned Temporary Assistance for Needy Families (TANF) and Food Stamps recipients required to work to either a treatment group, which received earnings-focused case management, job search, and other services, or to a control group, which did not receive services. The authors evaluated the treatment’s impact using Illinois administrative data and follow-up surveys. The study did not find any statistically significant effects on earnings or public benefit receipt in the first 18 months after participants were offered access to the program. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects would be attributable to the Future Steps rural welfare-to-work program and not to other factors. However, the study did not find statistically significant effects.","the Future Steps Rural Welfare-to-Work Program","Job search assistance and supportive services Other employment and reemployment","Low income",,"United States",2006,http://www.acf.hhs.gov/sites/default/files/opre/paths_to_work.pdf "Evaluating the effectiveness of the Massachusetts workforce development system using no-shows as a nonexperimental comparison group.","Raphael, S., & Stoll, M. A. (2006). Evaluating the effectiveness of the Massachusetts workforce development system using no-shows as a nonexperimental comparison group. Evaluation Review, 30(4), 379-429.",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Unfavorable impacts Earnings and wages","Summary: The study’s objective was to examine the impact of the Job Training Partnership Act (JTPA) workforce development program in Massachusetts on the earnings of disadvantaged adults. The study used a nonexperimental design to compare the earnings of program participants before and after the intervention, relative to the earnings of nonparticipants who were eligible and offered services but chose not to participate in a training program. The authors used administrative records from the Commonwealth Corporation of Massachusetts for their analysis. The study found that, although the participants in the Massachusetts JTPA program earned significantly less than nonparticipants during the year of the program, participants earned significantly more one year ($1,876) and two years ($2,285) after the program, compared with nonparticipants. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to JTPA, but other factors might also have contributed.","the Massachusetts JTPA Workforce Development Program","Job search assistance and supportive services Other training and education","Low-skilled, Low income",,"United States",2006, "Effects of housing vouchers on welfare families: Final report","Mills, G., Gubits, D., Orr, L., Long, D., Feins, J., Kaul, B., & Wood, M. (2006). Effects of housing vouchers on welfare families: Final report. Washington, DC: U.S. Department of Housing and Urban Development.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Welfare-to-Work housing voucher on employment, earnings, and public benefit receipt. The authors allocated the available vouchers by lottery to eligible families who were willing to participate in the study. Using Unemployment Insurance (UI), Temporary Assistance for Needy Families (TANF), housing assistance administrative data, and baseline and follow-up surveys, the authors compared the outcomes of those randomly assigned to receive a voucher with outcomes of those who were not, adjusting for chance preintervention differences between the groups. The study found that the Welfare-to-Work vouchers increased the likelihood of receiving TANF benefits in the third half-year (months 12–18) after random assignment by 2.1 percentage points and the likelihood of receiving Food Stamps in the same period by 2.5 percentage points. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Welfare-to-Work voucher and not to other factors.","the Welfare-to-Work Voucher Program","Other employment and reemployment","Low income",,"Urban, United States",2006,https://www.huduser.gov/publications/pdf/hsgvouchers_1_2011.pdf "A comparison of two Welfare-to-Work strategies among African American women in Atlanta, Georgia. (Unpublished doctoral dissertation).","Wilson-Brewster, V.L. (2006). A comparison of two Welfare-to-Work strategies among African American women in Atlanta, Georgia. (Unpublished doctoral dissertation). Capella University, Minneapolis, Minnesota.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the effectiveness of two welfare-to-work programs—the Labor Force Attachment (LFA) program and the Human Capital Development (HCD) program—on the employment and earnings of African American women 25, 35, and 45 years old in Atlanta. The author analyzed a subsample of participants in the National Evaluation of Welfare-to-Work Strategies (NEWWS) study. The study was a randomized controlled trial that assigned individuals within a geographic location to one of three groups: LFA, HCD, or a control group. The study found that women in the 35-year-old group who participated in LFA or HCD had higher earnings and needed less time to find a job than those in the other age cohorts. The quality of causal evidence presented in this report is low because the study was a randomized controlled trial with unknown attrition and the authors did not account for preexisting differences between the groups being compared in their analysis. This means we are not confident that the estimated effects are attributable to LFA or HCD programs; other factors are likely to have contributed.","Labor Force Attachment (LFA) and Human Capital Development (HCD)","Other employment and reemployment Other training and education","Female, Black or African American, Low income, Parent",,"United States, Urban",2006, "Net impact and benefit-cost estimates of the workforce development system in Washington State. (Upjohn Institute technical report no. TR06-020). [Apprenticeships]","Hollenbeck, K., & Huang, W-J. (2006). Net impact and benefit-cost estimates of the workforce development system in Washington State. (Upjohn Institute technical report no. TR06-020). Kalamazoo, MI: W. E. Upjohn Institute for Employment Research. [Apprenticeships]",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment Public benefits receipt-Low-Unfavorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Workforce Investment Act apprenticeship programs in Washington State on participants’ employment rates, earnings, and public benefit receipt. The authors used a nonexperimental design to compare the short-term (3 quarters after program exit) and long-term (9 to 12 quarters after program exit) employment, earnings, and public benefit receipt between those who took part in the apprenticeship programs and those who registered for employment services at the state Labor Exchange. The study found that, compared with those who registered for services at the Labor Exchange, participants in the apprentice programs had higher employment rates, more hours worked and greater quarterly earnings. Receipt of Unemployment Insurance benefits was higher for those in the apprenticeship group, and receipt of other public assistance was lower. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups compared were similar before program participation. This means we are not confident that the estimated effects are attributable to the apprenticeship programs; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","Workforce Investment Act (WIA) Apprenticeship Programs","Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) training programs",Adult,,"United States",2006,http://research.upjohn.org/cgi/viewcontent.cgi?article=1023&context=up_technica… "Evaluation of the strengthening the connections between unemployment insurance and the One-Stop Delivery Systems Demonstration Project in Wisconsin","Almandsmith, S., Ortiz Adams, L., & Bos, H. (2006). Evaluation of the strengthening the connections between unemployment insurance and the One-Stop Delivery Systems Demonstration Project in Wisconsin. Oakland, CA: Berkeley Policy Associates.",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-No impacts Employment Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study examined the impact of the Worker Profiling Reemployment Services program for Unemployment Insurance (UI) claimants in Wisconsin on several outcomes: the rate at which the UI claimants went back to work, average earnings, and UI benefit receipt.  The authors used a matching procedure and several statistical models to compare the outcomes of demonstration and comparison group members, using administrative data.  The study found that demonstration participants had higher average quarterly earnings, shorter durations of UI benefits, smaller proportions of maximum UI benefits paid, and a lower average total payout of UI benefits. The study found no statistically significant relationship between demonstration participation and employment outcomes.  The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Worker Profiling Reemployment Services program; other factors are likely to have contributed.","JSA services","RESEA Job search assistance and supportive services Unemployment Insurance","Dislocated or displaced worker, Unemployed",,"United States",2006,https://wdr.doleta.gov/research/FullText_Documents/Evaluation%20of%20the%20Stre… "Cash transfers, conditions, school enrollment, and child work: Evidence from a randomized experiment in Ecuador","Schady, N. & Araujo, M. C. (2006). Cash transfers, conditions, school enrollment, and child work: Evidence from a randomized experiment in Ecuador. Policy Research Working Paper No. 3930. Washington, DC: The World Bank. Retrieved from https://openknowledge.worldbank.org/handle/10986/8452  ","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The purpose of the study was to assess the impact of the Bono de Desarrollo Humano (BDH) program on child labor and school enrollment for children 6-17 years old. The study used a randomized controlled trial to compare the outcomes of children in households assigned to participate in the program to outcomes of those who did not participate. The study found a significant relationship between being selected for the BDH program and whether children worked and hours per week children worked; both were significantly lower for those in the treatment group than those in the control group. The study also found that children selected into the BDH program had significantly higher rates of school enrollment and significantly lower rates of having dropped out since the program began. The quality of causal evidence presented in this report is low because it is a randomized controlled trial with unknown attrition and the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Bono de Desarrollo Humano program; other factors are likely to have contributed.","Bono de Desarrollo Humano (BDH) program","Child labor","Other, Low income",,International,2006,https://openknowledge.worldbank.org/handle/10986/8452 "New evidence on earnings and benefit claims following the changes in the retirement earnings test in 2000.","Song, J. G., & Manchester, J. (2006). New evidence on earnings and benefit claims following the changes in the retirement earnings test in 2000. (ORES Working Paper 107). Washington, DC: Social Security Administration, Office of Policy, Office of Research, Evaluation, and Statistics. Also available in Journal of Public Economics, 91(3–4), 669–700 (2007).","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Low-No impacts Employment Public benefits receipt-Mod/high-Unfavorable impacts Public benefit receipt","Summary: The study examined the impact of the Senior Citizens Freedom to Work Act of 2000 on employment, earnings, and public benefit receipt outcomes of workers ages 65 to 69. The study was a nonexperimental analysis and used Social Security Administrative data to estimate the impacts. The study found that the Senior Citizens Freedom to Work Act of 2000 was associated with significant increases in the rate of Social Security claims for both sets of individuals affected by the law. The study found no statistically significant relationship between the Senior Citizens Freedom to Work Act of 2000 and earnings. The quality of casual evidence presented in this report for Social Security claims and earnings outcomes is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the Senior Citizens Freedom to Work Act of 2000, but other factors might also have contributed. The quality of causal evidence presented in this report on employment is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Senior Citizens Freedom to Work Act of 2000; other factors are likely to have contributed.","Senior Citizens Freedom to Work Act of 2000","Older workers' programs Other disparities or discrimination in employment and earnings","Adult, Older worker",,"United States",2006, "Employee development, commitment, and intention to turnover: A test of “employability” policies in action","Benson, G.S. (2006). Employee development, commitment, and intention to turnover: A test of “employability” policies in action. Human Resource Management Journal, 16(2), 173–192.","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the relationship between employees’ intent to leave (that is, employees’ stated intentions to leave the firm in the next year) and their participation in on-the-job training and company-sponsored training classes. The author used a statistical model to examine the association between employees’ participation in on-the-job and company-sponsored training classes and their intention to leave the firm in the next year, using data from an employee survey. The study found that participation in on-the-job training was associated with a reduction in employees’ intent to leave, but there was no significant relationship between participation in company sponsored training and intent to turnover. The quality of causal evidence presented in this report is low because the author did not ensure that groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the work-based training; other factors are likely to have contributed.","the on-the-job training","Work based and other occupational training","Employed, STEM professional","Professional, scientific, and technical services","United States",2006,https://doi.org/10.1111/j.1748-8583.2006.00011.x "The declining effects of OSHA inspections on manufacturing injuries, 1979-1998","Gray, W., & Mendeloff, J. (2005). The declining effects of OSHA inspections on manufacturing injuries, 1979-1998. Industrial and Labor Relations Review, 58(4), 571-587.","OSHA Enforcement","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Health and safety-Low-Favorable impacts Health and safety","Summary: The study’s objective was to examine the effect of federal OSHA inspections in manufacturing establishments on workplace injuries during three separate time periods: 1979–1985, 1987–1991, and 1992–1998. The study used a regression model to compare the changes in workplace injuries in manufacturing establishments that had received an inspection within the past four years to those in establishments that had not received inspections. The study found that OSHA inspections were associated with statistically significant reductions in lost-workday injuries of 10 percent in 1979–1985 and 4 percent in 1987–1991, but had no statistically significant effect on these injuries in 1992–1998. The quality of causal evidence presented in this study is low. This means we are not confident that the differences in workplace injuries between firms that did and did not receive OSHA inspections are attributable to the inspections.","OSHA Enforcement Activities","Inspections Other health and safety Workplace injury",Employed,Manufacturing,"United States",2005,http://digitalcommons.ilr.cornell.edu/cgi/viewcontent.cgi?article=1140&context=… "Barriers to employment for out-of-school youth: Evidence from a sample of recent CET applicants.","Miller, C., & Porter, K. (2005). Barriers to employment for out-of-school youth: Evidence from a sample of recent CET applicants. MDRC working paper. New York: MDRC.","Opportunities for Youth","Study Type: Descriptive Analysis",,,"Summary: This report describes the associations between barriers to employment and employment outcomes of a sample of applicants in the Center for Employment Training (CET) replication sites. The CET program provided an intensive, short-term job training program for economically disadvantaged out-of-school youth that was designed to mirror the workplace. The overall impact of CET on youths’ employment outcomes is described in a different report (see CLEAR profile of Miller et al. 2005). This report described whether three barriers to employment—(1) lack of a high school diploma or general education development (GED) certificate, (2) childbearing, and (3) arrests—were associated with lower employment rates, and whether lower employment rates stemmed from employment instability or a longer length of time needed to find a job. The authors used data from the 54-month survey of CET applicants from the impact evaluation. For that evaluation, eligible youth were randomly assigned to receive CET services or to the control group, which was ineligible for CET services. The authors found that youth who did not finish high school or obtain a GED were less successful in the labor market than those who received a high school credential. Wages for dropouts were lower on average and dropouts worked less than high school graduates and GED recipients. Among male dropouts, job instability contributed to low average employment rates; for female dropouts, both job instability and longer spells of unemployment contributed to low employment rates. Having children at study entry was not associated with poorer employment outcomes for males or females. However, young men who had arrest records faced substantial challenges in finding jobs and were more likely to work in lower quality jobs in the retail or service industries than those without arrest records.","the Center for Employment Training (CET) Replication","Basic skills Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",2005,http://www.mdrc.org/sites/default/files/full_24.pdf "Study of Hispanics in Job Corps: 2004-2005","Garcia, Y. Study of Hispanics in Job Corps: 2004–2005. Washington, DC: HMA Associates, 2007.","Opportunities for Youth","Study Type: Descriptive Analysis",,,"Summary: This report aimed to explore in greater detail the findings of the National Job Corps Study, an impact study whose final report was published in 2001. Specifically, the authors sought to understand why Hispanic youth did not experience positive impacts on employment outcomes similar to the rest of the study population. Job Corps offers intensive academic classroom instruction and vocational skills training, along with support services, to economically disadvantaged youth. The authors reviewed data on Hispanic youth from the National Job Corps Study, program data, and data from a survey administered in 2004 to Hispanic youth in Job Corps centers. They also conducted site visits to four Job Corps centers, where they interviewed program staff and current and former participants. The study found that Hispanic youth performed well in the Job Corps program, but did not fully leverage the training they received. Many took the first job they were offered in order to start supporting their family immediately instead of expanding their employment search to include more lucrative long-term options. They also limited their search to places of employment where they felt poor English language skills would not constrain them.","Job Corps","Job search assistance and supportive services Youth programs Other training and education Work based and other occupational training","Youth, Hispanic of any race, Low-skilled, Low income",,"United States",2005,http://wdr.doleta.gov/research/FullText_Documents/Hispanic%20Job%20Corps%202004… "Registered apprenticeship training in the U.S. construction industry","Glover, R. W., & Bilginsoy, C. (2005). Registered apprenticeship training in the U.S. construction industry. Education + Training, 47(4-5), 337-349.","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Training-Low-No impacts Training","Summary: The study’s objective was to examine the impact of participation in building trades apprenticeship programs sponsored jointly by employers and unions on apprentices’ program completion rates. The authors compared the program completion rates of apprentices who participated in registered apprenticeship programs sponsored jointly by employers and labor unions with those who participated in programs sponsored unilaterally by employers. Data on apprentices’ characteristics, program participation, and completion came from the U.S. Department of Labor’s Registered Apprentices Information System and California State Apprenticeship Council databases. The authors’ analysis included apprentices in 31 states from 1996 to 2003. The study found that the completion rate for joint apprenticeships was higher than for nonjoint apprenticeships, but did not conduct any statistical tests of differences in completion rates. The quality of causal evidence presented in this report is low because the authors did not account for relevant pre-intervention characteristics in their analysis. This means we are not confident that the estimated effects are attributable to joint apprenticeship programs; other factors are likely to have contributed.",,"Registered apprenticeship Work based and other occupational training",Adult,Construction,"United States",2005, "Net impact estimates for services provided through the Workforce Investment Act. ETA Occasional Paper 2005-06. [WIA Dislocated Worker]","Hollenbeck, K., Schroeder, D., King, C., & Huang, W. (2005). Net impact estimates for services provided through the Workforce Investment Act. ETA Occasional Paper 2005-06. Washington, DC: U.S. Department of Labor, Employment and Training Administration. [WIA Dislocated Worker]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Workforce Investment Act (WIA) Dislocated Worker Program’s core, intensive, and training services on the employment rate, earnings, and benefits receipt of low-income dislocated workers ages 22 to 64. The authors established three treatment groups based on the level of WIA services used and matched them to three comparison groups that participated in Employment Services (ES) and/or the core WIA services. The study found that the employment rate and average quarterly earnings were significantly higher for those in each of the treatment groups compared with their matched comparison groups. Benefit receipt was also significantly lower for those in the treatment groups than in their comparison groups. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before program participation. This means we are not confident that the estimated effects are attributable to the WIA Dislocated Worker Program; other factors are likely to have contributed.","the Workforce Investment Act (WIA) Dislocated Worker Program","Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) training programs","Dislocated or displaced worker",,"United States",2005,https://wdr.doleta.gov/research/FullText_Documents/Net%20Impact%20Estimates%20f… "Net impact estimates for services provided through the Workforce Investment Act. ETA Occasional Paper 2005-06. [WIA Adult]","Hollenbeck, K., Schroeder, D., King, C., & Huang, W. (2005). Net impact estimates for services provided through the Workforce Investment Act. ETA Occasional Paper 2005-06. Washington, DC: U.S. Department of Labor, Employment and Training Administration. [WIA Adult]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Workforce Investment Act (WIA) Adult Program’s core, intensive, and training services on the employment rate, earnings, and benefits receipt of low-income adults ages 22 to 64. The authors established three treatment groups based on the level of WIA services used and matched them to three comparison groups that participated in Employment Services (ES) and/or the core WIA services. The study found that the employment rate and average quarterly earnings were significantly higher for those in each of the treatment groups compared with their matched comparison groups. Benefits receipt was also significantly lower for those in the treatment groups than in their comparison groups. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before program participation. This means we are not confident that the estimated effects are attributable to the WIA Adult Program; other factors are likely to have contributed.","the Workforce Investment Act (WIA) Adult Program","Job search assistance and supportive services Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) training programs","Low-skilled, Low income",,"United States",2005,https://wdr.doleta.gov/research/FullText_Documents/Net%20Impact%20Estimates%20f… "Cost-effectiveness of targeted reemployment bonuses","O’Leary, C.J., Decker, P.T., Wandner, S.A. (2005). Cost-effectiveness of targeted reemployment bonuses. Journal of Human Resources, 40, 270-279.",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study examined the impact of the Pennsylvania Reemployment Bonus Demonstration on the amount of Unemployment Insurance (UI) receipt and on earnings of UI claimants approximately one year after program enrollment, both overall and for subgroups of claimants defined by their likelihood of exhausting UI benefits. The authors also examined the impact of the Washington Reemployment Bonus Demonstration; this study is an additional source to the main source examining that intervention, profiled here. About 15,000 eligible claimants were randomly assigned to one of six treatment groups or a control group. The six treatment groups were offered different combinations of reemployment bonus amounts and periods within which they were required to find a job in order to claim the bonus. The authors analyzed state administrative data and survey data of a subsample of approximately 5,000 participants from the original demonstration. The study found that the pooled bonus treatments in Pennsylvania reduced the total UI benefit amount received, but did not have a significant impact on earnings. Pooling across all bonus treatments, Pennsylvania treatment group members received $113 less in UI benefits, on average, than their control group counterparts. The quality of causal evidence for the Pennsylvania demonstration is low because the authors did not demonstrate that they adjusted for changes in rates of assignment to treatment and control conditions and did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Pennsylvania Reemployment Bonus Demonstration; other factors are likely to have contributed. See more CLEAR profiles related to The Reemployment Bonus Experiments.","Pennsylvania Reemployment Bonus Demonstration","Unemployment Insurance","Dislocated or displaced worker, Unemployed",,"United States",2005, "Youth Opportunity grants: Lessons can be learned from program, but Labor needs to make data available.","Bellis, D. D., & General, A. O. (2005). Youth Opportunity grants: Lessons can be learned from program, but Labor needs to make data available. Washington, DC: Government Accountability Office.","Opportunities for Youth","Study Type: Descriptive Analysis",,,"Summary: This report from the Government Accountability Office (GAO) summarizes the findings of a descriptive study of Youth Opportunity Grants. The 36 grants issued under this program, which began in 2000 and continued for five years, aimed to expand opportunities for at-risk youth in low-income areas by providing a variety of support services. The study explored how the grants were implemented, key barriers faced during implementation, and perceptions of the outcomes of the program and its impact on participating youth and their communities. To answer its research questions, the GAO conducted a survey with 36 Youth Opportunity Grant program directors and seven site visits. The site visits included interviews with program managers and staff, youth participants, and community members; facilities tours; observations of program activities; and collection of management information systems data. The study found that grantees adopted a variety of approaches to recruiting and serving at-risk youth, often responding to conditions in their local labor markets. However, many faced challenges in rolling out the program within the set time frames; addressing drug use, violence and unemployment in their communities; and adapting their services for youth struggling at school or with problems at home. Many program participants graduated from high school, enrolled in college, or joined the workforce after receiving Youth Opportunity Grant services. The GAO recommended that the Department of Labor complete the impact analysis of the Youth Opportunity Grant program and release all related reports and data.","Youth Opportunity Grant Initiative","Youth programs Other training and education Work based and other occupational training","Youth, Low-skilled, Low income",,"United States",2005, "Improving success in a veterans homeless domiciliary vocational program: Model development and evaluation","LePage, J. P., Bluitt, M., House-Hatfield, T., McAdams, H., Burdick, M., Dudley, D., …& Gaston, C. (2005). Improving success in a veterans homeless domiciliary vocational program: Model development and evaluation. Rehabilitation Psychology, 50(3), 297-304. doi: 10.1037/0090-5550.50.3.297",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the relationship between the risk factor-based decision making (RFBDM) program and employment attainment. The study used a non-experimental comparison-group analysis. The study’s relied on data collected from the Risk Factor Scale and through data from the Veterans Affairs (VA) North Texas Health Care System. The authors used Pearson’s chi-squared test, a statistical model, to examine the relationship between the RFBDM program and employment. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the RFBDM program; other factors are likely to have contributed to the study findings.","Risk factor-based decision making intervention.","Veterans' reemployment","Veteran or military",,"United States",2005,https://utsouthwestern.pure.elsevier.com/en/publications/improving-success-in-a… "Inside the black box: How do OSHA inspections lead to reductions in workplace injuries?","Mendeloff, J., & Gray, W. (2005). Inside the black box: How do OSHA inspections lead to reductions in workplace injuries? Law and Policy, 27(2), 219-237.","OSHA Enforcement","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Health and safety-Low-Favorable impacts Health and safety","Summary: The study’s objective was to examine the effects of OSHA inspections that resulted in penalties or citations on the types of injuries workers suffered. The study used a regression model to compare the changes in workplace injuries of manufacturing firms that had received an inspection that resulted in a penalty or citation to those that had not received a penalty or citation. The group of firms that had not received a penalty or citation combined two types of firms: firms that had not been inspected and firms that received inspections that did not result in a penalty or citation. The study found that OSHA inspections that resulted in a penalty were associated with statistically significant decreases in lost-workday injuries. Among the specific citations studied, citations for the standards for general requirements for personal protective equipment and general machine guarding were associated with statistically significant reductions in some types of lost-workday injuries. The quality of the causal evidence presented in this study is low. This means we are not confident that OSHA inspections that resulted in penalties or citations caused the reductions in workplace injuries.","OSHA Enforcement Activities","Inspections Other health and safety Workplace injury",Employed,Manufacturing,"United States",2005, "The challenge of repeating success in a changing world: Final report on the Center for Employment Training replication sites","Miller, C., Bos, J., Porter, K., Tseng, F., & Abe, Y. (2005). The challenge of repeating success in a changing world: Final report on the Center for Employment Training replication sites. New York: MDRC.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Mod/high-Mixed impacts Education and skills gains Employment-Mod/high-Mixed impacts Employment Training-Mod/high-Favorable impacts Training","Summary: This report’s objective was to examine the effectiveness of the Center for Employment Training (CET) model. Under this model, local employers help design training programs and provide them in a work-like environment to economically disadvantaged youth who are not in school or employed. A separate report examined CET implementation. The effectiveness of the CET model in improving employment, earnings, and participation in education and training programs was evaluated using a randomized controlled trial (RCT) conducted in 12 sites in seven states. The study found few statistically significant impacts on outcomes measured over a 54-month follow-up period. The quality of the causal evidence presented in this study is moderate. This means we have confidence that the effects estimated in this study are attributable at least in part to the CET program. However, other factors not accounted for in the study might also have contributed to the estimated effect.","the Center for Employment Training (CET) Replication","Basic skills Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",2005,http://www.mdrc.org/sites/default/files/full_530.pdf "Youth Opportunity Grant Initiative: Ethnographic evaluation final report.","Lewis-Charp, H., Soukamneuth, S. & Goger, A.(2005). Youth Opportunity Grant Initiative: Ethnographic evaluation final report. Houston, TX: Decision Information Resources, Inc.","Opportunities for Youth","Study Type: Descriptive Analysis",,,"Summary: The study aimed to understand the characteristics of communities participating in the Youth Opportunity (YO) grant initiative. It also sought to examine perceptions of whether the YO program had been implemented well and had enhanced the communities. Funded by the U.S. Department of Labor in 2000, the YO initiative looked to transform distressed neighborhoods by engaging youth in positive and productive activities and relationships. Programs were to provide education, employment, support, and leadership development services to youth ages 14 to 21 in high-poverty urban, rural, and Native American communities. The authors performed an ethnographic analysis based on site profiles for 35 YO communites. They also used U.S. Census data to further understand the characteristics of the communities. The authors described the social and economic trends of the 35 sites at length, focusing on the persistent and systemic obstacles facing the communities, including population decline, housing stress, and high rates of teen pregnancy. Participating communities had high rates of poverty and few quality jobs available.  The authors did not find a consensus about how well the YO initiative had been implemented in the communities. However, most community members, including participating youth, did strongly agree that YO programming benefited youth.","Youth Opportunity Grant Initiative","Basic skills Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",2005, "Results of a multisite randomized trial of supported employment interventions for individuals with severe mental illness","Cook, J., Leff, H., Blyler, C., Gold, P., Goldberg, R., Mueser, K., Toprac, M., McFarlane, W., Shafer, M., Blankertz, L., Dudek, K., Razzano, L., Grey, D., & Burke-Miller, J. (2005). Results of a multisite randomized trial of supported employment interventions for individuals with severe mental illness. Archives of General Psychiatry, 62, 505-512.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to estimate the 24-month employment effects of supported employment on people with severe mental illness. Supported employment interventions use a combination of employment and health services and supports to improve employment and other outcomes.  The authors analyzed data from seven sites, each of which implemented a distinct supported employment intervention using a randomized controlled trial. At each site, researchers interviewed participants in person twice yearly and collected weekly employment data. The supported employment interventions had a significant and positive impact on employment, working for 40 or more hours in a single month, and monthly earnings from paid employment. The quality of causal evidence provided in this study is moderate. This means we are somewhat confident that the estimated effects are attributable to the supported employment interventions, but other factors might also have contributed.","Supported Employment Programs","Health Supported employment or other employment supports Vocational rehabilitation",Disability,,"United States",2005, "Persistent Problems Demand Consistent Solutions: Evaluating Policies to Mitigate Occupational Segregation by Gender","Mastracci, S.H. (2005). Persistent Problems Demand Consistent Solutions: Evaluating Policies to Mitigate Occupational Segregation by Gender. Review of Radical Political Economics, 37(1), 23-38.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to determine the effect of two competitive grants that funded activities to support women in nontraditional occupations on women’s probability of employment in those occupations. Nontraditional occupations are those in which women represent fewer than one-quarter of all employed people in the occupation (for example, dentists or construction workers). The author estimated the grants’ impact on female employment in nontraditional occupations through a differences-in-differences model using Current Population Survey Merged Outgoing Rotation Groups data from 1990 to 1999. The study found that the grants were associated with increases in women’s chances of obtaining employment in a nontraditional occupation. The quality of causal evidence presented in this report is low because the author did not control or account for pretreatment trends in the outcome variables of interest. This means we are not confident that the estimated effects are attributable to the grants; other factors are likely to have contributed.","the NEW and WANTO Grant Programs","Other disparities or discrimination in employment and earnings Science, Technology, Engineering, and Math (STEM) programs",Female,,"United States",2005, "Participation in Programs Designed to Improve Employment Outcomes for Persons with Psychiatric Disabilities: Evidence from the New York WORKS Demonstration Project","Ruiz-Quintanilla, Antonio S., Weathers II, Robert R., Melburg, Valerie, Campbell, Kimberly, & Madi, Nawaf. (2005). Participation in Programs Designed to Improve Employment Outcomes for Persons with Psychiatric Disabilities: Evidence from the New York WORKS Demonstration Project. Social Security Bulletin, 66(2), 49–79.","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: This study used a sequential response model of conditional probabilities to examine the impact of characteristics of Supplemental Security Income (SSI) recipients on participation in the New York WORKS project. The analysis showed how individual characteristics were related to responses at each of four stages of the program recruitment process and how they contributed to the overall likelihood of enrollment. New York WORKS targeted people with a primary medical diagnosis of psychiatric illness. Characteristics examined in the study for their relationship to completion of enrollment included demographics, psychiatric diagnosis, and past employment and earnings. The study found that the relationship between the characteristics of SSI recipients and the outcomes at each stage of the recruitment process contributed to the overall likelihood of enrollment.",,"Disability insurance Supplemental security income (SSI)",Disability,,"United States",2005, "Are empowerment and education enough? Underdiversification in 401(k) plans","Choi, J., Laibson, D., & Madrian, B. (2005). Are empowerment and education enough? Underdiversification in 401(k) plans. Brookings Papers on Economic Activity 2005, (2), 151-213.","Behavioral Finance: Retirement","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employer benefits receipt-Low-No impacts Employer benefits receipt","Summary: The study examined factors that can affect diversification from employer stock in 401(k) plans. The study analyzed the impact of loosened diversification restrictions and media coverage of highly publicized events on 401(k) holdings in employer stock. The authors assessed factors affecting diversification in 401(k) plans through four studies. The first was an interrupted time series analysis of employer stock holdings at an unnamed company. The other three studies explored the impact of media attention to the Enron, WorldCom, and Global Crossing bankruptcies through regression analysis. All analyses were based on transaction-level and annual data from 1997 to 2003 from Hewitt Associates, a benefits administration company. The authors attributed only a 2.4 percentage point decline in employer stock holdings to news coverage of the Enron, WorldCom, and Global Crossing bankruptcies across the entire Hewitt 401(k) Index. The quality of causal evidence presented in this report is low. In the first study, the authors did not account for prior trends in the outcome variable and in the second through fourth studies they did not provide information a reader would need to assess changes in sample composition. This low rating means we are not confident that the estimated effects are attributable to any of the interventions studied, whether loosened diversification restrictions or media coverage of the Enron, Global Crossing, and WorldCom bankruptcies. Other factors are likely to have contributed.","Factors Promoting 401(k) Diversification","Employer provided retirement benefits",Employed,,"United States",2005, "State Partnership Initiative: Selection of comparison groups for the evaluation and selected impact estimates: Final report","Peikes, D., Orzol, S., Moreno, L., & Paxton, N. (2005). State Partnership Initiative: Selection of comparison groups for the evaluation and selected impact estimates: Final report. Princeton, NJ: Mathematica Policy Research.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Unfavorable impacts Earnings and wages Employment-Mod/high-Unfavorable impacts Employment","Summary: The study’s objective was to measure short-term impacts for the three State Partnership Initiative (SPI) sites whose effectiveness was evaluated using a randomized controlled trial. SPI was meant to increase employment and earnings for Supplemental Security Income (SSI) and Social Security Disability Insurance (SSDI) beneficiaries through the provision of direct services. The study’s data were collected from Social Security Administration (SSA) administrative data and the Summary Earnings Record (SER). The authors estimated program impacts on employment and earnings. The study found that SPI had negative and statistically significant impacts on employment and earnings, contrary to the initiative’s intent. The quality of causal evidence presented in this report is high because it is based on a well-conducted randomized controlled trial. This means we are confident that the effects estimated in the study are attributable solely to the SPI, and not to other factors.","the State Partnership Initiative","Supplemental security income (SSI) Disability insurance",Disability,,"United States",2005,http://www.mathematica-mpr.com/~/media/publications/PDFs/SPIselectimpact.pdf "Employment outcomes and PTSD symptom severity","Smith, M., Schnurr, P., & Rosenheck, R. (2005). Employment outcomes and PTSD symptom severity. Mental Health Services Research, 7(2), 89-101.","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: The authors assessed the relationship between male Vietnam-era veterans’ scores on the Clinician-Administered Post-Traumatic Stress Disorder (PTSD) Scale (CAPS), a clinically administered scale of PTSD severity, and their employment and earnings. The authors analyzed a data set containing demographic characteristics, PTSD symptom severity, employment status, and earnings for 325 male Vietnam-era veterans ages 18 to 54. The authors used a multinomial logistic regression framework to estimate the marginal effect of PTSD severity on three categories of employment—no employment, part-time employment, and full-time employment—and a Heckman selection model to estimate effects on earnings. The study found that a 10-point increase in the CAPS score was associated with a 5.9 percentage point increase in the probability of unemployment, a 2.1 percentage point decrease in the probability of part-time employment, and a 3.8 percentage point decrease in the probability of full-time work.",,,"Disability, Veteran or military",,"United States",2005, "More than robots: An evaluation of the FIRST robotics competition participant and institutional impacts","Melchior, A., Cohen, F., Cutter, T., & Leavitt, T. (2005). More than robots: An evaluation of the FIRST robotics competition participant and institutional impacts. Waltham, MA: Brandeis University Center for Youth and Communities Heller School for Social Policy and Management.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the FIRST Robotics Competition (FRC) on participants’ education and career outcomes. The FRC was a six-week competition in which teams of high school male and female students (with the help of mentors) used a set of standard parts to build a robot. Students showcased these robots by competing against teams from other high schools. The authors used propensity-score matching to create treatment and comparison groups and conducted an analysis of retrospective survey data to measure education and career outcomes of FRC participants who graduated from the program from 1999 to 2003. They administered a researcher-designed survey to students in the treatment group in 2004 and collected data from a national survey—the Beginning Postsecondary Student Survey (BPSS)—to measure outcomes for the comparison group, who began college in 1995-1996. The study found that a higher percentage of female FRC participants majored in engineering compared with females in the comparison group. The quality of causal evidence presented in this report is low because the authors did not demonstrate equivalency of the treatment and comparison groups on all required measures. This means we are not confident that the estimated effects are attributable to the FRC; other factors are likely to have contributed.","FIRST Robotics Competition","Science, Technology, Engineering, and Math (STEM) programs Youth programs","Youth, Female, Male",,"United States",2005,http://www.techfire225.com/uploads/6/3/7/1/6371896/first_study.pdf "An analysis of the impact of affirmative action programs on self-employment in the construction industry.","Blanchflower, D.G., & Wainwright, J. (2005). An analysis of the impact of affirmative action programs on self-employment in the construction industry. Working paper no. 11793. Cambridge, MA: National Bureau of Economic Research.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of City of Richmond v. J.A. Croson Co. (referred to as the Croson decision) in 1989, which weakened affirmative action policies, on self-employment, with a focus on the construction industry, by race, ethnicity, and gender. The study used a nonexperimental analyses to compare self-employment before and after the Croson decision. The authors used national data from the Current Population Survey (CPS) and the 2000 decennial U.S. Census. The study found that gender disparities in self-employment rates have declined since the Croson decision in all industries, but have declined most in construction. In contrast, racial and ethnic disparities in self-employment have declined since the Croson decision in all industries except construction. The quality of causal evidence presented in this study is low because the authors did not control for trends in self-employment or earnings before the Croson decision. This means we are not confident that the estimated effects are attributable to the Croson decision. Other factors are likely to have contributed.","City of Richmond v. J.A. Croson Co.","Affirmative action",Other,Construction,"United States",2005,http://www.nber.org/papers/w11793.pdf "Building learning communities: Early results from the Opening Doors Demonstration at Kingsborough Community College","Bloom, D., & Sommo, C. (2005). Building learning communities: Early results from the Opening Doors Demonstration at Kingsborough Community College. New York: MDRC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Opening Doors learning community program at Kingsborough Community College in Brooklyn, New York, on students’ persistence, course completion, and credits earned during the 2003–2004 academic year. The study was a randomized controlled trial in which students were randomly assigned to the Opening Doors learning community treatment group or the control group. Data sources included students’ transcript data provided by Kingsborough and data from a baseline survey completed by students at the time of random assignment. This study found that the Opening Doors learning community program at Kingsborough had positive impacts on developmental course enrollment and passage rates, percentage and number of courses passed, equated credits earned in the program semester, and developmental course enrollment in the first postprogram semester. During the first academic year, Opening Doors students earned significantly more equated credits and made significantly more progress in required English courses than the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Opening Doors learning communities, and not to other factors.","Opening Doors Learning Communities at Kingsborough Community College","Community college education and other classroom training","Adult, Low income",,"United States",2005,http://files.eric.ed.gov/fulltext/ED485506.pdf "Teaching strategies designed to change the undergraduate experience for college women learning chemistry","Khan, S. (2005). Teaching strategies designed to change the undergraduate experience for college women learning chemistry. Journal of Women and Minorities in Science and Engineering 11, 365-387.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of three teaching innovations—a contract, confidence-building exercises, and encouragement to apply for science internships—on performance in an Organic Chemistry II course at an all-female college. The author compared the final exam scores, final grades, and internship acceptance rates of students enrolled in the course that included these interventions to outcomes for students who had taken the course without these interventions in the three prior years. All courses were taught by the same professor and used the same syllabus. The study identified no statistically significant relationships between the three teaching innovations and students’ outcomes. The quality of causal evidence presented in this report is low. This means we are not confident that the estimated effects are attributable to the teaching innovations; other factors are likely to have contributed.","Innovative Teaching for Women in STEM","Science, Technology, Engineering, and Math (STEM) programs","Youth, Female",,"United States",2005, "4 schools for WIE","Erkut, S., Marx, F., & Wellesley College Center for Research on Women. (2005). 4 schools for WIE. Evaluation report. Wellesley, MA: Wellesley Centers for Women.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Attitudes-Low-Mixed impacts Attitudes","Summary: The study’s objective was to determine the effect of the 4 Schools for Women in Engineering (WIE) strategy on 8th-grade students’ attitudes toward STEM careers. The strategy involved forming teams of mostly female engineering professors, students, and practitioners to train middle school teachers on engineering and gender-inclusive teaching methods and to serve as in-class role models for students. The authors administered a study-designed survey at the beginning and end of the school year to a single cohort of students to measure changes in outcomes following implementation of the intervention. The authors estimated program impacts using regression models and paired t-tests. The study found that students’ attitudes toward science improved after the intervention, but attitudes toward engineering worsened. There was no change in students’ attitudes toward math. The quality of causal evidence presented in this report is low. This means we are not confident that the estimated effects are attributable to the 4 Schools for WIE strategy; other factors are likely to have contributed.","4 Schools for Women in Engineering","Science, Technology, Engineering, and Math (STEM) programs Youth programs","Youth, Female",,"United States",2005,http://files.eric.ed.gov/fulltext/ED500754.pdf "Implementation and outcome evaluation of the Intensive Aftercare Program: Final report","Wiebush, R., Wagner, D., McNulty, B., Wang, Y., & Le, T. (2005). Implementation and outcome evaluation of the Intensive Aftercare Program: Final report. National Council on Crime and Delinquency. Washington, DC: U.S. Department of Justice, Office of Justice Programs.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence",,"Summary: The study’s objective was to measure the impact of participation in an Intensive Aftercare Program (IAP) for high-risk youth from juvenile justice facility placements on recidivism. The authors used a random assignment design and multivariate regression analysis to estimate impacts on aggregate recidivism scores, the sum of all subsequent offenses, weighted by severity. Data for the study were collected from standardized forms, surveys, risk assessment tests, and state agency and police records. The study found no statistically significant effects of the program on participants’ aggregate recidivism scores. The quality of causal evidence presented in this report is moderate for some outcomes and low for other outcomes. This means we have little confidence that any estimated effects would be attributable to the IAP. However, the study found few statistically significant effects.","the Intensive Aftercare Program (IAP)","Reentry Youth programs","Youth, Justice-involved, Disconnected youth, Male",,"United States",2005,http://files.eric.ed.gov/fulltext/ED484683.pdf "The Employment Retention and Advancement project: Results from the South Carolina ERA site","Scrivener, S., Azurdia, G., & Page, J. (2005). The Employment Retention and Advancement project: Results from the South Carolina ERA site. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of South Carolina’s Moving Up program on former welfare recipients’ employment, earnings and public benefits receipt outcomes after one year. The South Carolina site was one of 16 sites nationwide that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 2,864 people who had recently left Temporary Assistance for Needy Families (TANF) to either a treatment group that received Moving Up services or a control group that could participate in other employment-related programs in the community. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamp administrative records for the entire sample and a survey administered to a subsample of study participants 12 months after random assignment. The study did not find any statistically significant effects on employment, earnings, and public benefits receipt one year after random assignment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects would be attributable to the South Carolina Moving Up program and not to other factors. However, the study did not find statistically significant effects.","the Employment Retention and Advancement Project, South Carolina","Job search assistance and supportive services Other employment and reemployment","Low income",,"United States",2005,http://files.eric.ed.gov/fulltext/ED490879.pdf "Evaluating an experimental intensive juvenile probation program: Supervision and official outcomes","Lane, J., Turner, S., Fain, T., & Sehgal, A. (2005). Evaluating an experimental intensive juvenile probation program: Supervision and official outcomes. Crime & Delinquency, 51(1), 26-52.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence",,"Summary: The study’s objective was to examine the impact of the South Oxnard Challenge Project (SOCP), an alternative juvenile probation program, on recidivism outcomes. The study was a randomized controlled trial. The authors used administrative data from the program and probation records to compare the outcomes of youth randomly assigned to the SOCP with those of youth randomly assigned to a control group that received standard probation services. The study found no statistically significant effects of SOCP on arrests or referrals to probation, convictions, or incarceration. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects would be attributable to SOCP and not to other factors. However, the study did not find statistically significant effects.","South Oxnard Challenge Project (SOCP)","Substance abuse recovery Youth programs Behavioral Interventions","Youth, Justice-involved, Disconnected youth",,"United States",2005, "Turning welfare into a work support: Six-year impacts on parents and children from the Minnesota Family Investment Program.","Gennetian, L., Miller, C., & Smith, J. (2005). Turning welfare into a work support: Six-year impacts on parents and children from the Minnesota Family Investment Program. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Unfavorable impacts Earnings and wages Employment-Mod/high-Mixed impacts Employment Public benefits receipt-Mod/high-Unfavorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Minnesota Family Investment Program (MFIP), a precursor to the national Temporary Assistance for Needy Families program, on employment, earnings, and public benefit receipt. The study was a randomized controlled trial: Families newly applying to Aid to Families with Dependent Children (AFDC) or families that were recertifying their eligibility were randomly assigned to MFIP or AFDC. Evaluators analyzed outcomes using a 36-month follow-up survey and administrative data from the six years after the intervention. The study found that, among single parents in the year after MFIP began, the MFIP group experienced higher rates of short-term employment and higher rates and levels of cash assistance than the AFDC group. For two-parent households, the study found that, in the first year after the study began, the MFIP group had lower rates of employment, lower levels of earnings, and higher rates and levels of benefits receipt than the AFDC group. In both family types, higher receipt of cash assistance for the MFIP group persisted through six years after the study began. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to MFIP, and not to other factors.","the Minnesota Family Investment Program (MFIP)","Other employment and reemployment Other training and education","Parent, Low income",,"United States",2005,http://www.mdrc.org/sites/default/files/full_594.pdf "The Employment Retention and Advancement project: Early results from four sites [Chicago]","Bloom, D, Hendra, R., Martinson, K., & Scrivener, S. (2005). The Employment Retention and Advancement project: Early results from four sites. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. [Chicago]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Public benefits receipt-Mod/high-Unfavorable impacts Public benefit receipt","Summary: The study’s objective was to determine the effectiveness of a Chicago program to increase the earnings of Temporary Assistance for Needy Families (TANF) recipients after one year. The Chicago site was one of 16 nationwide to participate in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 990 TANF recipients to either a treatment group, which received enhanced employment services, or a control group, which received benefits as usual. The authors collected employment and earnings data from Illinois Unemployment Insurance (UI) records and Food Stamps and TANF receipt data from Illinois administrative records. The study found that those in the Chicago ERA program received, on average, $193 less in TANF benefits in the first year after random assignment than those in the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Chicago ERA project, and not to other factors.","the Employment Retention and Advancement project, Chicago","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States, Urban",2005,http://www.acf.hhs.gov/sites/default/files/opre/early_results.pdf "The Employment Retention and Advancement project: Early results from four sites [Riverside, CA – Work Plus versus Training Focused]","Bloom, D., Hendra, R., Martinson, K., & Scrivener, S. (2005). The Employment Retention and Advancement project: Early results from four sites. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children & Families, U.S. Department of Health and Human Services. [Riverside, CA – Work Plus versus Training Focused]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to examine the effectiveness of a Riverside, California, program to increase the earnings of welfare recipients after one year. The Riverside Phase 2 site was one of two in Riverside that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned eligible single-parent participants in Riverside’s Temporary Assistance for Needy Families (TANF) program to one of two treatment groups (Work Plus and Training Focused) that received differing ERA services or to a control group that received standard TANF services. This review focuses on the comparison between the Work Plus program and the Training Focused program. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records. The study did not find any statistically significant effects of the Work Plus program on employment, earnings, and benefits receipt compared with the Training Focused program. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects are attributable to the Riverside Work Plus program and not to other factors. However, the study did not find any statistically significant effects.","the Employment Retention and Advancement Project—Work Plus and Training Focused (Phase 2), Riverside","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States",2005,http://www.acf.hhs.gov/sites/default/files/opre/early_results.pdf "The Employment Retention and Advancement project: Early results from four sites. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children & Families, U.S. Department of Health and Human Services. [South Carolina] (Bloom et al. 2005)","Bloom, D., Hendra, R., Martinson, K., & Scrivener, S. (2005). The Employment Retention and Advancement project: Early results from four sites. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children & Families, U.S. Department of Health and Human Services. [South Carolina]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on former welfare recipients’ employment and benefits receipt outcomes after one year. The South Carolina site was one of 16 sites nationwide that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,839 people who had recently left the Temporary Assistance for Needy Families (TANF) to either a treatment group (Moving Up) that received ERA services or a control group that could participate in other employment-related programs in the community. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records. The study did not find any statistically significant effects of Moving Up on employment, earnings, or benefits receipt one year after random assignment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects are attributable to Moving Up and not to other factors. However, the study did not find any statistically significant effects.","the Employment Retention and Advancement Project, South Carolina","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States",2005,http://www.acf.hhs.gov/sites/default/files/opre/early_results.pdf "The Employment Retention and Advancement project: Early results from four sites [Texas ERA—Corpus Christi]","Bloom, D., Hendra, R., Martinson, K., & Scrivener, S. (2005). The Employment Retention and Advancement project: Early results from four sites. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children & Families, U.S. Department of Health and Human Services. [Texas ERA—Corpus Christi]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on welfare recipients’ employment and benefits receipt outcomes after one year. The Corpus Christi site was one of three in Texas that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned about 1,300 single-parent participants in Corpus Christi’s Temporary Assistance for Needy Families (TANF) program to either a treatment group, which received ERA services, or a control group, which received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Supplemental Nutrition Assistance Program administrative records. The study did not find any statistically significant effects one year after random assignment on employment, earnings, and public benefits receipt. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects would be attributable to the Corpus Christi ERA program and not to other factors. However, the study found no statistically significant impacts.","the Employment Retention and Advancement project, Corpus Christi","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States",2005,http://www.acf.hhs.gov/sites/default/files/opre/early_results.pdf "The Employment Retention and Advancement project: Early results from four sites [Texas ERA—Fort Worth]","Bloom, D., Hendra, R., Martinson, K., & Scrivener, S. (2005). The Employment Retention and Advancement project: Early results from four sites. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children & Families, U.S. Department of Health and Human Services. [Texas ERA—Fort Worth]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on welfare recipients’ employment and benefits receipt outcomes after one year. The Fort Worth site was one of three in Texas that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,163 unemployed single-parent participants in Fort Worth’s Temporary Assistance for Needy Families (TANF) program to either a treatment group that received ERA services or a control group that received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records. The study did not find any statistically significant effects of the Texas ERA program in Fort Worth on employment, earnings, and benefits receipt one year after random assignment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects are attributable to Texas ERA and not to other factors. However, the study did not find any statistically significant effects.","the Employment Retention and Advancement project, Fort Worth","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States",2005,http://www.acf.hhs.gov/sites/default/files/opre/early_results.pdf "The Employment Retention and Advancement project: Early results from four sites [Texas ERA—Houston]","Bloom, D., Hendra, R., Martinson, K., & Scrivener, S. (2005). The Employment Retention and Advancement project: Early results from four sites. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. [Texas ERA—Houston]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on welfare recipients’ employment and benefits receipt outcomes after one year. The Houston site was one of three in Texas that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,816 unemployed single-parent participants in Houston’s Temporary Assistance for Needy Families (TANF) program to either a treatment group that received ERA services or a control group that received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records. The study did not find any statistically significant effects of the Houston ERA program on employment, earnings, and benefits receipt one year after random assignment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects are attributable to the Houston ERA program and not to other factors. However, the study did not find any statistically significant effects.","the Employment Retention and Advancement project, Houston","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States, Urban",2005,http://www.acf.hhs.gov/sites/default/files/opre/early_results.pdf "An experimental study of the Los Angeles County repeat offender program: Its implementation and evaluation","Zhang, S.X., & Zhang, L. (2005). An experimental study of the Los Angeles County repeat offender program: Its implementation and evaluation. Criminology and Public Policy, 4(2):205–236.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Education and skills gains-Mod/high-Mixed impacts Education and skills gains","Summary: The study examined the impact of the Los Angeles County Repeat Offender Prevention Program (ROPP) on youths’ recidivism and educational outcomes. The authors randomly assigned eligible youth to either the treatment group that received ROPP or a control group that received standard probation services. Using data from the Los Angeles Unified School District and probation records, the authors compared the educational outcomes and average recidivism rates of the two groups. The study found that ROPP had some early positive impacts on educational outcomes, but many of these gains faded after the first six months of the program. The study also found initial improvements (reductions) in recidivism for the treatment group during the first six months. There were no statistically significant effects of participation in the program on violations of probation. The quality of causal evidence presented in this report is moderate because it was based on a randomized controlled trial with high attrition that sufficiently accounted for other relevant factors. This means we are somewhat confident that the estimated effects are attributable to the Los Angeles County ROPP, but other factors might also have contributed.","The Los Angeles County Repeat Offender Prevention Program (ROPP)","Other training and education Youth programs","Youth, Justice-involved",,"United States",2005, "The effects of welfare-to-work program activities on labor marker outcomes","Dyke, A., Heinrich, C., Mueser, P., & Troske, K. (2005). The effects of welfare-to-work program activities on labor marker outcomes. Institute for Research on Poverty, 1295(5). [Missouri]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages","Summary: The study’s objective was to examine the impact of Missouri’s welfare-to-work program training activities on the quarterly earnings of women ages 18 to 65 years in single-parent households who were cash recipients of Temporary Assistance for Needy Families (TANF). Using data from the state’s administrative records and unemployment insurance program, the authors compared the quarterly earnings of women who took part in the training activities with those who enrolled in the welfare-to-work program but never took part in any of the training. The study found that those taking part in the training activities experienced an initial (quarter 1) reduction in their quarterly earnings, compared with those who did not take part in the training activities. However, both cumulative (based on all 16 quarters of follow-up) and average (based on quarters 11 to 15) quarterly earnings increased for those who took part in the training activities compared with those who did not. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the welfare-to-work program training activities, but other factors might also have contributed.","the Welfare-to-Work Program","Job search assistance and supportive services","Female, Low income, Parent",,"United States",2005,http://repec.iza.org/dp1520.pdf "The effects of welfare-to-work program activities on labor market outcomes","Dyke, A., Heinrich, C., Mueser, P., & Troske, K. (2005). The effects of welfare-to-work program activities on labor market outcomes. Institute for Research on Poverty, 1295(5). [North Carolina]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages","Summary: The study’s objective was to examine the impact of North Carolina’s welfare-to-work program training activities on the quarterly earnings of women ages 18 to 65 years in single-parent households who were cash recipients of Temporary Assistance for Needy Families (TANF). Using data from the state’s administrative records and unemployment insurance program, the authors compared the quarterly earnings of women who took part in the training activities with those who enrolled in the welfare-to-work program but never took part in any of the training. The study found that those taking part in any of the training activities experienced an initial (quarter 1) reduction in their quarterly earnings, compared with those who did not take part in the training activities. However, those who took part in the assessment or intensive training activities experienced an increase in both their cumulative (based on 16 quarters of follow-up) and average (based on quarters 11 to 15 of follow-up) quarterly earnings, compared with those who did not take part in any training activities. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the welfare-to-work program, but other factors might also have contributed.","the Welfare-to-Work Program","Job search assistance and supportive services","Female, Low income, Parent",,"United States",2005,http://repec.iza.org/dp1520.pdf "The Employment Retention and Advancement project: Early results from four sites [Riverside, CA – Work Plus]","Bloom, D., Hendra, R., Martinson, K. & Scrivener, S. (2005). The Employment Retention and Advancement project: Early results from four sites. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. [Riverside, CA – Work Plus]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the effectiveness of a Riverside, California, program to increase the earnings of welfare recipients after one year. The Riverside Phase 2 site was one of two in Riverside that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,912 employed single-parent participants in Riverside’s Temporary Assistance for Needy Families (TANF) program to one of two treatment groups (Work Plus or Training Focused) that received different ERA services, or to a control group (Work Focused) that received standard public benefits and some limited case management. This review compared the Work Plus program and the control group. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records. The study found that those in the Work Plus group were 5 percentage points more likely to receive Food Stamps in the year after random assignment than those in the control group. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to the Riverside Work Plus program and not to other factors.","the Employment Retention and Advancement (ERA) Project—Work Plus (Phase 2), Riverside","Other employment and reemployment","Low income, Parent",,"United States",2005,http://www.acf.hhs.gov/sites/default/files/opre/early_results.pdf "The Employment Retention and Advancement project: Early results from four sites [Riverside, CA – Training Focused]","Bloom, D., Hendra, R., Martinson, K., & Scrivener, S. (2005). The Employment Retention and Advancement project: Early results from four sites. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. [Riverside, CA – Training Focused]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the effectiveness of a Riverside, California, program to increase the earnings of welfare recipients after one year. The Riverside Phase 2 site was one of two in Riverside that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,912 employed single-parent participants in Riverside’s Temporary Assistance for Needy Families (TANF) program to one of two treatment groups (Work Plus or Training Focused) that received differing ERA services, or to a control group (Work Focused) that received standard public benefits and some limited case management. This review compared between the Training Focused program and the control group. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records. The study did not find any statistically significant effects on employment, earnings, or benefit receipt. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means that we would be confident that any estimated effects would be attributable to Riverside Training Focused program and not to other factors. However, the study did not find statistically significant effects.","the Employment Retention and Advancement (ERA) Project—Training Focused (Phase 2), Riverside","Other employment and reemployment","Low income",,"United States",2005,http://www.acf.hhs.gov/sites/default/files/opre/early_results.pdf "Promoting work in public housing: The effectiveness of Jobs-Plus","Bloom, H., Riccio, J., Verma, N., & Walter, J. (2005). Promoting work in public housing: The effectiveness of Jobs-Plus. New York City: MDRC","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages","Summary: The study’s objective was to examine the impact of the Jobs-Plus Community Revitalization Initiative for Public Housing Families (Jobs-Plus) program on the employment and earnings of residents in housing developments in six cities in the United States. The study was a randomized controlled trial that used data from administrative records to compare outcomes between treatment and control group members from one to five years after random assignment. The study found that residents in the Jobs-Plus housing developments had higher long-term earnings than residents in the control group developments. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Jobs-Plus program and not to other factors.","the Jobs-Plus Community Revitalization Initiative for Public Housing Families (Jobs-Plus) Program","Job search assistance and supportive services Other employment and reemployment Other training and education","Low income",,"United States, Urban",2005,http://www.mdrc.org/sites/default/files/full_485.pdf "Work rehabilitation for middle-aged and older people with schizophrenia: A comparison of three approaches","Twamley, E. W., Padin, D. S., Bayne, K. S., Narvaez, J. M., Williams, R. E., & Jeste, D. V. (2005). Work rehabilitation for middle-aged and older people with schizophrenia: A comparison of three approaches. Journal of Nervous and Mental Disease, 193(9), 596-601.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Unfavorable impacts Employment","Summary: The study examined the impact of the Wellness and Vocational Enrichment Clinic (WAVE), a conventional vocational rehabilitation program with some elements of supported employment, on veterans’ employment outcomes. The study used statistical tests to examine differences between veterans who were offered WAVE and individuals who were offered Individual Placement and Support (IPS), a supported employment program. The data from this study come from program records. The study found that participation in the WAVE program is associated with lower rates of volunteer or paid work, and lower rates of competitive work or compensated work therapy participation compared with participation in the IPS program. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the WAVE program; other factors are likely to have contributed.","Wellness and Vocational Enrichment Clinic (WAVE)","Veterans' reemployment","Veteran or military",,"United States",2005, "Work rehabilitation for middle-aged and older people with schizophrenia: A comparison of three approaches.","Twamley, E. W., Padin, D. S., Bayne, K. S., Narvaez, J. M., Williams, R. E., & Jeste, D. V. (2005). Work rehabilitation for middle-aged and older people with schizophrenia: A comparison of three approaches. Journal of Nervous and Mental Disease, 193(9), 596-601.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Unfavorable impacts Employment","Summary: The study examined the impact of the Wellness and Vocational Enrichment Clinic (WAVE), a conventional vocational rehabilitation program with some elements of supported employment, on veterans’ employment outcomes. The study used statistical tests to examine differences between veterans who were offered WAVE and individuals who were offered the Department of Rehabilitation’s Employment Services (DOR), a conventional vocational rehabilitation program. The data from this study come from program records. The study found no statistically significant relationships between participation in WAVE and volunteer or paid work, or between participation in WAVE and competitive work or compensated work therapy. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the WAVE program; other factors are likely to have contributed.","Wellness and Vocational Enrichment Clinic (WAVE)","Veterans' reemployment","Veteran or military",,"United States",2005, "The impact of enhanced incentives on vocational rehabilitation outcomes for dually diagnosed veterans.","Drebing, C. E., Van Ormer, E. A., Krebs, C., Rosenheck, R., & Rounsaville, B. (2005). The impact of enhanced incentives on vocational rehabilitation outcomes for dually diagnosed veterans. Journal of Applied Behavioral Analysis, 38(3), 359-372.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-No impacts Employment Health and safety-Low-Favorable impacts Health and safety","Summary: The study examined the impact of enhanced incentives within an existing Veteran’s Administration (VA) Compensated Work Therapy (CWT) program on sustained abstinence from substances, transitioning to competitive employment, retention in competitive employment, and wages. The study was a randomized controlled trial that compared outcomes for the intervention and control groups over 16 weeks. The CWT program’s clinical and financial records were used to assess employment and wage outcomes. Urine screens and participant reports were used to measure substance use outcomes. The study found that total wages for the enhanced incentives group were significantly higher than for the control group. The study also found that the intervention group abstained from substance use for a significantly longer time than the control group. The quality of causal evidence presented in this report is low for the employment and earnings outcomes because the authors did not establish that the intervention and control groups were equivalent one year before the intervention in terms of earnings or employment. This means we are not confident the estimated effects on these outcomes are attributable to the enhanced incentives in the CWT program; other factors are likely to have contributed.","Veterans’ Administration’s Compensated Work Therapy Program with Enhanced Incentives","Health Substance abuse recovery Veterans' reemployment","Veteran or military","Health care and social assistance","United States",2005,https://files.eric.ed.gov/fulltext/EJ725227.pdf "The effect of the SSI program on labor supply: Improved evidence from Social Security administrative files","Neumark, D., & Powers, E. T. (2005). The effect of the SSI program on labor supply: Improved evidence from Social Security administrative files. Social Security Bulletin, 65(3), 45-60.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study examined the relationship between generous state Supplemental Security Income (SSI) benefits and the employment of older worker nearing SSI eligibility age. The authors used a regression model and data from the Survey of Income and Program Participants (SIPP) and Social Security Administration (SSA) to estimate the effect. The study found that older males who were likely SSI participants in generous states worked significantly fewer hours and had lower employment rates compared with those living in less generous states. The authors, using the SSA administrative records, also found that likely older participants (ages 60 to 64) worked significantly fewer hours than younger ones. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to generosity of state SSI benefits; other factors are likely to have contributed.","state Supplemental Security Income (SSI) benefits","Older workers' programs Other employment and reemployment","Adult, Older worker",,"United States",2005,https://www.ssa.gov/policy/docs/ssb/v65n3/v65n3p45.html "Career Academies: Impacts on labor market outcomes and educational attainment","Kemple, J. (2004). Career Academies: Impacts on labor market outcomes and educational attainment. New York: MDRC.","Career Academies","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-No impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment","Summary: The report’s objective was to evaluate the impact of Career Academies on labor market and educational outcomes four years after participants’ scheduled high school graduation. Earlier reports presented impact findings over a shorter time horizon, and a subsequent report presents impact findings over a longer period (eight years). For this evaluation, about 2,000 9th-grade students were randomly assigned to the treatment group, which could enroll in a Career Academy, or the control group, which continued to participate in general education. The study team administered a survey to treatment and control group members 48 months after their scheduled graduation from high school. The study reported statistically significant, positive impacts on average monthly earnings, average hours worked per week, and average hourly wages over the four years following scheduled high school graduation. There were no statistically significant differences in educational attainment of the two groups. The quality of the causal evidence presented in this report is high because it was a well-implemented randomized controlled trial. This means we are confident that the estimated impacts are attributable solely to Career Academies, not other factors.","Career Academies","Youth programs Community college education and other classroom training Work based and other occupational training",Youth,,"Urban, United States",2004,http://www.mdrc.org/sites/default/files/full_49.pdf "The Quantum Opportunity Program Demonstration: Initial post-intervention impacts","Schirm, A., & Rodriguez-Planas, N. (2004). The Quantum Opportunity Program Demonstration: Initial post-intervention impacts. Washington, DC: Mathematica Policy Research.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Unfavorable impacts Employment","Summary: The report’s objective was to evaluate the impact of the Quantum Opportunity Program (QOP)—which includes case management and mentoring, education, developmental activities, community service, supportive services, and financial incentives—on educational attainment and labor market participation approximately seven years after program enrollment. Other reports presented impact findings from different time periods. About 1,100 9th-grade students from 11 high schools were randomly assigned to the treatment group, which could enroll in QOP, or to the control group, which could not participate in QOP activities. The study team administered a survey to treatment and control group members about seven years after program enrollment (three years after their scheduled graduation from high school) to collect information on postsecondary educational attainment and labor market outcomes. Participation in QOP had no statistically significant impact on most measures of postsecondary attainment and employment. The exceptions were that participation increased enrollment in college or vocational/technical school, an apprenticeship, or the military by 10 percentage points. It decreased the likelihood of working at least 35 hours at a main job by 11 percentage points. The quality of the causal evidence presented in this report is low. This means we do not have confidence that the estimated effects are attributable to QOP; other factors likely contributed.","Quantum Opportunities Program (QOP)","Mentoring Other training and education Youth programs",Youth,,"United States",2004,http://www.doleta.gov/reports/searcheta/occ/papers/June_04_QOP_report.pdf "Enriching summer work: An evaluation of the Summer Career Exploration Program.","McClanahan, W., Sipe, C., & Smith, T. (2004). Enriching summer work: An evaluation of the Summer Career Exploration Program. Philadelphia, PA: Public/Private Ventures.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Mixed impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The evaluation’s objective was to examine the effects of the Summer Career Exploration Program (SCEP) on short-term earnings, employment, and other outcomes. SCEP offers youth job-related counseling, places them in career-related jobs, and supports them through mentoring. The report also describes program implementation and ways of improving SCEP. The program’s effectiveness was evaluated using a randomized control ed trial.  The study found statistically significant, positive impacts of SCEP on participants’ employment and earnings over the summer that the evaluation occurred; however, these were not sustained over the one-year follow-up period.  The quality of the causal evidence presented in this study is high for most outcomes and moderate for the remaining outcomes examined. For the outcomes with high causal evidence, this means we are confident that the estimated impacts are attributable to SCEP, and not other factors. For those with moderate causal evidence, other factors besides SCEP might have contributed to the estimated effects.","Summer Career Exploration Program","Basic skills Job search assistance and supportive services Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",2004,http://www.cityofmadison.com/dpced/communitydevelopment/funding/documents/AreaI… "Life after YouthBuild: 900 YouthBuild graduates reflect on their lives, dreams, and experiences","Hahn, A., Leavitt, T., Horvat, E., & Davis, J. (2004). Life after YouthBuild: 900 YouthBuild graduates reflect on their lives, dreams, and experiences. Somerville, MA: Brandeis University Heller School for Social Policy and Management and Temple University College of Education.","Opportunities for Youth","Study Type: Descriptive Analysis",,,"Summary: This report summarizes YouthBuild participants’ experiences after program completion. YouthBuild was founded in 1991 and offers academic instruction and construction training to economically disadvantaged youth who use those skills to build affordable housing for low-income households. The authors collected information on what students go on to do after YouthBuild by conducting in-depth interviews with 57 graduates and a detailed survey of 882 graduates. YouthBuild graduates who were interviewed had a very positive view of the program; they appreciated that staff set high expectations for them while acting as their substitute families and providing a caring environment. They also enjoyed the construction work, which enabled them to see tangible results of their efforts. Many expressed the need for additional career- or education-related programming after the period of full-time participation in YouthBuild. Seventy-five percent of the graduates who were surveyed were either working or engaged in postsecondary studies at the time of the survey, and similar percentages were free of government support and participating in at least one community activity. Like the interview findings, many survey respondents expressed a need for further career- or education-related programming.",Youthbuild,"Youth programs Other training and education Work based and other occupational training","Youth, Low income",Construction,"United States",2004, "Long-term ethylene oxide exposure trends in U.S. hospitals: relationship with OSHA regulatory and enforcement actions","LaMontagne, A., Oakes, J., & Turley, R. (2004). Long-term ethylene oxide exposure trends in U.S. hospitals: Relationship with OSHA regulatory and enforcement actions. American Journal of Public Health, 94(9), 1614-1619.","OSHA Enforcement","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Health and safety-Low-Mixed impacts Health and safety","Summary: The study’s objective was to examine differences in hospital worker exposures to ethylene oxide (EtO) after the implementation of the 1984 and 1988 OSHA EtO standards. The authors used a random effects model to examine changes over time in hospital worker exposures to EtO. The study reported a steady, statistically significant decline in EtO exposures for the first several years after each OSHA standard was set. The quality of evidence presented in this study is low. This means we are not confident that changes in worker EtO exposures over time are attributable to OSHA’s implementation of EtO standards.","OSHA Enforcement Activities","Other health and safety Safety",Employed,"Health care and social assistance","United States",2004,http://www.ncbi.nlm.nih.gov/pmc/articles/PMC1448503/pdf/0941614.pdf "Evaluation of OSHA’s impact on workplace injuries and illnesses in manufacturing using establishment-specific targeting of interventions: programmed inspections vs. high hazard notification letters","ERG. (2004). Evaluation of OSHA’s impact on workplace injuries and illnesses in manufacturing using establishment-specific targeting of interventions: programmed inspections vs. high hazard notification letters. Final report. Lexington, MA: Author.","OSHA Enforcement","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Health and safety-Low-Favorable impacts Health and safety","Summary: The study’s objective was to determine the impact of two types of notifications sent by the Occupational Safety & Health Administration (OSHA)—those with and without subsequent inspections—on workplace injuries. The study used a regression model to analyze annual changes in workplace injuries in manufacturing firms that received OSHA notifications of high existing injury rates and/or inspections in the current or past two years. The study found that firms that received notifications without a subsequent inspection experienced a statistically significant decline in injury rates. Firms that received a notification and an inspection experienced larger declines. The quality of the causal evidence presented in this study is low. This means we are not confident that OSHA notifications and inspections caused the reductions in workplace injuries.","OSHA Enforcement Activities","Inspections Other health and safety Workplace injury",Employed,,"United States",2004, "Save More Tomorrow™: Using behavioral economics to increase employee saving","Thaler, R., & Benartzi, S. (2004). Save More Tomorrow™: Using behavioral economics to increase employee saving. Journal of Political Economy, 112(S1), S164-S187.","Behavioral Finance: Retirement","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employer benefits receipt-Low-Favorable impacts Employer benefits receipt","Summary: The study aimed to determine whether a retirement savings plan that automatically increased 401(k) contributions whenever an enrolled employee’s salary increased improved savings rates among employees. The authors compared savings rates among employees who opted to participate in the plan with savings rates among employees who declined to join the plan. Across the three experimental sites, average savings rates tended to increase, with higher increases for program participants than for nonparticipants. The quality of causal evidence presented in this study is low. This low rating means that we are not confident that the difference in savings rates between program participants and nonparticipants results from participation in the savings plan.","Save More Tomorrow™","Employer provided retirement benefits",Employed,,"United States",2004, "For better or for worse default effects and 401(k) savings behavior","Choi, J.J., Laibson, D., Madrian, B.C., & Metrick, A. (2004). For better or for worse default effects and 401(k) savings behavior. National Bureau of Economic Research, 81-126","Behavioral Finance: Retirement","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employer benefits receipt-Low-Favorable impacts Employer benefits receipt","Summary: The study’s key objective was to examine the impact of automatic 401(k) plan enrollment on enrollment rates and contribution levels at three firms in the United States. The analysis was based on data on enrollment in and contributions to retirement plans from the companies themselves. The study used an interrupted time series (ITS) design, analyzing changes in outcomes before and after the implementation of automatic enrollment. The study found that automatic enrollment increased participation rates. In addition, automatic enrollment led to a larger percentage of participants investing at the plan’s default contribution rate. The quality of causal evidence presented in this report is low. This means we are not confident that the estimated effects are attributable to the companies’ automatic enrollment policies. Other factors are likely to have contributed.","Automatic Enrollment","Employer provided retirement benefits",Employed,,"United States",2004, "A Ten-Year Follow-Up of a Supported Employment Program","Salyers, Michelle P, Becker, DR, Drake RE, Torrey WC, and Wyzick PF (2004). A Ten-Year Follow-Up of a Supported Employment Program. Psychiatric Services, 55(3), 302–308.","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: The objective of this study was to examine the outcomes of supported employment 10 years after an initial demonstration project. Authors interviewed 36 of 62 clients who had participated in 1990 or 1992 in a supported employment program at one of two mental health centers located in rural areas. Although few of the 36 clients made the transition to full-time employment with health benefits, 75 percent of them worked beyond the initial study period and 35 percent worked during at least 5 years of the 10-year follow-up period. Current and recent jobs tended to be competitive (that is, not reserved for people with disabilities), with an average tenure of 32 months. Clients reported that employment led to substantial benefits in diverse areas, such as improvements in self-esteem, hope, relationships, and control of substance abuse.",,"Supported employment or other employment supports",Disability,,"United States",2004, "Saving for retirement on the path of least resistance","Choi, J., Laibson, D., Madrian, B., and Metrick, A. (2004). Saving for retirement on the path of least resistance. Working paper. Cambridge, MA.","Behavioral Finance: Retirement","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employer benefits receipt-Low-Favorable impacts Employer benefits receipt","Summary: The study examined the impact of different 401(k) plan designs on employees’ saving behavior at several U.S.-based firms. The analysis was based on administrative data provided by each company. The study used five analyses—one based on an interrupted time series (ITS) design, one based on a randomized controlled trial (RCT), and three quasi-experimental regression analyses—to estimate impacts on 401(k) participation and contribution rates. The study found that employees’ decision making was influenced by defaults, such as automatic enrollment and automatic disbursements from 401(k) plans. It also found that the gap in 401(k) participation rates between new employees facing a mandatory waiting period for eligibility and those with immediate eligibility disappeared shortly after the former group gained eligibility. The quality of causal evidence presented in this report is low. This means we are not confident that the estimated effects are attributable to the various 401(k) program designs evaluated in this study. Other factors are likely to have contributed.","401(k) Plan Design Changes","Employer provided retirement benefits",Employed,,"United States",2004,http://www.hks.harvard.edu/fs/bmadria/Documents/Madrian%20Papers/Saving%20for%2… "Estimating the returns to community college schooling for displaced workers","Jacobson, L., LaLonde, R., & Sullivan, D. (2004). Estimating the returns to community college schooling for displaced workers. (IZA discussion paper no. 1018). Bonn, Germany: Institute for the Study of Labor.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages","Summary: The study’s objective was to examine the impact of taking community college courses on the earnings of displaced workers in Washington State. The authors matched data from unemployment insurance wage records to community college records and used regression models to compare the outcomes of displaced workers who earned community college credits with the outcomes of those who did not. The study found that long-term earnings among displaced workers increased 9 percent for men and 13 percent for women as a result of one year of community college, and that the effects were largest for those who took quantitative or vocational courses. The quality of causal evidence provided in this study is moderate. This means we are somewhat confident that the estimated effects are attributable to the community college course taking, but other factors might also have contributed.","the Study","Community college education and other classroom training","Adult, Dislocated or displaced worker",,"United States",2004,http://repec.iza.org/dp1017.pdf "An examination of the utility of training: Relationships with turnover and promotion","Wagner, S. (2004). An examination of the utility of training: Relationships with turnover and promotion. A thesis presented to the Department of Psychology and Special Education, Emporia State University, [1-69].","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-No impacts Employment","Summary: The study’s objective was to explore the relationship between employee training investment, promotion strategies, and employee turnover in credit unions in the United States. Using data from a 13-item survey, the author compared employee turnover rates and promotions across organizations with differing human resource management practices, such as employee training programs and promotion strategies. The study found no statistically significant relationships between employee training investment or turnover and the human resource management practices examined. The quality of causal evidence presented in this study is low. This means that we would not be confident that any estimated effects would be attributable to the human resource management practices examined. However, the study found no statistically significant effects.","the Human Resource Management Strategies Examined","Other employer services Other training and education",,"Finance and insurance","United States",2004,https://esirc.emporia.edu/bitstream/handle/123456789/995/Wagner%202004.pdf?sequ… "Do scientists help people? Beliefs about scientists and the influence of pro-social context on girls’ attitudes toward physics","Yanowitz, K. (2004). Do scientists help people? Beliefs about scientists and the influence of pro-social context on girls’ attitudes toward physics. Journal of Women and Minorities in Science and Engineering, 10(4), 393-399.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Attitudes-Mod/high-No impacts Attitudes","Summary: The study’s objective was to examine the impact of reading a passage featuring a pro-social context on careers in physics on female students’ interest in science. The authors randomly assigned 88 5th- and 6th-grade girls to four conditions. In the treatment condition, participants read a story describing a female physicist who entered that profession to benefit society. Participants assigned to the control conditions read different stories. After reading these stories, the participants responded to a short survey asking how much they liked the story and how interested they were in becoming physicists. The study found no relationship between the treatment story and participants’ interest in becoming physicists. The quality of causal evidence presented in this study is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects would be attributable to the scientists’ stories and not to other factors. However, the study did not find statistically significant effects.",,"Science, Technology, Engineering, and Math (STEM) programs Youth programs","Youth, Female",,"United States",2004, "Evaluation of the Welfare to Work Voucher program: Report to Congress","Patterson, R., Wood, M., Lam, K., Patrabansh, S., Mills, G., Sullivan, S., . . . Zandniapour, L. (2004). Evaluation of the Welfare to Work Voucher program: Report to Congress. Washington, DC: U.S. Department of Housing and Urban Development.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Unfavorable impacts Earnings and wages Public benefits receipt-Mod/high-Unfavorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Welfare-to-Work housing voucher on employment, earnings, and public benefit receipt. The authors allocated the available vouchers by lottery to eligible families who were willing to participate in the study. Using Unemployment Insurance (UI), Temporary Assistance for Needy Families (TANF), and housing assistance administrative data, as well as baseline and follow-up surveys, the authors compared the outcomes of those randomly assigned to receive a voucher to outcomes of those who were not, adjusting for chance pre-intervention differences between the groups. The authors found that the Welfare-to-Work vouchers reduced the total number of quarters employed in the first five quarters after random assignment by 0.165 quarters, on average. In the first five quarters, the program reduced total earnings by $325, on average. At the same time, the voucher program decreased the average likelihood of receiving TANF by 1.8 percentage points. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Welfare-to-Work Voucher program and not to other factors.","the Welfare-to-Work Voucher Program","Unemployment Insurance","Low income",,"United States",2004,https://www.huduser.gov/portal/publications/pdf/welfrwrkVchrPrg.pdf "Is the threat of reemployment services more effective than the services themselves? Evidence from random assignments in the UI system","Black, D., Smith, J., Berger, M., & Noel, B. (2003). Is the threat of reemployment services more effective than the services themselves? Evidence from random assignments in the UI system. American Economic Review, 93(4), 1313-1327.",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study examined the impact of the Kentucky Worker Profiling and Reemployment Services (WPRS) on Unemployment Insurance (UI) benefit receipt and earnings.  In this study, about 2,000 UI claimants in Kentucky were randomly assigned to the treatment group, which was required to participate in reemployment services, or to the control group, which was not required to participate but could receive services voluntarily. The authors collected administrative data on UI benefit receipt and earnings for all study participants. The study found that those in the WPRS treatment group had a statistically significant reduction in UI benefit receipt of 2.2 weeks during the six-quarter follow-up period, compared to the control group. There were no statistically significant impacts of the program on the fraction of recipients exhausting benefits or total UI benefits received. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial (RCT). This means we are confident that the estimated effects are attributable to the WPRS and not to other factors.",Profiling,"RESEA Job search assistance and supportive services Unemployment Insurance","Dislocated or displaced worker, Unemployed",,"United States",2003, "The Quantum Opportunity Program Demonstration: Implementation findings","Maxfield, M., Castner, L., Maralani, V., & Vencill, M. (2003). The Quantum Opportunity Program Demonstration: Implementation findings. Washington, DC: Mathematica Policy Research.","Opportunities for Youth","Study Type: Implementation Analysis",,,"Summary: The objective of this report was to assess how the implementation of the Quantum Opportunity Program (QOP) at seven demonstration sites compared with the program model. QOP provided case management and mentoring, education, developmental activities, community service, supportive services, and financial incentives to at-risk students entering 9th grade. The demonstration was conducted from 1995 through 2001. The authors conducted site visits during each year of the demonstration as well as periodic telephone calls with staff at each site. The authors reported that the QOP model proved difficult to replicate; two sites “deviated substantially” and the other five “deviated moderately” from the program model, according to the study’s authors. All sites implemented the case management, mentoring, and developmental activities components of the model, but few implemented the community service component and none successfully implemented the education component. QOP did meet its goal of enrolling a representative sample of disadvantaged youth, and not solely the most motivated. QOP-enrolled students, on average, spent 174 hours in QOP-related activities, falling short of the goal of 750 hours per student. For the five-year program, the average cost per enrollee was $25,000.","Quantum Opportunities Program (QOP)","Mentoring Other training and education Youth programs",Youth,,"United States",2003,http://www.mathematica-mpr.com/~/media/publications/PDFs/quanimp.pdf "The Quantum Opportunity Program Demonstration: Short-term impacts","Schirm, A., Rodriguez-Planas, N., Maxfield, M., & Tuttle, C. (2003). The Quantum Opportunity Program Demonstration: Short-term impacts. Washington, DC: Mathematica Policy Research.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The report’s objective was to evaluate the impact of the Quantum Opportunity Program (QOP)—which includes case management and mentoring, education, developmental activities, community service, supportive services, and financial incentives—on educational attainment and labor market participation approximately five years after program enrollment. Other studies examine longer-term impacts. About 1,100 9th-grade students from 11 high schools were randomly assigned to the treatment group, which could enroll in QOP, or the control group, which could not participate in QOP activities. The study team administered a survey to treatment and control group members about five years after program enrollment (one year after their scheduled graduation from high school) to collect information on high school and postsecondary educational attainment and labor market outcomes. QOP increased the likelihood that students earned a high school diploma one year after their scheduled graduation by 7 percentage points. No other employment or educational attainment outcomes were statistically significant. The quality of the causal evidence presented in this report is low. This means we do not have confidence that the estimated effects are attributable to QOP; other factors likely contributed.","Quantum Opportunities Program (QOP)","Mentoring Other training and education Youth programs",Youth,,"United States",2003,http://www.doleta.gov/reports/papers/QOP_short_term_impacts.pdf "Evaluation of the Youthbuild Program.","Mitchell, M., Jenkins, D., Nguyen, D., Lerman, A., & DeBerry, M. (2003). Evaluation of the Youthbuild Program. Report submitted to U.S. Department of Housing and Urban Development, Office of Policy Research and Development Division. Chicago: The Counselors of Real Estate.","Opportunities for Youth","Study Type: Implementation Analysis",,,"Summary: This report presents an implementation analysis of the Youthbuild program. The program provided hands-on construction training, educational experiences, leadership training, and counseling and other support to youth ages 16 to 24 who had very low incomes (or resided in very low-income households) and had dropped out of high school. The study examined Youthbuild programs in 20 sites, focusing on program design, grantees’ characteristics, changes in program participants’ outcomes, and costs of operation. The study used program documentation, staff interviews, site visits, participant interviews, and a literature review of other workforce development programs targeting at-risk youth. The program was successful in enrolling and graduating more participants, and working on more housing units, than planned. More participants held jobs and a high school diploma or general equivalency degree (GED) at program exit than entry. However, many grantees faced implementation challenges. The authors noted that study results should not be interpreted as generalizable to all Youthbuild program sites because studied sites were only those that received a second round of funding.",Youthbuild,"Other training and education Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",2003,http://www.huduser.org/Publications/PDF/YouthBuild.pdf "National Job Corps Study: Findings using administrative earnings records data","Schochet, P., McConnell, S., & Burghardt, J. (2003). National Job Corps Study: Findings using administrative earnings records data. Princeton, NJ: Mathematica Policy Research.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-No impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment Training-Mod/high-No impacts Training","Summary: The study’s objective was to estimate the impact on long-term earnings and employment of the Job Corps program, which offers intensive academic classroom instruction and vocational skills training to economically disadvantaged youth. The program’s effectiveness was evaluated using a randomized controlled trial conducted in 48 states and the District of Columbia. The study found statistically significant, positive impacts of Job Corps on participants’ earnings within the first three years and employment within the first four years of follow-up, but no impacts of Job Corps on these outcomes in the fifth and sixth years. The quality of the causal evidence presented in this study is high. This means we are confident that the Job Corps program—not other factors—caused the estimated impacts. ","Job Corps","Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",2003,http://www.mathematica-mpr.com/publications/pdfs/jobcorpsadmin.pdf "Impact of public support payments, intensive psychiatric community care, and program fidelity on employment outcomes for people with severe mental illness","Resnick, S., Neale, M., & Rosenheck, R. (2003). Impact of public support payments, intensive psychiatric community care, and program fidelity on employment outcomes for people with severe mental illness. The Journal of Nervous and Mental Disease, 191(3), 139-144.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Unfavorable impacts Employment","Summary: The study evaluated the one-year impacts of a U.S. Department of Veterans Affairs (VA) model of assertive community treatment for veterans with serious mental illnesses known as Intensive Psychiatric Community Care (IPCC) on employment. The study conducted a randomized controlled trial (RCT); those randomly assigned to the treatment group were eligible to receive the IPCC services, whereas those randomly assigned to the control group could not access IPCC services but could use other available health- and workforce-related services from the VA. The authors analyzed outcomes based on self-reported employment data collected from participants one year after random assignment. The study found that 7 percent of veterans in the IPCC group were employed one year after random assignment compared to 11 percent of veterans in the control group. The authors did not report the statistical significance of this difference. The quality of the causal evidence presented in this report is high because it was based on a well-conducted RCT. This means we have confidence that the estimated effects are attributable to the IPCC program and not other factors.","Intensive Psychiatric Community Care (IPCC)","Health Job search assistance and supportive services Veterans' reemployment Basic skills","Disability, Veteran or military",,"United States",2003,https://journals.lww.com/jonmd/Abstract/2003/03000/IMPACT_OF_PUBLIC_SUPPORT_PAY… "Family Independence Initiative (FII): Follow-up study final report","Tao, F., & Alamprese, J. A. (2003). Family Independence Initiative (FII): Follow-up study final report. Retrieved from http://abtassociates.com/reports/2003/family-independence-initiative-%28fii%29-follow-up-stu.aspx.","Literacy, Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Education and skills gains-Low-No impacts Education and skills gains Employment-Low-No impacts Employment Public benefits receipt-Low-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Family Independence Initiative (FII) on education, earnings, employment, and public benefit receipt outcomes of low-income adults. The authors used a pre-post study design to compare outcomes before and after participating in a work-focused family literacy program. The study found that program participation was associated with increased employment, earnings, and receipt of a high school diploma or GED, and a reduction in government cash assistance. However, the study did not include tests of statistical significance. The quality of causal evidence presented in this report is low because the authors did not observe outcomes for multiple periods before and after the intervention. This means we are not confident that the estimated effects are attributable to the Family Independence Initiative; other factors are likely to have contributed.","the Family Independence Initiative","Basic skills Other training and education","Adult, Low income",,"United States",2003,http://abtassociates.com/reports/2003/family-independence-initiative-%28fii%29-… "The heterogeneous impact of conditional cash transfers","Galiani, S., & McEwan, P. J. (2013). The heterogeneous impact of conditional cash transfers. Journal of Public Economics, 103, 85-96. doi:10.1016/j.jpubeco.2013.04.004","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Honduran Programa de Asignación Familiar (PRAF-II) conditional cash transfer program on child labor and school enrollment. The authors used census data from a randomized sample of municipalities to compare the outcomes of children who received the conditional cash transfer to those who did not. The authors used statistical models to estimate program effects. The study found a significant relationship between the PRAF-II and child labor, with work outside the home decreasing by 3 percentage points and work inside the home decreasing by 4 percentage points. Program participation was also significantly related to an 8-percentage point increase in school enrollment. The quality of causal evidence presented in this report is low because it is a randomized controlled trial with unknown attrition and the authors did not account for preexisting differences between the groups before program participation. This means we are not confident that the estimated effects are attributable to the Programa de Asignación Familiar; other factors are likely to have contributed.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2003,https://doi.org/10.1016/j.jpubeco.2013.04.004 "Workplace Health and Safety Regulations: Impact of Enforcement and Consultation on Workers’ Compensation Claims Rates in Washington State","Baggs, J., Silverstein, B., & Foley, M. (2003). Workplace health and safety regulations: Impact of enforcement and consultation on workers’ compensation claims rates in Washington State. American Journal of Industrial Medicine, 43(5), 483-494.","OSHA Enforcement","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Health and safety-Low-Favorable impacts Health and safety","Summary: The study examined the effects of Washington’s Occupational Safety & Health Administration (OSHA) State Plan (named WISHA) inspections and consultations on workers’ compensation claim rates for employers in Washington State. The study used a difference-in-differences model to compare the changes in compensable claim rates for employers that had received WISHA inspections or consultations in the previous year with those that had not received the specific WISHA intervention. The study found that WISHA enforcement activity was associated with a statistically significant reduction in workers’ compensation claims rates for fixed-site industries (for example, manufacturing) but not nonfixed-site industries (for example, construction). The quality of the causal evidence presented in this study is low. This means we are not confident that the relative reductions in the compensable claim rates between employers that experienced WISHA enforcement activities or consultations and employers that did not were attributable to the WISHA enforcement activities or consultations.","OSHA Enforcement Activities","Inspections Other health and safety Workers compensation Workplace injury",Employed,,"United States",2003,http://onlinelibrary.wiley.com/doi/10.1002/ajim.10209/abstract "The role of information and social interactions in retirement plan decisions: Evidence from a randomized experiment","Duflo, E., & Saez, E. (2003). The role of information and social interactions in retirement plan decisions: Evidence from a randomized experiment. Quarterly Journal of Economics, 118(3), 815–842.","Behavioral Finance: Retirement","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employer benefits receipt-Mod/high-Favorable impacts Employer benefits receipt","Summary: The study’s objective was to determine the impact of receiving information about tax-deferred retirement accounts (TDAs) on enrollment in the accounts. The study used a randomized controlled trial (RCT) at a large university. Departments within the university were randomly assigned into two groups. In the treatment group, nonfaculty employees were randomly selected to receive or not receive a letter offering a $20 incentive to attend an employee-benefits fair, at which information on TDAs was provided. In the other group of departments, no employees received a letter. The study examines both the effect of receiving the letter or being in a department in which some people received the letter. Under most model specifications, the study found that people in both treatment groups had higher enrollment in TDAs, as measured 4.5 and 11.0 months after the fair. The quality of the causal evidence presented in this study is high. This means we are confident that the estimated effects of the intervention are attributable to the intervention itself, and not some other factor.","Incentives for Attending a Benefits Fair","Employer provided retirement benefits",Employed,,"United States",2003, "Student enrollment in high school AP sciences and calculus: how does it correlate with STEM careers?","Robinson, M. (2003). Student enrollment in high school AP sciences and calculus: how does it correlate with STEM careers? Bulletin of Science, Technology & Society, 23, 265–273.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: This study’s objective was to examine differences in the intended choice of college science, technology, engineering, and mathematics (STEM) majors between females and males enrolled in high school advanced placement (AP) science and calculus courses. The study used survey data from eight high schools to examine the percentage of AP students who chose a STEM field as their intended college major. The authors compared outcomes for minority and nonminority males and females. The study found that among students taking AP science or calculus classes, males were generally more likely than females to plan to choose a college major in engineering but less likely to plan to choose a college major in medicine. The quality of causal evidence presented in this study is low. This means we are not confident that the estimated effects are attributable to AP courses. Other factors are likely to have contributed.","the Advanced Placement (AP) Program","Science, Technology, Engineering, and Math (STEM) programs Youth programs","Youth, Female, Male",,"United States",2003, "How much choice is too much? Contributions to 401 (k) retirement plans","Iyengar, S.S., Huberman, G., & Jiang, W. (2003). How much choice is too much? Contributions to 401 (k) retirement plans. Pension Research Council working paper.","Behavioral Finance: Retirement","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employer benefits receipt-Low-Unfavorable impacts Employer benefits receipt","Summary: This study’s objective was to examine whether the number of fund options offered by a 401(k) retirement plan influenced employees’ decisions to enroll in the plan. The authors analyzed employees’ participation rates in 401(k) plans using administrative data provided by an investment management company and regression analysis, controlling for both employee- and plan-level characteristics. The analysis demonstrated that as the number of fund options increased, employees became less likely to enroll in a 401(k) plan. Adding one fund to the list of investment options was associated with a decrease in participation of 0.15 to 0.20 percentage points. The quality of causal evidence presented in this study is low. This means that we are not confident that the increase in the number of funds offered caused the decrease in 401(k) enrollment. Other factors are likely to have contributed to the observed relationship.","the Number of Fund Choices","Employer provided retirement benefits",Employed,,"United States",2003, "Impact of public support payments, intensive psychiatric community care, and program fidelity on employment outcomes for people with severe mental illness","Resnick, S., Neale, M., & Rosenheck, R. (2003). Impact of public support payments, intensive psychiatric community care, and program fidelity on employment outcomes for people with severe mental illness. The Journal of Nervous and Mental Disease, 191(3), 139-144.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to evaluate the one-year impacts of a Department of Veterans Affairs (VA) model of assertive community treatment for veterans with serious mental illnesses known as Intensive Psychiatric Community Care (IPCC). The study was based on a randomized controlled trial. Roughly half of the 528 veterans participating in the study were randomly assigned to receive the IPCC treatment while the other half received standard VA services. The authors analyzed self-reported employment data collected from participants one year after random assignment. The study found that veterans in the IPCC group were three times more likely to be employed one year after random assignment than veterans in the control group. The quality of the causal evidence presented in this report is high because it is based on a well-conducted randomized controlled trial. This means we have confidence that the estimated effects are attributable to the IPCC program, and not other factors.","Intensive Psychiatric Community Care (IPCC)","Veterans' reemployment Vocational rehabilitation","Disability, Veteran or military",,"United States",2003, "Alleviating women’s mathematics stereotype threat through salience of group achievements","McIntyre, R., Paulson, R., & Lord, C. (2003). Alleviating women’s mathematics stereotype threat through salience of group achievements. Journal of Experimental Social Psychology, 39, 83-90.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of alleviating women’s stereotype threat—that is, the idea that men outperform women in mathematics—on women’s subsequent performance on a difficult mathematics test. The study contained two experiments in which participants were randomly assigned to either a treatment condition, which received an intervention to alleviate women’s stereotype threat, or a control condition, which did not receive the intervention. The primary outcome of interest was an adjusted score for a study-administered mathematics test consisting of difficult questions from the Graduate Record Examination (GRE), an entry test for graduate school. The study found that women in the treatment group scored 2.0 to 2.5 points higher on the math test than women in the control condition. These results were statistically significant. The quality of causal evidence presented in this study is high because it was a well-conducted randomized controlled trial. This means that we are confident that the estimated effects are attributable to the intervention, and not to other factors.",,"Preventing discrimination Science, Technology, Engineering, and Math (STEM) programs Youth programs","Youth, Female",,"United States",2003, "The effects of the Americans with Disabilities Act: A longitudinal model analysis","Moon, S., Chung, K, & Yang, D. (2003). The effects of the Americans with Disabilities Act: A longitudinal model analysis. Clinical Research and Regulatory Affairs, 20(4), 433-445.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Mixed impacts Employment","Summary: The study’s objective was to examine the impact of the Americans with Disabilities Act (ADA), both the original 1992 legislation and its 1994 extension, on working hours and employment among men with disabilities.  The authors applied a multiple regression model to panel data from the 1989–1995 Survey of Income and Program Participation (SIPP). The study found that working hours and employment decreased on average among all men with disabilities, regardless of their labor force participation, relative to men without disabilities after the ADA was first implemented in 1992. In contrast, relative working hours and employment increased for labor force participants who self-reported a disability after the law’s 1994 extension went into effect. The quality of causal evidence presented in this report is low because the authors did not control for possible disparities in pre-intervention trends in working hours and employment among men with and without disabilities. This means we are not confident that the estimated effects are attributable to the ADA; other factors are likely to have contributed.","the Americans with Disabilities Act of 1990","Americans with Disabilities Act (ADA)","Disability, Male",,"United States",2003, "College as a job advancement strategy: An interim report on the New Visions Self-Sufficiency and Lifelong Learning Project","Fein, D., Beecroft, E., Long, D., & Robertson A. (2003). College as a job advancement strategy: An interim report on the New Visions Self-Sufficiency and Lifelong Learning Project. Cambridge, MA: Abt Associates Inc.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of Riverside Community College’s New Visions Self-Sufficiency and Lifelong Learning Project on welfare recipients’ employment, earnings, and welfare receipt. The study is based on a randomized controlled trial and estimated the effect of offering welfare recipients the New Visions program by using California and community college administrative data to compare average outcomes among those offered access to the program to the average outcomes of those excluded, after adjusting for differences between the groups. The authors found that access to the New Visions program increased the average number of quarters during which participants received Temporary Assistance for Needy Families (TANF) benefits and increased the average amount of TANF benefits received in the first two years. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the New Visions program, and not to other factors.","the New Visions Self-Sufficiency and Lifelong Learning Project","Community college education and other classroom training Other employment and reemployment","Low income, Parent",,"United States",2003, "Working with disadvantaged youth: Thirty-month findings from the evaluation of the Center for Employment Training replication sites","Miller, C., Bos, J., Porter, K., Tseng, M., Doolittle, F., Tanguage, D., & Vencill, M. (2003). Working with disadvantaged youth: Thirty-month findings from the evaluation of the Center for Employment Training replication sites. New York: MDRC.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: This report’s objective was to examine the effectiveness of the Center for Employment Training (CET) model. Under this model, local employers helped to design training programs and provide them in a work-like environment to economically disadvantaged youth who were not in school or employed. The effectiveness of the CET model in improving employment, earnings, and participation in education and training programs was evaluated using a randomized controlled trial (RCT) conducted in 12 sites in seven states. The study found few statistically significant impacts on outcomes measured over a 30-month follow-up period. The quality of causal evidence presented in this report is high because it was based on a well-implemented RCT. This means we are confident that any estimated effects would be attributable to the CET program and not to other factors. However, the study did not generally find statistically significant effects.","the Center for Employment Training (CET) Replication","Other employment and reemployment Other training and education Youth programs","Youth, Low-skilled, Low income",,"United States",2003,https://www.doleta.gov/reports/searcheta/occ/papers/cet_full_report.pdf "New Hope for families and children: Five-year results of a program to reduce poverty and reform welfare.","Huston, A., Miller, C., Richburg-Hayes, C., Duncan, G., Eldred, C., Weisner, T., Lowe, T., McLoyd, V., Crosby, D., Ripke, M., & Redcross, C., (2003). New Hope for families and children: Five-year results of a program to reduce poverty and reform welfare. New York: MDRC.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the New Hope program on employment, earnings, and public benefit receipt. The authors estimated the impact of the New Hope program by comparing average outcomes among a treatment group randomly selected to have access to the program with those of a randomly selected control group that did not have access to the program. The study found that receiving access to New Hope services increased average earnings as determined through unemployment insurance data during the first year of the program by $1,088 and the average likelihood of ever being employed during the first year of the program by 8.2 percentage points. The authors also found that the program increased the likelihood of treatment group members reporting being employed in 12 consecutive quarters of the five years after the program began by 6.9 percentage points, on average. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the New Hope program, and not to other factors.","The New Hope Program","Health insurance Other employment and reemployment","Low income",,"United States",2003,http://www.mdrc.org/sites/default/files/full_457.pdf "Career Academies: Additional evidence of positive student outcomes","Elliott, M., Hanser, L., & Gilroy, C. (2002). Career Academies: Additional evidence of positive student outcomes. Journal of Education for Students Placed at Risk, 7(1), 71–90.","Career Academies","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Mixed impacts Education and skills gains","Summary: The study examines the effect of the Junior Reserve Officers Training Corps Career Academies (JROTCCA) on student attendance, grade point average (GPA), and high school graduation. Using school administrative records, the study reports the four-year impacts for students who entered a JROTCCA in the 1994–1995 school year, and one-year impacts for the students who entered a JROTCCA in the 1995–1996 school year, compared with one of three control groups: (1) students in other academy or magnet programs, (2) students in regular non-Career Academy (CA) Junior Reserve Officers’ Training Corps (JROTC) programs, and (3) students in a general academic program. About 27,500 students from eight schools in five urban high school districts participated in the study. The authors reported several positive impacts of the JROTCCA program, including a reduction in the failure to graduate, substantial increases in the proportion of graduates with high GPAs, and a reduction in the proportion of students with low GPAs, compared with students in non-CA JROTC programs and general academic programs. However, some JROTCCA groups had statistically significantly higher first-year absenteeism rates than their magnet school counterparts. The quality of the causal evidence presented in this study is low because the analysis did not adequately control for characteristics of the students before their entry into JROTCCA. This means that we are not confident that the results estimated in the study are attributable to JROTCCA; other factors are likely to be responsible.","Junior Reserve Officers Training Corps Career Academies","Youth programs Community college education and other classroom training Other training and education","Youth, Other barriers",,"United States",2002, "Evaluation of the Significant Improvement Demonstration Grants for the provision of reemployment services for UI claimants","Needels, K., Corson, W., & Van Noy, M. (2002). Evaluation of the Significant Improvement Demonstration Grants for the provision of reemployment services for UI claimants. Princeton, NJ: Mathematica Policy Research.",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Public benefits receipt-Low-No impacts Public benefit receipt","Summary: The study examined the impacts of the Significant Improvement Demonstration Grants—awarded to 11 states to improve reemployment services for Unemployment Insurance (UI) claimants—on weeks of UI receipt and UI benefit exhaustion. For each state, the authors compared outcomes before and at the end of the grant period using monthly data that states reported to the UI Service. The study found no statistically significant relationships between the Significant Improvement Demonstration Grants and UI benefit receipt outcomes. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Significant Improvement Demonstration Grants; other factors are likely to have contributed.","Significant Improvement Demonstration Grants","Job search assistance and supportive services Unemployment Insurance","Dislocated or displaced worker, Unemployed",,"United States",2002,https://www.doleta.gov/reports/searcheta/occ/papers/UI_final.pdf "Going to war and going to college: Did World War II and the G.I. Bill increase educational attainment for returning veterans?","Bound, J., & Turner, S. (2002). Going to war and going to college: Did World War II and the G.I. Bill increase educational attainment for returning veterans? Journal of Labor Economics, 20(4), 784-815.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the World War II (WWII) G.I. Bill on years of college completed and college completion. The authors used nonexperimental analyses to compare education outcomes for those eligible and not eligible for the WWII G.I. Bill benefits using data from the 1970 U.S. Census. The study found that being eligible for WWII G.I. Bill benefits was associated with completing more years of college and a greater likelihood of completing college. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the WWII G.I. Bill; other factors are likely to have contributed to the findings.","the WWII G.I. Bill","Veterans' reemployment Community college education and other classroom training","Veteran or military",,"United States",2002,https://www.journals.uchicago.edu/doi/abs/10.1086/342012 "Improving basic skills: The effects of adult education in welfare-to-work programs","Bos, J. M., Scrivener, S., Snipes, J., Hamilton, G., Schwartz, C., & Walter, J. (2002). Improving basic skills: The effects of adult education in welfare-to-work programs. New York: Manpower Demonstration Research Corporation.","Literacy, Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of both education- and employment-focused welfare-to-work programs on earnings and public benefit receipt. The study was a randomized controlled trial conducted in seven geographic areas. The authors randomly assigned welfare recipients to the treatment condition (an education-focused intervention or an employment-focused intervention) or the control group. The study sample included a subset of welfare recipients who lacked a high school diploma or GED. The study found that participation in the welfare-to-work programs significantly increased earnings and reduced public benefit receipt and that participation in the employment-focused programs had a greater impact on earnings. The quality of causal evidence presented in this report is low because it was based on a randomized controlled trial with unknown attrition, and the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the effects are attributable the education-focused or employment-focused interventions; other factors are likely to have contributed.","the Education-Focused and Employment-Focused Interventions","Basic skills Other training and education","Adult, Low income",,"United States",2002,https://www.govinfo.gov/content/pkg/ERIC-ED464267/pdf/ERIC-ED464267.pdf "The impact of Equal Employment Opportunity Commission enforcement on the wages of African American and white women, 1988–1996","Wilhelm, S. (2002). The impact of Equal Employment Opportunity Commission enforcement on the wages of African American and white women, 1988–1996. The Review of Black Political Economy, 30(2), 25-51.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages","Summary: The study’s objective was to examine the impact of employment discrimination charges filed with the Equal Employment Opportunity Commission (EEOC) on the wages of African American and white women. The author used regression analyses to compare the effects of sex- and race-based discrimination charges within an industry in a given year on the wages of African American and white women from 1988 to 1996. Data came from the Current Population Survey and the EEOC National Database. The study found that increases in employment discrimination charges based on sex were positively correlated with increases in wages for both African American and white women.  The quality of causal evidence provided in this study is low because the study did not adequately control for existing differences between the study groups. This means that we are not confident that the estimated effects are attributable to EEOC enforcement. Other factors are likely to have contributed.","Equal Employment Opportunity Commission Enforcement","Equal Employment Opportunity Act of 1972","Female, Black or African American, White",,"United States",2002, "Career Academies: Impacts on students’ initial transitions to post-secondary education and employment.","Kemple, J. (2001). Career Academies: Impacts on students’ initial transitions to post-secondary education and employment. New York: MDRC","Career Academies","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment","Summary: The report’s objective was to evaluate the impact of Career Academies on labor market and educational outcomes 14 months after participants’ scheduled high school graduation. Subsequent reports presents impact findings over a longer period (up to eight years after scheduled graduation). For this evaluation, about 2,000 9th-grade students who applied to participate in a Career Academy were randomly assigned to the treatment group and admitted into a Career Academy, or to the control group, which continued to participate in general education. The study team administered a survey to treatment and control group members 14 months after their scheduled graduation from high school. The study reported that participation in Career Academies had no impact on primary educational outcomes, including the likelihood of high school graduation and post-secondary education enrollment over the 14 months following scheduled high school graduation. It also had no impact on employment outcomes, including the likelihood of employment, hours worked per week, or average earnings over this period. The quality of the causal evidence presented in this report is high because it was a well-implemented randomized controlled trial.","Career Academies","Youth programs Community college education and other classroom training Work based and other occupational training",Youth,,"Urban, United States",2001,http://www.gpo.gov/fdsys/pkg/ERIC-ED463412/pdf/ERIC-ED463412.pdf "Step to College: Moving from the High School Career Academy through the 4 Year University","Maxwell, N. (2001). Step to College: Moving from the High School Career Academy through the 4 Year University. Evaluation Review, 25(6), 619–654.","Career Academies","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study aimed to examine the effect of attending a Career Academy on students’ secondary and post-secondary academic outcomes. The authors compared the outcomes of students who had attended a Career Academy in a large, inner-city school district in California and had applied to a medium-sized state university in California, with those of peers who had graduated from a traditional public high school in the same district and had applied to the same university. The analysis was based on university records, which provided information on student demographics, high school grade point average (GPA) and college GPA, enrollment status, and major of those students who actually attended the university. The study found that students from Career Academies had higher GPAs in college and less need for remediation in English at the university level. Students from career academies still had a high need for remediation in math and low college graduation rates, but they graduated at a 4-percent-higher rate than students from traditional high schools. The quality of causal evidence presented in this study is low, because the authors did not adequately control for the academic achievement of students before they enrolled in a career academy, nor for students’ pre-intervention financial disadvantage. This means that we are not confident that the results estimated in the study are attributable to Career Academies; other factors are likely to be responsible.","Career Academies","Youth programs Community college education and other classroom training Work based and other occupational training",Youth,,"Urban, United States",2001, "National Job Corps Study: Impacts by center characteristics.","Burghardt, J. & Schochet, P. (2001). National Job Corps Study: Impacts by center characteristics. Princeton, NJ: Mathematica Policy Research, Inc.","Opportunities for Youth","Study Type: Descriptive Analysis",,,"Summary: The National Job Corps Study produced several reports, including a main impact report (see CLEAR profile of Schochet et al. 2001 ) that found positive impacts of Job Corps—a national vocationally focused education and training program for disadvantaged youth ages 16 to 24—on participants’ employment, earnings, and education and training outcomes measured after four years. In this report, the authors examined whether these impacts were related to center characteristics, including the type of center operator, capacity of the center, region of the country, and performance ranking. The authors used data collected as part of the National Job Corps Study, which consisted of 9,400 program participants and 6,000 nonparticipants randomly selected from 81,000 first-time Job Corps applicants nationwide. Data included Job Corps center characteristics and student outcomes in the areas of educational services and attainment, earnings, and arrests. The authors used Job Corps counselors’ predictions of which Job Corps center applicants would attend before random assignment to compare outcomes of treatment youth with those of comparison youth who would have attended the same centers, had they been randomly assigned a slot in the program. The authors found few impacts that varied by center characteristics. The impacts of Job Corps were similar across operators; large, medium, and small centers; most regions of the United States; and across high-, medium-, and low-performing centers, as determined by the Job Corps performance measurement system.","Job Corps","Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",2001,http://wdr.doleta.gov/opr/fulltext/01-jccenter.pdf "National Job Corps Study: Assessing program effects on earnings for students achieving key program milestones","Gritz, R. M., and Johnson, T. (2001). National Job Corps Study: Assessing program effects on earnings for students achieving key program milestones. Report Prepared for the U.S. Department of Labor, Employment and Training Administration.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages","Summary: The study’s objective was to estimate the impact of Job Corps on the employment and earnings of participants who obtained a general education development (GED) certificate or vocational training certificate during the course of the program. Job Corps offers intensive academic classroom instruction and vocational skills training to economically disadvantaged youth. Job Corps’ overall effectiveness was evaluated using a randomized controlled trial—the National Job Corps Study (NJCS)—conducted in 48 states and the District of Columbia (see the Clearinghouse for Labor Evaluation and Research [CLEAR] profile of Schochet et al. 20011 for full results). For this report, the authors used data from the NJCS 48-month follow-up survey to match Job Corps participants to control group members who had similar propensities to obtain a GED or vocational certificate. The study found that Jobs Corps participants who completed a vocational certificate during the course of the program earned $40 to $50 per week more than their control group counterparts, and those who completed a GED earned $60 to $70 per week more. The quality of causal evidence presented in this study is moderate, the highest possible rating for a nonexperimental study. This means that we have some confidence that the estimated impacts are attributable to achieving programmatic milestones in the Job Corps program, although other factors might also have contributed.","Job Corps","Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",2001,http://wdr.doleta.gov/opr/fulltext/MilestoneImpactReport-Final.pdf "The benefits and costs of Job Corps","McConnell, S., & Glazerman, S. (2001). The benefits and costs of Job Corps. Mathematica Policy Research: Washington, DC.","Opportunities for Youth","Study Type: Descriptive Analysis",,,"Summary: The study’s objective was to determine whether the benefits of Job Corps exceeded its costs. The authors used data on impacts from the National Job Corps Study to estimate the program’s benefits and administrative data from the Office of Job Corps to estimate the program’s costs. The study found that the benefits of Job Corps to society exceeded its costs by almost $17,000 per participant. This included positive benefits of about $20,000 to participants and negative benefits of about $3,000 to the rest of society.","Job Corps","Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",2001,http://www.mathematica-mpr.com/~/media/publications/PDFs/01-jcbenefit.pdf "National Job Corps Study: The impacts of Job Corps on participants’ employment and related outcomes","Schochet, P., Burghardt, J., & Glazerman, S. (2001). National Job Corps Study: The impacts of Job Corps on participants’ employment and related outcomes. Princeton, NJ: Mathematica Policy Research.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment Training-Mod/high-Favorable impacts Training","Summary: The National Job Corps Study included several reports, including this final impact report. The report’s objective was to examine the impact of the Job Corps program on participants’ long-term earnings, employment, and other outcomes. It also described the participants’ Job Corps experiences. Job Corps offers intensive academic classroom instruction and vocational skills training to economically disadvantaged youth. Its effectiveness was evaluated using a randomized controlled trial conducted in 48 states and the District of Columbia. This report found statistically significant, positive impacts of Job Corps on participants’ employment, earnings, and education and training outcomes measured after four years. The quality of the causal evidence presented in this report is high because it is based on a well-conducted randomized controlled trial. This means we are confident that the Job Corps program—not other factors—caused the estimated impacts.","Job Corps","Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",2001,http://wdr.doleta.gov/research/FullText_Documents/01-jcimpacts.pdf "Effect of state workplace safety laws on occupational injury rates","Smitha, M., Kirk, K., Oestenstad, K., Brown, K., & Lee, S. (2001). Effect of state workplace safety laws on occupational injury rates. Journal of Occupational Environmental Medicine, 43(12), 1001-1010.","OSHA Enforcement","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Health and safety-Low-Favorable impacts Health and safety","Summary: The study’s objective was to examine the effect of four types of mandatory state workplace safety interventions on occupational injury rates in manufacturing industries. The study used a regression model to compare differences in injury rates for industries in which higher or lower percentages of the workforce were affected by the four mandatory safety requirements. The study found that the mandatory safety committee requirements were associated with statistically significant decreases in injury rates; the other three initiatives were not. The quality of the causal evidence presented in this study is low. This means we are not confident that the differences in injury rates between industries in states with the mandatory safety laws and industries in states without these laws are attributable solely to the laws.","OSHA Enforcement Activities","Other health and safety Workplace injury",Employed,Manufacturing,"United States",2001, "Assessing OSHA performance: New evidence from the construction industry","Weil, D. (2001). Assessing OSHA performance: evidence from the construction industry. Journal of Policy Analysis and Management, 20(4), 651-74.","OSHA Enforcement","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Compliance-Low-Favorable impacts Compliance","Summary: The study’s objective was to examine the effect of Occupational Safety & Health Administration (OSHA) inspections on compliance behavior among construction contractors from 1987 to 1993. Although OSHA no longer operates as it did during this period, this study provides interesting historical context. The study also contains a descriptive analysis that examined whether OSHA regulatory standards were related to causes of injuries and fatalities (analysis not included in this summary). The study used regression models to analyze the change in compliance probability between the first and subsequent inspections for a given contractor and for a given contractor at a specific work site. The study found that the probability of citation decreased with each additional inspection, with the largest difference between the first and second inspections. The quality of causal evidence presented in this study is low. Although the study provides interesting descriptive information, it does not provide evidence of a causal effect of reinspections on compliance behavior.","OSHA Enforcement Activities","Inspections Safety",Employed,Construction,"United States",2001, "The returns to community college schooling for displaced workers","Jacobson, L., LaLonde, R., & Sullivan, D. G. (2001). The returns to community college schooling for displaced workers. Retrieved from: https://files.eric.ed.gov/fulltext/ED481841.pdf","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages","Summary: The study's objective was to examine the impact of the Displaced Workers Educational Training Program (DWETP) on earnings. This summary focuses on the Pittsburgh sample. The study used a nonexperimental design to compare the outcomes of displaced workers who completed community college courses as part of the DWETP and displaced workers who did not receive such schooling. Using state unemployment insurance earnings records and community college transcripts, the authors conducted statistical models to examine the differences in earnings between the groups. The study found that post-schooling earnings for both male and female participants in the DWETP were greater than their counterparts in the comparison group who did not participate in the program. However, the authors did not provide tests of statistical significance. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design; this is the highest causal evidence rating possible for a nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to enrollment in the DWETP, but other factors might also have contributed.","the Displaced Workers Educational Training Program (DWETP)","Employment and Training Services Training and Education Basic skills Community college education and other classroom training","Adult, Dislocated or displaced worker",,"United States",2001,https://files.eric.ed.gov/fulltext/ED481841.pdf "The returns to community college schooling for displaced workers.","Jacobson, L., LaLonde, R., & Sullivan, D. G. (2001). The returns to community college schooling for displaced workers. Retrieved from: https://files.eric.ed.gov/fulltext/ED481841.pdf","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment","Summary: The study's objective was to examine the impact of community college schooling on displaced workers’ earnings and employment outcomes. This summary focuses on the Washington State sample. The study used a nonexperimental design to compare the earnings and employment outcomes between displaced workers who completed community college schooling and displaced workers who did not receive such schooling. Using state unemployment insurance earnings records and community college transcripts, the authors conducted statistical models to examine the differences in outcomes between the groups. The study found that displaced workers who completed at least one community college course earned more than displaced workers who either did not enroll in community college courses or who enrolled but did not complete any courses. The study also found community college schooling to be associated with higher hourly wages and number of hours worked for both males and females and higher employment rates for females only. However, the authors did not provide tests of statistical significance. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design; this is the highest causal evidence rating possible for a nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to enrollment in community college, but other factors might also have contributed.",,"Employment and Training Services Training and Education Basic skills Community college education and other classroom training","Adult, Dislocated or displaced worker",,"United States",2001,https://files.eric.ed.gov/fulltext/ED481841.pdf "Career academy programs in California: Outcomes and implementation.","Maxwell, N., & Rubin, V. (2001). Career academy programs in California: Outcomes and implementation. Berkeley, CA: California Policy Research Center.","Career Academies","Study Type: Implementation Analysis",,,"Summary: This report contains findings from an outcome analysis and an implementation study of career academies in a large, urban California school district. The findings from the outcome analysis are also presented in two related reports (see CLEAR profile of Maxwell and Rubin [1997] and CLEAR profile of Maxwell [2001]). The objective of the implementation study was to understand the strengths and challenges of implementing Career Academies. Career Academies share three core features: a school-within-a-school structure, integration of career learning into the high school curriculum, and involvement of local employers in designing the curriculum and providing work-based learning experiences. The study covered 33 Career Academies across the six high schools in the school district, which ranged in size from 85 to 221 students per academy in the 1994–1995 school year. The authors conducted qualitative analyses of site visit data collected over a nine-year period and interviews with academy directors, high school principals, and academy partners. The authors reported that the strengths of the program included creating community among academy teachers and students and providing students with experiential learning. The greatest challenges were scheduling academy courses within the constraints of the school and district, gaining support from administrators, and raising enough funds to cover the costs.","Career Academies",,,,,2001,http://www.gpo.gov/fdsys/pkg/ERIC-ED467000/pdf/ERIC-ED467000.pdf "The power of suggestion: Inertia in 401(k) participation and savings behavior","Madrian, B. C., & Shea, D. F. (2001). The power of suggestion: Inertia in 401(k) participation and savings behavior. The Quarterly Journal of Economics, 116(4), 1149-1187.","Behavioral Finance: Retirement","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employer benefits receipt-Low-Mixed impacts Employer benefits receipt","Summary: The study examined the impact of two simultaneously implemented changes in the 401(k) plan of a large, Fortune 500 company: (1) automatic enrollment into the plan immediately after hire (a change from requiring employees to opt in to the plan to requiring them to opt out); and (2) removing the one-year tenure requirement for employees to participate in the 401(k) plan, enabling immediate contributions for employees with less than one year of tenure at the firm. The study used employee-level data from the company. It used an interrupted time series design to compare the participation and contribution rates of those hired before the company’s 401(k) plan changes to the behaviors of those hired after the changes were implemented. The authors compared employees subject to changes (1) and (2) to those subject to change (2) only and those subject to change (2) only to those subject to neither change. Employees subject to both immediate contributions and automatic enrollment had higher 401(k) participation rates and lower 401(k) contribution rates than those subject to immediate contributions only. Employees subject to immediate contributions had only slightly higher participation rates compared with those not subject to either plan change. The quality of causal evidence presented in this report is low. This means we are not confident that the estimated effects are attributable to the company’s changes to its 401(k) plan design. Other factors are likely to have contributed.","Allowing Immediate 401(k) Contributions and Automatic Enrollment","Employer provided retirement benefits",Employed,"Large business","United States",2001, "The labor market impact of state-level anti-discrimination laws","Collins, W. (2001). The labor market impact of state-level anti-discrimination laws. National Bureau of Economic Research working paper no. 8310. Cambridge, MA: NBER.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Mixed impacts Employment","Summary: This study’s objective was to assess the impact of state-level fair employment legislation, enacted in the 1940s through the 1960s, on labor market outcomes including income, unemployment, and labor force participation, by gender and race. The study used a nonexperimental design, drawing on data from the 1940, 1950, and 1960 decennial U.S. Censuses for 19 non-southern states. The study found that state-level fair employment laws adopted in the 1940s had larger positive effects on the relative income of African American workers than those adopted in the 1950s. In contrast, laws adopted in the 1950s led to larger increases in African American male unemployment but larger increases in African American women’s labor force participation. Only states that implemented the laws in the 1940s experienced a narrowed income gap between white and African American workers. The quality of causal evidence presented in this report is low because the author did not demonstrate that the states that adopted fair employment legislation when they did were comparable to those that did not adopt or adopted at a later time. This means we are not confident that the estimated effects are attributable to state-level fair employment legislation. Other factors are likely to have contributed.","State-level Fair Employment Legislation","Affirmative action","Black or African American, Female, Male",,"United States",2001,http://www.nber.org/papers/w8310.pdf "Consequences of employment protection? The case of the Americans with Disabilities Act.","Acemoglu, D., & Angrist, J. (2001). Consequences of employment protection? The case of the Americans with Disabilities Act. Journal of Political Economy, 109(5), 915-957.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-Unfavorable impacts Employment","Summary: The study’s objective was to examine the consequences of the Americans with Disabilities Act (ADA) on the employment and wages of people with disabilities. The main analysis estimated regression models of weeks worked and weekly earnings as a function of self-reported work disability status, allowing effects to differ each year and controlling for factors relating to demographics, region, and time. Data came from the 1988–1997 March Current Population Survey. The study found that a year after the ADA came into effect (1993), the employment of men and women ages 21 to 39 with disabilities declined and this change could not be explained by potential changes in how individuals reported disability status or by increases in Supplemental Security Income (SSI) or Old-Age, Survivors, and Disability Income (OASDI). The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the ADA, but other factors might also have contributed.","the Americans with Disabilities Act of 1990","Americans with Disabilities Act (ADA)",Disability,,"United States",2001, "Career Academies: Impacts on students’ engagement and performance in high school","Kemple, J., & Snipes, J. (2000). Career Academies: Impacts on students’ engagement and performance in high school. New York: MDRC.","Career Academies","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-No impacts Employment","Summary: The report’s objective was to evaluate the impact of Career Academies on students’ engagement and performance in high school three to four years after enrollment in a Career Academy. Later reports present impacts on transitions to post-secondary education measured 14 months after scheduled graduation and employment and earnings four and eight years after scheduled graduation. For this evaluation, about 2,000 9th-grade students who applied to participate in a Career Academy were randomly assigned to the treatment group and admitted into a Career Academy, or the control group, which continued to participate in general education. Data sources for this report include school transcript records, student surveys, and standardized math and reading tests. This study reported a statistically significant, positive impact on the number of vocational classes taken and credits completed to graduate, but no impacts on standardized test scores, dropout rates, or the proportion of students who applied to college or for a job. The quality of the causal evidence presented in this report is high because it was a well-implemented randomized controlled trial. This means we are confident that the estimated impacts are attributable solely to Career Academies, not other factors.","Career Academies","Youth programs Community college education and other classroom training Work based and other occupational training",Youth,,"Urban, United States",2000,http://www.mdrc.org/sites/default/files/full_45.pdf "Assisting Unemployment Insurance claimants: The long-term impacts of the Job Search Assistance Demonstration","Decker, P., Olsen, R., & Freeman, L. (2000). Assisting Unemployment Insurance claimants: The long-term impacts of the Job Search Assistance Demonstration. Princeton, NJ: Mathematica Policy Research.","Job Search Assistance, Reemployment","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Job Search Assistance Demonstration in Washington, D.C., and Florida on Unemployment Insurance (UI) benefits receipt, earnings, and employment. In this demonstration, about 20,000 UI claimants were randomized into one of three intervention groups, all of which received some variation of job search assistance services, or into a control group, which could receive existing services in the community. For all participants, the study team collected administrative data, which provided information on UI receipt, earnings, and employment. The study found that structured job search assistance was generally successful at reducing UI benefits receipt and increasing earnings in Washington, D.C., but not in Florida. The findings for individualized job search assistance treatment groups were less robust. The quality of causal evidence presented in this report is high because it is based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the job search assistance strategies tested, and not to other factors.","JSA services","Job search assistance and supportive services Other training and education","Dislocated or displaced worker, Unemployed",,"United States",2000, "Evaluation of the Center for Employment Training replication sites: Interim report.","Walsh, S., Goldsmith, D., Abe, Y., & Cann, A. (2000). Evaluation of the Center for Employment Training replication sites: Interim report. Oakland, CA: Berkeley Policy Associates.","Opportunities for Youth","Study Type: Implementation Analysis",,,"Summary: This report presents an implementation analysis of 12 Center for Employment Training (CET) replication sites. The Center for Employment Training (CET) model targets economically disadvantaged youth who are not in school or employed. It delivers training in a work-like environment, requires full-time participation, and involves local employers in program design and delivery. The analysis assessed the fidelity of implementation to the CET model using qualitative data collected during site visits to 12 sites and preliminary administrative data from 8 sites. The study found that all the replication sites were generally successful in structuring services to mirror the workplace. Sites operated by CET (8 of 12) had overall higher fidelity to the model than non-CET-operated sites. Additionally, the study suggested that organizational capacity and stability are critical to replication; the 7 replication sites led by less-experienced organizations were prone to upheavals, and 4 closed during the course of the evaluation.","the Center for Employment Training (CET) Replication","Basic skills Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",2000, "Retention in the United States Job Corps: Analysis and recommendations.","Ginsburg, K. R., Forke, C.M., Kinsman, S.B., Fleegler, E., Grimes, E.K., et al. (2000). Retention in the United States Job Corps: Analysis and recommendations. Philadelphia, PA: The Children’s Hospital of Philadelphia.","Opportunities for Youth","Study Type: Descriptive Analysis",,,"Summary: The study’s objective was to collect information to help Job Corps program and policy staff improve participant retention in the program. Job Corps offers intensive academic classroom instruction and vocational skills training, along with support services, to economically disadvantaged youth. The authors used information from the Job Corps database on the demographic and other characteristics of participants who dropped out to study the timing of and reasons for withdrawal from the program. They administered a survey to the centers with the highest and lowest retention rates, and they conducted focus groups, interviews with program staff and participants, and observations of service delivery at five Job Corps sites. The authors’ analysis of characteristics and survey responses found that students with certain characteristics—for example, older students, those who entered the program with more advanced educational attainment, and those who interacted more closely with admissions counselors at Job Corps centers—were more likely to remain in the program. However, the authors noted that these were not highly reliable predictors of whether a student would remain in the program, suggesting unobserved factors played a role as well. The qualitative analysis of focus groups, interviews, and observations indicated that the students’ motivation, emotional maturity, and interpersonal skills and the strength of the relationships between participants and staff were important determinants of retention. Based on these findings, the authors recommended launching a staff training initiative to ensure staff were prepared to communicate effectively with students, challenge them, and build their sense of connectedness with one another and the program.","Job Corps","Job search assistance and supportive services Youth programs Other training and education Work based and other occupational training","Youth, Low-skilled, Low income",,"United States",2000,http://wdr.doleta.gov/research/FullText_Documents/00-jobcorps.pdf "National Job Corps Study: Job Corps applicants’ programmatic experiences","Johnson, T., Gritz, M., & Dugan, M. (2000). National Job Corps Study: Job Corps applicants’ programmatic experiences. Seattle, WA: Battelle Memorial Institute.","Opportunities for Youth","Study Type: Descriptive Analysis",,,"Summary: This report built on the process and descriptive analyses of the National Job Corps Study to understand which Job Corps program features led to positive results for applicants and participants. Job Corps offers intensive academic classroom instruction and vocational skills training to economically disadvantaged youth. The authors investigated programs’ enrollment procedures, characteristics of the Job Corps centers, and program practices to identify those that seemed to be related to positive programmatic experiences for participants. The authors used data from the program’s management information system, the Bureau of Labor Statistics, and surveys of program staff. The study found that students who had admissions counselors who put the onus on them to complete the admissions process, attended smaller centers in rural areas, and had access to high quality vocational training and academic instruction were more likely to have positive programmatic outcomes than those that did not. The extent to which staff and student populations had a similar racial make-up and gender composition, and the types and variety of vocational training offered, did not appear to influence programmatic outcomes.","Job Corps","Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",2000,http://wdr.doleta.gov/research/FullText_Documents/00-jc_programmatic.pdf "Measuring the effect of public labor exchange (PLX) referrals and placements in Washington and Oregon","Jacobson, L., & Petta, I. (2000). Measuring the effect of public labor exchange (PLX) referrals and placements in Washington and Oregon (Workforce Security Research Publications 2000–06). Washington, DC: U.S. Department of Labor.",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Public benefits receipt-Low-Mixed impacts Public benefit receipt","Summary: The study examined the impact of receiving public labor exchange (PLX) job referrals and placements on the duration of Unemployment Insurance (UI) benefit receipt for UI recipients in Oregon and Washington. The authors used statistical models to compare two distinct treatment groups to a comparison group within each state. The treatment groups both received PLX job search assistance, a job referral, and a job offer; one group did not actually work at the position offered while the other did. The comparison group received job search assistance but not PLX job referrals or placements. The authors used data from the Oregon Employment Department and the Washington State Employment Security Department. The study found that individuals in the treatment group tended to receive UI benefits for fewer weeks than individuals in the comparison group; this was a statistically significant difference. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups compared were similar before the intervention. This means we are not confident that the estimated relationships are attributable to PLX job referrals or placements; other factors are likely to have contributed.",Other,"RESEA Job search assistance and supportive services Labor Exchange Wagner-Peyser Act",Unemployed,,"United States",2000,https://wdr.doleta.gov/owsdrr/00-6/00-6.pdf "Case management for dually diagnosed individuals involved in the criminal justice system","Godley, S. H., Finch, M., Dougan, L., McDonnell, M., McDermeit, M., & Carey, A. (2000). Case management for dually diagnosed individuals involved in the criminal justice system. Journal of Substance Abuse Treatment, 18(2), 137–148.",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Unfavorable impacts Education and skills gains Employment-Low-Unfavorable impacts Employment Public benefits receipt-Low-Unfavorable impacts Public benefit receipt","Summary: The study’s objective was to examine the relationship between the Treatment Alternatives for Safe Communities/Mental Illness Substance Abuse (TASC/MISA) program and a range of outcomes, including education and training, employment, public benefit receipt, and recidivism outcomes. The authors used a nonexperimental interrupted time series (ITS) study design to compare the outcomes of people with prior justice-system contact and mental health and substance abuse issues, before and after participating in the TASC/MISA program. Using survey data, the authors looked at the change in participants’ Addiction Severity Index (ASI) scores, incarceration, and other outcomes between baseline and six months following program intake. The study found that program participation was associated with less favorable employment and education outcomes but favorable recidivism outcomes. Associations between participation and public benefit receipt outcomes were mixed. The quality of causal evidence presented in this report is low. This means we are not confident that the estimated effects on education and training, employment, public benefit receipt, and recidivism outcomes are attributable to the program; other factors are likely to have contributed.","the Treatment Alternatives for Safe Communities/Mental Illness Substance Abuse (TASC/MISA) program","Substance abuse recovery Reentry","Justice-involved, Other barriers",,"United States",2000,https://doi.org/10.1016/S0740-5472(99)00027-6 "Follow-up on North Carolina community college cooperative education graduates: Additional education and salary gains","Johnson, L. R. (2000). Follow-up on North Carolina community college cooperative education graduates: Additional education and salary gains (Unpublished doctoral dissertation.). North Carolina State University.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Education and skills gains-Low-No impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study's objective was to examine the impact of cooperative education on education, earnings, and employment outcomes. The study used a nonexperimental design to compare the outcomes of graduates of a cooperative education program, graduates who did not participate in a cooperative education program that was offered at their college, and graduates who attended a school in which cooperative education was not offered. Using survey data, the author conducted statistical tests to examine the differences between the three groups 10 years after they graduated. The study found no statistically significant relationship between graduating from a cooperative education program and pursuing additional education, employment status, or earning a higher salary. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to cooperative education; other factors are likely to have contributed.","Cooperative Education","Employment and Training Services Training and Education Community college education and other classroom training","Adult, Low-skilled",,"United States",2000,https://archive.org/details/ERIC_ED458904 "High School Career Academies: A Pathway to Educational Reform in Urban School Districts?","Maxwell, N., & Rubin, V. (2000). High School Career Academies: A Pathway to Educational Reform in Urban School Districts? Kalamazoo, MI: W. E. Upjohn Institute for Employment Research.","Career Academies","Study Type: Implementation Analysis",,,"Summary: The study examined an urban school district's attempt to develop and implement a uniform education-centric Career Academy model between 1990 and 1997. The study also included an impact evaluation of student outcomes (see CLEAR’s profile of Maxwell [2001] for impact evaluation results). The Career Academy model created a school-within-a-school structure, with both school-based and work-based elements, for students who were in grades 10 through 12. The program sought to increase students’ knowledge and skill acquisition in high school, continuation rates onto higher education, employment rates and wages, and capacity for lifelong learning. The study drew on qualitative data from the program’s annual evaluations of district and program performance and on student characteristics, program participation, and outcomes. The qualitative study found that although the program succeeded in articulating a uniform model of school-to-work program throughout the district, schools and academies differed in their development and implementation of this model. These differences were due to the political, community, and funding environments of these organizations.",,,,,,2000,http://www.ncspe.org/publications_files/Rev5.pdf "The unintended consequences of the Americans with Disabilities Act","DeLeire, T. (2000). The unintended consequences of the Americans with Disabilities Act. Regulation 23(1), 21–24.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Unfavorable impacts Employment","Summary: The study’s objective was to examine the effect of the Americans with Disabilities Act (ADA) on the employment rate for men with disabilities. Using data from the Survey of Income and Program Participation from 1985 to 1995, the author compared the change in employment for men with disabilities ages 18 to 65 pre- and post-ADA with the change in employment for men without disabilities over the same period. The study found that the employment rate for men with disabilities was 8 percentage points lower relative to men without disabilities after ADA, with particularly large differences for those with mental disabilities or low education levels. The quality of causal evidence provided in this study is low. This means that we are not confident that the estimated effects are attributable to the ADA; other factors are likely to have contributed.","the Americans with Disabilities Act of 1990","Americans with Disabilities Act (ADA)","Disability, Male",,"United States",2000, "Using establishment size to measure the impact of Title VII and affirmative action","Carrington, W.J., McCue, K., & Pierce, B. (2000). Using establishment size to measure the impact of Title VII and affirmative action. Journal of Human Resources, 35(3): 503-523.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-No impacts Employment","Summary: This study’s objective was to assess the impact of the Civil Rights Act of 1964 (the Civil Rights Act) and subsequent affirmative action executive orders on the employment share of African American employees at larger employers (which were subject to those laws) and the African American–white wage gap. The authors examined trends in the annual employment shares of African American men, African American women, white men, and white women at employers in different size classes. They also assessed the contributions of individual- and firm-level factors to the gaps in wages earned by African American and white workers over time. Analyses used March Current Population Survey Annual Demographic Survey (1964–1988) linked with County Business Pattern data. The authors estimated that the Civil Rights Act and affirmative action increased the share of African American men and women employed by large firms. In addition, the authors found that a substantial proportion of African American–white wage convergence during the study period was attributable to African American employees’ growing employment share at large firms. The quality of causal evidence presented in this report is low. This means that we are not confident that the observed changes in employment are attributable to the Civil Rights Act and affirmative action; other factors are likely to have contributed.","the Civil Rights Act of 1964 and Affirmative Action Executive Orders","Affirmative action Civil Rights Act of 1964 Executive Order 11246 (E.O. 11246)","Black or African American",,"United States",2000, "Changes in wage discrimination against people with disabilities.","DeLeire, T. (2000). Changes in wage discrimination against people with disabilities: 1984–93. The Journal of Human Resources, 37(1), 144-158.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Unfavorable impacts Earnings and wages","Summary: The study’s objective was to estimate changes in wage discrimination against people with disabilities before and after the Americans with Disabilities Act of 1990 (ADA).  The author used data from the 1984, 1992, and 1993 panels of the Survey of Income and Program Participation to compare earnings for people who reported functional and work limitations, people who reported only functional limitations, and people who reported no limitations. The percentage of the gap between the first two groups that was not explained by control variables and self-reported health status was attributed to discrimination, and that percentage was compared between 1984 and 1993 to estimate the effect of the ADA. The study found earnings gaps between people with no disabilities and those with work limitations and/or functional limitations in each year, and the share of the gap explained by discrimination rose slightly after passage of the ADA. The quality of causal evidence provided in this study is low. This means that we are not confident that the estimated effects were attributable to the passage of the ADA; other factors are likely to have contributed.","the Americans with Disabilities Act of 1990","Americans with Disabilities Act (ADA)",Disability,,"United States",2000, "Cognitive rehabilitation for traumatic brain injury: A randomized trial","Salazar, A., Warden, D., Schwab, K., Spector, J., Braverman, S., Walter, J., . . . Ellenbogen, R. (2000). Cognitive rehabilitation for traumatic brain injury: A randomized trial. Journal of American Medical Association, 283(23), 3075-3081.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine the impact of in-hospital and home rehabilitation programs on the employment and health status of active duty military members with severe traumatic brain injuries (TBIs). The study was a randomized controlled trial conducted at the Walter Reed Army Medical Center, where 120 active duty military members with TBI were randomly assigned to receive either in-hospital rehabilitation or home rehabilitation. Researchers collected outcome data 8 weeks and 6, 12, and 24 months after randomization. Although the study authors originally hypothesized that in-hospital rehabilitation would increase the rates of patients who were able to return to work or able to return to active duty, the study found no statistically significant difference between the two groups on these outcomes. The quality of the causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any differences in outcomes would be attributable to the more effective program; however, there were no statistically significant differences between the programs.","the In-hospital and Home Rehabilitation Programs Studied","Vocational rehabilitation","Disability, Veteran or military",,"United States",2000, "A mixed-method approach to evaluating learning communities for underprepared community college students: The Integrated Studies Communities at Parkland College","Moore, L.H. (2000). A mixed-method approach to evaluating learning communities for underprepared community college students: The Integrated Studies Communities at Parkland College (Doctoral dissertation). Retrieved from ProQuest Dissertations and Theses database. (UMI No. 9971142)","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Integrated Studies Community (ISC) at Parkland College in Champaign, Illinois, on credit hours earned, course completion, and persistence during the 1998–1999 academic year. The study used a matched comparison group design to compare ISC participants with nonparticipants. Data sources included administrative data from Parkland College and interview and survey data. This study found that ISC students earned significantly more credit hours than comparison students. The quality of causal evidence presented in this report is low because the study did not include sufficient controls in the analysis. This means we are not confident that the estimated effects are attributable to the ISC. Other factors are likely to have contributed.","the Integrated Studies Community (ISC) at Parkland College","Basic skills Community college education and other classroom training","Adult, Other barriers",,"United States",2000,http://files.eric.ed.gov/fulltext/ED457936.pdf "College as a job advancement strategy: An early report of the New Visions Self-Sufficiency and Lifelong Learning Project","Fein, D., Beecroft, E., Long, D., & Catalfamo, A. (2000). College as a job advancement strategy: An early report of the New Visions Self-Sufficiency and Lifelong Learning Project. Bethesda, MD: Abt Associates Inc.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of a pilot for Riverside Community College’s New Visions Self-Sufficiency and Lifelong Learning Project on welfare recipients’ welfare receipt. The study was based on a randomized controlled trial and estimated the effect of offering welfare recipients the New Visions program compared with encouraging recipients to participate in other employment services. The authors used California Temporary Assistance for Needy Families (TANF) records to compare average outcomes among those offered access to the program against the average outcomes of those excluded, after adjusting for differences in demographic and pre-intervention characteristics between the groups. The authors did not find any statistically significant effect of the New Visions program on the likelihood of receiving TANF or the amount of TANF benefits received. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the New Visions Project, and not to other factors.","the New Visions Self-Sufficiency and Lifelong Learning Project","Community college education and other classroom training Other employment and reemployment","Low income, Parent",,"United States",2000,http://files.eric.ed.gov/fulltext/ED466834.pdf "Antidiscrimination measures of the 1960s and occupational mobility: Evidence for black American men","Fosu, A. (2000). Antidiscrimination measures of the 1960s and occupational mobility: Evidence for black American men. Journal of Labor Research, 21(1), 169-180.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to assess the effect of the Civil Rights Act of 1964 on the occupational status of African American men in the United States. Using labor force statistics derived from the Current Population Survey and other sources, the author used an interrupted time series design to estimate the occupational status of black men relative to white men from 1958 to 1981, specifically focusing on differences after the Civil Rights Act of 1964. The study found a positive trend in the occupational status of African American men relative to white men over the entire 1958–1981 period and a larger positive trend for years after 1964. The author estimated that about half of the rise in relative earnings for African American men from 1964 to 1981 could be attributed to increased occupational status. The quality of causal evidence provided in this study is low because the author examined only one demonstration of the intervention. This means that we are not confident that the estimated effects are attributable to the passage of the Civil Rights Act of 1964. Other factors are likely to have contributed.","the Civil Rights Act of 1964","Civil Rights Act of 1964","Black or African American",,"United States",2000, "Two years after a job loss: Long-term impact of the JOBS Program on reemployment and mental health","Vinokur, A., Schul, Y., Vuori, J., & Price, R. (2000). Two years after a job loss: Long-term impact of the JOBS Program on reemployment and mental health. Journal of Occupational Health Psychology, 5(1), 32-47.",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the JOBS II program on long-term employment, earnings, and monthly hours worked. The authors randomly assigned eligible unemployed individuals to either a treatment group, which could participate in JOBS II, or the control group, which could receive other services in the community, but not JOBS II. The study included a pre-test two weeks before the intervention and follow-up questionnaires 2, 6, and 24 months after the intervention. The authors found that JOBS II was associated with positive effects on the treatment group’s rate of reemployment and monthly earnings as measured two years after assignment, compared with the control group. The quality of causal evidence presented in this report is low because the study was a randomized controlled trial with unknown attrition and lack of sufficient controls in the analysis. This means we are not confident that the estimated effects are attributable to the JOBS II program; other factors are likely to have contributed.","the JOBS II Program","Job search assistance and supportive services","Dislocated or displaced worker, Unemployed",,"United States",2000, "Final report on the implementation and impacts of the Minnesota Family Investment Program in Ramsey County. [MFIP-R versus AFDC, single parents in the early cohort]","Auspos, P., Miller, C., & Hunter, J. A. (2000). Final report on the implementation and impacts of the Minnesota Family Investment Program in Ramsey County. Washington, DC: U.S. Department of Health and Human Services, Administration for Children and Families, Office of Planning, Research and Evaluation. [MFIP-R versus AFDC, single parents in the early cohort]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: The study’s objective was to examine the impact of the Minnesota Family Investment Program of Ramsey County (MFIP-R), a precursor to the national Temporary Assistance for Needy Families program, on participants’ employment, earnings, and benefit receipt. The authors used a randomized controlled trial design, assigning eligible families to either MFIP-R or existing services. Employment, earnings, and benefit receipt data were collected quarterly from Minnesota’s Unemployment Insurance earnings and public assistance benefit records. This review was conducted in collaboration with the Employment Strategies for Low-Income Adults Evidence Review (ESER). Because ESER did not report findings for studies that received a low causal evidence rating, this CLEAR profile does not report the findings either. The quality of causal evidence presented in this report is low because assignment to condition was not fully random, and the authors did not account for potential pre-existing differences in group characteristics in their analysis. This means we are not confident that the estimated effects are attributable to MFIP-R; other factors are likely to have contributed.","the Minnesota Family Investment Program of Ramsey County (MFIP-R)","Job search assistance and supportive services Other employment and reemployment","Low income, Parent",,"United States",2000,http://www.mdrc.org/sites/default/files/full_364.pdf "The effects of enrollment in the Transportation Career Academy Program on student outcomes","Hanser, L., & Stasz, C. (1999). The effects of enrollment in the Transportation Career Academy Program on student outcomes. Paper presented at the American Educational Research Association (Unpublished).","Career Academies","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to examine the effects of enrolling in a Transportation Career Academy Program (TCAP) on students’ academic outcomes. The authors used school district administrative records of students in the six high schools included in the evaluation in school year 1996–1997. TCAP students achieved higher grade point averages, earned more credits, and had higher attendance rates than students in general academic programs. Outcomes for TCAP students were not statistically significantly different, however, from those for magnet school students. The quality of causal evidence in this study is low because the authors did not adequately control for the academic achievement of students before they enrolled in TCAP. This means we are not confident that the results estimated in the study are attributable to TCAP; other factors are likely responsible.","Transportation Career Academy Program (TCAP)","Youth programs Community college education and other classroom training Work based and other occupational training","Youth, Other barriers",,"Urban, United States",1999, "Evaluation of Worker Profiling and Reemployment Services systems: Final Report.","Dickinson, K., Kreutzer, S., West, R., & Decker, P. (1999). Evaluation of Worker Profiling and Reemployment Services systems: Final report. Research and Evaluation Report Series 99-D. Washington, DC: U.S. Department of Labor, Employment, and Training Administration.",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study assessed the effectiveness of Worker Profiling and Reemployment Services (WPRS), a system for predicting which Unemployment Insurance (UI) recipients are at greatest risk of exhausting benefits and offering them early intervention services.  The study used a nonexperimental design to compare the UI benefit receipt, employment, and earnings outcomes of WPRS participants in six states to the outcomes of similar UI claimants who did not receive WPRS. The main data source was state UI administrative records for nearly 457,000 UI claimants. The study found that WPRS reduced UI benefit weeks and amounts in three of the states during the benefit year. However, there were few statistically significant impacts on employment rates or earnings in the four quarters after the initial claim, and some of the impacts were in an unexpected direction. The quality of causal evidence presented in this report is moderate, because it is a well-implemented nonexperimental study. This means we are somewhat confident that the estimated effects are attributable to WPRS, but other factors might also have contributed.",Profiling,"RESEA Job search assistance and supportive services Unemployment Insurance","Dislocated or displaced worker, Unemployed",,"United States",1999, "Career Academies: Building career awareness and work-based learning activities through employer partnerships","Kemple, J., Poglinco, S., & Snipes, J. (1999). Career Academies: Building career awareness and work-based learning activities through employer partnerships. New York: Manpower Demonstration Research Corporation.","Career Academies","Study Type: Descriptive Analysis",,,"Summary: This is the third report summarizing results from an evaluation of Career Academies, which are institutes within high schools that have a specific occupational focus and offer students the opportunity to both prepare for employment in that field and enroll in college preparatory courses. This report focused on the partnerships that Career Academies established with employers—analyzing successes and challenges in building these partnerships and the level of student participation in employer-supported activities. The authors visited 10 program sites, where they observed program activities and conducted interviews with Career Academy, high school and school district staff, representatives of employer partners, and participating students. They also administered a survey to 1,600 Academy and non-Academy students at those sites. The analysis of interview and survey data found that students at sites with a formalized structure for collaborating with employers, a coordinator for the employer partnerships who did not have teaching responsibilities, and structured orientations on experiential learning participated in a wider variety of career preparation activities than did students at sites without these features. Academy students had higher levels of participation in career-related activities than non-Academy students and were also more likely to be working in jobs related to their occupational studies in the Academy.","Career Academies",,,,,1999,http://www.mdrc.org/sites/default/files/full_46.pdf "National Job Corps Study: Report on study implementation.","Burghardt, J., McConnell, S., Meckstroth, A., Schochet, P., Johnson, T., & Homrighausen, J. (1999). National Job Corps Study: Report on study implementation. Princeton, NJ: Mathematica Policy Research.","Opportunities for Youth","Study Type: Implementation Analysis",,,"Summary: This report describes the implementation of and lessons learned from the National Job Corps Study, a random assignment impact evaluation of Job Corps. Job Corps provides comprehensive job training to disadvantaged youth in the areas of basic education, vocational skills training, health care and education, counseling, and residential support. The authors conducted a qualitative analysis of planning and process documents for the study, as well as accounts of study team members’ first-hand experiences. The authors described the study design, sampling procedures, how they monitored sample build-up and decided when to end random assignment, and how they monitored adherence to the study’s random assignment procedures. They noted three key factors important for successful implementation of a randomized study design in an ongoing program: (1) commitment of program managers to the goals of the study and its related tasks, (2) close collaboration between research and program staff, and (3) monitoring of study procedures to ensure integrity.","Job Corps","Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",1999,http://wdr.doleta.gov/research/FullText_Documents/99-jc_implement.pdf "National Job Corps Study: Report on the Process Analysis","Johnson, T., Gritz, M., Jackson, R., Burghardt, J., Boussy, C., Leonard, J., & Orians, C. (1999). National Job Corps Study: Report on the Process Analysis. Submitted to the U.S. Department of Labor, Employment and Training Administration, Office of Policy and Research. Seattle: Battelle Human Affairs Research.","Opportunities for Youth","Study Type: Implementation Analysis",,,"Summary: This report presents a process study of the national Job Corps program. Initiated in 1964, Job Corps provides comprehensive education and employment skills training to disadvantaged youth ages 16 to 24. The study drew on survey, administrative, and qualitative data to present students’ and Job Corps centers’ characteristics across the full population of participating students and centers in 1996; sampling for site visits excluded noncontiguous states. This study was part of the National Job Corps Study that also included an impact evaluation and a benefit-cost analysis. Job Corps united federal agencies, private contractors, and unions in implementing a training and support model for disadvantaged youth. Job Corps centers generally implemented core service components with consistency. Links between outreach and admissions counselors to Job Corps centers, and job placement services, proved challenging. Findings are generally applicable to program implementation nationally; however, the study did not measure outputs such as content or quality of services, participation, or dosage.","the Job Corps Program","Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",1999,http://wdr.doleta.gov/opr/FULLTEXT/99-jc_analysis.pdf "The employment and training outcomes of a job training partnership act program in a community college setting","Carter, D. L. (1999). The employment and training outcomes of a job training partnership act program in a community college setting (Unpublished doctoral dissertation). University of Florida.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages","Summary: The study's objective was to examine the impact of a Job Training Partnership Act (JTPA) funded vocational training program at a community college in North Florida on earnings outcomes. The author used an interrupted time series design to compare outcomes of participants before and after they participated in the JTPA program. Data for the study were compiled from the community college's existing JTPA records. The study found that participation in JTPA funded training was significantly related to higher post-training wages. The quality of causal evidence presented in this report is low because the author did not observe outcomes for multiple periods before or after the program nor account for selection into the intervention. This means we are not confident that the estimated effects are attributable to the JTPA funded vocational training program; other factors are likely to have contributed.","Job Training Partnership Act","Employment and Training Services Training and Education Basic skills Capacity building programs Community college education and other classroom training","Youth, Adult, Other barriers, Dislocated or displaced worker, Low income",,"Rural, United States",1999, "An evaluation of an urban community college Single Parent and Displaced Homemaker Program (Doctoral dissertation)","Rice, L. M. (1999). An evaluation of an urban community college Single Parent and Displaced Homemaker Program (Doctoral dissertation). Old Dominion University. DOI: 10.25777/tqh7-3c76","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study's objective was to examine the impact of the Single Parent and Displaced Homemaker Program on education outcomes by students at an urban community college. The study used a nonexperimental design to compare the outcomes of program participants to those on the waiting list. Using data from the community college’s Students Information System, the author conducted statistical tests to examine the differences between groups. The study found that participation in the Single Parent and Displaced Homemaker Program was significantly related to increased retention rates and number of credits taken. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Single Parent and Displaced Homemaker Program; other factors are likely to have contributed.","the Single Parent and Displaced Homemaker Program","Employment and Training Services Training and Education Capacity building programs Community college education and other classroom training Other training and education","Adult, Other barriers, Female, Parent",,"Urban, United States",1999,https://digitalcommons.odu.edu/urbanservices_education_etds/50/ "Impacts of the Project NetWork Demonstration: Final Report","Kornfeld R.., Wood M. L., Orr L. L., & Long D. A. (1999). Impacts of the Project NetWork Demonstration: Final Report. Cambridge, MA: Abt Associates, Inc.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Health and safety-Mod/high-No impacts Health and safety Public benefits receipt-Low-No impacts Public benefit receipt","Summary: This study’s objective was to report impacts for Project NetWork. Created by the Social Security Administration (SSA), Project NetWork tested specific approaches to improving employment among Social Security Disability Insurance (SSDI) recipients and Supplemental Security Income (SSI) applicants and recipients, with a particular focus on case and referral management systems.  The study used multiple data sources, including the Master Earnings File (MEF), Master Beneficiary Record (MBR), Supplemental Security Record (SSR), and survey data collected 25 to 36 months after enrollment. The study found that Project NetWork increased earnings one and two years after enrollment, but these effects did not persist in the third follow-up year. The program led to a slight increase in the average number of months employed, but no changes in participants’ Social Security disability benefit receipt, health, or well-being. The quality of causal evidence presented in this study is considered high for the annual earnings, proportion of months receiving SSI/SSDI benefits, and average monthly SSI/SSDI benefits outcomes measured through administrative data because they are based on a well-implemented randomized controlled trial with low attrition. However, the quality of causal evidence is moderate for annual earnings, hours and months worked, and mental and physical health outcomes due to high attrition for these domains.","Project NetWork","Health Disability insurance Supplemental security income (SSI) Vocational rehabilitation Health Disability insurance Supplemental security income (SSI) Vocational rehabilitation",Disability,,"United States",1999,http://www.abtassociates.com/reports/19994080203411.pdf "New Hope for people with low incomes: Two-year results of a program to reduce poverty and reform welfare","Bos, J., Huston, A., Granger, R., Duncan, G., Brock, T., & McLoyd, V. (1999). New Hope for people with low incomes: Two-year results of a program to reduce poverty and reform welfare. New York: MDRC.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the New Hope program on employment, earnings, public benefits receipt, and educational attainment. The authors estimated the impact of the New Hope program by comparing average outcomes among a treatment group randomly selected to have access to the program with those of a randomly selected control group that did not have access to the program. The study found that receiving access to New Hope services increased average earnings in the first year of the program by $583 and the average likelihood of ever being employed in the first and second year of the program by 7.8 percentage points and 5.5 percentage points, respectively. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the New Hope program, and not to other factors.","The New Hope Program","Other employment and reemployment Other training and education","Low income, Parent",,"United States",1999,http://files.eric.ed.gov/fulltext/ED433455.pdf "Matching the disadvantaged to job opportunities: Structural explanations for the past successes of the Center for Employment Training.","Melendez, E., & Harrison, B. (1998). Matching the disadvantaged to job opportunities: Structural explanations for the past successes of the Center for Employment Training. Economic Development Quarterly, 12(1), 3-11.","Opportunities for Youth","Study Type: Descriptive Analysis",,,"Summary: The authors’ objective was to propose a plausible explanation for the Center for Employment Training-San Jose’s (CET) success in placing disadvantaged people into jobs. CET is a national program that provides job training for disadvantaged people and matches them with entry-level jobs. The San Jose site, the focus of this article, served a mostly Hispanic population, consisting of dislocated farm workers, mothers on public assistance, out-of-school youth, and ex-offenders. The authors reviewed findings from a recent case study on CET-San Jose and posited explanations for the program’s success. They attributed the success of the program to its ability to develop in its participants the skills necessary in the local labor market and become part of employers’ trusted recruiting networks. They also noted that CET-San Jose is embedded in a powerful social movement (West Coast Hispanic politics and culture).","the Center for Employment Training (CET) Replication","Basic skills Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs","Youth, Hispanic of any race, Low-skilled, Low income",,"United States",1998, "National Job Corps Study: Characteristics of youths served by Job Corps.","Schochet, P. (1998). National Job Corps Study: Characteristics of youths served by Job Corps. Princeton, NJ: Mathematica Policy Research.","Opportunities for Youth","Study Type: Descriptive Analysis",,,"Summary: One of a series of reports emanating from the National Job Corps Study, a random assignment evaluation of the Job Corps program, this report describes the characteristics of eligible Job Corps applicants and compares them with the broader national population of disadvantaged youth. The Job Corps program offers intensive academic classroom instruction and vocational skills training, along with support services, to economically disadvantaged youth. The authors examined data collected as part of the National Job Corps Study on the characteristics of eligible youth. The study collected data through an interview at the time of random assignment and through surveys administered 12, 30 and 48 months after it. The findings in this report are based on the data collected through baseline interviews. The authors reported that, as intended, Job Corps served disadvantaged youth, most of whom had not completed high school (about 80 percent). Eligible applicants tended to be male (about 60 percent) and members of racial or ethnic minority groups (about 70 percent; 50 percent African American). More than a quarter of applicants had been arrested before applying to Job Corps. Female applicants tended to be older, more likely to have children and to have completed high school, and less likely to admit drug use or arrests than male applicants. Compared with the broader national population of disadvantaged youth, eligible Job Corps applicants were more likely to be 16- or 17-year-old African American males from large urban areas who were high school dropouts.","Job Corps","Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",1998,http://wdr.doleta.gov/opr/fulltext/99-jc_characteristics.pdf "Two essays on unemployment insurance: Claimant responses to policy changes [Contrast 1: Comparison between claimants who applied for UI benefits after WPRS only]","Noel, B. J. (1998). Two essays on unemployment insurance: Claimant responses to policy changes (Doctoral dissertation). Retrieved from UMI (UMI No. 9922624). [Comparison between claimants who applied for UI benefits after WPRS only]",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of reemployment services through the Worker Profiling and Reemployment System (WPRS) on unemployment insurance (UI) benefit receipt and earnings for individuals who applied for UI in Kentucky. The authors investigated a similar research questions in another contrast, the profiles of which can be found here. The author compared outcomes for treatment group members, who were eligible to receive reemployment services, and comparison group members, who were not eligible to receive the reemployment services but could access other services in the community, using data from the Kentucky Department of Employment Services Unemployment Insurance administrative records. The study found statistically significant relationships between reemployment services and UI benefit receipt, where those who were offered the reemployment services received less UI benefits in 26 weeks, compared to those who did not receive reemployment services. There were no statistically significant relationships between reemployment services and earnings. The quality of causal evidence presented in this report is low because the author did not ensure that the groups compared were similar before the intervention. This means we are not confident that the estimated relationships are attributable to the WPRS reemployment services; other factors are likely to have contributed.",Profiling,"RESEA Job search assistance and supportive services Unemployment Insurance","Dislocated or displaced worker, Unemployed",,"United States",1998, "Two essays on unemployment insurance: Claimant responses to policy changes. [Comparison between claimants who applied for UI benefits before and after WPRS]","Noel, B. J. (1998). Two essays on unemployment insurance: Claimant responses to policy changes (Doctoral dissertation). Retrieved from UMI (UMI No. 9922624). [Comparison between claimants who applied for UI benefits before and after WPRS]",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of reemployment services through the Worker Profiling and Reemployment System (WPRS) on unemployment insurance (UI) benefit receipt and earnings for individuals who applied for UI in Kentucky. The authors investigated similar research questions for another contrast, the profile of which can be found here. The author compared outcomes for treatment group members, who were eligible to receive reemployment services, and comparison group members, who were not eligible to receive the reemployment services but could access other services in the community, using data from the Kentucky Department of Employment Services Unemployment Insurance administrative records. The study found statistically significant relationships between the WPRS reemployment services and UI benefit receipt and earnings, where those offered the reemployment services received fewer UI benefits in 26 weeks and earned more in one year, compared to those who did were not eligible to receive reemployment services. The quality of causal evidence presented in this report is low because the author did not account for trends in outcomes before the intervention. This means we are not confident that the estimated relationships are attributable to the WPRS reemployment services; other factors are likely to have contributed.  ",Profiling,"RESEA Job search assistance and supportive services Unemployment Insurance","Dislocated or displaced worker, Unemployed",,"United States",1998, "The impact of federal civil rights policy on black economic progress: Evidence from the Equal Employment Opportunity Act of 1972","Chay, K. (1998). The impact of federal civil rights policy on black economic progress: Evidence from the Equal Employment Opportunity Act of 1972. Industrial and Labor Relations Review, 51(4), 608-632.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the 1972 Equal Employment Opportunity Act (EEOA) on employment, earnings, and occupational outcomes of African American men. The study used a non-experimental design that used regression analysis for impact evaluation. The author used data from the 1968–1980 Current Population Survey (CPS). This study found that the 1972 EEOA had positive impacts on the employment, earnings, and occupational status of African American men in the South in industries with more than 50 percent of workers employed in small establishments covered by the law. The quality of causal evidence presented in this study is moderate because it was based on a strong non-experimental design. This means we are somewhat confident that the estimated effects are attributable to the 1972 EEOA, but other factors might also have contributed.","the 1972 Equal Employment Opportunity Act","Civil Rights Act of 1964 Equal Employment Opportunity Act of 1972","Male, Black or African American","Small business","United States",1998, "Addressing literacy needs at work: Implementation and impact of workplace literacy programs","Moore, M., Myers, D., & Silva, T. (1998). Addressing literacy needs at work: Implementation and impact of workplace literacy programs. Washington, DC: Mathematica Policy Research, Inc.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Mod/high-No impacts Education and skills gains Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine the impact of workplace literacy programs on workers’ literacy and career and educational attainment. The authors randomly assigned workers in three sites to either the treatment group, which could participate in the workplace literacy program, or the control group, which was barred from participating in the program for a period of time. The authors estimated impacts of the program by comparing outcomes of the two groups, controlling for the probability of their participation. The study did not find any statistically significant effects of the workplace literacy programs on GED attainment, employment, average weekly earnings, or standardized literacy assessments. The quality of causal evidence presented in this report is high for most outcomes because it was based on a well-implemented randomized controlled trial. This means we have confidence that any estimated effects would be attributable to the workplace literacy programs studied and not to other factors; however, the study found no statistically significant effects.","the Workplace Literacy Programs Studied","Other employment and reemployment Other training and education","Other barriers",,"United States",1998,http://www.mathematica-mpr.com/~/media/publications/PDFs/education/workplace_li… "The effect of workplace education on earnings, turnover, and job performance","Krueger, A., & Rouse, C. (1998). The effect of workplace education on earnings, turnover, and job performance. Journal of Labor Economics, 16(1), 61-94.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages","Summary: The study’s objective was to examine the impact of employer-based workplace education on wage growth at two mid-sized companies in New Jersey, one in the manufacturing sector and the other in the service sector. In this nonexperimental study, the authors used employee survey data and administrative records from the participating companies and the community college that provided the training to compare the wage growth of workers who participated in training with the wage growth of workers who did not participate. The study found that employees in the manufacturing company who participated in training had higher wage growth than those who did not participate. The quality of causal evidence presented in this report is low because the authors did not account for potential pre-program differences in earnings between groups in the analysis. This means we are not confident that the estimated effects are attributable to the employer-based workplace education program. Other factors are likely to have contributed.","Employer-Based Workplace Education","Community college education and other classroom training Other training and education",Low-skilled,,"United States",1998, "The relative impact of a Career Academy on post-secondary work and education skills in urban, public high schools.","Maxwell, N., & Rubin, V. (1997). The relative impact of a Career Academy on post-secondary work and education skills in urban, public high schools. Hayward, CA: The Human Investment Research and Education Center discussion paper.","Career Academies","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Favorable impacts Employment","Summary: The study aimed to examine the academic and labor market outcomes of students who were enrolled in a Career Academy track in a large, West Coast, urban high school district, compared with peers enrolled in general, vocational, and academic track programs. The analysis is based on a 1996 survey of students who were high school sophomores in 1990 to 1993. Career Academy graduates reported higher graduation rates (8.7 percentage points) and higher rates of enrollment in a two- or four-year college (11.6 and 17.9 percentage points, respectively) than students in the general education track. The quality of causal evidence presented in this study is low because the authors did not adequately control for the academic achievement of students before they enrolled in a Career Academy. This means we are not confident that the results estimated in the study are attributable to Career Academies; other factors are likely responsible.","Career Academies","Youth programs Community college education and other classroom training Work based and other occupational training",Youth,,"Urban, United States",1997, "Evaluation of the Maryland Unemployment Insurance Work Search Demonstration","Benus, J., Johnson, T., Klepinger, D., & Joesch, J. (1997). Evaluation of the Maryland Unemployment Insurance Work Search Demonstration. Prepared for the Maryland Department of Labor, Licensing and Regulation, 1-43. Baltimore, MD: Maryland Department of Labor.",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study assessed the effectiveness of four interventions designed to encourage rapid reemployment among Unemployment Insurance (UI) recipients. The study was a randomized controlled trial with more than 27,000 participants. Participants were randomly assigned to one of four treatment groups, each of which had different work search requirements, or to a control group that abided by existing requirements for receipt of UI benefits. The study used state UI administrative records to estimate impacts on employment, earnings, and UI benefit receipt. The authors found that the three treatments that imposed stricter work search requirements than those imposed on the control group reduced the amount of benefits received by $75 to $116 and duration of benefit receipt by 0.6 to 0.9 weeks, on average. There were no statistically significant differences between treatment and control groups on employment or earnings. The quality of causal evidence presented in this report is high because it was a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the work search treatments, and not to other factors.","the Maryland Unemployment Insurance Work Search Demonstration","Job search assistance and supportive services Other employment and reemployment","Dislocated or displaced worker, Unemployed",,"United States",1997,http://wdr.doleta.gov/owsdrr/98-2/98-2.pdf "Helping at-risk youth: Lessons from community-based initiatives.","Morley, E., & Rossman, S. (1997). Helping at-risk youth: Lessons from community-based initiatives. Washington, DC: The Urban Institute.","Opportunities for Youth","Study Type: Descriptive Analysis",,,"Summary: The report sought to provide guidance on best practices for operating programs for at-risk youth. The authors based their conclusions on best practices from evaluations they conducted of three comprehensive, integrated programs for at-risk youth: Communities in Schools, SafeFutures, and Children at Risk. Each of these programs was designed to coordinate services across community agencies in order to prevent and mitigate risky behaviors among at-risk youth. The authors provided suggested practices in six key areas: services integration, case management, parental involvement, volunteer tutors and mentors, fund-raising and marketing, and monitoring of program outcomes to improve accountability.","Communities in Schools (CIS) and SafeFutures","Mentoring Other training and education Youth programs",Youth,,"United States",1997, "Job Training Partnership Act: Long-term earnings and employment outcomes (GAO/HEHS-96-40).","United States General Accounting Office. (1996). Job Training Partnership Act: Long-term earnings and employment outcomes (GAO/HEHS-96-40). Washington, DC: U.S. Government Printing Office.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to estimate the impact of Job Training Partnership Act (JTPA) programs on the long-term earnings and employment of male and female out-of-school youth and adults. This review focuses on the findings for out-of-school youth. The programs’ effectiveness was evaluated by analyzing outcomes five years after program entry for a subset of participants in the National JTPA Study, a random assignment study that examined impacts of JTPA programs in 16 local service-delivery areas. The authors found no statistically significant impacts of JTPA on earnings or employment rates five years after program entry. The quality of the causal evidence presented in this study is high because it is a well-executed randomized controlled trial. This means we have confidence that estimated effects would be attributable to JTPA programs, and not other factors.","Job Training Partnership Act","Basic skills Community college education and other classroom training Job search assistance and supportive services Work based and other occupational training Youth programs",Youth,,"United States",1997,http://www.gao.gov/assets/230/222393.pdf "Youth Corps: Promising strategies for young people and their communities","Jastrzab, J., Blomquist, J., Masker, J., & Orr, L. (1997). Youth Corps: Promising strategies for young people and their communities. Cambridge, MA: Abt Associates Inc.","Opportunities for Youth","Study Type: Descriptive Analysis",,,"Summary: This report provides a high-level summary of a study on Youth Corps programs, which have engaged disadvantaged youth in community service projects since 1933. An in-depth impact analysis is contained in Jastrzab et al. 1996. The study’s objective was to gain insight into participants’ contributions and experiences; analyze program impacts on educational, employment, and behavioral outcomes; and assess the costs and benefits of the programs. The authors analyzed data on initiatives sponsored by the Commission on National and Community Service in 1993 and 1994, and during that time also collected data directly from Youth Corps programs for the impact analysis and cost-benefit assessment. In addition, the authors talked with several program staff and participants. The study found that although program completion rates were low, most participants felt the program was helpful and sponsors and beneficiaries were generally satisfied with youths’ performance. The program had a significant impact on the employment and earnings of corps members. The analysis of program costs and benefits showed aggregate benefits to society.","Youth Corps Programs","Mentoring Youth programs","Youth, Disconnected youth, Low-skilled, Low income",,"United States",1997,http://www.abtassociates.com/reports/Youth-Corps.pdf "The benefits and costs of JTPA Title II-A programs: Key findings from the National Job Training Partnership Act Study","Bloom, Howard S. et. al. (1997). The benefits and costs of JTPA Title II-A programs: Key findings from the National Job Training Partnership Act Study. The Journal of Human Resources, 32(3), 549-546.1","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Mixed impacts Earnings and wages Education and skills gains-Mod/high-Mixed impacts Education and skills gains","Summary: The study’s objective was to determine the impact of the offer to enroll in Job Training Partnership Act (JTPA) Title II-A programs on labor market earnings, educational and training participation and attainment, and welfare receipt compared with a control group that that was not allowed to enroll in JTPA services. About 6,000 out-of-school youth across 16 service delivery areas (SDAs) in the United States were randomly assigned to the treatment group (which was offered JTPA Title II-A services) or the control group (which could not participate in JTPA Title II services for 18 months). Although not the focus of this review, the study also randomly assigned more than 14,000 adults to treatment and control groups. Random assignment occurred from 1987 to 1989. The study team administered surveys to treatment and control group members 18 and 30 months after random assignment to collect information on earnings and educational attainment. The study found that, for female youth, JTPA had a statistically significant, positive impact on attainment of a general educational development (GED) or high school diploma after 30 months; however, this did not hold for male youth. In addition, JTPA did not have a statistically significant impact on earnings for either female or male youth who had never been arrested. The quality of the causal evidence presented in this study is high for the employment outcomes for female and male youth who had not been arrested. This means we are confident that estimated impacts are solely attributable to JTPA, and not other factors. The education outcomes for all groups, and the employment outcomes for male youth who had been arrested, have moderate evidence. This means we have some confidence that the estimated effects would be attributable to JTPA, but other factors might also have contributed.","Job Training Partnership Act","Basic skills Community college education and other classroom training Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs",Youth,,"United States",1997, "Falls in Construction: Injury Rates for OSHA-Inspected Employers Before and After Citation for Violating the Washington State Fall Protection Standard","Nelson, N., Kaufman, J., Kalat, J., & Silverstein, B. (1997). Falls in construction: Injury rates for OSHA-inspected employers before and after citation for violating the Washington State Fall Protection Standard. American Journal of Industrial Medicine, 31(3), 296-302.","OSHA Enforcement","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Health and safety-Low-Favorable impacts Health and safety","Summary: The study’s objective was to determine the effect of receiving an OSHA citation for violating the Washington State Fall Protection Standard on injury claim rates among construction employers. The study used a regression model to compare injury claim rates for construction employers that had received a citation for violating the Washington State Fall Protection Standard between 1991 and 1992 to rates for those that had not received a citation for violating this standard during this time period. The study found that being cited for violating the falls in construction standard was associated with a statistically significant increase in the likelihood of experiencing a subsequent reduction in injury claim rates compared to construction employers that were not cited. The quality of the causal evidence presented in this study is low. This means we are not confident that the differences in the likelihood of experiencing a reduction in injury rates between employers that received a citation for violating the Washington State Fall Protection Standard and employers that did not receive such a citation are attributable to the citations.","OSHA Enforcement Activities","Other health and safety Workers compensation Workplace injury",Employed,Construction,"United States",1997, "Net impact evaluation of retraining under ESHB 1988.","Jacobson, L., & LaLonde, R. (1997). Net impact evaluation of retraining under ESHB 1988. Retrieved from https://files.eric.ed.gov/fulltext/ED413525.pdf","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages","Summary: The study's objective was to examine the impact of the Washington State Employment and Training Act of 1993 (ESHB 1988) on earnings. The study used a nonexperimental design to compare the earnings of displaced workers who received re-training to those who did not receive re-training. Using administrative data from Washington State's Employment Security Department and transcript data from the community colleges, the authors conducted statistical models to examine the differences between groups. The study found that participation in the re-training program increased long-term earnings; however, the authors did not provide a test of statistical significance. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design; this is the highest causal evidence rating possible for a nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the Washington State Employment and Training Act of 1993 (ESHB 1988), but other factors might also have contributed.","Washington State Employment and Training Act of 1993 (ESHB 1988)","Employment and Training Services Training and Education Basic skills Capacity building programs Community college education and other classroom training","Adult, Dislocated or displaced worker, Low-skilled",,"United States",1997,https://files.eric.ed.gov/fulltext/ED413525.pdf "The effect of OSHA lead exposure in construction standard on blood lead levels among iron workers employed in bridge rehabilitation","Levin, S., Goldberg, M., & Doucette, J. (1997). The effect of the OSHA lead exposure in construction standard on blood lead levels among iron workers employed in bridge rehabilitation. American Journal of Industrial Medicine, 31(3), 303–309.","OSHA Enforcement","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Health and safety-Low-Favorable impacts Health and safety","Summary: The study’s objective was to examine the effect of the Lead Exposure in Construction Standard imposed by the Occupational Safety & Health Administration (OSHA), which was introduced in May 1993, on the blood lead levels of iron workers employed in the renovation of a large, lead-painted, steel bridge in New York City in 1993 and 1994. The study compared the blood lead levels of iron workers in 1993 and 1994, before and after the introduction of OSHA’s Lead Exposure in Construction Standard. The study found that there was no significant difference in the maximum blood lead levels of iron workers from 1993 to 1994, but there was a decline in the increment in blood lead levels, defined as the difference between the maximum and minimum levels. The quality of causal evidence presented in this study is low. This means we are not confident that any differences in blood lead levels of iron workers before and after the introduction of the OSHA Lead Exposure in Construction Standard were attributable solely to the introduction of the standard.","OSHA Enforcement Activities","Safety Workplace injury",Employed,Construction,"United States",1997, "Follow-up analyses of the National JTPA Study sample","Orr, L., Barnow, B., Lerman, R., & Beecroft, E. (1997). Follow-up analyses of the National JTPA Study sample. Cambridge, MA: Abt Associates, Inc.","Opportunities for Youth","Study Type: Descriptive Analysis",,,"Summary: This report presented and analyzed findings from a follow-up examination of the National Job Training Partnership Act (JTPA) Study, an impact study whose final report was published in 1994. The JTPA program offered academic and occupational training, on-the-job training, job search assistance, and other support services to adults and out-of-school youth. This report used the experimental data from the National JTPA Study to explore whether JTPA had positive effects on earnings of subgroups of youth, factors that had positive impacts on welfare recipients’ earnings, and implications of the National JTPA Study for improving the JTPA performance management system. The report found that the JTPA program had a small impact on the earnings of out-of-school youth and positive impacts on the earnings of female welfare recipients. The impact was greater for females older than 25 years than for females ages 16 to 24. JTPA services adapted toward immediate employment were more effective than other services for welfare recipients, and access to JTPA increased earnings of welfare recipients without decreasing welfare receipts because earnings increased only after they left welfare. The authors concluded that the correlation between measured impact and performance indicators was usually positive, but statistically weak, and that this suggested the performance management system did not work as intended.","National Job Training Partnership Act (JTPA)",,,,,1997, "An exploratory cost-benefit analysis of natural support strategies in the employment of people with severe disabilities","Zivolich, S., Shueman, S.A., & Weiner, J.S. (1997). An exploratory cost-benefit analysis of natural support strategies in the employment of people with severe disabilities. Journal of Vocational Rehabilitation, 8, 211–221.","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: Natural support programs use existing job-site routines, people, and methods, rather than job coaches, to assist workers with severe disabilities. This exploratory cost-benefit analysis used data from the first 59 of 110 people employed through a grant program using natural supports to estimate costs and benefits to participants, taxpayers, and society. Benefits were estimated from relevant combinations of earnings, taxes, Supplemental Security Income benefits (transfers) and administrative costs, and savings from a most likely alternative program, rather than from impact estimates derived from experimental evaluation. Under this approach, results suggested substantive benefits to participants, taxpayers, and society for a natural support approach, and the superiority of this approach over the traditional sheltered workshop (job coaching) model.",,"Disability insurance Supplemental security income (SSI) Supported employment or other employment supports",Disability,,"United States",1997, "Case management at work for SSA disability beneficiaries: process results of the Project NetWork","Leiter, V., & Wood, M.L. (1997). Case management at work for SSA disability beneficiaries: process results of the Project NetWork. Social Security Bulletin, 60 (1), 29–57.","Disability Employment Policy","Study Type: Implementation Analysis",,,"Summary: This article summarized the results of a process evaluation of Project NetWork, a demonstration launched by the Social Security Administration (SSA) to test various strategies for providing vocational rehabilitation (VR) services to its disability insurance beneficiaries as well as blind and disabled applicants for and recipients of Supplemental Security Income benefits. The study, which was part of an evaluation that also included impact and cost analyses, assessed the feasibility of providing VR services to SSA beneficiaries with severe disabilities. It drew on interviews with program staff, management information system data, and a variety of program documents to examine the roll-out and implementation of four models of service delivery, each implemented at two sites. The authors determined that it was feasible to recruit people with severe disabilities for a rehabilitation program and provide the range of required services. Models with varying institutional arrangements were equally successful in attracting the interest of this population and arranging for the services they needed to meet their vocational goals.","Project NetWork","Disability insurance Supplemental security income (SSI) Vocational rehabilitation",Disability,,"United States",1997,http://www.ssa.gov/policy/docs/ssb/v60n1/v60n1p29.pdf "The New Jersey Unemployment Insurance Reemployment Demonstration Project: Six-year follow-up and summary report","Corson, W., & Haimson, J. (1996). The New Jersey Unemployment Insurance Reemployment Demonstration Project: Six-year follow-up and summary report. Revised edition. Unemployment Insurance Occasional Paper 96-2. Washington, DC: U.S. Department of Labor, Employment and Training Administration.","Job Search Assistance, Reemployment","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the long-term impacts of the New Jersey Unemployment Insurance Reemployment Demonstration Project on the unemployment insurance (UI) receipt, employment, and earnings of UI claimants in New Jersey approximately six years after program enrollment. In this demonstration, about 11,000 UI claimants were randomized into one of three treatment groups, all of which received some variation of Job Search Assistance (JSA) services, or into the control group, which could receive only existing services in the community. For all participants, the study team collected administrative data, which provided information on UI receipt, employment, and earnings. The study found that the treatment group that received JSA services and a reemployment bonus had a statistically significant reduction in UI dollars received and UI weeks paid, compared with the control group. There were no significant impacts on the probability of working, level of earnings, or weeks worked in the long run for any of the treatment groups. The quality of causal evidence presented in this report is high because it is based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the interventions studied, and not to other factors.","JSA services","Job search assistance and supportive services Other employment and reemployment Other training and education","Dislocated or displaced worker, Unemployed",,"United States",1996,http://workforcesecurity.doleta.gov/dmstree/op/op95/op_02-95.pdf "Impacts of service: Final report on the evaluation of American Conservation and Youth Service Corps.","Jastrzab, J., Masker, J., Blomquist, J., & Orr, L. (1996). Impacts of service: Final report on the evaluation of American Conservation and Youth Service Corps. Cambridge, MA: Abt Associates Inc.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to estimate the impacts of eight Conservation and Youth Service Corps programs that sought to improve educational and employment outcomes for out-of-school youth ages 18 to 25 and to improve their personal development. The full evaluation consisted of an estimation of participant impacts and cost-benefit analysis for four of eight study sites and estimation of community impacts for all eight sites. Data sources for the participant-level impact analysis included a self-administered baseline survey and enrollment form and a follow-up telephone survey conducted 15 months after random assignment. The study found statistically significant, positive impacts for program participants on the likelihood of having worked for pay since program enrollment and working a larger number of total hours since program enrollment (including time spent in the corps). The quality of the causal evidence presented in this study is moderate. This means we have some confidence that the estimated effects are attributable to the Conservation and Youth Service Corps programs, but other factors might also have contributed.","Youth Corps Programs","Job search assistance and supportive services Other training and education Youth programs",Youth,,"United States",1996, "Career Academies: Early implementation lessons from a 10-site evaluation","Kemple, J., & Roch, J. (1996). Career Academies: Early implementation lessons from a 10-site evaluation. New York: MDRC.","Career Academies","Study Type: Implementation Analysis",,,"Summary: The study’s objective was to determine the implementation of Career Academies, specifically how they work and how they shape students’ education and career preparation. The study was part of a larger randomized control trial (see CLEAR’s profile of Kemple & Willner [2008] for final evaluation results). The study drew on data from a baseline student questionnaire, site visits, information gathering during site selection and monitoring for the broader evaluation, a teacher survey, and school administrative data on study participants. The study focused on implementation of the Career Academies model in the sites that were purposively selected to participate in the broader evaluation. The authors noted that all 10 study sites adopted and maintained the key elements of the Career Academy approach in a variety of contexts. Study sites attracted high application rates from students with diverse demographic and educational characteristics, and the program was attractive to both at-risk students and students performing well in school. Most (84 percent) students accepted in the Academies enrolled and three-quarters of enrollees were still engaged with the program two years later. Compared with non-Academy teachers, Career Academy teachers were more likely to report having opportunities to partner with their colleagues, to view their workplace as a learning community, and to develop individualized relationships with students. The study’s insights on fidelity to the program model and the ability of the program to be adapted to diverse contexts and types of students should be extrapolated with caution because these were the very criteria used to select sites for participation in the evaluation.","Career Academies",,,,,1996,http://files.eric.ed.gov/fulltext/ED398401.pdf "Effective employment services for persons with mental retardation","Decker, Paul T., and Thornton, Craig. (1996). Effective employment services for persons with mental retardation. Journal of Vocational Rehabilitation 7, 29-40.","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: This study combined data from an impact evaluation and an associated process study of the Transitional Employment Intervention (TEI) to identify effective supported employment services for people with mental retardation. TEI randomly assigned eligible Supplemental Security Income recipients to a treatment or control group at eight training agencies serving 13 communities in seven states. All eight agencies implemented the basic demonstration model successfully, although their methods of providing basic services differed, as did their results. Overall, average earnings were substantially higher for people who were enrolled in the demonstration. However, agency-specific estimates varied from large and statistically significant to small and not statistically significant. By comparing the implementing agencies across multiple characteristics identified in the process study, this study found that the most successful programs tailored their services to the needs of each participant, developed jobs in a wide array of occupations, and kept people in the program for a longer period than the other agencies. The implementing agencies persisted in placing participants who lost a job into second, third, or fourth jobs. The study also found cost implications of the successful strategies. Average costs for the three high-impact agencies were approximately $7,000 per enrolled participant, and approximately $6,000 per participant for the three low-impact agencies.",,"Disability insurance Supplemental security income (SSI) Supported employment or other employment supports",Disability,,"United States",1996, "The effect of federal contractor status on racial differences in establishment-level employment shares: 1979–1992.","Rodgers, W., & Spriggs, W. (1996). The effect of federal contractor status on racial differences in establishment-level employment shares: 1979–1992. The American Economic Review 86(2), 290–293.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Mixed impacts Employment","Summary: The study’s objective was to assess the effect of Executive Order 11246, a 1965 directive that subjected federal contractors to stringent antidiscrimination standards, by comparing the proportion of minority employees among federal contracting firms who were covered by such policies to the share among other private organizations that were not covered. The authors analyzed the effect of federal contractor status on racial and ethnic groups’ shares of a firm’s employment while also accounting for other establishment-level differences using data from the 1979–1992 Employer Information Report EEO-1 files. The study found that by 1992, the African American employment share was 1.36 percentage points higher among federal contractors than at an average EEO-1 reporting company. For Hispanics, however, federal contractor status had the opposite effect; it decreased the proportion of Hispanic employees by 0.45 percentage points in 1992. The quality of causal evidence presented in this study is low. This means we are not confident that the estimated effects are attributable to Executive Order 11246; other factors are likely to have contributed.","Executive Order 11246","Executive Order 11246 (E.O. 11246) Civil Rights Act of 1964","Asian, Black or African American, Hispanic of any race",,"United States",1996, "Enhancing substance abuse treatment with case management: Its impact on employment","Siegal, H. A., Fisher, J. H., Rapp, R. C., & Kelliher, C. W. (1996). Enhancing substance abuse treatment with case management: Its impact on employment. Journal of Substance Abuse Treatment, 13(2), 93-98.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study aimed to examine the impact of a strengths-based case management intervention on veterans’ employment and earnings. Even though the treatment and control groups were randomly assigned, the study used a pre/post analysis design to compare all participants before the study to all participants six months after the study began. The study collected data using the Addiction Severity Index (ASI-5) and study-created measures including levels of drug use, substance abuse treatment history, health and psychiatric status, occupational and education functioning, living situation, relationship with family and peers, and HIV risk status. The study found all study participants, including those in the intervention and control groups, increased earnings and days employed at the six-month follow-up. The quality of causal evidence presented in this report is low because the authors did not account for trends in outcomes before the intervention. This means we are not confident that the estimated effects are attributable to strengths-based case management; other factors are likely to have contributed.","the strengths-based case management","Substance abuse recovery Job search assistance and supportive services Veterans' reemployment","Other barriers, Veteran or military",,"United States",1996,https://doi.org/10.1016/0740-5472(96)00029-3 "Evaluating pooled evidence from the reemployment bonus experiments","Decker, P., & O’Leary, C. (1995). Evaluating pooled evidence from the reemployment bonus experiments. The Journal of Human Resources, 30(3), 534-550.",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: This study’s objective was to assess the effectiveness of Pennsylvania and Washington programs that aimed to encourage faster reemployment among Unemployment Insurance (UI) recipients by offering them financial incentives for faster reemployment. Randomized controlled trials were conducted separately in both Pennsylvania and Washington State and included a total of about 27,500 UI claimants. The authors estimated impacts of the reemployment bonus programs on UI benefits receipt and earnings using state UI administrative records. The study found that, on average, UI claimants who had been randomly assigned to receive any of the reemployment bonus offers received 0.5 fewer weeks and $85 less in total UI benefits than those assigned to the control group. However, they were no more or less likely to exhaust UI benefits or have higher earnings in the year following random assignment than control group members. The quality of causal evidence presented in this report is high because it is based on pooled analysis of two well-implemented randomized controlled trials. This means we are confident that the estimated effects are attributable to reemployment bonus incentives, and not to other factors.","the Pennsylvania Reemployment Bonus Demonstration and the Washington Reemployment Bonus Experiment","Other employment and reemployment","Dislocated or displaced worker, Unemployed",,"United States",1995, "The Jobs I Preventive Intervention for Unemployed Individuals: Short- and long-term effects on reemployment and mental health","Vinokur, A., Price, R., Caplan, R., van Ryn, M.,& Curran, J. (1995). The Jobs I Preventive Intervention for Unemployed Individuals: Short- and long-term effects on reemployment and mental health. In L.R. Murphy, J.J. Hurrell, Jr., S.L. Sauter, & G.P. Keita (Eds.), Job Stress Interventions. Washington, DC: American Psychological Association (125-138).",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages","Summary: The study’s objective was to examine the impact of the Jobs Program on short-term earnings. The authors conducted a randomized controlled trial (RCT). Researchers administered a pre-test two weeks before the intervention and two post-tests one and four months after the intervention, comparing the outcomes of Jobs Program participants against those of a control group. The study found statistically significant associations between being offered access to the Jobs Program and increased earnings one and four months later. The quality of causal evidence presented in this report is low because the study was an RCT with post-intervention subsampling based on participation in the intervention. In addition, the authors did not include sufficient controls in their analysis. This means we are not confident that any estimated effects would be attributable to the Jobs Program; other factors are likely to have contributed.","the Jobs Program","Job search assistance and supportive services","Dislocated or displaced worker, Unemployed",,"United States",1995, "Outcome evaluation of the Army Career and Alumni Program’s Job Assistance Centers (Study Report 96-04)","Sadacca, R., Laurence, J. H., DiFazio, A. S., Rauch, H. J., & Hintz, D. W. (1995) Outcome evaluation of the Army Career and Alumni Program’s Job Assistance Centers (Study Report 96-04). Alexandria, VA: Human Resources Research Organization.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Mixed impacts Earnings and wages Public benefits receipt-Low-Mixed impacts Public benefit receipt","Summary: The study’s objective was to examine the impact Job Assistance Centers (JACs) and the Transition Assistance Program (TAP) offered to ex-servicemembers had on their earnings and public benefits receipt. The study used a nonexperimental analysis to compare the outcomes of ex-servicemembers transitioning from military to civilian jobs who received various JAC or TAP services to the outcomes of those who did not receive JAC or TAP services. The authors used administrative records from the U.S. Department of Defense, the U.S. Army, and JACs, as well as data from a follow-up survey. The study showed mixed findings on the relationships between receipt of JAC and TAP services and earnings, as well as on the relationships between receipt of JAC and TAP services and receipt of unemployment compensation. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to JACs and TAP; other factors are likely to have contributed.","Job Assistance Centers and the Transition Assistance Program","Job search assistance and supportive services Other employment and reemployment Veterans' reemployment","Dislocated or displaced worker, Veteran or military",,"United States",1995, "The long-term effects of transitional employment services","Decker, P., & Thornton, C. (1995). The long-term effects of transitional employment services. Social Security Bulletin, 58(4), 71–81.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to determine the long-term effects of an intervention designed to improve employment and earnings outcomes among Supplemental Security Income (SSI) recipients with intellectual disabilities. The study was a component of the Transitional Employment Training Demonstration (TETD). The authors examined data from the Supplemental Security Record (SSR) maintained by the Social Security Administration (SSA) and demographic information from intake data collection forms. They estimated impacts on employment, earnings, total income, amount of SSI benefits received, and probability of receiving Social Security Disability Insurance (SSDI) benefits for the six years following enrollment. The study found statistically significant, positive impacts on employment, earnings, and total income over the follow-up period. There were also modest declines in the amount of SSI benefits received. The quality of causal evidence presented in this study is high because it is a well-conducted randomized controlled trial. This means that we are confident that the estimated effects in this study are attributable to the intervention, and not to other factors.","Transitional Employment Training Demonstration","Disability insurance Other training and education Supplemental security income (SSI) Vocational rehabilitation",Disability,,"United States",1995,http://www.ssa.gov/policy/docs/ssb/v58n4/v58n4p71.pdf "Lessons from the US unemployment insurance experiments","Meyer, B. (1995). Lessons from the US unemployment insurance experiments. Journal of Economic Literature, 33(1), 91-131.","Behavioral Insights","Study Type: Descriptive Analysis",,,"Summary: The article provided an overview of experimental evaluations of unemployment insurance (UI) reforms conducted from 1977 to 1992 in the United States. These reforms typically tried to improve the employment prospects of beneficiaries and reduce UI costs. The author reviewed 10 randomized controlled trials of UI reforms—4 cash bonus experiments and 6 job-search experiments—and provided a comparative analysis on how these reforms affected average weeks of UI benefits paid, UI program costs, and recipients’ earnings, when available. The cash bonus experiments offered a cash payment to participants who quickly found and kept a job for an indicated length of time, although the details varied greatly across experiments. Job-search assistance reforms also varied but typically involved changes in the way job-search programs were implemented in terms of services offered and reporting and participation requirements. The review found that some cash bonus reforms reduced the average number of weeks participants spent on UI by a statistically significant margin, compared with the control group. The review also found that some job-search assistance reforms reduced participants’ average number of weeks on UI and increased average quarterly earnings compared with the control group; however, not all findings for all reforms were statistically significant.",,"Disability insurance Job search assistance and supportive services","Adult, Dislocated or displaced worker, Unemployed",,"United States",1995, "The impact of Reemployment Bonuses on Insured Unemployment in the New Jersey and Illinois Reemployment Bonus Experiments","Decker, P. (1994). The impact of Reemployment Bonuses on Insured Unemployment in the New Jersey and Illinois Reemployment Bonus Experiments. Journal of Human Resources, 29(3), 718-741.",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: This study’s objective was to assess the effectiveness of New Jersey and Illinois programs that aimed to encourage faster reemployment among Unemployment Insurance (UI) recipients by offering them financial incentives for faster reemployment. Each state conducted separate randomized controlled trials. The authors calculated weekly UI exit rates using state UI administrative records. The study found that both programs significantly increased the weekly rates at which bonus-eligible UI claimants left the UI rolls during the qualification period relative to claimants who were not bonus-eligible, by 14 percent in New Jersey and 18 percent in Illinois. The quality of causal evidence presented in this report is high because it is based on two well-implemented randomized controlled trials. This means we are confident that the estimated effects are attributable to reemployment bonus incentives and not to other factors.","the New Jersey Unemployment Insurance Reemployment Demonstration Project and Illinois Job Search Incentive Experiment","Job search assistance and supportive services Other employment and reemployment Other training and education","Dislocated or displaced worker, Unemployed",,"United States",1994, "First impact analysis of the Washington State Self-Employment and Enterprise Development (SEED) demonstration","Benus, J., Johnson, T., & Wood, M. (1994). First impact analysis of the Washington State Self-Employment and Enterprise Development (SEED) demonstration. Unemployment Insurance Occasional Paper, 94(1), 1-172.",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Mixed impacts Earnings and wages Employment-Mod/high-Mixed impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study examined the impact of Washington State’s Self-Employment and Enterprise Demonstration (SEED) on reemployment via self-employment for Unemployment Insurance (UI) claimants. SEED was evaluated using a randomized controlled trial in which SEED applicants were randomly assigned to a treatment group, which could receive several types of business start-up training and support services, or a control group, which received UI benefits as usual. Outcomes of interest included measures of employment, self-employment, earnings, and UI benefit receipt. The study found that applicants in the treatment group entered self-employment at significantly higher and faster rates than those in the control group did. SEED participants also earned significantly more from self-employment than nonparticipants did. The quality of the causal evidence presented in this study is high because it was a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to SEED, and not other factors.","Washington State’s Self-Employment and Enterprise Demonstration","Other employment and reemployment Other training and education","Dislocated or displaced worker, Unemployed",,"United States",1994,http://wdr.doleta.gov/research/FullText_Documents/op_01-94.pdf "Self-employment as a reemployment option: Demonstration results and national legislation","Benus, J., Johnson, T., Wood, M, & Grover, N. (1994). Self-employment as a reemployment option: Demonstration results and national legislation. Unemployment Insurance Occasional Paper, 94(3), 1-61.",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study estimated the impacts of Washington State’s Self-Employment and Enterprise Demonstration (SEED) and the Massachusetts Enterprise Project. Both programs sought to determine how feasible self-employment was as a reemployment option for Unemployment Insurance (UI) recipients. This profile focused only on the program design and outcomes of the Enterprise Project. The Enterprise Project was evaluated using a randomized controlled trial in which program applicants were randomly assigned to either a treatment group, which could receive Enterprise Project services, or a control group, which received UI benefits as usual. Outcomes of interest included measures of employment, self-employment, earnings, and UI benefit receipt. The study found that applicants in the treatment group entered self-employment and wage employment at higher rates than those in the control group. They also had higher earnings, on average, and reduced UI benefit duration and amount received. The quality of the causal evidence presented in this study is high. This means we are confident that the estimated effects are attributable to the Enterprise Project, and not to other factors.","the Enterprise Project Demonstration","Job search assistance and supportive services Other employment and reemployment","Dislocated or displaced worker, Unemployed",,"United States",1994,http://workforcesecurity.doleta.gov/dmstree/op/op94/op_03-94.pdf "The study of the replication of the CET job training model.","Hershey, A., & Rosenberg, L. (1994). The study of the replication of the CET job training model. Princeton, NJ: Mathematica Policy Research.","Opportunities for Youth","Study Type: Implementation Analysis",,,"Summary: The Center for Employment Training (CET) was shown by rigorous research conducted in the 1980s to increase the earnings and employment prospects of disadvantaged youth. The U.S. Department of Labor (DOL) commissioned a study to determine whether other organizations could replicate the CET model. This study reported on early efforts by 10 replication sites to implement the key features of the CET job training model. DOL later commissioned an impact evaluation of CET replication sites, including some sites examined in this study (see CLEAR profile of Miller et al. 2005). The CET model provides individualized, intensive, full-time job training. Its focus is on integrating basic and technical skills with job placement as the final goal. CET’s advisory board and instructors are well connected to industry and help to ensure that the skills taught in the program align with those desired by employers. The authors conducted telephone interviews with staff from the CET main office in San Jose, California, telephone interviews with key staff and project directors of the 10 replication sites, and site visits to 5 of the 10 sites. The authors noted that the replication sites faced considerable challenges initiating the program, including finding a suitable space and ensuring consistent funding. When the programs began offering services, the authors reported some deviations from the CET model. In particular, they found that some sites used a screening process, rather than allowing open access to training, as specified by the CET model; some sites used whole group rather than individualized instruction; some did not integrate basic skills and technical skills training; some had not formed an advisory board to provide labor market analysis and guidance for needed training areas; and most were not placing participants into jobs at the completion of training.","the Center for Employment Training (CET) Replication","Basic skills Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",1994, "Coordinated studies programs: Their effect on student involvement at a community college","Tinto, V., & Russo, P. (1994). Coordinated studies programs: Their effect on student involvement at a community college. Community College Review, 22(2), 16-25.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of coordinated studies programs (CSPs) on students’ persistence in college. The authors used administrative data to compare reenrollment rates between a treatment group of students enrolled in CSP classes and a comparison group of students enrolled in humanities and social science classes. The study found that the spring reenrollment rate for CSP students was 84 percent, significantly higher than the 81 percent rate for comparison students. The fall reenrollment rate for CSP students was 67 percent, significantly higher than the 52 percent rate for comparison students. The quality of causal evidence presented in this report is low because the authors did not control for relevant student characteristics in the analysis. This means we are not confident that the estimated effects are attributable to CSPs. Other factors are likely to have contributed.","Coordinated Studies Programs","Community college education and other classroom training",Adult,,"United States",1994, "New evidence on workplace education","Krueger, A., & Rouse, C. (1994). New evidence on workplace education (No. w4831). Cambridge, MA: National Bureau of Economic Research.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages","Summary: The study’s objective was to examine the impact of employer-based workplace education on wage growth at two mid-sized companies in New Jersey, one in the manufacturing sector and the other in the service sector. In this nonexperimental study, the authors used employee survey data and administrative records from the participating companies and the community college that provided the training to compare the wage growth of workers who participated in training with the wage growth of workers who did not participate. The study found that employees in the manufacturing company who participated in occupational training had higher wage growth than those who did not participate in the training. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the employer-based workplace education program, but other factors might also have contributed.","Employer-Based Workplace Education","Community college education and other classroom training Other training and education",Low-skilled,,"United States",1994,http://www.nber.org/papers/w4831.pdf "Expressive writing and coping with job loss","Spera, S., Buhrfeind, E., & Pennebaker, J. (1994). Expressive writing and coping with job loss. Academy of Management Journal, 37(3), 722-733.","Behavioral Insights","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of expressive writing activities on the reemployment of people who had recently lost their jobs. The authors randomly assigned 41 people who had recently been laid off to either a treatment group, which was instructed to write daily about their feelings on their job loss, or to a control group, which was instructed to write about their plans for the day, but not about their feelings. Another 22 participants were assigned (non-randomly) to a comparison group that did not participate in a writing activity. The authors compared outcomes for the three study groups collected from administrative records and four surveys. The study found that participants who wrote about their feelings and attitudes about being laid off were more likely to find employment eight months after the program than those who wrote about other topics and those who did no writing activities. The quality of causal evidence presented in this report is high for comparisons between the treatment group and the writing control group because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to expressive writing, and not to other factors. However, the quality of causal evidence is moderate for comparisons between the treatment group and the non-writing comparison group because there was non-random assignment to this group. This means we are somewhat confident that the estimated effects are attributable to expressive writing, but other factors might also have contributed.",,"Behavioral Interventions","Unemployed, Adult",,"United States",1994, "Job Corps costs and outcomes","Crawford, C. (1993). Job Corps costs and outcomes. Washington, DC: Government Accountability Office.","Opportunities for Youth","Study Type: Descriptive Analysis",,,"Summary: This Government Accountability Office brief studied the costs and outcomes of the Job Corps program during program year 1991 (covering calendar year July 1991 through June 1992). Job Corps offers intensive academic classroom instruction and vocational skills training, along with support services, to economically disadvantaged youth. The authors used data from the Department of Labor's Office of Job Corps to explore the differences in the costs of Job Corps centers run by contractors and those run by federal agencies. They also studied the employment outcomes of Job Corps participants who received training from sole-source contractors—those awarded contracts through a non-competitive process. The authors found that the cost per participant was higher in Job Corps centers run by federal departments than in centers run by contractors. This difference was driven by variation in the types of training the centers offered. Participants in Job Corps centers operated by sole-source contractors, especially those offering training under national training contracts, tended to have higher rates of job placement than participants in other types of Job Corps centers.","Job Corps","Job search assistance and supportive services Youth programs Other training and education Work based and other occupational training","Youth, High-skilled, Low-skilled",,"United States",1993,http://www.gao.gov/assets/90/82925.pdf "Does regulatory enforcement work? A panel analysis of OSHA enforcement","Gray, W., & Scholz, J. (1993). Does regulatory enforcement work? A panel analysis of OSHA enforcement. Law & Society Review, 27(1), 177-213.","OSHA Enforcement","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Health and safety-Low-Favorable impacts Health and safety","Summary: The study’s objective was to determine the effect on injury rates of OSHA inspections that resulted in penalties during the 1980s. Although OSHA no longer operates as it did during this period, this study provides historical context for changes that were later made to the program. The study used a regression model to compare the percentage change in injury rates when firms had received inspections that resulted in penalties during the past four years and when the same firms had not received penalties during the past four years. The study found that inspections that resulted in penalties were associated with statistically significant reductions in lost workday injuries (by 22 percent) and lost workdays (by 20 percent) during the three years following the inspection. The quality of the causal evidence presented in this study is low. This means we are not confident that the changes in injury rates within firms when they received inspections that resulted in penalties are attributable solely to these penalties.","OSHA Enforcement Activities","Inspections Workplace injury",Employed,,"United States",1993, "Pay and participation in work activity: Clinical benefits for clients with schizophrenia","Bell, M.D., & Milstein, R.M. (1993). Pay and participation in work activity: Clinical benefits for clients with schizophrenia. Psychosocial Rehabilitation Journal, 17(2), 173-176.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of a paid supported work program for veterans diagnosed with schizophrenia or schizoaffective disorder on their employment, earnings, wages, and health outcomes. The authors used a randomized controlled trial to compare outcomes of veterans assigned to the paid supported work condition with those assigned to the unpaid work condition using data collected through interviews at baseline and five months later. The authors found that the paid group had higher employment and earnings and fewer depressive symptoms five months after random assignment compared with the unpaid group. The quality of causal evidence presented in this report is low because it was based on a randomized controlled trial in which the analytic sample sizes are unknown, and the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to paid supported work; other factors are likely to have contributed to the findings.","the Paid Supported Work Program","Health Veterans' reemployment","Disability, Veteran or military",,"United States",1993,https://psycnet.apa.org/doi/10.1037/h0095590 "JOBSTART: Final report on a program for school dropouts.","Cave, G., Bos, H., Doolittle, F. & Toussaint, C. (1993). JOBSTART: Final report on a program for school dropouts. New York: MDRC.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Unfavorable impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-Unfavorable impacts Employment","Summary: The study’s objective was to examine the impact of the JOBSTART program on employment, earnings, and education and training outcomes over a four-year follow-up period. About 2,300 youth were randomly assigned to either the treatment group, which was eligible to participate in JOBSTART, or the control group, which could not participate in JOBSTART but could access other services in the community. The authors compared the outcomes of the treatment and control groups using data collected through follow-up surveys 12, 24, and 48 months after random assignment. The study found that, 48 months after random assignment, members of the treatment group were significantly more likely to have participated in education or training, and completed significantly more hours of it, compared with the control group. The treatment group was significantly less likely to be employed and earned significantly less than the control group in the first year after random assignment. There were no significant impacts on earnings or employment outcomes in later follow-up years. The quality of causal evidence presented in this report is high because it is based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the JOBSTART program, and not to other factors.","the JOBSTART Program","Basic skills Job search assistance and supportive services Work based and other occupational training Youth programs","Youth, Low-skilled, Low income",,"United States",1993,http://www.mdrc.org/sites/default/files/full_416.pdf "The effect of veterans benefits on education and earnings","Angrist, J. D. (1993). The effect of veterans benefits on education and earnings. Industrial and Labor Relations Review, 46(4), 637-652.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the effects of veteran benefits on the post-service education and earnings of soldiers who served in the Vietnam era and in the first years of the All-Volunteer Forces (AVF). The study used statistical tests in a nonexperimental analysis to evaluate the effects of veteran benefits. The data came from the U.S. Census Bureau’s 1987 Survey of Veterans. The study found a statistically significant positive relationship between veteran benefits and education and earnings outcomes. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to veteran benefits; other factors are likely to have contributed.","the veteran benefits","Other wages and benefits Other training and education","Veteran or military",,"United States",1993,https://doi.org/10.1177%2F001979399304600404 "Pennsylvania Reemployment Bonus Demonstration final report","Corson, W., Decker, P., Dunstan, S., & Kerachsky, S. (1992). Pennsylvania Reemployment Bonus Demonstration final report. Unemployment Insurance Occasional Paper 92-1. Washington, DC: Employment and Training Administration, U.S. Department of Labor.",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Mixed impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impacts of the Pennsylvania Reemployment Bonus Demonstration Project on the unemployment insurance (UI) receipt, employment, and earnings of UI claimants approximately one year after program enrollment. In this demonstration, about 15,000 eligible claimants were randomly assigned to one of six treatment groups with varying financial incentives and qualification periods or a control group. For all participants, the study team collected administrative data, which provided information on UI benefits receipt, employment, and earnings. The study team also surveyed a subsample of approximately 5,000 participants about their experiences in the year following random assignment. The study found that two of the bonus treatments reduced the weeks of UI benefits and total UI benefit dollars received, but the others did not. The study found very few impacts of the bonus treatments on claimants’ reemployment rates or earnings. The quality of causal evidence is high for UI benefits receipt outcomes because it is based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to reemployment bonus incentives, and not to other factors. However, the quality of causal evidence is moderate for the employment and earnings outcomes because study attrition could not be determined for those outcomes.","the Pennsylvania Reemployment Bonus Demonstration","Other employment and reemployment","Dislocated or displaced worker, Unemployed",,"United States",1992,http://www.mathematica-mpr.com/~/media/publications/PDFs/pennreemploy.pdf "Time-varying effects of recall expectation, a reemployment bonus, and job counseling on unemployment durations","Anderson, P. (1992). Time-varying effects of recall expectation, a reemployment bonus, and job counseling on unemployment durations. Journal of Labor Economics, 10 (1), 99-115.","Job Search Assistance, Reemployment","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study assessed the effectiveness of a reemployment bonus on the reemployment rates of Unemployment Insurance (UI) claimants with differing expectations of being recalled to their previous jobs. The study used data from the New Jersey Unemployment Insurance Reemployment Demonstration Project. For the demonstration, about 11,000 UI claimants were randomized into one of three treatment groups, all of which received some variation of Job Search Assistance (JSA) services, or into the control group, which could receive only existing services in the community. The author estimated weekly UI exit rates from state UI administrative records. The study found that the JSA-plus-reemployment-bonus group members were more likely than members of the JSA-only group to leave UI for a new job during weeks 7 through 12, which corresponded to the first half of the bonus qualification period, suggesting the bonuses were effective in spurring UI claimants to find new jobs more quickly. The quality of causal evidence presented in this report is moderate because it is a secondary analysis of data from a well-implemented randomized controlled trial for which attrition cannot be calculated. However, the author included sufficient statistical controls to receive a moderate evidence rating. This means we have some confidence that the estimated effects are attributable to the interventions studied, although other factors also could have contributed.","the New Jersey Unemployment Insurance Reemployment Demonstration Project","Job search assistance and supportive services Other employment and reemployment Other training and education","Dislocated or displaced worker, Unemployed",,"United States",1992, "The Washington Reemployment Bonus Experiment: Final report","Spiegelman, R., O’Leary, C., & Kline, K. (1992). The Washington Reemployment Bonus Experiment: Final report. Kalamazoo, MI: W.E. Upjohn Institute for Employment Research.",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to assess the impacts of the Washington Reemployment Bonus experiment, which aimed to encourage faster reemployment rates among Unemployment Insurance (UI) claimants by offering them financial incentives, on the UI benefits receipt of UI claimants. In this demonstration about 15,500 eligible claimants were randomized into one of six treatment groups or a control group. The six treatment groups were offered different combinations of reemployment bonus amounts and periods within which they were required to find a job in order to claim the bonus. For all participants, the study team collected administrative data, which provided information on UI benefits receipt. The study found that three of the bonus treatments reduced the weeks of UI benefits and total UI benefits dollars received, but the other three did not. Pooling across all bonus treatments, treatment group members received 0.4 fewer weeks and $65 less in UI benefits, on average, than their control group counterparts. The quality of causal evidence presented in this study is high because it is based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the reemployment bonuses, and not to other factors.","the Washington Reemployment Bonus Experiment","Other employment and reemployment","Dislocated or displaced worker, Unemployed",,"United States",1992,http://research.upjohn.org/externalpapers/44/ "Schizophrenic symptoms, work adjustment, and behavioral family therapy","Glynn, S. M., Randolph, E. T., Eth, S., Paz, G. G., Leong, G. B., Shaner, A. L., & Vort, W. V. (1992). Schizophrenic symptoms, work adjustment, and behavioral family therapy. Rehabilitation Psychology, 37(4), 323-338.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-No impacts Employment","Summary: This study examined the impact of behavioral family therapy on male veterans’ employment. The study conducted a randomized controlled trial using data from self-reported responses to the Social Adjustment Scale, Version I. The study showed that behavioral family therapy did not have statistically significant effects on employment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects are attributable to behavioral family therapy and not to other factors. However, the study did not show any statistically significant effects.","Behavioral Family Therapy","Health Veterans' reemployment","Disability, Veteran or military",,"United States",1992, "Disability beneficiaries who work and their experience under program work incentives","Muller, L. Scott. (1992). Disability beneficiaries who work and their experience under program work incentives. Social Security Bulletin, 55(2), 2–42.","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: This study used data from the New Beneficiary Survey and claims folders to describe the experiences of recipients’ experiences under Social Security Disability Insurance (DI) work incentive provisions. The analysis found that relatively few DI recipients worked while in benefit status, and considerably smaller numbers had benefit terminations. About 10 percent of people initially entitled to benefits from mid-1980 to mid-1981 were found to have worked while in benefit status over the approximately 10-year period under study. The vast majority (84 percent) of those who worked were granted a trial work period (TWP). Nearly 75 percent of those granted a TWP successfully completed nine months of trial work, yet fewer than half of those who completed the TWP were eventually terminated from the program for substantial gainful activity (SGA). Overall, fewer than 3 percent of this cohort of initial entitlements had SGA terminations and, among this small number, nearly one-third had returned to the rolls by 1990. Recipients most likely to make a work attempt were young and had high levels of education.",,"Disability insurance Supplemental security income (SSI) Other employment and reemployment",Disability,,"United States",1992,http://www.ssa.gov/policy/docs/ssb/v55n2/v55n2p2.pdf "Some new historical evidence on the impact of affirmative action: Detroit, 1972","Hyclak, T., Taylor, L., & Stewart, J. (1992). Some new historical evidence on the impact of affirmative action: Detroit, 1972. The Review of Black Political Economy, 21(2), 81-98.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the effect of federal affirmative action reporting requirements on Detroit firms’ hiring of minorities into managerial positions in 1972. The authors compared the probability that minority candidates applied to and were hired for managerial positions at firms that were and were not subject to affirmative action reporting requirements. The sample comprised 99 Detroit firms that fully responded to the 1972 Detroit Area Study survey. The study found that firms subject to affirmative action reporting requirements were significantly more likely to hire African American males than firms not subject to the requirements. The quality of causal evidence presented in this report is low because the authors did not adequately control for existing differences between firms that were and were not subject to affirmative action reporting requirements. This means we are not confident that the estimated effects are attributable to affirmative action reporting requirements. Other factors are likely to have contributed.","the Civil Rights Act of 1964 and Affirmative Action reporting requirements","Affirmative action Civil Rights Act of 1964 Equal Employment Opportunity Act of 1972","Adult, Black or African American",,"United States",1992, "The New Jersey Unemployment Insurance Reemployment Demonstration Project: Follow-up report","Anderson, P., Corson, W., & Decker, P. (1991). The New Jersey Unemployment Insurance Reemployment Demonstration Project: Follow-up report. Unemployment Insurance Occasional Paper 91-1. Washington, DC: U.S. Department of Labor, Employment and Training Administration.","Job Search Assistance, Reemployment","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the New Jersey Unemployment Insurance Reemployment Demonstration Project on the unemployment insurance (UI) receipt, employment, and earnings of UI claimants in New Jersey three to four years after program enrollment. In this demonstration, about 11,000 UI claimants were randomized into one of three treatment groups, all of which received some variation of Job Search Assistance (JSA) services, or into the control group, which could receive only existing services in the community. For all participants, the study team collected administrative data, which provided information on UI receipt, employment, and earnings. The study found that, over the claim year and three follow-up years, the JSA-plus-reemployment-bonus group had statistically significant differences from the control group on UI dollars received ($293 fewer than control) and UI weeks paid (1.6 fewer weeks than control). The study found few statistically significant impacts on the probability of working, earnings, or weeks worked for any of the treatment groups compared with the control group. The quality of causal evidence presented in this report is high because it based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the interventions studied, and not to other factors.","JSA services","Job search assistance and supportive services Other employment and reemployment Other training and education","Dislocated or displaced worker, Unemployed",,"United States",1991,http://workforcesecurity.doleta.gov/dmstree/op/op91/op_01-91.pdf "Evaluation of the impacts of the Washington Alternative Work Search Experiment","Johnson, T., & Klepinger, D. (1991). Evaluation of the impacts of the Washington Alternative Work Search Experiment. Unemployment Insurance Occasional Paper, 91(4), 1–90.",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study assessed the impacts of four different work search policy approaches implemented through the Washington Alternative Work Search Experiment on Unemployment Insurance (UI) benefits receipt, employment, and earnings outcomes. Eligible UI claimants were randomly assigned to one of three treatment groups or a control group. The four study groups faced different work search requirements to continue receiving UI benefits. For all participants, the study team collected administrative data, which provided information on UI benefits receipt, employment, and earnings. The study found that UI claimants facing less-stringent work search requirements received more UI benefits for longer and were more likely to exhaust their benefits, on average, than those facing standard work search requirements. There were few differences in UI benefits, employment, or earnings among claimants subject to more stringent work search requirements compared with those facing standard work search requirements. The quality of causal evidence presented in this study is high because it is based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the alternative work search requirements, and not to other factors.","the Washington Alternative Work Search Experiment","Job search assistance and supportive services Unemployment Insurance","Dislocated or displaced worker, Unemployed",,"United States",1991, "Long-term follow-up and benefit-cost analysis of the Jobs Program","Vinokur, A., van Ryn, M., Gramlich, E., & Price, R. (1991). Long-term follow-up and benefit-cost analysis of the Jobs Program. Journal of Applied Psychology, 76(2), 213-219.",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the Jobs Program on long-term earnings and monthly hours worked. The authors conducted a randomized controlled trial (RCT). Researchers administered a pre-test two weeks before the intervention and three post-tests at 1, 4, and 30 months after the intervention comparing the outcomes of Jobs Program participants against a control group. The study found no statistically significant relationships between the Jobs Program and increased long-term earnings or time in work during the follow-up period. The quality of causal evidence presented in this report is low because the study was an RCT with post-intervention subsampling based on participation in the intervention. In addition, the authors did not include sufficient controls in their analysis. This means we are not confident that any estimated effects would be attributable to the Jobs Program; however, the study found no statistically significant effects.","the Jobs Program","Job search assistance and supportive services","Dislocated or displaced worker, Unemployed",,"United States",1991, "Are OSHA Health Inspections Effective? A Longitudinal Study in the Manufacturing Sector ","Gray, W., & Jones, C. (1991). Are OSHA health inspections effective? A longitudinal study in the manufacturing sector. Review of Economics & Statistics, 73(3), 504.","OSHA Enforcement","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Compliance-Mod/high-Favorable impacts Compliance","Summary: The study’s objective was to examine the effect of past Occupational Safety & Health Administration (OSHA) health inspections on the number of violations found in subsequent inspections. The study used regression models to compare the number of hazards found at the first, second, and higher-order inspections conducted by OSHA from 1972 to 1983. Although OSHA no longer operates as it did during the period of this study, the study provides interesting historical context. The study found that the number of workplace hazards cited decreased with each additional OSHA inspection. The largest drop occurred between the first and second inspections. The quality of causal evidence presented in this study is moderate because the study used a well-conducted nonexperimental design. This means we have confidence that the estimated effects are attributable at least in part to OSHA inspections. However, as with any nonexperimental design, other factors not accounted for in the study could also have contributed to the estimated effects.","OSHA Enforcement Activities","Inspections Safety",Employed,,"United States",1991, "Longitudinal patterns of compliance with Occupational Safety and Health Administration health and safety regulations in the manufacturing sector","Gray, W., & Jones, C. (1991). Longitudinal patterns of compliance with Occupational Safety and Health Administration health and safety regulations in the manufacturing sector. Journal of Human Resources, 26(4), 623-653.","OSHA Enforcement","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Compliance-Mod/high-Favorable impacts Compliance","Summary: The study’s objective was to examine the effect of past Occupational Safety & Health Administration (OSHA) inspections on the number of violations found in subsequent inspections. The study used a regression model to compare the number of hazards found at the first, second, and higher-order inspections conducted by OSHA from 1972 to 1983. Although OSHA no longer operates as it did during the period of this study, the study provides interesting historical context. The study found that the number of workplace hazards cited decreased with each additional inspection. The largest drop occurred from the first to the second inspections. The quality of causal evidence presented in this study is moderate because the study used a well-implemented nonexperimental design. This means we have confidence that the effects estimated in this study are attributable at least in part to OSHA inspections. However, as with any nonexperimental design, other factors not accounted for in the study could also have contributed to the estimated effects.","OSHA Enforcement Activities","Inspections Safety",Employed,,"United States",1991, "Re-estimating OSHA’s Effects: Have the data changed?","Ruser, J. & Smith, R. (1991). Re-estimating OSHA’s effects: Have the data changed? Journal of Human Resources, 26(2), 212-235.","OSHA Enforcement","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Health and safety-Low-No impacts Health and safety","Summary: The study’s objective was to determine the effect of OSHA inspections and inspection procedures on injury rates in manufacturing firms between 1980 and 1985. Although OSHA no longer operates as it did during this period, this study provides historical context for changes that were later made to the program. For their main analysis, the authors used a regression model to compare differences in injury rates for manufacturing plants that received inspections in March and April (“early”) and those that received inspections in November and December (“late”) of the same year. The study found that, relative to late OSHA inspections, early OSHA inspections were not associated with a statistically significantly reduction in injury rates within the year of inspection. The quality of the causal evidence presented in this study is low. This means we are not confident that the estimated relationships in this study are the result of OSHA inspections and procedures.","OSHA Enforcement Activities","Inspections Workplace injury",Employed,Manufacturing,"United States",1991, "Transitional employment training for SSI recipients with intellectual disabilities.","Prero, A.J., & Thornton, C. (1991). Transitional employment training for SSI recipients with intellectual disabilities. Social Security Bulletin, 54(11), 2-25.","Disability Employment Policy","Study Type: Implementation Analysis",,,"Summary: This article summarized the findings of a process evaluation of the Transitional Employment Training Demonstration, which aimed to transition Supplemental Security Income (SSI) recipients with intellectual disabilities to permanent employment. To achieve this goal, the demonstration provided participants with short-term training for potentially permanent jobs in which they would conduct tasks for their employers and interact with nondisabled colleagues. The study developed findings on recruitment, training, placement, and the provision of other services by collecting data from all eight program sites. It drew on several qualitative sources, such as program staff interviews, observations of service provision, and program documents, as well as a few quantitative sources, including program, survey, and SSI administrative data. The study found that it was feasible to successfully place a wide variety of SSI recipients with intellectual disabilities in mainstream jobs using transitional employment services. However, the programs faced several challenges in program design and implementation. Recruitment and job placement could be difficult, given opinions among caregivers and employers that people with intellectual disabilities cannot perform well in competitive jobs. Job placement was hampered further by the lack of suitable transportation options.","Transitional Employment Training Demonstration","Supplemental security income (SSI) Basic skills Job search assistance and supportive services",Disability,,"United States",1991,http://www.ssa.gov/policy/docs/ssb/v54n11/v54n11p2.pdf "The economic impact of the Nevada Claimant Employment Program","Hanna, J., & Turney, Z. (1990). The economic impact of the Nevada Claimant Employment Program. Unemployment Insurance Occasional Paper 90(4), 79-92.",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study determined the effect of reemployment services, particularly job training for those with insufficient skills or education, on Unemployment Insurance (UI) receipt duration. The study was a randomized controlled trial (RCT), with sample members’ outcomes drawn from Nevada state UI records. The study found that reemployment services reduced UI receipt duration by 1.6 weeks, on average, during the first year. The quality of causal evidence presented in this report is low. This means we are not confident that the estimated effects are attributable to the Nevada Claimant Employment Project; other factors are likely to have contributed.","JSA services","RESEA Job search assistance and supportive services","Dislocated or displaced worker, Unemployed",,"United States",1990, "Back to work: Testing reemployment services for displaced workers","Bloom, H. (1990). Back to work: Testing reemployment services for displaced workers. Kalamazoo, MI: W.E. Upjohn Institute for Employment Research.","Job Search Assistance, Reemployment","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Texas Worker Adjustment Demonstration on the Unemployment Insurance (UI) receipt, employment, and earnings of UI claimants one year after program enrollment. In this demonstration, about 2,200 UI claimants across three sites were randomized into a treatment group, which received job-search assistance services and, if needed, occupational training, or into the control group, which could receive only existing services in the community. For all participants, the study team collected administrative data and conducted a one-year follow up survey. The study found that women who received services at the two El Paso sites earned $987 more and received $193 less in UI benefits in the first year, and were 10 to 20 percentage points more likely to be employed in the first three quarters after entering the program, compared with the control group. The study also found that men in the treatment groups at all three sites received $143 less in UI benefits than men in the control group, but there were no other statistically significant impacts one year after random assignment. The quality of causal evidence presented in this report is moderate because it is an analysis of data from a randomized controlled trial for which attrition cannot be calculated, but for which the author included sufficient statistical controls. This means we have some confidence that the estimated effects are attributable to the demonstration services, although other factors also could have contributed.","JSA services","Job search assistance and supportive services Basic skills Community college education and other classroom training Work based and other occupational training","Dislocated or displaced worker, Unemployed",,"United States",1990, "The New Jersey Unemployment Insurance Reemployment Demonstration Project: Final evaluation report","Corson, W., Decker, P.T., Dunstan, S.M., Gordon, A.R., Anderson, P., & Homrighausen, J. (1989). The New Jersey Unemployment Insurance Reemployment Demonstration Project: Final evaluation report. Princeton, NJ: Mathematica Policy Research.","Job Search Assistance, Reemployment","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the short-term impacts of the New Jersey Unemployment Insurance Reemployment Demonstration Project on the unemployment insurance (UI) receipt, employment, and earnings of UI claimants in New Jersey approximately one year after program enrollment. In this demonstration, about 11,000 UI claimants were randomized into one of three treatment groups, all of which received some variation of Job Search Assistance (JSA) services, or into the control group, which could receive only existing services in the community. For all participants, the study team collected administrative data, which provided information on UI receipt, employment, and earnings. The study team also surveyed a subsample of roughly 7,500 participants about their experiences in the year following random assignment. The study found that all three treatments reduced at least one measure of UI benefits received in the benefit year. According to the survey data, the JSA-only and JSA-plus-bonus groups had higher employment and earnings in the year following participants’ initial UI claims than control group members (no difference was found for the JSA-plus-training group). However, these impacts were not observed in the administrative data. The quality of causal evidence presented in this report is high because it is based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the interventions studied, and not to other factors.","JSA services","Job search assistance and supportive services Other employment and reemployment Other training and education","Dislocated or displaced worker, Unemployed",,"United States",1989,http://workforcesecurity.doleta.gov/dmstree/op/op89/op_03-89.pdf "Requiring Unemployment Insurance recipients to register with the Public Employment Service","Director, S., & Englander, F. (1988). Requiring Unemployment Insurance recipients to register with the Public Employment Service. The Journal of Risk and Insurance, 55(2), 245-258.",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of New Jersey’s repeal of mandatory Employment Services (ES) registration for Unemployment Insurance (UI) claimants on the length of claimants’ UI spells and their probability of exhausting available UI benefits. The authors compared UI outcomes before and after repeal using an interrupted time series design based on monthly, state-level time series data from 1971 to 1981. The study found that the UI exhaustion rate and weeks of UI benefits received were lower when ES registration was mandatory than when it was voluntary. The quality of causal evidence presented in this report is low. This means we are not confident that the estimated effects are attributable to mandatory ES registration; other factors are likely to have contributed.","More stringent work search requirements","RESEA Unemployment Insurance Wagner-Peyser Act","Dislocated or displaced worker, Unemployed",,"United States",1988, "The effect of OSHA records-check inspections on reported occupational injuries in manufacturing establishments","Ruser, J., & Smith, R. (1988). The effect of OSHA records-check inspections on reported occupational injuries in manufacturing establishments. Journal of Risk and Uncertainty, 1(4), 415–435.","OSHA Enforcement","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Health and safety-Low-Mixed impacts Health and safety","Summary: The study’s objective was to determine whether OSHA’s records-check procedure—which was introduced in 1981 in states with federal OSHA enforcement and targeted inspections based on reports of past injuries—caused manufacturing plants to underreport injuries. Although OSHA no longer operates as it did around the time of the records-check procedure’s implementation, this study provides historical context for changes that were later made to the program. The authors used several approaches, the strongest of which compared the percentage change in lost-workday injury rates in the years when the plant’s state had a records-check procedure and the years when the state did not have this procedure. The study found no statistically significant differences between the percentage change in reported injury rates in plants in states with the records-check procedure and plants in states without this procedure. However, plants in risky industries in records-check states reported a statistically significant 4.7 percent reduction in injury rates. The quality of the causal evidence presented in this study is low. This means we are not confident that any changes in reported injuries within plants in records-check states or in risky industries in records-check states could be attributed to the records-check procedure.","OSHA Enforcement Activities","Other health and safety Workplace injury",Employed,Manufacturing,"United States",1988, "Evaluation of the perceivable demand list pilot project","Behrens, J. (1987). Evaluation of the perceivable demand list pilot project. Trenton, NJ: New Jersey Department of Labor.",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The report’s objective was to evaluate the Perceivable Demand List (PDL) Pilot Project on the duration of unemployment insurance (UI) receipt among recent beneficiaries laid off from high-demand occupations.  For this evaluation, UI recipients in Hackensack, New Jersey, who were recently laid off from high-demand occupations, as determined by the New Jersey Department of Labor, were randomly assigned to either participate in the PDL pilot or receive services as usual. The PDL pilot reduced UI receipt by an average of 2.6 weeks, reduced total UI benefits received by $340, and reduced the proportion of UI recipients who exhausted their benefits by 9.8 percentage points. The quality of the causal evidence presented in this report is high because it was a well-implemented randomized controlled trial. This means we are confident that the estimated impacts are attributable solely to the PDL Pilot, not other factors.","More stringent work search requirements","RESEA Other employment and reemployment Wagner-Peyser Act","Dislocated or displaced worker, Unemployed",,"United States",1987, "The Illinois Unemployment Insurance Incentive Experiments","Spiegelman, R., & Woodbury, S. (1987). The Illinois Unemployment Insurance Incentive Experiments. Kalamazoo, MI: W.E. UpJohn Institute for Employment Research.",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Job Search Incentive Experiment and the Hiring Incentive Experiment in Illinois on Unemployment Insurance (UI) benefit receipt and earnings. In this study, about 17,000 new UI claimants were randomly assigned to one of two treatment groups, both of which could participate in a reemployment bonus program, or the control group, which faced existing UI program rules and could not receive a reemployment bonus. For all participants, the study team collected administrative data on UI benefits receipt. The study found that those in the job search incentive group had a significant reduction in UI benefits received, length of UI receipt, and proportion of claimants exhausting UI benefits, compared with the control group. Those in the hiring incentive group had a significant reduction in UI benefits received relative to the control group, but no other outcomes.  The quality of causal evidence presented in this report is high because it is based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the reemployment bonuses, and not to other factors.","the Illinois Job Search Incentive and Hiring Incentive Experiments","Job search assistance and supportive services Other employment and reemployment","Dislocated or displaced worker, Unemployed",,"United States",1987, "Safety Regulation and Workplace Injuries","Curington, W. (1986). Safety regulation and workplace injuries. Southern Economic Journal, 53(1), 51.","OSHA Enforcement","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Health and safety-Low-Favorable impacts Health and safety","Summary: The study’s objective was to examine the effect of the introduction of OSHA regulation in 1971 on the severity and frequency of workplace injuries in manufacturing industries in New York. Although OSHA no longer operates as it did during this period, this study provides historical context for changes that were later made to the program. The study used a regression model to examine the change in the frequency and severity of injuries from the period 1964 to 1970 compared with 1971 to 1976, which represent the time periods before and after the implementation of OSHA standards. The study found that the implementation of OSHA standards was not associated with a statistically significant reduction in the average frequency or the severity of all injuries. The study found a statistically significant association between implementation of OSHA standards and a reduction in ""struck by machine"" injuries. The quality of the causal evidence presented in this study is low. This means we are not confident that the differences in injuries from the period 1964 to 1970 compared with 1971 to 1976 are attributable to the introduction of OSHA standards.","OSHA Enforcement Activities","Other health and safety Workplace injury",Employed,Manufacturing,"United States",1986, "The impact of Occupational Safety and Health regulations, 1973-1983","Viscusi, W. (1986). The impact of Occupational Safety and Health regulations, 1973-1983. RAND Journal of Economics, 17(4), 567–580.","OSHA Enforcement","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Health and safety-Low-Mixed impacts Health and safety","Summary: The study’s objective was to examine changes in the effects of OSHA inspections and penalties on injury rates in manufacturing industries between 1973 and 1983. Although OSHA no longer operates as it did during this period, this study provides historical context for changes that were later made to the program. The study used a regression model to examine the changes in injury rates in manufacturing industries associated with higher and lower rates of OSHA inspections and penalties during the prior two years. The study found that the evidence of the effectiveness of OSHA inspections and penalties in reducing injuries was mixed, and the effects of OSHA enforcement activities on most outcomes varied over time. The quality of the causal evidence presented in this study is low. This means we are not confident that the differences in injuries within industries are attributable to the inspections or penalties.","OSHA Enforcement Activities","Inspections Other health and safety Workplace injury",Employed,Manufacturing,"United States",1986, "Evaluation of the Charleston Claimant Placement and Work Test Demonstration","Corson, W., Long, D., & Nicholson, W. (1985). Evaluation of the Charleston Claimant Placement and Work Test Demonstration. Department of Labor Unemployment Insurance Occasional Paper, 85(2), 1-113.","Job Search Assistance, Reemployment","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to determine the impact of a more-stringent work test and enhanced employment services on Unemployment Insurance (UI) claimants’ benefits receipt and reemployment outcomes. The authors randomly assigned UI claimants to four conditions, comprising three distinct treatment groups and one control group. Administrative data sources, including UI and Employment Service (ES) records as well as records of claimants’ interactions with program staff provided outcomes for sample members in all four conditions. The study found that UI claimants in the more-intensive treatment conditions—treatment groups 1 and 2—collected UI benefits for fewer weeks than those in the control condition, by 0.76 weeks in treatment group 1 and 0.61 weeks in treatment group 2; these differences were statistically significant. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Charleston Claimant Placement and Work Test Demonstration, and not to other factors.","JSA services","Job search assistance and supportive services","Dislocated or displaced worker, Unemployed",,"United States",1985, "Direct and indirect effects of regulation: A new look at OSHA’s impact","Bartel, A., & Thomas, L. (1985). Direct and indirect effects of regulation: A new look at OSHA’s impact. Journal of Law and Economics, 28(1), 1–25.","OSHA Enforcement","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Compliance-Low-Favorable impacts Compliance Health and safety-Low-No impacts Health and safety","Summary: The study’s objective was to determine the effect of Occupational Safety & Health Administration (OSHA) inspections on noncompliance with OSHA standards and the effect of noncompliance on lost-workday injuries in the 1970s. Although OSHA no longer operates as it did during that period, this study provides historical context for later changes made to the program. The study used a structural model to examine differences in the injury rates and noncompliance for industries that received higher rates of OSHA inspections. The study did not find a statistically significant relationship between noncompliance with OSHA standards and workplace injuries. The quality of the causal evidence presented in this study is low. This means we are not confident that the differences in injury rates among industries with higher rates of noncompliance are attributable solely to noncompliance or that differences in noncompliance rates among industries with higher rates of inspections are attributable to inspections.","OSHA Enforcement Activities","Inspections Workplace injury",Employed,,"United States",1985, "Impacts of transitional employment for mentally retarded young adults: Results of the STETS demonstration","Kerachsky, S., Thornton, C., Bloomenthal, A., Maynard, R. & Stephens, S. (1985). Impacts of transitional employment for mentally retarded young adults: Results of the STETS demonstration. New York: Manpower Demonstration Research Corporation.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Structured Training and Employment Transitional Services (STETS) program on employment rates, earnings, and Social Security Disability Income (SSDI) and Supplemental Security Income (SSI) receipt. The STETS program included a suite of work-readiness training, transitional jobs, and postplacement support services for young adults with intellectual disabilities. The study was a randomized controlled trial that randomly assigned young adults to the treatment group, which could participate in the STETS program, or to the control group, which could not. The study drew on data from in-person interviews conducted 6, 15, and 22 months after the start of the program. The study found that young adults in the treatment group were employed at significantly higher rates and, on average, earned more than the control group 15 and 22 months after the program began. The study also found that 15 months after random assignment, the young adults in the treatment group were significantly less likely than those in the control group to receive SSI or SSDI benefits. The quality of causal evidence presented in this report is high because it is based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the STETS program, and not to other factors.","Structured Training and Employment Transitional Services","Job search assistance and supportive services Other employment and reemployment","Disability, Low income",,"United States",1985,http://www.mdrc.org/sites/default/files/impacts_of_transitional_employment_fr.p… "Wisconsin Job Service: ERP Pilot Project final report","Wisconsin Department of Industry, Labor, and Human Relations (1984). Wisconsin Job Service: ERP Pilot Project final report. Madison, WI: DILHR.","Job Search Assistance, Reemployment","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study estimated the effect of mandatory participation in a job search workshop for Unemployment Insurance (UI) recipients separated indefinitely from their previous employers. The study was a randomized controlled trial (RCT) conducted in six sites in Wisconsin. Eligible UI recipients were randomly assigned to either the treatment group, which was required to attend a six-hour workshop, or a control group, which was not required to attend the workshop. In general, there were no statistically significant differences in duration of UI benefit receipt between treatment and control group members across all six sites or for individual sites. The quality of causal evidence presented in this report is high because it was based on a well-implemented RCT. This means we are confident that the estimated effects are attributable to the job search workshop and not to other factors.","JSA services","Job search assistance and supportive services","Dislocated or displaced worker, Unemployed",,"United States",1984, "An assessment of OSHA’s recent effects on injury rates","McCaffrey, D. (1983). An assessment of OSHA’s recent effects on injury rates. Journal of Human Resources, 18(1), 131-146.","OSHA Enforcement","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Health and safety-Mod/high-No impacts Health and safety","Summary: The study’s objective was to examine the effect of OSHA inspections on injury rates in manufacturing and construction firms from 1976 to 1978. Although OSHA no longer operates as it did during this period, this study provides historical context for changes that were later made to the program. The author used a regression model to compare the differences in injury rates of manufacturing and construction firms that received inspections in March and April (“early”) with those that received inspections in November and December (“late”). The study found that, relative to late OSHA inspections, early OSHA inspections were not associated with a statistically significantly reduction in injury rates within the year of inspection. The quality of causal evidence for some analyses presented in this study is moderate because the analyses used a well-conducted nonexperimental design. This means we have confidence that these findings provide some evidence that OSHA inspections had no effect on injury rates.","OSHA Enforcement Activities","Inspections Workplace injury",Employed,"Construction, Manufacturing","United States",1983, "Worker injuries: The effects of Workers’ Compensation and OSHA inspections","Robertson, L., & Keeve, J. (1983). Worker injuries: The effects of Workers' Compensation and OSHA inspections. Journal of Health Politics, Policy and Law, 8(3), 581-597.","OSHA Enforcement","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment Health and safety-Low-Favorable impacts Health and safety","Summary: The study had two objectives: (1) to examine the effect of OSHA citations on injuries (method 1) and (2) to examine the effect of changes in OSHA inspections on changes in days of work lost because of injuries (method 2). Although OSHA no longer operates as it did during the study period, the study provides historical context for the program. Method 1 used a regression model to compare injuries across three firms from 1973 to 1980. Method 2 used a different regression model to compare changes in work days lost because of injuries from 1975 to 1976 to changes in OSHA inspections during the same period, using data at the industry-by-state level. The study found that firms had 35.8 fewer injuries in the years in which they received a citation; however, citations in past years were not significantly related to current year injuries. One additional OHSA inspection was associated with a 2.8 day reduction in the number of work days lost because of injuries.  The quality of causal evidence presented by both methods in this study is low. This means we are not confident that the differences in workplace injuries or lost work days are attributable to OSHA citations or inspections.","OSHA Enforcement Activities","Inspections Workplace injury",Employed,Manufacturing,"United States",1983, "The impact of Occupational Safety and Health regulation","Viscusi, W. (1979). The impact of Occupational Safety and Health regulation. The Bell Journal of Economics, 10(1), 117–140.","OSHA Enforcement","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Health and safety-Low-No impacts Health and safety","Summary: The study’s objective was to examine the effects of OSHA inspections and penalties at the industry level on workplace injuries between 1972 and 1975. Although OSHA no longer operates as it did during this period, this study provides historical context for changes that were later made to the program. The study used a regression model to examine differences in injury rates for industries and years with higher rates of OSHA inspections and penalties, relative to industries and years with lower rates of OSHA inspections or penalties. The study found that OSHA inspections and proposed penalties were not statistically significantly related to injuries. The quality of causal evidence presented in this study is low. This means we are not confident that the study’s findings provide causal evidence of the effect of inspections on injuries.","OSHA Enforcement Activities","Inspections Other health and safety Workplace injury",Employed,,"United States",1979,http://law.vanderbilt.edu/files/archive/009_Impact_of_Occupational_Safety.pdf "The Impact of OSHA Inspections on Manufacturing Injury Rates","Smith, R (1979). The Impact of OSHA Inspections on Manufacturing Injury Rates. Journal of Human Resources, 14(2),  145-170.","OSHA Enforcement","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Health and safety-Mod/high-Favorable impacts Health and safety","Summary: The study’s objective was to examine the effect of OSHA inspections on injury rates in manufacturing firms in 1973 and 1974. Although OSHA no longer operates as it did during this period, this study provides historical context for changes that were later made to the program. The authors used a regression model to compare the differences in injury rates of firms that received inspections in March and April (“early”) and those that received inspections in November and December (“late”). The study found that in 1973, firms receiving early inspections had significantly lower injury rates that year than those that were inspected later in the year. However, in 1974, firms inspected early and late in the year had similar injury rates. The quality of causal evidence presented in this study is moderate because the study used a well-conducted nonexperimental design. This means we have confidence that the effects estimated in this study are attributable at least in part to OSHA inspections. However, as with any nonexperimental study design, other factors not accounted for in the study could also have contributed to the estimated effects.","OSHA Enforcement Activities","Inspections Workplace injury",Employed,Manufacturing,"United States",1979, "The Nevada claimant placement project.","Steinman, J. (1978). The Nevada claimant placement project. Washington, DC: U.S. Department of Labor, Employment & Training Administration.",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of the Nevada Claimant Placement Project (NCPP), an intervention designed to accelerate labor force reattachment among Unemployment Insurance (UI) claimants through mandatory, intensive case management. The study was a randomized controlled trial; UI claimants were randomly assigned to either a treatment group, which received enhanced case management services, or to a control group, which received typical services available to UI claimants. The author used UI administrative records to compare the UI benefit receipt of treatment group members with that of control group members. The study found that the treatment group members received $318 less in UI benefits than control group members. The quality of the causal evidence presented in this report is low because attrition could not be determined and the study did not include controls for claimant characteristics in its analysis. This means we are not confident that the estimated effects are attributable to the NCPP.","Reemployment Eligibility Assessment","RESEA Job search assistance and supportive services Other employment and reemployment","Dislocated or displaced worker, Unemployed",,"United States",1978, "Evaluating the Vocational Rehabilitation Program using longitudinal data: Evidence for a quasi-experimental research design","Dean, D., Dolan, R., & Schmidt, R. (1999). Evaluating the Vocational Rehabilitation Program using longitudinal data: Evidence for a quasi-experimental research design. Evaluation Review, 23(2), 162–189","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages","Summary: The study’s objective was to determine the impact of participation in Vocational Rehabilitation (VR), a state and federal program, on earnings for people with disabilities. VR provides services and supports to people with disabilities to help them achieve their employment goals. The authors analyzed linked Rehabilitation Services Administration (RSA) and Social Security Administration (SSA) data for about 29,000 people whose VR cases were closed in 1980. The linked data contained annual earnings histories, service expenditures, and disability and demographic information. By the eighth year after first receiving VR services, women in six of seven disability categories and men in four of seven disability categories earned significantly more than their counterparts who had not received VR services. The quality of the causal evidence presented in this study is moderate. This means we have some confidence that the observed effects represent the impact of VR, although other factors might also have contributed.","the Vocational Rehabilitation (VOC) Programs","Disability insurance Supplemental security income (SSI) Vocational rehabilitation",Disability,,"United States",, "Investor behavior and the purchase of company stock in 401(k) plans—the importance of plan design","Liang, N., & Weisbenner, S. (2002). Investor behavior and the purchase of company stock in 401(k) plans—the importance of plan design. National Bureau of Economic Research working paper 9131. Cambridge, MA: NBER.","Behavioral Finance: Retirement","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employer benefits receipt-Low-Favorable impacts Employer benefits receipt","Summary: The study’s objective was to determine whether 401(k) plan characteristics, including the number of total investment options offered by a 401(k) plan and the requirements for whether employers’ matching contributions had to be allocated to employer stock, influenced the percentage of employees’ 401(k) plan contributions allocated to employer stock. The authors analyzed differences in portfolio allocations based on the number of funds available and other key plan characteristics using data from Compustat and Securities and Exchange Commission (SEC) forms and regression analyses, controlling for firm-fixed effects. The number of investment options and the percentage of assets allocated to employer stock were negatively correlated. Further, employees at firms that required employer matching contributions to be allocated to employer stock allocated a larger share of assets to employer stock than those at other firms. The quality of causal evidence presented in this study is low. This low rating means that we are not confident that differences among plan characteristics caused changes in the share of funds allocated to employer stock. Other factors are likely to have contributed.","Number of Fund Choices and Restrictions on Employer Matching Contributions","Employer provided retirement benefits",Employed,,"United States",,