Title,Citation,Topic_area,Study_type,Study_evidence_rating,Outcome_effectiveness,Findings,Intervention_program,Topics,Target_population,Firm_characteristics,Geographic_setting,Original_publication_date,Original_publication_link,"Review Protocol" "Synthesis Report: Research Synthesis: Employment Programs and Demonstrations for SSI and SSDI Beneficiaries",,"Disability Employment Policy",,,,"Findings: Evidence echoes previous literature reviews on the challenges of generating substantive impacts, though customized supports to well-targeted populations show some potential. The most effective interventions provided intensive, customized supports and services focused on job training, placement, and retention to narrowly defined target populations. Interventions that provided support services or incentives to help beneficiaries keep more of their benefits when working had small or no impacts on employment, even if spending on services was high. There is no evidence of SSI or SSDI caseload reductions, even among interventions that improved employment and/or earnings. Little is known about interventions for improving earnings of people with TBI and PTSD. Recruiting beneficiaries to participate in demonstrations was difficult, which limited the generalizability of study findings. Fidelity to the demonstration model is important. Work incentives and supports can be difficult to implement in the context of SSA’s existing work incentives, creating potential confusion for beneficiaries and program staff. A strong technical assistance component, with incentives for service providers to accept the assistance, is important to successful implementation. Demonstrations should be pilot tested before being implemented on a national scale.",,,Disability,,,,,"Disability Employment Policy Review Protocol" "Synthesis Report: Behavioral Finance Synthesis: Findings",,"Behavioral Finance: Retirement",,,,"Findings: People have relatively limited knowledge about saving for retirement and can be induced to save more when provided with additional information. Making retirement more salient, by having people think of themselves in retirement or providing a target retirement date, can increase intentions to save and alter investment choices. People can become overwhelmed by the number of investment options they face; when this occurs, they tend to use simple rules to make decisions.",,"Employer provided retirement benefits","Adult, Older worker",,"United States",,,"Behavioral Finance: Retirement Review Protocol" "Reflections on Accelerating CTE: Final evaluation report","Smith, T. (2019). Reflections on Accelerating CTE: Final evaluation report. Washington, DC: JFF.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Accelerating Career & Technical Education (CTE) program on community college students’ credential completion. The author compared outcomes before the implementation of the Accelerating CTE program and during the program using an interrupted time-series (ITS) design based on aggregate college data. The study participants were enrolled in Accelerating CTE programs, including health career and applied technologies pathways. The study found that participating in the Accelerated CTE program was associated with an increase in credential completion. However, the study did not include tests of statistical significance. The quality of causal evidence presented in this report is low because the author did not account for trends in outcomes before the intervention. This means we are not confident that the effects are attributable to the Accelerating CTE program; other factors are likely to have contributed.","Accelerating Career & Technical Education (CTE) Program","Community college education and other classroom training","Adult, Other barriers",,"Rural, United States",2019,https://files.eric.ed.gov/fulltext/ED598367.pdf,"Community College Review Protocol" "Does AVID Higher Education (AVID HE) increase student term-to-term progression, persistence toward credited classes and social capital for first-generation college students placing into developmental education: A mixed methods study","Plinski, C. M. (2018). Does AVID Higher Education (AVID HE) increase student term-to-term progression, persistence toward credited classes and social capital for first-generation college students placing into developmental education: A mixed methods study. (Doctoral dissertation). Retrieved from ProQuest Dissertations and Theses database. (UMI No. 10825692) doi: 10.15760/etd.6311","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to assess the impact of the Advancement via Individual Determination Higher Education (AVID HE), a developmental education program, on first generation college students’ educational persistence. The study used a nonexperimental design to compare the outcomes of students who participated in AVID HE and those who did not. Using data from college institutional records, the author tested for group differences in educational persistence. The study found that AVID HE participation was significantly related to higher cumulative credits and higher enrollment rates in a credit-earning writing course. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to AVID HE; other factors are likely to have contributed.","the Advancement via Individual Determination Higher Education (AVID HE)","Community college education and other classroom training","Adult, Other barriers",,"United States",2018,http://dx.doi.org/10.15760/etd.6311,"Community College Review Protocol" "Accelerating developmental math students in California community colleges: A comparative assessment of two acceleration models","Martinez, A. F. (2018). Accelerating developmental math students in California community colleges: A comparative assessment of two acceleration models. (Unpublished doctoral dissertation). California State University, Long Beach, CA.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to compare the impact of two accelerated pathway models (course redesign and compression) on completion rates for community college students. This summary focuses on the course redesign accelerated model. This study used a nonexperimental design to compare accelerated and non-accelerated pathways to college-level math by tracking the progress of students placed in developmental math courses. The study found that participation in the course redesign accelerated program was significantly related to higher college-level and developmental math completion rates for first-generation students and students placed in both low-level and mid-level remediation. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the course redesign accelerated model; other factors are likely to have contributed.","the course redesign accelerated model","Community college education and other classroom training","Adult, Other barriers",,"United States",2018,https://search.proquest.com/openview/adffc87f79e0373131993e9c4e2f5070/1?pq-orig…,"Community College Review Protocol" "Starting to succeed: The impact of CUNY Start on academic momentum","Webber (2018). Starting to succeed: The impact of CUNY Start on academic momentum. Retrieved from http://www1.cuny.edu/sites/cunystart/wp-content/uploads/sites/51/2018/08/gateway_brief_final.pdf","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the CUNY Start program on community college students’ gateway course completion. The study used a nonexperimental design to compare the outcomes of students who participated in the CUNY Start program to a matched comparison group who did not participate in the program. Using program and institutional research data, the author conducted statistical models to examine differences between the groups. The study found that students participating in CUNY Start were significantly more likely to complete gateway courses than nonparticipating students. The quality of causal evidence presented in this study is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to CUNY Start, but other factors might also have contributed.","the CUNY Start Program","Community college education and other classroom training","Age, Other barriers",,"United States",2018,http://www1.cuny.edu/sites/cunystart/wp-content/uploads/sites/51/2018/08/gatewa…,"Community College Review Protocol" "STEM education for workforce development through online contextualized training","Mohammadi, A. (2018). STEM education for workforce development through online contextualized training. (Unpublished doctoral dissertation). University of Nebraska, Lincoln, Nebraska.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of contextualized teaching and learning (CTL) on education outcomes. Using institutional data, the author conducted a nonexperimental design to compare education outcomes of CTL participants to non-CTL participants. The study found no statistically significant relationships between participation in the contextualized teaching and learning training and credit hours completed, length of program enrollment, or credentials attained. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention and did not include sufficient controls. This means we are not confident that the estimated effects are attributable to CTL; other factors are likely to have contributed.","the Contextualized Teaching and Learning (CTL) Training","Basic skills Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Other barriers, Dislocated or displaced worker",,"United States",2018,https://search.proquest.com/openview/2185911e68616901d0e3cf2e958e11d6/1?cbl=187…,"Community College Review Protocol" "Accelerating developmental math students in California community colleges: A comparative assessment of two acceleration models","Martinez, A. F. (2018). Accelerating developmental math students in California community colleges: A comparative assessment of two acceleration models. (Unpublished doctoral dissertation). California State University, Long Beach, CA.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of two accelerated pathway models (course redesign and compression) on completion rates for community college students. This summary focuses on the compression accelerated model. This study used a nonexperimental design to compare accelerated and non-accelerated pathways to college-level math by tracking the progress of students placed in developmental math courses. The study found that participation in the compression accelerated program was significantly related to higher college-level and developmental math completion rates for students placed in mid-level remediation. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the accelerated pathway programs; other factors are likely to have contributed.","the Compression Accelerated Model","Community college education and other classroom training","Adult, Other barriers",,"United States",2018,https://search.proquest.com/openview/adffc87f79e0373131993e9c4e2f5070/1?pq-orig…,"Community College Review Protocol" "Does stacking work? The academic value of short-term, stackable certificates (Unpublished doctoral dissertation)","Bowers, J. M. (2018). Does stacking work? The academic value of short-term, stackable certificates (Unpublished doctoral dissertation). University of Washington, Seattle, WA.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-No impacts Education and skills gains","Summary: The study’s objective was to evaluate the benefits of stackable certificates on education and earnings outcomes for full-time students with no prior post-secondary education. The author used a nonexperimental design to compare the effects of participating in stackable short-term certificate programs on outcomes for those in the treatment group versus those in the comparison group. The study found that students who attained a single short-term stackable certificate had a sufficiently lower likelihood of earning a two-year degree, whereas attaining two or more short-term, stackable certificates more than doubled a student’s likelihood of earning a degree. The quality of causal evidence presented in this study is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to short-term stackable certificates, but other factors might also have contributed.","Short-Term Stackable Certificates","Capacity building programs Community college education and other classroom training","Adult, Other barriers",,"United States",2018,https://digital.lib.washington.edu/researchworks/bitstream/handle/1773/43361/Bo…,"Community College Review Protocol" "Becoming college-ready: Early findings from a CUNY Start evaluation","Scrivener, S., Gupta, H., Weiss, M. J., Cohen, B., Cormier, M. S., & Brathwaite, J. (2018). Becoming college-ready: Early findings from a CUNY Start evaluation. New York: MDRC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Mixed impacts Education and skills gains","Summary: The study’s objective is to examine the impact of the CUNY Start program on community college students’ enrollment rates, college readiness, and credits attempted and earned. The study used a randomized controlled trial that examined data obtained from CUNY student transcripts, the CUNY Administrative Data Warehouse, and Start applications. The study found that CUNY Start participants were significantly more likely to enroll in college and become college-ready by the end of the program than students in the control group. The quality of causal evidence presented in this report is high because it is a well-implemented randomized controlled trial with low attrition. This means we are confident that the estimated effects are attributable to CUNY Start, and not to other factors.","the CUNY Start Program","Community college education and other classroom training","Adult, Other barriers",,"United States",2018,https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3269901,"Community College Review Protocol" "Assessing the effectiveness of Quantway®: A multilevel model with propensity score matching","Yamada, H., Bohannon, A. X., Grunow, A., & Thorn, C. A. (2018). Assessing the effectiveness of Quantway®: A multilevel model with propensity score matching. Community College Review, 46(3), 257-287. doi: 10.1177/0091552118771754","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Quantway® 1 math program on community college students’ developmental math completion rates. The authors used a nonexperimental design to compare the outcomes of students who were in the Quantway® 1 program to a matched comparison group. When compared to non-participating students, the study found that Quantway® 1 program participation was associated with a significantly higher likelihood of successfully completing the developmental math course. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Quantway® 1 program; other factors are likely to have contributed.",Quantway®,"Community college education and other classroom training","Adult, Other barriers",,"United States",2018,https://doi.org/10.1177%2F0091552118771754,"Community College Review Protocol" "Testing rapid connections to subsidized private sector jobs for low-income individuals in San Francisco: Implementation and early impacts of the STEP Forward program","Walter, J, Navarro, D, Anderson, C., & Tso, A. (2017). Testing rapid connections to subsidized private sector jobs for low-income individuals in San Francisco: Implementation and early impacts of the STEP Forward program. OPRE Report 2017-103. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-No impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of STEP Forward on employment, earnings, and education outcomes. The authors used a randomized controlled trial to estimate impacts of enrollment in STEP Forward, using administrative data on enrollees and enrollees’ self-reported data. The study found that people enrolled in STEP Forward were more likely to become employed and earned more after random assignment than people in the control group. There were no significant differences between the groups in their education outcomes. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to STEP Forward, and not to other factors.","STEP Forward","Adult and Dislocated Worker programs Job search assistance and supportive services","Other barriers",,"Urban, United States",2017,https://www.acf.hhs.gov/opre/resource/testing-rapid-connections-subsidized-priv…,"Employment and Training Review Protocol" "Orthotics, Prosthetics, and Pedorthics (HOPE) careers consortium: Final evaluation report","Good, K., & Yeh-Ho, H. (2017). Orthotics, Prosthetics, and Pedorthics (HOPE) careers consortium: Final evaluation report. Denver, CO: McREL International.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Orthotics, Prosthetics & Pedorthics (HOPE) careers consortium program on education outcomes. The authors used a nonexperimental design to compare education outcomes of HOPE participants to a matched comparison group with institutional research data. The study found no significant associations between HOPE participation and program completion rates, completion of more than one certificate or degree, or furthering education status. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the HOPE program; other factors are likely to have contributed.","the Orthotics, Prosthetics & Pedorthics (HOPE) Careers Consortium Program","Capacity building programs Community college education and other classroom training","Adult, Other barriers, Dislocated or displaced worker, Unemployed, Veteran or military",,"United States",2017,https://www.skillscommons.org/bitstream/handle/taaccct/13872/hope-consortium-tc…,"Community College Review Protocol" "Final evaluation report: Linn-Benton Community College","Kelley-Smith, A., Schoeph, K., Hamai, T., & Bishop, M. (2017). Final evaluation report: Linn-Benton Community College. Albany, OR: LB iLearn Campus.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study’s objective was to assess the impact of degree and certificate programming offered at Linn-Benton Community College’s (LBCC) iLearn campus compared to traditional programming offered at the community college on various educational, employment, and earnings outcomes. The study used a nonexperimental design to compare the outcomes of students enrolled in the Linn-Benton (LB) iLearn campus to students enrolled in traditional programming. The study found that program participation was significantly associated with increased rates of program completion. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the LB iLearn campus program; other factors are likely to have contributed.","the LB iLearn Campus Program","Capacity building programs Community college education and other classroom training","Adult, Other barriers, Dislocated or displaced worker, Veteran or military",,"United States",2017,https://www.skillscommons.org/handle/taaccct/15675,"Community College Review Protocol" "Midlands Technical College TAACCCT Better Occupational Outcomes with Simulation Training: Program evaluation final report.","Center for Applied Research. (2017). Midlands Technical College TAACCCT Better Occupational Outcomes with Simulation Training: Program evaluation final report. Charlotte, NC: Center for Applied Research.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Mixed impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Better Occupational Outcomes with Simulation Training (BOOST) program on education outcomes. The authors used a nonexperimental design to compare the outcomes of students participating in BOOST to a matched comparison group using data from the colleges’ student information systems and the National Student Clearinghouse. The study found a significant relationship between BOOST participation and increased semester enrollment, increased certificate program completion, lower transfer rates, and faster rates of school completion. The quality of causal evidence presented in this report is low because the authors did not use sufficient controls in their analysis. This means we are not confident that the estimated effects are attributable to the BOOST program; other factors are likely to have contributed.","Better Occupational Outcomes with Simulation Training (BOOST) Program","Basic skills Capacity building programs Community college education and other classroom training","Adult, Other barriers",,"United States",2017,https://www.skillscommons.org/bitstream/handle/taaccct/15679/BOOST%20Final%20Ev…,"Community College Review Protocol" "The effect of changing employers’ access to criminal histories on ex-offenders’ labor market outcomes: Evidence from the 2010-2012 Massachusetts CORI Reform","Jackson, O., & Zhao, B. (2017). The effect of changing employers’ access to criminal histories on ex-offenders’ labor market outcomes: Evidence from the 2010-2012 Massachusetts CORI Reform. Boston, MA: Federal Reserve Bank of Boston. [Study 2: Record access reform]",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Mixed impacts Employment","Summary: The state of Massachusetts, as part of the Criminal Offender Record Information (CORI) Reform, implemented a policy change to reduce access to job applicants’ criminal histories. The study’s objective was to examine the impact of the record access reform on employment and earnings among people with a criminal record. The authors investigated similar research questions for another contrast, which is available here. The authors used a nonexperimental design to compare people with a criminal record who were impacted by the record access reform with a similar group of people who were not impacted by the reform. The authors compared impacts on employment and earnings using Unemployment Insurance wage records and CORI from the state Department of Criminal Justice Information Services for 14 quarters after the reform was implemented. The study found a mixed relationship between record access reform and the employment rate of people. In quarters 1 to 5, there was either no impact on employment or a small positive impact. In quarters 6 to 14, this relationship was significant and negative, which means that record access reform was associated with a lower employment rate among the treatment group compared with the comparison group. The record access reform was associated, however, with significantly increased earnings in 5 of the 14 quarters after implementation, but it showed no impact in the rest of the 14 quarters. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the record access reform; other factors are likely to have contributed.","Criminal Offender Record Information (CORI) Reform",Reentry,Justice-involved,,"United States",2017,https://papers.ssrn.com/sol3/papers.cfm?abstract_id=2942005,"Employment and Training Review Protocol" "New evidence on integrated  career pathways: Final impact report for Accelerating Opportunity"," Anderson, T., Kuehn, D., Eyster, L., Barnow, B., & Lerman, R. I. (2017). New evidence on integrated career pathways: Final impact report for Accelerating Opportunity. Washington, D.C.: Urban Institute.  ","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Unfavorable impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Accelerating Opportunity (AO) program on education, earnings, and employment outcomes in four states. This summary contains the findings from Kentucky. The authors used a nonexperimental design to compare education, earnings, and employment outcomes of AO participants to a matched comparison group.  The study found AO participants were significantly more likely to earn a credential, earn more credentials, earn more college credits, and were likely to earn more than 12 credits than the comparison group. AO participants also had a significantly higher employment rate, but also lower earnings compared to the comparison group.  The quality of causal evidence presented in this study is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the Accelerating Opportunity program, but other factors might also have contributed.","Accelerating Opportunity (AO) program","Basic skills Capacity building programs Community college education and other classroom training","Adult, Other barriers",,"United States",2017,http://tawb.org/wp-content/uploads/2017/06/ao_final_impacts.pdf,"Community College Review Protocol" "The effect of changing employers’ access to criminal histories on ex-offenders’ labor market outcomes: Evidence from the 2010-2012 Massachusetts CORI Reform","Jackson, O., & Zhao, B. (2017). The effect of changing employers’ access to criminal histories on ex-offenders’ labor market outcomes: Evidence from the 2010-2012 Massachusetts CORI Reform. Boston, MA: Federal Reserve Bank of Boston. [Study 1: Ban the Box reform]",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Unfavorable impacts Earnings and wages Employment-Low-Unfavorable impacts Employment","Summary: The state of Massachusetts, as part of the Criminal Offender Record Information (CORI) Reform, implemented a policy change known as Ban the Box, which refers to a box job seekers would check to report their criminal histories in job applications. The study’s objective was to examine the impact of Ban the Box on employment and earnings among people with a criminal record. The authors investigated similar research questions for another contrast, which is available here. The authors used a nonexperimental design to compare people with a criminal record who were impacted by the Ban the Box reform with a group of people with a criminal record who were not impacted (that is, those who did not have a criminal record until after the Ban the Box reform). The authors compared impacts on employment and earnings using Unemployment Insurance wage records and CORI from the state Department of Criminal Justice Information Services for six quarters after the reform was implemented. For each of the six quarters after the start of the reform, the Ban the Box reform was significantly associated with an employment rate that was 1.0 to 3.8 percentage points lower among the treatment group compared with the comparison group. The reform was also significantly associated with relatively lower earnings among the treatment group in two of the six quarters after the reform but was not associated with a difference in earnings in the other four quarters. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Ban the Box reform; other factors are likely to have contributed.","Criminal Offender Record Information (CORI) Reform",Reentry,Justice-involved,,"United States",2017,https://papers.ssrn.com/sol3/papers.cfm?abstract_id=2942005,"Employment and Training Review Protocol" "The impact of Medicare Part D on self-employment.","Moulton, J. G., Diebold, J. C., & Scott, J. C. (2017). The impact of Medicare Part D on self-employment. Research on Aging, 39(1), 64-85.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The study examined the effect of the introduction of Medicare Part D on self-employment. The authors used a nonexperimental approach and data from the American Community Survey to estimate the impact. The authors found that self-employment significantly increased by 0.5 percentage points after the program began. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects on self-employment are attributable to the introduction of Medicare Part D, although other factors might also have contributed.","Medicare Part D","Federal retirement benefits Older workers' programs","Adult, Older worker",,"United States",2017,,"Employment and Training Review Protocol" "Project IMPACT: Innovative multi-industry partnership and career training project final evaluation report. Gateway Community Technical College","Jensen, J., Horohov, J., & Waddington, J. (2017). Project IMPACT: Innovative multi-industry partnership and career training project final evaluation report. Gateway Community Technical College. Lexington, KY: University of Kentucky, College of Education, Educational Policy Studies & Evaluation.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study’s objective was to assess the impact of Project IMPACT on education, earnings, and employment outcomes. Using academic records from the college as well as data obtained from the Kentucky Center for Workforce Statistics, the authors used a nonexperimental design to compare outcomes of Project IMPACT participants to outcomes of historical cohort students who were enrolled in the Project IMPACT programs of study prior to grant implementation. The study found that participating in Project IMPACT was significantly associated with a higher likelihood to take courses, pass courses, earn credits, and receive credentials. The study also found that participating in Project IMPACT was significantly associated with higher earnings in the quarter following enrollment. The quality of causal evidence presented in this study is low for the education and employment outcomes because the authors used a comparison group from previous enrollment years presenting a confounding factor and because the authors did not ensure the groups being compared were similar before the intervention, respectively. This means we are not confident that the estimated effects are attributable to Project IMPACT; other factors are likely to have contributed.","Project IMPACT","Employer partnerships Capacity building programs Community college education and other classroom training","Adult, Other barriers, Veteran or military",,"United States",2017,https://www.skillscommons.org/bitstream/handle/taaccct/15674/IMPACT%20Final%20E…,"Community College Review Protocol" "Does protecting older workers from discrimination make it harder to get hired? Evidence from disability discrimination laws.","Neumark, D., Song, J., & Button, P. (2017). Does protecting older workers from discrimination make it harder to get hired? Evidence from disability discrimination laws. Research on Aging, 39(1), 29-63.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Mixed impacts Employment","Summary: The study examined the impact of the strength of state disability discrimination laws on hiring rates of older men. The study used statistical models and data from the Health and Retirement Study and the Survey of Income and Program Participation to estimate the impacts. The study found no relationship between the strength of disability discrimination laws and the hiring rate for older unemployed disabled and nondisabled men. The quality of casual evidence presented in this report is low because the study is a nonexperimental analysis that did not demonstrate that the groups being compared were similar and did not account for possible differences in the analysis. This means we are not confident that the estimated effects are attributable to state disability discrimination laws; other factors are likely to have contributed.","Disability discrimination laws","Health Older workers' programs","Adult, Older worker, Male",,"United States",2017,https://journals.sagepub.com/doi/full/10.1177/0164027516656142,"Employment and Training Review Protocol" "New evidence on integrated career pathways: Final impact report for Accelerating Opportunity","Anderson, T., Kuehn, D., Eyster, L., Barnow, B., & Lerman, R. I. (2017). New evidence on integrated career pathways: Final impact report for Accelerating Opportunity. Washington, D.C.: Urban Institute.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-Mixed impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Accelerating Opportunity (AO) program on education, earnings, and employment outcomes in four states. This summary contains the findings from Kansas. The authors used a nonexperimental design to compare education, earnings, and employment outcomes of AO participants to a matched comparison group.  The study found AO participants were significantly more likely to earn a credential and earn more credentials than the comparison group. AO participants also had a significantly higher employment rate and earning gains compared to the comparison group. However, AO participants earned significantly fewer college credits than the comparison group. The quality of causal evidence presented in this study is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the Accelerating Opportunity program, but other factors might also have contributed.  ","Accelerating Opportunity (AO) program","Basic skills Capacity building programs Community college education and other classroom training","Adult, Other barriers",,"United States",2017,http://tawb.org/wp-content/uploads/2017/06/ao_final_impacts.pdf,"Community College Review Protocol" "Evaluating recidivism and job quality outcomes for participants in the Hoosier Initiative for Reentry Employment (HIRE) program","Northcutt Bohmert, M., Hood, B. J., & Meckes, J. (2017). Evaluating recidivism and job quality outcomes for participants in the Hoosier Initiative for Reentry Employment (HIRE) program. Corrections: Policy, Practice and Research, 2(2), 110-129.",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of job placement through the Hoosier Initiative for Reentry Employment (HIRE) program on recidivism among people released from Indiana prisons in 2014. The authors used HIRE program data and Indiana Department of Corrections data on the prison population to compare the recidivism outcomes of previously incarcerated people who were placed in a job through HIRE with the outcomes of those who were not placed in a job by the HIRE program. The authors used a statistical model to compare rates of recidivism between these two groups. The study found a statistically significant relationship between the intervention and recidivism. People obtaining a job placement were less likely to be reincarcerated between one to two years after release than nonparticipants who did not use intervention program services. The study also examined employment outcomes but these were not eligible for review. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to job placement through HIRE; other factors are likely to have contributed.","the Hoosier Initiative for Reentry Employment (HIRE) program","Other employment and reemployment Reentry",Justice-involved,,"United States",2017,https://doi.org/10.1080/23774657.2016.1277378,"Employment and Training Review Protocol" "Assessing the statewide impact of the Specter Vocational Program on reentry outcomes: A propensity score matching analysis.","Hill, L., Scaggs, S., & Bales, W. D. (2017). Assessing the statewide impact of the Specter Vocational Program on reentry outcomes: A propensity score matching analysis. Journal of Offender Rehabilitation, 56(1), 61-86.",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine the impact of completing the Workplace and Community Transition Training for Incarcerated Individuals (WCTTII) program on the employment and recidivism outcomes of young people released from prison in Florida. The authors used a nonexperimental matching design to create a comparison group of former prisoners who were similar to WCTTII program graduates but who did not participate in the WCTTII program or who started the program but did not complete it. The authors estimated the program’s impact by comparing employment and recidivism outcomes for program graduates with those for the matched comparison group using administrative data from the Florida Department of Corrections Offender Based Information System, law enforcement, and the Department of Revenues. The study found that the WCTTII program decreased the proportion of former prisoners who were reconvicted or re-incarcerated within three years of their release. The study found no statistically significant relationships between the program and employment within three months of release. The quality of causal evidence on recidivism outcomes presented in this report is moderate because they were based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the WCTTII program, but other factors might also have contributed. The quality of causal evidence on employment is low because the authors did not adequately account for differences in employment history before the intervention.","Workplace and Community Transition Training for Incarcerated Individuals","Other employment and reemployment Reentry",Justice-involved,,"United States",2017,,"Employment and Training Review Protocol" "Impact of the Accelerate You! instructional model on student success","Henderson, T. F. (2017). Impact of the Accelerate You! instructional model on student success. (Unpublished doctoral dissertation). Murray State University, Murray, KY.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to examine the effects of the Accelerate You! (AY!) program on academic persistence. The study used a nonexperimental design to compare the outcomes of AY! program participants to a comparison group. Using academic records, the author tested for group differences in semester-to-semester persistence. The study found no significant relationships between AY! program participation and academic persistence. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to Accelerate You!; other factors are likely to have contributed.","the Accelerate You! (AY!) program","Community college education and other classroom training","Adult, Other barriers",,"United States",2017,https://digitalcommons.murraystate.edu/cgi/viewcontent.cgi?referer=https%3A//sc…,"Community College Review Protocol" "New evidence on integrated  career pathways: Final impact report for Accelerating Opportunity","Anderson, T., Kuehn, D., Eyster, L., Barnow, B., & Lerman, R. I. (2017). New evidence on integrated career pathways: Final impact report for Accelerating Opportunity. Washington, D.C.:  Urban Institute.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Mixed impacts Earnings and wages Education and skills gains-Mod/high-Mixed impacts Education and skills gains Employment-Mod/high-Mixed impacts Employment","Summary: The study’s objective was to examine the impact of the Accelerating Opportunity (AO) program on education, earnings, and employment outcomes in four states. This summary contains the findings from Illinois. The authors used a nonexperimental design to compare education, earnings, and employment outcomes of AO participants to a matched comparison group. The study found that AO participants were significantly more likely to earn a credential, earn more credentials, and earn more than 12 credits than the comparison group. AO participants also had a significantly higher employment rate and medium-term earning gains compared to the comparison group. However, AO participants earned fewer college credits than the comparison group. The quality of causal evidence presented in this study is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the Accelerating Opportunity program, but other factors might also have contributed.","Accelerating Opportunity (AO) program","Basic skills Capacity building programs Community college education and other classroom training","Adult, Other barriers",,"United States",2017,http://tawb.org/wp-content/uploads/2017/06/ao_final_impacts.pdf,"Community College Review Protocol" "The effect of the Affordable Care Act on labor transitions among older workers.","Camilleri, S. E. (2017). The effect of the Affordable Care Act on labor transitions among older workers. In Three papers on the Affordable Care Act (Doctoral dissertation). North Carolina State University, Raleigh, NC.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-No impacts Employment","Summary: The study examined the impact of the Affordable Care Act (ACA) on the employment outcomes of older workers. The author used data from the Current Population Survey for 2011–2016 and regression analyses to estimate impacts. The study found that the ACA was not associated with employment outcomes among older workers. The quality of causal evidence presented in this report is moderate because the study is based on a well-implemented nonexperimental design. This means we are somewhat confident that any estimated effects are attributable to the ACA, but other factors might also have contributed.","Affordable Care Act (ACA)","Older workers' programs Health insurance","Adult, Older worker",,"United States",2017,,"Employment and Training Review Protocol" "New evidence on integrated career pathways: Final impact report for Accelerating Opportunity. ","Anderson, T., Kuehn, D., Eyster, L., Barnow, B., & Lerman, R. I. (2017). New evidence on integrated career pathways: Final impact report for Accelerating Opportunity. Washington, D.C.:  Urban Institute.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Mixed impacts Earnings and wages Education and skills gains-Mod/high-Mixed impacts Education and skills gains Employment-Mod/high-Mixed impacts Employment","Summary: The study’s objective was to examine the impact of the Accelerating Opportunity (AO) program on education, earnings, and employment outcomes in four states. This summary contains the findings from Louisiana. The authors used a nonexperimental design to compare education, earnings, and employment outcomes of AO participants to a matched comparison group.  The study found AO participants were significantly more likely to earn a credential and earn more credentials than the comparison group. AO participants also had a significantly higher short-term employment rate and earning gains compared to the comparison group.  However, AO participants earned significantly fewer college credits than the comparison group. The quality of causal evidence presented in this study is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the Accelerating Opportunity program, but other factors might also have contributed.","Accelerating Opportunity (AO) program","Basic skills Capacity building programs Community college education and other classroom training","Adult, Other barriers",,"United States",2017,http://tawb.org/wp-content/uploads/2017/06/ao_final_impacts.pdf,"Community College Review Protocol" "Wealth differentials in the impact of conditional and unconditional cash transfers on education: Findings from a community-randomised controlled trial in Zimbabwe","Fenton, R, Nyamukapa, C., Gregson, S., Robertson, L., Mushati, P., Thomas, R., & Eaton, J.W. (2016). Wealth differentials in the impact of conditional and unconditional cash transfers on education: Findings from a community-randomised controlled trial in Zimbabwe. Psychology, Health & Medicine, 21(8), 909-917","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-No impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the effects of conditional cash transfers (CCT) and unconditional cash transfers (UCT) on child labor and schooling outcomes. This summary focuses on the comparison between the UCT group and the control group. The study was a randomized controlled trial in which households were randomly assigned to receive one of two cash transfers (conditional or unconditional) or to participate in the control group that did not receive a cash transfer. Using household survey data, the authors analyzed the impact of the treatment conditions on child labor and schooling outcomes a year after the intervention began. The study found that receipt of an unconditional cash transfer was significantly associated with an increases in school attendance for the poorest households, but not significantly related to child labor outcomes. The quality of causal evidence presented in this report is low because it based on a randomized controlled trial with unknown attrition and the authors did not ensure that the groups being compared were similar before receiving the cash transfers. This means we are not confident that the estimated effects are attributable to the unconditional cash transfers; other factors are likely to have contributed.","Cash Transfer Program","Child labor","Other barriers, Other, Low income",,International,2016,https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5044770/,"Child Labor Review Protocol" "Spousal labor market effects from government health insurance: Evidence from a veterans affairs expansion.","Boyle, M. A. & Lahey, J. N. (2016). Spousal labor market effects from government health insurance: Evidence from a veterans affairs expansion. Journal of Health Economics, Elsevier, 45(C), 63-76.","Older Workers, Veterans","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Mod/high-No impacts Employment","Summary: The study examined the impact of the expansion of health insurance for veterans through the U.S. Department of Veterans Affairs (VA) in the mid-1990s (as a result of the implementation of the Veteran’s Health Care Eligibility Reform Act) on the employment and earnings of non-covered spouses. The authors used a statistical model and data from the Census Bureau’s March Current Population Survey and the Health and Retirement Study to compare the employment and earnings of wives of male veterans with wives of non-veterans of the same ages before and after the expansion of health insurance for veterans through the VA. The study found no statistically significant associations between the expansion of health insurance for veterans and the employment of their wives and mixed evidence on associations between the expansion of health insurance for veterans and the earnings of their wives. The quality of causal evidence presented in this report is moderate for the employment outcomes because it was based on a well-implemented nonexperimental design. This means we would be somewhat confident that any estimated effects would be attributable to the expansion of health insurance for veterans through the VA, but other factors might also have contributed. The quality of causal evidence presented in this report is low for earnings outcomes because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the expansion of health insurance for veterans through the VA; other factors are likely to have contributed.","Veteran Health Insurance Expansion","Health Older workers' programs Veterans' reemployment","Adult, Older worker, Veteran or military",,"United States",2016,,"Older Workers, Veterans Review Protocol" "Third-party evaluation of implementation & impact of the Southwest Missouri Public Safety and Emergency Medical Initiative TAACCCT grant.","Cosgrove & Associates. (2016). Third-party evaluation of implementation & impact of the Southwest Missouri Public Safety and Emergency Medical Initiative TAACCCT grant. St. Louis, MO: Cosgrove & Associates.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of Crowder College’s enhanced Public Safety and Emergency Medical Initiative (PSP) program on education and employment outcomes. The study used a nonexperimental design to compare the outcomes of students who were in Crowder College’s enhanced PSP program to a comparison group of students who were not enrolled in the program. The study found that participation in the PSP program was significantly associated with higher program completion and employment rates than the comparison group. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to Crowder College’s enhanced PSP program; other factors are likely to have contributed.","Crowder College Public Safety and Emergency Medical Initiative (PSP) Program","Capacity building programs Community college education and other classroom training","Adult, Other barriers, Unemployed, Low-skilled",,"United States",2016,https://www.skillscommons.org/bitstream/handle/taaccct/9128/Crowder%20College_P…,"Community College Review Protocol" "Assessing the First Two Years’ Effectiveness of Statway®","Yamada, H., & Bryk, A. S. (2016). Assessing the First Two Years’ Effectiveness of Statway®. Community College Review, 44(3), 179–204. doi: 10.1177/0091552116643162","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to evaluate the impact of Statway® on community college students’ earning of math course credits. The study used a nonexperimental design to compare the outcomes of students who were in the Statway® program to a matched comparison group. Using institutional research data from the community colleges, the authors conducted statistical models to examine differences between the groups. When compared to non-participating students, the study found that Statway® program participation was associated with a significantly higher likelihood of earning college math credit. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to Statway®; other factors are likely to have contributed.",Statway®,"Community college education and other classroom training","Adult, Other barriers",,"United States",2016,https://doi.org/10.1177%2F0091552116643162,"Community College Review Protocol" "Wealth differentials in the impact of conditional and unconditional cash transfers on education: Findings from a community-randomised controlled trial in Zimbabwe","Fenton, R., Nyamukapa, C., Gregson, S., Robertson, L., Mushati, P., Thomas, R., & Eaton, J. W. (2016) Wealth differentials in the impact of conditional and unconditional cash transfers on education: Findings from a community-randomized controlled trial in Zimbabwe. Psychology, Health & Medicine, 21(8), 909-917","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the effects of conditional cash transfers (CCT) and unconditional cash transfers (UCT) on child labor and schooling outcomes. This summary focuses on the comparison between the CCT group and the control group. The study was a randomized controlled trial in which households were randomly assigned to receive one of two cash transfers (conditional or unconditional) or to participate in the control group that did not receive a cash transfer. Using household survey data, the authors analyzed the impact of the treatment conditions on child labor and schooling outcomes a year after the intervention began. The study found that receipt of a conditional cash transfer was significantly associated with a reduction in child work and increases in school attendance for the poorest households. The quality of causal evidence presented in this report is low because it based on a randomized controlled trial with unknown attrition and the authors did not ensure that the groups being compared were similar before receiving the cash transfer. This means we are not confident that the estimated effects are attributable to the conditional cash transfer; other factors are likely to have contributed.","Cash Transfer Program","Child labor","Other barriers, Other, Low income",,International,2016,https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5044770/,"Child Labor Review Protocol" "Men and women expecting to work longer: Do changing work conditions matter?","Moen, P., Kojola, E., Kelly, E.L., & Karakaya, Y. (2016). Men and women expecting to work longer: Do changing work conditions matter? Work, Aging and Retirement, 2(3), 321-344.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of a work flexibility intervention called STAR (Support. Transform. Achieve. Results) on workers’ expectations of retirement age and bridge jobs. The study is a randomized controlled trial that uses surveys of workers before the intervention and five years post-intervention. The study found that receiving STAR was associated with higher expectations of working at age 65 and retiring at age 67 or older. The quality of causal evidence presented in this report is low because, although it was based on a randomized controlled trial, it had unknown attrition and the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to STAR; other factors are likely to have contributed.","STAR (Support. Transform. Achieve. Results.)","Work based and other occupational training Other employer services","Adult, Older worker",,"United States",2016,https://experts.umn.edu/en/publications/men-and-women-expecting-to-work-longer-…,"Employment and Training Review Protocol" "Enhanced vocational rehabilitation for veterans with mild traumatic brain injury and mental illness: Pilot study","O’Connor, M. K., Mueller, L., Kwon, E., Drebing, C. E., O’Connor, A. A., Semiatin, A., & Daley, R. (2016). Enhanced vocational rehabilitation for veterans with mild traumatic brain injury and mental illness: Pilot study. Journal of Rehabilitation Research & Development, 53(3), 307-319.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of an embedded cognitive rehabilitation intervention on employment and earnings. The study was a randomized controlled trial with the authors using administrative data. The study found no statistically significant relationships between an embedded cognitive rehabilitation intervention and employment and earnings after one year. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to an embedded cognitive rehabilitation intervention; other factors are likely to have contributed.","the cognitive rehabilitation intervention","Substance abuse recovery Vocational rehabilitation","Other barriers, Male, Veteran or military",,"United States",2016,http://search.proquest.com/openview/ee479834dd8beedff02771b00bc95e0a/1?pq-origs…,"Employment and Training Review Protocol" "The impact of disability benefits on labor supply: Evidence from the VA’s disability compensation program","Autor, D. H., Duggan, M., Greenberg, K., & Lyle, D. S. (2016). The impact of disability benefits on labor supply: Evidence from the VA’s disability compensation program. American Economic Journal: Applied Economics, 8(3), 31-68. http://www.aeaweb.org/aej-applied/ [Impact of eligibility expansion]",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Unfavorable impacts Earnings and wages Employment-Low-Unfavorable impacts Employment Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study examined the impact of a 2001 expansion in eligibility for Disability Compensation (DC) to type 2 diabetes for Vietnam-era veterans on labor force participation, earnings, and receipt of public benefits. The authors also examined the impact of receiving DC benefits and amount on labor force participation and earnings; see profile here . The authors estimated statistical models to compare outcomes for Vietnam-era Army veterans who served with “boots on the ground” (BOG) with those who served “not on the ground” (NOG) Veterans who did not fight directly in the conflict, from before and after the implementation of the type 2 diabetes policy change in 2001. The authors used administrative data from the U.S. Army Office of Economic and Manpower Analysis, the U.S. Department of Veterans Affairs (VA), and the Social Security Administration. The implementation of expanded DC coverage and benefits in 2001 resulted in reductions in labor force participation and earnings among impacted veterans as well as increases in the receipt of disability benefits. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the expansion in eligibility for Disability Compensation (DC); other factors are likely to have contributed to the findings.",DC,"Disability insurance Veterans' reemployment","Disability, Male, Veteran or military",,"United States",2016,https://pubs.aeaweb.org/doi/pdf/10.1257/app.20150158,"Employment and Training Review Protocol" "The effect of Social Security information on the labor supply and savings of older Americans.","Armour, P., & Lovenheim, M. F. (2016). The effect of Social Security information on the labor supply and savings of older Americans. (Working paper no. 361). Ann Arbor, MI: University of Michigan, Michigan Retirement Research Center.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Mixed impacts Employment","Summary: The study examined the impact of the Social Security statements issued by the Social Security Administration (SSA) on older men’s annual hours worked. The authors used a nonexperimental design and data from Health and Retirement Study surveys and Social Security administrative records to estimate the impacts. The study found that receiving the first Social Security Statement is associated with a decrease in self-reported annual hours worked and receiving the second Social Security Statement is associated with an increase in self-reported annual hours worked. The quality of casual evidence presented in this report is moderate because that the study was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to Social Security statements, but other factors might also have contributed.","Social Security statements","Older workers' programs Other disparities or discrimination in employment and earnings","Adult, Older worker, Male",,"United States",2016,,"Employment and Training Review Protocol" "The impact of disability benefits on labor supply: Evidence from the VA’s disability compensation program","Autor, D. H., Duggan, M., Greenberg, K., & Lyle, D. S. (2016). The impact of disability benefits on labor supply: Evidence from the VA’s disability compensation program. American Economic Journal: Applied Economics, 8(3), 31-68. http://www.aeaweb.org/aej-applied/ [Impact of DC enrollment and benefit amount]",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Unfavorable impacts Employment","Summary: The study examined the impact of Disability Compensation (DC) enrollment and benefit amount on labor force participation and earnings. The authors also examined the impact of the expansion of eligibility for DC benefits on labor force participation and earnings; see profile here . The authors estimated statistical models to compare outcomes for Vietnam-era Army veterans who served with “boots on the ground” (BOG) with those who served “not on the ground” (NOG) who did not fight directly in the conflict, before and after the implementation of the Type 2 diabetes policy change in 2001. The authors used administrative data from the U.S. Army Office of Economic and Manpower Analysis, the U.S. Department of Veterans Affairs (VA), and the Social Security Administration (SSA). The increases in DC enrollment due to the expansion in eligibility for DC in 2001 were associated with reductions in labor force participation and earnings. Increases in DC benefit amounts due to the expansion in eligibility were also associated with reductions in labor force participation. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to DC enrollment and benefit amounts, but other factors might also have contributed to the findings.",DC,"Disability insurance Veterans' reemployment","Disability, Male, Veteran or military",,"United States",2016,https://pubs.aeaweb.org/doi/pdf/10.1257/app.20150158,"Employment and Training Review Protocol" "The effect of private sector work opportunities in prison on labor market outcomes of the formerly incarcerated","Cox, R. (2016). The effect of private sector work opportunities in prison on labor market outcomes of the formerly incarcerated. Journal of Labor Research, 37, 412-440.",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study examines the effectiveness of a prison work program, Prison Industry Enhancement Certification Program (PIECP), on employment, earnings, and recidivism. The author used a nonexperimental design to compare employment, earnings, and recidivism outcomes among PIECP participants with those of a group of nonparticipants with similar demographic and criminal-justice backgrounds. They used data from state departments of corrections merged with data on reported earnings. The study found that PIECP participation was associated with a shorter time to employment after release from prison and with higher subsequent earnings. The study found PIECP had no impact on the risk of reconviction or the risk of reincarceration. The quality of causal evidence for recidivism outcomes is moderate because they were based on a well-implemented nonexperimental design. This means we are somewhat confident that any estimated effects would have been attributable to PIECP if the study had found statistically significant effects on recidivism. The quality of causal evidence on employment and earnings outcomes is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects on employment and earnings are attributable to PIECP; other factors are likely to have contributed.","Prison Industry Enhancement Certification Program (PIECP)","Other employment and reemployment Reentry",Justice-involved,,"United States",2016,https://doi.org/10.1007/s12122-016-9229-0,"Employment and Training Review Protocol" "To work for yourself, for others, or not at all? How disability benefits affect the employment decisions of older veterans","Coile, C., Duggan, M., & Guo, A. (2016). To work for yourself, for others, or not at all? How disability benefits affect the employment decisions of older veterans. Unpublished manuscript.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study examined the impact of a 2001 expansion in eligibility for Disability Compensation (DC) to cover type 2 diabetes for Vietnam-era veterans on their employment, earnings, and public benefit receipt. The authors estimated statistical models to compare outcomes among male Vietnam-era veterans who did and did not serve with on the ground using data from the Veterans Supplement to the Current Population Survey from 1995 to 2015. The study found that the expansion of eligibility for DC was associated with greater receipt of DC, a lower likelihood of working for others, and a greater likelihood of self-employment by on-the-ground veterans compared with those veterans who did not serve on the ground. The study did not find a relationship between the expansion and earnings. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to changes in eligibility for DC and not to other factors.",DC,"Other wages and benefits Veterans' reemployment","Disability, Male, Veteran or military",,"United States",2016,https://www.nber.org/papers/w23006,"Employment and Training Review Protocol" "The Green Jobs and Health Care impact evaluation: Findings from the impact study of four training programs for unemployed and disadvantaged workers","Martinson, K., Williams, J., Needels, K., Peck, L., Moulton, S., Paxton, N., Mastri, A., Copson, E., Comfort, A., & Brown-Lyons, M. (2016). The Green Jobs and Health Care impact evaluation: Findings from the impact study of four training programs for unemployed and disadvantaged workers. Retrieved from https://wdr.doleta.gov/research/FullText_Documents/ETAOP-2017-07%20Findings%20from%20the%20Impact%20Study.pdf","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine the impact of the Grand Rapids Community College (GRCC) Pathways to Prosperity program on education, earnings, and employment outcomes. The study was a randomized controlled trial. The authors used a baseline information form, the National Directory of New Hires (NDNH), a follow-up survey, and administrative program data to compare the outcomes between the treatment and control groups over an 18-month follow-up period. The study found that the GRCC Pathways to Prosperity program had a significant positive impact on completion rates for vocational training and life skills classes, and receipt of a vocational credential. The quality of causal evidence presented in this report is high because it is based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the GRCC Pathways to Prosperity program and not to other factors.","the Grand Rapids Community College (GRCC) Pathways to Prosperity Program","Basic skills Capacity building programs Community college education and other classroom training","Adult, Justice-involved, Other barriers, Unemployed, Low income",,"United States",2016,https://wdr.doleta.gov/research/FullText_Documents/ETAOP-2017-07%20Findings%20f…,"Community College Review Protocol" "Wealth differentials in the impact of conditional and unconditional cash transfers on education: Findings from a community-randomised controlled trial in Zimbabwe","Fenton, R., Nyamukapa, C., Gregson, S., Robertson, L., Mushati, P., Thomas, R., & Eaton, J.W. (2016). Wealth differentials in the impact of conditional and unconditional cash transfers on education: Findings from a community-randomised controlled trial in Zimbabwe. Psychology, Health & Medicine, 21(8), 909-917.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-No impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the effects of conditional cash transfers (CCT) and unconditional cash transfers (UCT) on child labor and schooling outcomes. This summary focuses on the comparison between the CCT group and the UCT group. The study was a randomized controlled trial in which households were randomly assigned to receive one of two cash transfers (conditional or unconditional) or to participate in the control group that did not receive a cash transfer. Using household survey data, the authors analyzed the impact of the treatment conditions on child labor and schooling outcomes a year after the intervention began. The study found that the CCT group had significantly higher levels of school attendance than the UCT group for the least poor households. However, the study found no statistically significant difference in the number of hours worked between the two groups. The quality of causal evidence presented in this report is low because it based on a randomized controlled trial with unknown attrition and the authors did not ensure that the groups being compared were similar before receiving the cash transfers. This means we are not confident that the estimated effects are attributable to the cash transfers; other factors are likely to have contributed.","Cash Transfer Program","Child labor","Other barriers, Other, Low income",,International,2016,https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5044770/,"Child Labor Review Protocol" "Job insecurity, unemployment insurance and on-the-job search. Evidence from older American workers.","Gutierrez, I. A. (2016). Job insecurity, unemployment insurance and on-the-job search. Evidence from older American workers. Labour Economics, 41, 228-245. doi:10.1016/j.labeco.2016.05.011","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-No impacts Employment","Summary: The study examined the impact of the potential wage replacement rate through Unemployment Insurance (UI) on the probability of transitioning to non-employment. The study used a nonexperimental design and data from the Health and Retirement Study (HRS) from 1996–2006 and 2010–2012 to identify workers who expected job loss during the baseline survey and who experienced job transitions by the follow-up survey two years later. The study found no statistically significant relationships between potential wage replacement rates and transitions to non-employment. The quality of causal evidence presented in this report is low because the analyses do not sufficiently account for other factors that might contribute to the estimated effects. This means we are not confident that the estimated effects are attributable to the potential wage replacement rate through UI; other factors are likely to have contributed.","Unemployment Insurance (UI)","Older workers' programs Unemployment Insurance","Adult, Older worker, Employed",,"United States",2016,,"Employment and Training Review Protocol" "Evaluation of the Re-Integration of Ex-Offenders (RExO) program: Final impact reports","Wiegand, A., & Sussell, J. (2016). Evaluation of the Re-Integration of Ex-Offenders (RExO) program: Final impact reports. Retrieved from the Department of Labor website: https://wdr.doleta.gov/research/FullText_Documents/ETAOP-2015-10_The-Evaluation-of-the-Re-Integration-of-Ex-Offenders-%28RExO%29-Program-Final-Impact-Report_Acc.pdf",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of Reintegration of Ex-Offenders (RExO) programs on employment, earnings, public benefits receipt, and recidivism outcomes. The study was a randomized controlled trial whose authors employed a statistical method to estimate the impact of RExO using data from four sources, including qualitative data generated from an implementation study, administrative data on criminal justice outcomes, administrative data on employment and earnings from the National Directory of New Hires, and a follow-up survey of participants. The study found that the RExO program did not increase the long-term employment, earnings, public benefit receipt, or recidivism. The quality of causal evidence on employment, earnings, public benefit receipt, and recidivism outcomes presented in this report is high because the evidence is based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects would have been attributable to the RExO program and not to other factors had the study found statistically significant effects.","Reintegration of Ex-Offenders (RExO) programs","Job search assistance and supportive services Reentry Mentoring",Justice-involved,,"Urban, United States",2016,https://wdr.doleta.gov/research/FullText_Documents/ETAOP-2015-10_The-Evaluation…,"Employment and Training Review Protocol" "Employment outcomes among African American and white women with disabilities: Examining the inequalities.","Balcazar, F. E., & Suarez-Balcazar, Y. (2015). Employment outcomes among African American and white women with disabilities: Examining the inequalities. Women, Gender, and Families of Color, 3(2), 144-164.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-No impacts Employment","Summary: The study examined the impact of adult vocational rehabilitation (VR) services on employment outcomes for African American and white women. The authors used a statistical model and data from a Midwestern state VR system to compare the odds of employment after completing VR services for older versus younger women. The study found no significant difference in employment outcomes between older and younger women who completed VR services. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before receiving VR services. This means we are not confident that the estimated effects are attributable to participation in VR services; other factors are likely to have contributed.","Vocational Rehabilitation (VR) Services","Vocational rehabilitation","Adult, Older worker, Female, Black or African American, White, Disability",,"United States",2015,,"Employment and Training Review Protocol" "A controlled trial of supported employment for people with severe mental illness and justice involvement","Bond, G. R., Kim, S. J., Becker, D. R., Swanson, S. J., Drake, R. E., Krzos, I. M., . . . Frounfelker, R. L. (2015). A controlled trial of supported employment for people with severe mental illness and justice involvement. Psychiatric Services, 66(10), 1027-1034.",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Individual Placement and Support (IPS) intervention on employment and recidivism outcomes relative to a job club program called Work Choice. The authors used an experimental design to estimate the impact of IPS and analyzed data from people’s self-reports on forms and interviews and electronic medical and employment records. The authors found positive statistically significant impacts of IPS on employment compared with the job club program. The authors found no statistically significant impacts of IPS on recidivism. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the IPS intervention and not to other factors.","the Individual Placement and Support (IPS) intervention","Health Reentry","Justice-involved, Unemployed",,"United States",2015,https://doi.org/10.1176/appi.ps.201400510,"Employment and Training Review Protocol" "An experimental evaluation of a comprehensive employment-oriented prisoner re-entry program","Cook, P. J., Kang, S., Braga, A. A., Ludwig, J., & O’Brien, M. E. (2015). An experimental evaluation of a comprehensive employment-oriented prisoner re-entry program. Journal of Quantitative Criminology, 31, 355-382.",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Milwaukee Safe Street Prisoner Release Initiative on employment, earnings, public benefit receipt, and recidivism. Drawing on administrative data from the Wisconsin Department of Corrections, the study used a randomized controlled trial to estimate program impacts. The authors used statistical models to compare the outcomes of treatment and comparison group members. The study found that those in the treatment group had significantly higher earnings and rates of employment and significantly lower likelihood of new arrests than those in the control group. The study found no significant differences between the groups in the likelihood of reimprisonment in the one year of follow-up. The quality of causal evidence presented in this report for the recidivism outcomes is moderate because it was based on a randomized controlled trial in which the authors did not account for the different probabilities of assignment to the treatment group; nevertheless, this study can be considered to have employed a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to Milwaukee Safe Street Prisoner Release Initiative and not to other factors. The quality of causal evidence presented in this report for the employment, earnings, and public benefit receipt outcomes is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Milwaukee Safe Street Prisoner Release Initiative; other factors are likely to have contributed.","the Milwaukee Safe Street Prisoner Release Initiative","Reentry Work based and other occupational training",Justice-involved,,"Urban, United States",2015,https://www.researchgate.net/profile/Philip_Cook2/publication/284942331_An_Expe…,"Employment and Training Review Protocol" "An outcome evaluation of a prison work release program: Estimating its effects on recidivism, employment, and cost avoidance","Duwe, G. (2015). An outcome evaluation of a prison work release program: Estimating its effects on recidivism, employment, and cost avoidance. Criminal Justice Policy Review, 26(6), 531-554.",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study examined the impact of the Minnesota Department of Correction’s work release program on post-release employment, earnings, and recidivism outcomes for adult offenders. The author used a nonexperimental design (propensity score matching) to create a comparison group of nonparticipants who were similar to program participants. The author estimated the program’s effects by comparing these groups’ post-release employment, earnings, and recidivism outcomes using data from the Minnesota Bureau of Criminal Apprehension, Minnesota Department of Corrections, and the Minnesota Department of Employee and Economic Development. The author found that, on average, program participation decreased the risk of reconviction by 14 percent and of re-incarceration by 17 percent, but increased the risk of participants having their supervised release revoked for a technical violation by 78 percent. The quality of causal evidence presented in this report is moderate for outcomes related to recidivism and low for post-release employment and earnings outcomes. This means we are somewhat confident that the estimated effects on recidivism are attributable to the work release program, although other factors might also have contributed, and we are not confident that the estimated effects on employment and earnings are attributable to the program; other factors are likely to have contributed.","Minnesota Department of Correction’s work release program","Job search assistance and supportive services Reentry",Justice-involved,,"United States",2015,,"Employment and Training Review Protocol" "How much does access to health insurance influence the timing of retirement?","Coe, N. B., & Goda, G. S. (2015). How much does access to health insurance influence the timing of retirement? (SIEPR Discussion Paper No. 14-007). Stanford, CA: Stanford Institute for Economic Policy Research. City, ST: Publisher.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Unfavorable impacts Employment Public benefits receipt-Low-No impacts Public benefit receipt","Summary: The study examined the impact of state-level reforms of health insurance on early retirement and Social Security retirement benefit claims. The authors used 1996–2010 data from the Health and Retirement Study (HRS) and statistical models to compare the outcomes of individuals in states with state-level reforms of health insurance with those in non-reform states. The study found that employed individuals in states with non-group health insurance reform were significantly more likely to retire at age 63. The quality of causal evidence presented in this report is low because the authors did not demonstrate that individuals in states with state-level reforms of health insurance were similar to those in non-reform states. This means we are not confident that the estimated effects are attributable to the non-group health insurance reform; other factors are likely to have contributed.","Retiree Health Insurance","Health insurance Older workers' programs","Adult, Older worker",,"United States",2015,,"Employment and Training Review Protocol" "What factors contributed to changes in employment during and after the great recession?","Farooq, A., & Kugler, A. D. (2015). What factors contributed to changes in employment during and after the great recession? IZA Journal of Labor Policy, 4(3), 1-28.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: This study examined the impact of the Work Opportunity Tax Credit (WOTC) on employment for veterans with disabilities and unemployed veterans. The study used a nonexperimental design to examine the effects of the WOTC on employment, based on data from the Annual Social and Economic (ASEC) supplement of the Current Population Survey from 2003 to 2013. The study showed no statistically significant relationships between the WOTC and employment for veterans with disabilities or for unemployed veterans. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that any estimated effects are attributable to the WOTC; other factors likely contributed to the outcomes. However, the study did not show any statistically significant effects.","the Work Opportunity Tax Credit","Veterans' reemployment Work Opportunity Tax Credit (WOTC)","Disability, Veteran or military",,"United States",2015,https://link.springer.com/article/10.1186/s40173-014-0029-y,"Employment and Training Review Protocol" "An assessment of the effectiveness of prison work release programs on post-release recidivism and employment.","Bales, W. D., Clark, C., Scaggs, S., Ensley, D., Coltharp, P., Singer, A., & Blomberg, T. G. (2015). An assessment of the effectiveness of prison work release programs on post-release recidivism and employment. Tallahassee, FL: Florida Department of Corrections and Tallahassee, FL: Florida State University College of Criminology and Criminal Justice.",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of work release programs in the state of Florida on recidivism and employment outcomes for people released from prison. The authors used a nonexperimental design to create a comparison group of nonparticipants who were eligible for work release program services but did not participate. The authors estimated the work release program’s effects by comparing treatment and comparison groups’ post-release recidivism and employment outcomes using administrative data from the state of Florida for three years after release. The authors found that participating in a work release program decreased the risk of arrest for a new felony or misdemeanor crime by about 10 percent one year following release from prison, by about 8 percent two years following release, and by about 9 percent three years following release. The study also found that people who completed the work-release program were less likely to have a reconviction at three years following release from prison, but reconvictions were the same across groups at one and two years following release. People who completed the work release program were more likely to return to prison for any reason after one year, but returns were the same across groups after two or three years. The quality of causal evidence presented in this report is moderate for outcomes related to recidivism and low for outcomes related to employment. This means we are somewhat confident that the estimated effects on recidivism are attributable to the work release program, although other factors might also have contributed; we are not confident that the estimated effects on employment are attributable to the program, as other factors are likely to have contributed","Florida's Back to Work Program",Reentry,Justice-involved,,"United States",2015,https://www.ncjrs.gov/pdffiles1/nij/grants/249845.pdf,"Employment and Training Review Protocol" "The impact of a randomly assigned time and place management initiative on work and retirement expectations.","Cahill, K. E., James, J. B., & Pitt-Catsouphes, M. (2015). The impact of a randomly assigned time and place management initiative on work and retirement expectations. Work, Aging and Retirement, 1(4), 350-368.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Unfavorable impacts Employment","Summary: The study examined the impact of a time and place management (TPM) initiative at a medical provider on retirement expectations among workers ages 50 and older. The study was a randomized control trial and used a series of surveys and administrative data to estimate the impact. The study found that, when surveyed 12 months after randomization, employees in the treatment group were statistically significantly more likely to expect to directly exit their job as opposed to staying in their current job within the next five years. The quality of causal evidence presented in this report is moderate because the study was a randomized controlled trial with high attrition, but the authors did demonstrate that the treatment and control groups were similar before the intervention. This means we are somewhat confident that the estimated effects are attributable to TPM, but other factors might also have contributed.","Time and Placement Management (TPM)","Older workers' programs","Older worker","Health care and social assistance",,2015,https://hrs.isr.umich.edu/publications/biblio/8231,"Employment and Training Review Protocol" "The effect of a severe health shock on work behavior: Evidence from different health care regimes.","Datta Gupta, N., Kleinjans, K. J., & Larsen, M. (2015). The effect of a severe health shock on work behavior: Evidence from different health care regimes. Social Science and Medicine, 136-137, 44-51.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the national health policies of the United States and Denmark on employment of older workers after a health shock, defined as a new cancer or cardiovascular disease diagnosis. The authors used a nonexperimental approach to compare the impact of a health shock on the likelihood of nonemployment in the United States’ private multipayer system with Denmark’s nationalized universal health care model. The authors used the data from the RAND Health and Retirement Study survey from 1994 to 2002 and Danish population registers for 1993 to 2001. The study found no differences between the United States and Denmark in the relationship between a health shock and employment for older workers. The quality of causal evidence presented in this report is low because the authors did not account for unobserved differences between the countries. This means we are not confident that differences in the association between health shocks and employment in the United States and Denmark are attributable to the national health care policies; other factors are likely to have contributed.","National Healthcare Policy","Health Older workers' programs","Adult, Older worker",,"International, United States",2015,https://www.sciencedirect.com/science/article/pii/S0277953615002816,"Employment and Training Review Protocol" "Veterans’ labor force participation: What role does the VA’s disability compensation program play?","Coile, C., Duggan, M., & Guo, A. (2015). Veterans’ labor force participation: What role does the VA’s disability compensation program play? American Economic Review, 105(5), 131-136.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study examined the impact of expanding eligibility for veterans’ Disability Compensation (DC) in 2001 and 2010 on labor force participation. The authors conducted a nonexperimental analysis to compare veteran and non-veteran labor force participation over time using the March Current Population Survey data from 1980 to 2014. The study found that veteran labor force participation was generally lower than that of non-veterans in the same 10-year age range during the periods following eligibility expansions. The quality of causal evidence presented in this report is low because there could be differences in external conditions that affected the treatment group and not the comparison group. This means we are not confident that the estimated effects are attributable to veterans’ receipt of DC; other factors are likely to have contributed to the findings.",DC,"Other wages and benefits Veterans' reemployment","Disability, Male, Veteran or military",,"United States",2015,https://www.aeaweb.org/articles?id=10.1257/aer.p20151062,"Employment and Training Review Protocol" "The effect of health reform on retirement.","Levy, H., Buchmueller, T. C., & Nikpay, S. (2015). The effect of health reform on retirement (Research Paper 329). Ann Arbor, MI: Michigan Retirement Research Center.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the expansion of Medicaid to low-income adults in 2014 on retirement rates of workers ages 55 to 64. The authors used a nonexperimental analysis to compare those who lived in an expansion state to those who lived in other states. The study used data from the monthly Current Population Survey from January 2005 through July 2015. The study found no statistically significant relationships between Medicaid expansion and retirement. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the expansion of Medicaid; other factors are likely to have contributed.","Medicaid expansion","Health insurance Older workers' programs","Adult, Older worker, Low income",,"United States",2015,https://deepblue.lib.umich.edu/handle/2027.42/116062,"Employment and Training Review Protocol" "The benefits of keeping idle hands busy: An outcome evaluation of a prisoner reentry employment program.","Duwe, G. (2015). The benefits of keeping idle hands busy: An outcome evaluation of a prisoner reentry employment program. Crime & Delinquency, 61(4), 559-586.",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Minnesota Department of Correction’s EMPLOY work release program on post-release employment, earnings, and recidivism outcomes for incarcerated adults. The author used propensity-score matching to create a comparison group of nonparticipants similar to EMPLOY program participants. The author estimated the program’s effects by comparing these groups’ post-release recidivism, employment, and earnings outcomes. Data from the Minnesota Department of Corrections provided recidivism information, and data from the Minnesota Department of Employee and Economic Development provided employment and earnings information. EMPLOY program participation decreased the risk of conviction for a new crime by 32 percent, the risk of reincarceration by 55 percent, and the risk of revocation for technical violations by 63 percent, on average. The quality of causal evidence presented in this report for recidivism outcomes is moderate because it was based on a well-implemented nonexperimental design that established that the criminal history of the two groups was similar before the intervention. This means we are somewhat confident that the estimated effects on recidivism are attributable to the EMPLOY program, but other factors might also have contributed. The quality of causal evidence presented in this report for employment outcomes is low because the author did not ensure that the groups being compared were similar in terms of employment history before the intervention. This means we are not confident that the estimated effects on employment outcomes are attributable to the EMPLOY program; other factors are likely to have contributed.","EMPLOY Program",Reentry,Justice-involved,,"United States",2015,http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.1019.6826&rep=rep1&typ…,"Employment and Training Review Protocol" "Three accelerated developmental education programs: Features, student outcomes, and implications","Jaggars, S. S., Hodara, M, Cho, S., & Xu, D. (2015). Three accelerated developmental education programs: Features, student outcomes, and implications. Community College Review 43(1), 3-26. doi: 10.1177/0091552114551752","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of three accelerated developmental education programs on gatekeeper (entry-level) course completion and college-level credit accumulation. This summary focuses on the Accelerated Learning Program (ALP) at the Community College of Baltimore. This nonexperimental study used regression analysis and propensity score matching to compare the outcomes of students who participated in the ALP to those who did not. The study reported outcomes one year and three years after students first enrolled in the course. The study found that ALP students had significantly higher course completion rates, course enrollment rates, and credit accumulation than comparison students one year and three years after enrollment. The quality of causal evidence presented in this study is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the Accelerated Learning Program, but other factors might also have contributed.","Accelerated Developmental Education","Community college education and other classroom training","Adult, Other barriers",,"United States",2015,https://doi.org/10.1177%2F0091552114551752,"Community College Review Protocol" "Becoming adults: One year impact findings from the youth villages’ Transitional Living evaluation","Valentine, E.J., Skemer, M., & Courtney, M.E. (2015). Becoming adults: One year impact findings from the youth villages’ Transitional Living evaluation. New York: MDRC.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Transitional Living program on education, earnings, and recidivism outcomes. The authors used a randomized controlled trial and estimated impacts by comparing the means of the treatment and control groups. Outcome data on education, earnings, and criminal involvement came from a 12-month survey conducted by the authors. The study found a statistically significant impact on earnings only. Youth in the treatment group earned an average $611 more than youth in the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Transitional Living, and not to other factors.","Transitional Living","Basic skills Other training and education Youth programs","Youth, Justice-involved, Disconnected youth",,"United States",2015,http://www.mdrc.org/sites/default/files/Becoming_Adults_FR.pdf,"Opportunities for Youth Review Protocol" "First Year Initiative's impact on developmental students' re-enrollment and course success at a community college","Rogers, S. S. (2015). First Year Initiative's impact on developmental students' re-enrollment and course success at a community college. (Unpublished doctoral dissertation). Wilmington University, New Castle, DE","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Mixed impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the First Year Initiative (FYI) program on community college students’ re-enrollment rates and successful completion of developmental math and reading courses. The study used a nonexperimental design to compare the outcomes of students who participated in the FYI program to eligible students who did not participate in the program. When compared to non-participating students, the study found that FYI program participation was associated with significantly higher re-enrollment rates and significantly lower successful course completes rates. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the FYI program; other factors are likely to have contributed.","the First Year Initiative (FYI) program","Community college education and other classroom training","Adult, Other barriers",,"United States",2015,https://search.proquest.com/openview/844c6b71d3a0c97530d29127a97348bd/1?pq-orig…,"Community College Review Protocol" "Did age discrimination protections help older workers weather the Great Recession?","Neumark, D., & Button, P. (2014). Did age discrimination protections help older workers weather the Great Recession? Journal of Policy Analysis and Management, 33(4), 566-601. doi:10.1002/pam.21762","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Unfavorable impacts Employment","Summary: The study examined whether the strong age discrimination laws moderated the impact of the Great Recession on employment outcomes of older workers. The study used statistical models and the data from the 2003–2011 Current Population Survey (CPS) and 2004–2011 Quarterly Workforce Indicators to estimate impacts. The study found that states with stronger age discrimination laws had experienced increases in unemployment rates, longer unemployment durations, and decreases in hiring rates for some types of older workers relative to younger workers in the months during and following the Great Recession. The quality of causal evidence presented in this study is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the differential effect of the Great Recession on older workers in states with strong age discrimination laws, but other factors might also have contributed.","Age Discrimination Laws","Older workers' programs Other disparities or discrimination in employment and earnings","Adult, Older worker, Female, Male",,"United States",2014,https://www.nber.org/papers/w19216,"Employment and Training Review Protocol" "Cognitive Symptom Management and Rehabilitation Therapy (CogSMART) for veterans with traumatic brain injury: Pilot randomized controlled trial","Twamley, E., Jak, A., Delis, D., Bondi, M., & Lohr, J. (2014). Cognitive Symptom Management and Rehabilitation Therapy (CogSMART) for veterans with traumatic brain injury: Pilot randomized controlled trial. Journal of Rehabilitation Research and Development, 51(1), 59-70.","Disability Employment Policy, Veterans","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of adding Cognitive Symptom Management and Rehabilitation Therapy (CogSMART) to standard supported employment programming for veterans with a history of traumatic brain injury (TBI) and persistent related postconcussive symptoms. Veterans were referred to the program and completed a series of baseline neurocognitive and neuropsychological assessments to determine eligibility. Eligible veterans were randomly assigned to either the CogSMART treatment group, which received supported employment, enhanced by CogSMART sessions, or to a control group that did not participate in CogSMART sessions. The study found that veterans in the CogSMART group demonstrated statistically significant reductions in postconcussive symptoms and improvements in prospective memory functioning. Although a higher proportion of the treatment group entered competitive employment within 14 weeks of starting the program—50 percent compared to 26 percent in the control group—the difference was not statistically significant. The quality of causal evidence presented in this study is low because it is a randomized controlled trial with high or unknown attrition and no control variables included in the analysis. This means we are not confident that the estimated effects are attributable to CogSMART. Other factors are likely to have contributed.","Cognitive Symptom Management and Rehabilitation Therapy","Vocational rehabilitation Veterans' reemployment","Disability, Veteran or military",,"United States",2014,,"Disability Employment Policy, Veterans Review Protocol" "The impact of ABS program participation on long-term GED attainment","Reder, S. (2014). The impact of ABS program participation on long-term GED attainment. Washington, DC: United States Department of Education, Office of Career, Technical and Adult Education.",Literacy,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of Adult Basic Skills (ABS) training on GED attainment. The author used a nonexperimental design to compare the outcomes of adults who participated in various levels of ABS training to a matched comparison group who did not, over a ten-year time period. The study found that ABS participants had significantly higher rates of GED attainment than adults who did not participate in ABS training. The quality of causal evidence presented in this report is moderate because it is based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to Adult Basic Skills training, but other factors might also have contributed.",,"Basic skills","Adult, Other barriers, Low-skilled",,"United States",2014,https://lincs.ed.gov/publications/pdf/ABS_GED.pdf,"Employment and Training Review Protocol" "The impact of ABS program participation on long-term economic outcomes","Reder, S. (2014). The impact of ABS program participation on long-term economic outcomes. Washington, DC: United States Department of Education, Office of Career, Technical and Adult Education.",Literacy,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages","Summary: The study’s objective was to examine the impact of Adult Basic Skills (ABS) training on earnings and wages. The author used a nonexperimental design to compare the outcomes of adults who participated in various levels of ABS training to a matched comparison group who did not, over a ten-year time period. The study found a significant relationship between participating in ABS training and higher income, with a greater increase in income for those with at least 100 hours of ABS training. The study also found that wages were significantly associated with the length of time since training and intensity of training, with higher wages among participants who had attained 100 hours of ABS training in earlier years. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to Adult Basic Skills training; other factors are likely to have contributed.",,"Basic skills","Adult, Other barriers, Low-skilled",,"United States",2014,https://lincs.ed.gov/publications/pdf/ABS_EconomicOutcomes.pdf,"Employment and Training Review Protocol" "Actions against poverty: The impact of career technical education","Rabren, K., Carpenter, J., Dunn, C., & Carney, J. (2014). Actions against poverty: The impact of career technical education. Career Development and Transition for Exceptional Individuals, 37(1), 29-39.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of participation in career or technical education (career tech) on post-high school employment for people with specific learning or intellectual disabilities who lived in relatively high-poverty areas. The authors estimated regression models comparing employment outcomes for youth who participated in career tech with those who did not, while controlling for differences in demographic characteristics. The study found that career tech participants were 0.235 times more likely than those in the comparison group to be employed when leaving high school. Career tech participants were also 0.064 times more likely to be employed at any point within the first year after high school (0.066 times for those who were unemployed upon leaving high school). These findings were statistically significant. The quality of causal evidence presented in this report is low because the study did not control for students’ degree of disadvantage. This means we are not confident that the estimated effects are attributable to career tech participation; other factors are likely to have contributed.","Career Tech","Other employment and reemployment Other training and education Youth programs","Youth, Disability, Other barriers",,"United States",2014,,"Employment and Training Review Protocol" "Effects of cash transfers on child labor and schooling in Kenya","Owoko, S. A. (2014). Effects of cash transfers on child labor and schooling in Kenya (Unpublished master's thesis). Nairobi, Kenya: University of Nairobi.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The objective of the study was to assess the impact of Kenya’s Cash Transfer to the Orphaned and Vulnerable Children (CT-OVC) program on children’s participation in work and school. The study used a post-test only design to assess differences in school enrollment and work participation between 5-17 year-old children in the CT-OVC program and those who were not in the program. The study found that receipt of the cash transfer was significantly related to lower rates of child labor and higher rates of school enrollment. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to CT-OVC; other factors are likely to have contributed.","Kenya Cash Transfer for Orphans and Vulnerable Children Program (Kenya CT-OVC)","Child labor","Other barriers, Other",,International,2014,,"Child Labor Review Protocol" "Substance Use Treatment and Reentry (STAR) program: Final evaluation report","Hunter, S. B., & Huang, C. Y. (2014). Substance Use Treatment and Reentry (STAR) program: Final evaluation report. Santa Monica, CA: RAND Corporation.",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Unfavorable impacts Employment","Summary: The study’s objective was to examine the impact of the Substance Use Treatment and Reentry (STAR) program on post-release employment and recidivism outcomes for justice-involved young adults in California. The authors used an interrupted time series design to compare the outcomes of justice-involved young adults before and after participating in the STAR program. They assessed the change in participants’ scores on the Center for Substance Abuse Treatment (CSAT) Government Performance Reporting Act assessments, which were administered at baseline and at 3, 6, and 12 months following program intake. The authors found statistically significant relationships between program participation and employment and recidivism outcomes. At six months after program intake, employment decreased by 26.7 percentage points but the number of participants who spent any time in a confined setting (jail, prison, juvenile hall) decreased by 11.5 percentage points. The quality of causal evidence presented in this report is low because the authors did not account for trends in outcomes before the intervention. This means we are not confident that the estimated effects on employment and recidivism are attributable to the program; other factors are likely to have contributed.","the Substance Use Treatment and Reentry (STAR) program","Substance abuse recovery Reentry","Youth, Justice-involved",,"United States",2014,https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5051995/,"Employment and Training Review Protocol" "Reducing child labour in Panama: An impact evaluation","Andisha, N., Chiquito-Saban, O., Emmerich, E., Figueroa, A., Jiang, Y., Lee, J. H., Manning, D., Ortega-Sanchez, A., & Gawande, K. (2014.) Reducing child labour in Panama: An impact evaluation. Journal of Development Effectiveness, 6(2), 128-146.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-No impacts Child labor","Summary: The study’s objective was to examine the impact of two components of the DESTINO program—CEC (a tutoring course) and EPA (an alternative primary school program)—on children’s participation in agricultural work in Panama. This summary focuses on the comparison between the EPA treatment group and the comparison group. The study used a nonexperimental comparison group design. Using post-intervention survey data, the authors compared the outcomes for children receiving the EPA program to children over 12, who had not received the CEC program and were not attending school. The study found that there were no significant relationships between participation in the EPA program and child work participation or hours worked. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the EPA program; other factors are likely to have contributed.","DESTINO’s EPA program","Child labor","Other barriers, Other",,International,2014,https://www.researchgate.net/publication/271673211_Reducing_child_labour_in_Pan…,"Child Labor Review Protocol" "Distinctive and unique outreach programs: Promoting academic excellence and diversity","Monaco, P., & Morse, A. (2014). Distinctive and unique outreach programs: Promoting academic excellence and diversity. Proceedings of the 2014 American Society for Engineering Education Annual Conference & Exposition. Washington, DC: American Society for Engineering Education.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study examined a series of residential environmental engineering summer camps run by a southern technology university that were intended to stimulate interest in STEM fields, primarily for girls and underrepresented minority groups. Three different types of summer camps were offered for different populations: international mixed-gender Brazilian students, female-only, and local mixed-gender students. The authors reviewed qualitative data collected from 81 4th- through 12th-grade students participating in one of five summer camp sessions. These data included pre-session oral surveys; ongoing observations of class participation; and post-session group discussions, activity worksheets that asked for open-ended application of STEM theories to examples, and oral surveys. According to post-session discussions and surveys, across the five camp sessions, about 65 percent of camp participants, of whom 25 percent were females, expressed interest in pursuing a STEM major. The authors also reported that the females had higher levels of participation and engagement in female-only sessions compared with mixed-gender sessions.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Other barriers, Female",,"United States",2014,https://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=1&cad=rja&uact=8&…,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "An experimental evaluation of a nationally recognized employment-focused offender reentry program.","Farabee, D., Zhang, S. X., & Wright, B. (2014). An experimental evaluation of a nationally recognized employment-focused offender reentry program. Journal of Experimental Criminology, 10(3), 309–322.",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study examined the impact of an employment-focused offender reentry program (STRIVE) operated in Southern California on the education, employment, and recidivism outcomes of a sample of people released from prison or jail between 2008 and 2011. Study members were randomly assigned to either receive STRIVE services (the treatment) or a list of other resources in the community, but not STRIVE services (the control). The primary data sources were interviews conducted at baseline and 12 months after random assignment and administrative recidivism data provided by the California Department of Justice. The study found no statistically significant relationships between STRIVE and education, employment, or recidivism 12 months after random assignment. The study also found no statistically significant relationship between STRIVE and recidivism two years after random assignment. The quality of causal evidence presented in this report is low because it was based on a randomized controlled trial with fewer members of the control group participating in the study at follow-up than members of the STRIVE intervention group (thus, the study has high attrition). The authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects would have been attributable to the STRIVE program if the study had found statistically significant effects.","the STRIVE program","Reentry Other training and education",Justice-involved,,"United States",2014,,"Employment and Training Review Protocol" "Mapping success: Performance-based scholarships, student services, and developmental math at Hillsborough Community College","Sommo, C., Boynton, M., Collado, H., Diamond, J., Gardenhire, A., Ratledge, A., . . . Weiss, M. J. (2014). Mapping success: Performance-based scholarships, student services, and developmental math at Hillsborough Community College. New York: MDRC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Mathematics Access Performance Scholarship (MAPS) on completion of developmental and college-level math, credits attempted and earned, and retention at two Hillsborough Community College campuses in Florida (the Dale Mabry campus and the Brandon campus). Developmental math students were randomly assigned to the MAPS program or to the control group. College transcripts were used to assess outcomes. The study found that students in the treatment group attempted and earned more math credits and were more likely to complete Intermediate Algebra (a developmental math course). The quality of causal evidence provided in this study is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the MAPS program and not to other factors.","the Mathematics Access Performance Scholarship (MAPS)","Basic skills Community college education and other classroom training","Adult, Other barriers",,"United States",2014,http://test.mdrc.org/sites/default/files/PBS-HCC%202014%20Full%20Report.pdf,"Community College Review Protocol" "The impact of rehabilitation and counseling services on the labor market activity of Social Security Disability (SSDI) beneficiaries","Weathers, R., & Bailey, M. (2014). The impact of rehabilitation and counseling services on the labor market activity of Social Security Disability (SSDI) beneficiaries. Journal of Policy Analysis & Management, 33(3), 623-648.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine up to 36 month employment and earnings impacts of the Accelerated Benefits Demonstration (ABD), an effort to provide immediate health insurance and employment and benefits counseling to new, uninsured Social Security Disability Insurance (SSDI) recipients during the 24 month Medicare eligibility waiting period.  About 2,000 eligible people were randomly assigned to participate in the ABD. Evaluation data sources included a baseline telephone interview, a 12-month follow-up survey, the Master Beneficiary Record data file, the Summary Earnings Record data file, and Ticket to Work SSA administrative records. The authors estimated the impacts on earnings and employment outcomes for each of three years following enrollment. The study found positive impacts on employment and earnings for those receiving ABD telephonic services. The quality of causal evidence presented in this study is high because it is a well-implemented randomized controlled trial. This means that we are confident that the estimated effects are attributable to the intervention and not to other factors.","Accelerated Benefits Demonstration","Disability insurance Health insurance Supplemental security income (SSI) Vocational rehabilitation",Disability,,"United States",2014,,"Disability Employment Policy Review Protocol" "Reducing child labour in Panama: An impact evaluation","Andisha, N., Chiquito-Saban, O., Emmerich, E., Figueroa, A., Jiang, Y., Lee, J. H., Manning, D., Ortega-Sanchez, A., & Gawande, K. (2014.) Reducing child labour in Panama: An impact evaluation. Journal of Development Effectiveness, 6(2), 128-146.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor","Summary: The study’s objective was to examine the impact of two components of the DESTINO program—CEC (a tutoring course) and EPA (an alternative primary school program)—on children’s participation in agricultural work in Panama. This summary focuses on the comparison between the CEC treatment group and the comparison group. The study used a nonexperimental comparison group design. Using post-intervention survey data, the authors compared the outcomes for children in schools receiving CEC services to those that were the same age as the CEC children but did not participate in the program. The study found that participation in the CEC program was significantly associated with a reduction in the number of hours that children worked per day but not the probability of children working. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the CEC program; other factors are likely to have contributed.","DESTINO’s CEC program","Child labor","Other barriers, Other",,International,2014,https://www.researchgate.net/publication/271673211_Reducing_child_labour_in_Pan…,"Child Labor Review Protocol" "The effects of prison-based educational programming on recidivism and employment","Duwe, G., & Clark, V. (2014). The effects of prison-based educational programming on recidivism and employment. The Prison Journal, 94(4), 454–478. [Comparison #1: between secondary degree completion and no secondary degree completion]",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study examined whether obtaining a secondary degree through Minnesota’s Department of Corrections (MnDOC) affected former inmates’ post-release employment, earnings, and recidivism. The authors also investigated whether obtaining a post-secondary degree impacted similar outcomes, the profile of which can be found here. The authors used a nonexperimental design (propensity score matching) to create a comparison group of former prisoners who were similar to the secondary degree program graduates but who did not complete a secondary degree while incarcerated. The authors estimated the program’s impact using data from the Minnesota Department of Employee and Economic Development, the Minnesota Bureau of Criminal Apprehension, and the Correctional Operations Management System database maintained by MnDOC. The authors found no relationship between completing a secondary degree and recidivism. The quality of causal evidence on recidivism outcomes presented in this report is moderate because it is based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects would have been attributable to completing a secondary degree through MnDOC if the study had found statistically significant effects.","MnDOC’s educational programs","Community college education and other classroom training Reentry Other training and education",Justice-involved,,"United States",2014,,"Employment and Training Review Protocol" "Twelve-month employment intervention outcomes for drug-involved offenders","Webster, J. M., Staton-Tindall, M., Dickson, M. F., Wilson, J. F., & Leukefeld, C. G. (2014). Twelve-month employment intervention outcomes for drug-involved offenders. American Journal of Drug & Alcohol Abuse, 40(3), 200-205.",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of a drug court employment intervention on participants’ employment and earnings one year after the intervention. The study is a randomized controlled trial. A total of 500 participants at two drug court sites in Kentucky were randomly assigned to receive either an employment intervention and a standard drug court program (the treatment group) or a standard drug court program alone (the control group). Using self-reported survey data from participants, the authors compared outcomes for the treatment and control groups. The study found that members of the treatment group worked an average of 210 days in the year after random assignment compared with 200 days for the control group; this was a statistically significant difference. The study found no significant impacts of the intervention on earnings. The quality of causal evidence presented in this report is low because it was based on a randomized controlled trial for which the study did not provide enough information to demonstrate that the groups had similar response rates on the survey, and it also did not account for other factors that could have affected the difference between the treatment and control groups. This means we are not confident that the estimated effects are attributable to the employment intervention; other factors are likely to have contributed.","the employment intervention","Substance abuse recovery Other employment and reemployment Reentry","Justice-involved, Other barriers",,"United States",2014,https://doi.org/10.3109/00952990.2013.858722,"Employment and Training Review Protocol" "The economics of federal tax and employment laws: Empirical evidence from three studies.","Figinski, T. F. (2013). The economics of federal tax and employment laws: Empirical evidence from three studies. (Doctoral dissertation). Retrieved from ProQuest. Accession No. 1415455735.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment Public benefits receipt-Low-Unfavorable impacts Public benefit receipt","Summary: The study examined the impact of removing the Social Security earnings test on Social Security claims, earnings, and labor force participation for female beneficiaries. The study used a statistical model and the data from the Social Security Administration’s Benefit and Earnings Public Use File to estimate impacts. The study found that removing the earnings test was associated with an increase in Social Security claims among women who were primary or spousal beneficiaries and with an increase in average earnings and in labor force participation among women who were primary beneficiaries. The qaulity of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the change in Social Security earings test. This means we are not confident that the estimated effects are attributable to the removal of the Social Security earnings test; other factors are likely to have contributed.","Social Security 2000 Earnings Test Removal","Federal retirement benefits Older workers' programs","Adult, Older worker, Female",,"United States",2014,,"Employment and Training Review Protocol" "Given time it worked: Positive outcomes from a SSDI benefit offset pilot after the initial evaluation period","Delin, B., Hartman, E., & Sell, C. (2014). Given time it worked: Positive outcomes from a SSDI benefit offset pilot after the initial evaluation period. Journal of Disability Policy Studies, 1-11.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of Wisconsin’s Benefit Offset Pilot Demonstration (BOPD), which provided a more-generous work incentive for Social Security Disability Insurance (SSDI) recipients, on recipients’ employment status and earnings. Although the original evaluation of BOPD was a randomized controlled trial, this study focused on the outcomes of a nonrandom subset of BOPD participants who had completed a trial work period (TWP). Data sources included Wisconsin Unemployment Insurance administrative records and Social Security Administration (SSA) administrative data to evaluate study sample outcomes for 2009 and 2010. The study found that treatment group members who completed a TWP were significantly more likely to be employed or earn at least three times more than the substantial gainful activity (SGA) amount than control group TWP completers over the eight quarters of follow-up. However, there were no significant impacts on earnings. The quality of the causal evidence presented in this report is moderate because it is based on a well-implemented nonexperimental design. This means we have confidence that the effects estimated in this study are attributable at least in part to the BOPD. However, as with any nonexperimental analysis, other factors not accounted for in the study could also have contributed to the estimated effects.","the Benefit Offset Pilot Demonstration","Disability insurance Other wages and benefits Supplemental security income (SSI)",Disability,,"United States",2014,,"Disability Employment Policy Review Protocol" "Retiree health insurance for public school employees: Does it affect retirement?","Fitzpatrick, M. D. (2014). Retiree health insurance for public school employees: Does it affect retirement? Journal of Health Economics, 38, 88-98.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Mixed impacts Employment","Summary: The study’s objective was to examine the impact of an Illinois Public Schools retiree health insurance program on the retirement rates of eligible staff ages 55 to 75. The study used a nonexperimental approach to compare the retirement rates of eligible staff with those of staff who were not eligible and staff in years prior to the introduction of the health insurance program who would have been eligible. The author used data from the Illinois Public Schools' Teacher Service Record database from 1970 to 1992. The study found that eligibility for the program was associated with an overall decrease in retirement age, with eligible staff more likely to retire at ages 55 or 56, but less likely to retire after age 65 compared with those who were not eligible for the program. The quality of the causal evidence presented in this report is low because the study is a nonexperimental analysis that does not account for possible differences in the groups. This means we are not confident that the estimated effects are attributable to the Illinois Public Schools Teachers Retirement Health Insurance Plan; other factors are likely to have contributed.","Illinois Public Schools Teachers Retirement Health Insurance Plan","Employer provided retirement benefits Health insurance Older workers' programs","Adult, Older worker",,"United States",2014,https://www.nber.org/papers/w19524,"Employment and Training Review Protocol" "Earnings and disability program participation of Youth Transition Demonstration Participants after 24 months","Hemmeter, J. (2014). Earnings and disability program participation of Youth Transition Demonstration Participants after 24 months. Social Security Bulletin, 74(1), 1–26.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: This study’s objective was to measure 24-month impacts for the six Youth Transition Demonstration (YTD) sites that used a randomized evaluation. YTD projects provided services to help youth with disabilities improve their education and employment outcomes and become more economically self-sufficient. Data were collected from the Master Earnings File (MEF), Supplemental Security Record (SSR), Master Beneficiary Record (MBR), and Numerical Identification System (Numident) file. The authors estimated program impacts on measures of paid employment and Social Security disability benefit receipt. The study found that, in three of the sites examined, YTD participants were more likely to have at least some earnings in the first calendar years after random assignment; this was also the case for three sites in the second calendar year after random assignment. However, YTD had no statistically significant impacts on average earnings during either calendar year. In four of the six sites, YTD participants were more likely to receive Supplemental Security Income (SSI) 24 months after random assignment. The quality of the causal evidence presented in this report is high because it is based on a well-implemented randomized controlled trial. This means we can be confident that the estimated impacts are attributable to YTD, and not other factors.","the Youth Transition Demonstration","Disability insurance Supplemental security income (SSI) Youth programs","Disability, Youth",,"United States",2014,http://www.ssa.gov/policy/docs/ssb/v74n1/v74n1p1.html,"Disability Employment Policy Review Protocol" "The effects of prison-based educational programming on recidivism and employment","Duwe, G., & Clark, V. (2014). The effects of prison-based educational programming on recidivism and employment. The Prison Journal, 94(4), 454–478. [Comparison #2: between post-secondary degree completion and no post-secondary degree completion]",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-No impacts Employment","Summary: The study examined whether obtaining a post-secondary degree through Minnesota’s Department of Corrections (MnDOC) affected former inmates’ post-release employment, earnings, and recidivism. The authors also investigated whether obtaining a secondary degree impacted similar outcomes, the profile of which can be found here. The authors used a nonexperimental design (propensity score matching) to create a comparison group of former prisoners who were similar to program graduates but who did not complete a post-secondary degree while incarcerated. The authors estimated the program’s effects using data from the Minnesota Department of Employee and Economic Development, the Minnesota Bureau of Criminal Apprehension, and the Correctional Operations Management System database maintained by MnDOC. The authors found that completing a post-secondary degree reduced the risk of reconviction by 16 percent and re-incarceration for a new crime by 24 percent and had no statistically significant effect on revocations for technical violations. The quality of causal evidence on recidivism outcomes presented in this report is moderate because it is based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to completing a post-secondary degree through MnDOC, but other factors might also have contributed.","MnDOC’s educational programs","Other training and education Reentry",Justice-involved,,"United States",2014,,"Employment and Training Review Protocol" "Who pays the high health costs of older workers? Evidence from prostate cancer screening mandates.","Bailey, J. (2014). Who pays the high health costs of older workers? Evidence from prostate cancer screening mandates. Applied Economics, 46(32), 3931-3941. doi:10.1080/00036846.2014.948673","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Unfavorable impacts Earnings and wages Employment-Mod/high-Unfavorable impacts Employment","Summary: The study examined the impact of state mandates that health insurance plans cover prostate cancer screenings on the earnings and employment of men older than age 50 The study used nonexperimental regression analyses to compare older men in states that had enacted a mandate with women, younger men, and older men living in states without a mandate. The author used data from the Current Population Survey(CPS) between 1990 and 2009. The study found that older men in states with mandates had lower wages and were less likely than the comparison group to be employed. The quality of causal evidence presented in this study is moderate, because it is a well-implemented nonexperimental study. This means we are somewhat confident that the estimated effects are attributable to the prostrate screening mandate, but other factors might also have contributed.","Prostate cancer screening mandates","Health insurance Older workers' programs","Adult, Older worker, Male",,"United States",2014,https://sites.temple.edu/jamesbailey/files/2013/08/Who-Pays-the-High-Health-Cos…,"Employment and Training Review Protocol" "CogSMART compensatory cognitive training for traumatic brain injury: Effects over 1 year","Twamley, E. W., Thomas, K. R., Gregory, A. M., Jak, A. J., Bondi, M. W., Delias, D. C., & Lohr, J. B. (2014). CogSMART compensatory cognitive training for traumatic brain injury: Effects over 1 year. Journal of Head Trauma Rehabilitation, 30(6), 391-401.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of Cognitive Symptom Management and Rehabilitation Therapy (CogSMART) and enhanced supported employment (ESE) on employment, earnings, and health outcomes. The authors conducted a randomized controlled trial that randomly assigned participants to the intervention and comparison groups. Employment data came from weekly reports on job attainment, hours worked, and wages earned. The study did not find any statistically significant relationships between CogSMART plus ESE and employment, earnings, or health outcomes. The quality of causal evidence presented in this report is low because the study had a confounding factor. Specifically, one interventionist delivered CogSMART plus ESE and another interventionist implemented services to the comparison group, which makes it impossible to separate the effect of CogSMART plus ESE from the effect of the individual interventionists. This means we are not confident that the estimated effects are attributable to CogSMART plus ESE; other factors are likely to have contributed to the findings.","CogSMART Plus ESE","Health Job search assistance and supportive services Supported employment or other employment supports Veterans' reemployment","Disability, Veteran or military",,"United States",2014,https://doi.org/10.1097/HTR.0000000000000076,"Employment and Training Review Protocol" "Net impact and benefit-cost estimates of the workforce development system in Washington State. (Upjohn Institute Technical Report No. 13-029). [VOC]","Hollenbeck, K., & Huang, W-J. (2014). Net impact and benefit-cost estimates of the workforce development system in Washington State. (Upjohn Institute Technical Report No. 13-029). Kalamazoo, MI: W.E. Upjohn Institute for Employment Research. Retrieved from W.E. Upjohn Institute for Employment Research website: http://dx.doi.org/10.17848/tr13-029. [VOC]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-Favorable impacts Employment Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of Vocational Rehabilitation (VOC) programs on the employment rate, earnings, and benefit receipt of adults with disabilities in Washington State. The authors used a nonexperimental method to compare the short-term (3 quarters after program exit) and long-term (9 to 12 quarters after program exit) employment, earnings, and Unemployment Insurance benefits between those who took part in VOC programs relative to those who were eligible, but did not receive services from VOC programs. The study found that, compared with those who did not receive services from VOC programs, VOC program participants had higher employment and earnings. Receipt of benefits was lower in the short-term for VOC program participants relative to those who did not receive VOC program services. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before program participation. This means we are not confident that the estimated effects are attributable to VOC programs; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Vocational Rehabilitation (VOC) Programs","Unemployment Insurance Vocational rehabilitation",Disability,,"United States",2014,http://research.upjohn.org/cgi/viewcontent.cgi?article=1032&context=up_technica…,"Employment and Training Review Protocol" "The role of intensive case management services in reentry: The northern Kentucky female offender reentry project","McDonald, D., & Arlinghaus, S. L. (2014). The role of intensive case management services in reentry: The northern Kentucky female offender reentry project. Women & Criminal Justice, 24(3), 229-251.",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Mixed impacts Education and skills gains Employment-Low-Favorable impacts Employment","Summary: This study examined the impact of the Northern Kentucky Female Offender Reentry Project’s intensive case management (ICM) services on releasees’ education, employment, and recidivism outcomes. Using program data and administrative data from state and county judicial databases, the study compared outcomes of the treatment group, which received ICM services pre-release (in prison) and post-release (in the community), with outcomes of the comparison group, which only received ICM services pre-release (in prison). The study found mixed results for education, employment, and recidivism. The authors did not conduct statistical significance tests. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Female Offender Reentry Project’s pre- and post- release ICM services; other factors are likely to have contributed.","Northern Kentucky Female Offender Reentry Project’s intensive case management (ICM) services","Other employment and reemployment Reentry","Justice-involved, Female",,"United States",2014,https://doi.org/10.1080/08974454.2014.909759,"Employment and Training Review Protocol" "An examination of the impact of accelerating community college students’ progression through developmental education","Hodara, M., & Jaggars, S. (2014). An examination of the impact of accelerating community college students’ progression through developmental education. Journal of Higher Education, 85(2), 246-276.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Education and skills gains-Mod/high-Mixed impacts Education and skills gains","Summary: The study’s objective was to examine the impact of accelerated developmental writing and math sequences on enrollment, persistence, and academic achievement outcomes at six City University of New York (CUNY) community colleges. At some colleges, students assigned to the lowest level of developmental writing or math were required to complete an accelerated sequence of only one or two developmental courses before moving to college-level courses, compared with the longer sequence of two or three courses required at other colleges. This nonexperimental study used regression analysis and propensity-score matching to estimate the impact of accelerated developmental writing and math sequences among students in need of developmental courses from 2001 to 2007. CUNY’s Office of Institutional Research provided students’ data. The study reported outcomes three years after students first enrolled in community college. The study found that students in the shorter math and writing sequences were more likely to enroll in and pass college-level math and writing. Students in the shorter writing sequence earned more credits, on average, within three years and were more likely to earn an associate’s or bachelor’s degree within five years than those in the longer writing sequence. Among students who enrolled in college English, however, those who had taken the shorter English sequence were 2.5 percentage points less likely to pass college English. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the accelerated developmental education program, but other factors might also have contributed.","Accelerated Developmental Education","Basic skills Community college education and other classroom training","Adult, Other barriers",,"United States",2014,,"Community College Review Protocol" "Cash transfer programme, productive activities and labour supply: Evidence from a randomised experiment in Kenya","Asfaw, S., Davis, B., Dewbre, J., Handa, S., & Winters, P. (2014). Cash transfer programme, productive activities and labour supply: Evidence from a randomised experiment in Kenya. The Journal of Development Studies, 50(8), 1172-1196. doi: 10.1080/00220388.2014.919383","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to assess the impact of a monthly cash transfer program on household food consumption, resources, and work, including child labor. The study used survey data from a clustered randomized controlled trial. Households from seven districts in Kenya were randomly assigned to either the treatment or control group. Within those locations, 20 percent of the poorest households were recruited if they had one or more children 17 years old or younger who was an orphan or had a chronically ill parent or caregiver.  The study found a statistically significant relationship between the program and a reduction in farm labor for children ages 10-15. This relationship was significant for boys but not for girls. There was also a statistically significant relationship between the program and an increase in school enrollment for children ages 12-18. The quality of causal evidence presented in this report is low because it was based on a randomized controlled trial with high attrition and the authors did not demonstrate that groups were similar at baseline. This means we are not confident that the estimated effects are attributable to the Kenya Cash Transfer Programme for Orphans and Vulnerable Children; other factors are likely to have contributed.","Kenya Cash Transfer Programme for Orphans and Vulnerable Children (CT-OVC) Experiment","Child labor","Other barriers, Other, Low income",,International,2014,,"Child Labor Review Protocol" "Enhancing GED instruction to prepare students for college and careers: Early success in LaGuardia Community College’s Bridge to Health and Business program","Martin, V. & Broadus, J. (2013). Enhancing GED instruction to prepare students for college and careers: Early success in LaGuardia Community College’s Bridge to Health and Business program. New York: MDRC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of LaGuardia Community College’s general educational development (GED) Bridge to Health and Business program on GED completion, college enrollment, and college persistence. The study was a randomized controlled trial. Eligible students (369 in total) were randomly assigned to either the treatment group, which could participate in the GED Bridge program, or the control group, which could not participate in the GED Bridge program but could participate in a traditional GED preparation course. The study found that, compared with students randomly assigned to the traditional GED Prep course, those offered enrollment in the GED Bridge to Health and Business program were more likely to complete the GED course, pass the GED exam within a year, enroll in a City University of New York (CUNY) community college by the end of the study, and reenroll for a second semester at a CUNY community college by the end of the study. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the GED Bridge to Health and Business program, and not to other factors.","the GED Bridge to Health and Business Program","Basic skills Community college education and other classroom training","Adult, Other barriers, Low income",,"United States",2013,http://www.mdrc.org/sites/default/files/Enhancing_GED_Instruction_brief.pdf,"Community College Review Protocol" "Can benefits and work incentives counseling be a path to future economic self-sufficiency for SSI/SSDI beneficiaries?","Nazarov, Z. (2013). Can benefits and work incentives counseling be a path to future economic self-sufficiency for SSI/SSDI beneficiaries? Center for Retirement Research Working Paper 17.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages","Summary: This study’s objective was to determine whether benefits and work incentives counseling provided by New York State’s vocational rehabilitation (VR) agency increased earnings and increased the number of hours worked among Social Security disability benefit recipients. The primary data source for this study was New York State administrative data. The author conducted an instrumental variables analysis and a propensity score matching analysis. Weekly earnings for individuals who received benefits and work incentives counseling were higher than earnings among nonrecipients, with differences estimated between 40 and 31 percent by instrumental variables analysis, and between 12.5 and 10.9 percent by propensity score matching. The effect of benefits and work incentives counseling on case closure was estimated to be positive under both methods but was not statistically significant. The quality of causal evidence provided in this study is moderate. This means we are somewhat confident that the estimated effects are attributable to the counseling, but other factors might also have contributed.","the Vocational Rehabilitation (VOC) Programs","Disability insurance Supplemental security income (SSI) Vocational rehabilitation",Disability,,"United States",2013,http://crr.bc.edu/working-papers/can-benefits-and-work-incentives-counseling-be…,"Disability Employment Policy Review Protocol" "Linking Youth Transition Support Services: Results from Two Demonstration Projects","Camacho, Christa B., & Hemmeter, Jeffrey. (2013). Linking Youth Transition Support Services: Results from Two Demonstration Projects. Social Security Bulletin, 73(1).","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: This study explored the findings of a 2003–2009 evaluation of the Youth Transition Demonstration (YTD) program, which offered employment and self-sufficiency services and other support services to transition-age youth with disabilities. The study used a sample of youth ages 14 to 25 with disabilities, who were served by 2 of the 10 YTD projects in operation. It summarized the outcomes of 2 YTD projects and described the experiences of one youth from each of the 2 projects who successfully completed the program. The study found that youth who received enhanced transition services and used YTD waivers of Social Security Administration program rules had many YTD program successes; however, the project duration was too short to yield long-term findings. Although the outcomes reported in this article were not causal, they suggested that youth with disabilities can enter the workforce and achieve some self-sufficiency.",,"Disability insurance Supplemental security income (SSI) Youth programs","Youth, Disability",,"United States",2013,http://www.ssa.gov/policy/docs/ssb/v73n1/v73n1p59.html,"Disability Employment Policy Review Protocol" "An effective model for enhancing underrepresented minority participation and success in geoscience undergraduate research","Blake, R., Liou-Mark, J., & Chukuigwe, C. (2013). An effective model for enhancing underrepresented minority participation and success in geoscience undergraduate research. Journal of Geoscience Education, 61(4), 405-414.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: This study described the implementation of the National Science Foundation Research Experiences for Undergraduates (REU) program at New York City College of Technology. This year-long program aimed to retain undergraduates in STEM disciplines and prepare them for STEM careers, especially for underrepresented minority groups, including women. The authors, as directors of the REU program, described each of its components, including research, minicourses, seminars and workshops, mentoring, support and networking opportunities, and presenting at and attending conferences. Outcomes were discussed in terms of post-program experiences and achievements, as well as quotes from program participants. Overall, the authors concluded that the program was successful in terms of demonstrated interest in, attendance in, or completion of a STEM graduate program; achievement in STEM publications; and attainment of STEM awards. These outcomes were complemented by five quotes from student participants who discussed how the program changed their academic lives.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Other barriers, Female",,"United States",2013,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "An outcome evaluation of an adult education and postsecondary alignment program: The Accelerate New Mexico experience","Rivera, M., Davis, M., Feldman, A., & Rachkowski, C. (2013). An outcome evaluation of an adult education and postsecondary alignment program: The Accelerate New Mexico experience. Problems and Perspectives in Management, 11(4), 105-120.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Attitudes-Low-Favorable impacts Attitudes","Summary: The study’s objective was to examine the impact of the Accelerate New Mexico Math Camp on outcomes for community college students, including women and minority students traditionally underrepresented in STEM. The study used course-administered assessments to compare the math competency and attitudes about math of students before and after participation in the Accelerate summer program. The authors found that students (both male and female) who participated in the Accelerate program had higher math competency and less anxiety about math after completing the program, compared with their competency and anxiety measured before enrollment in the program. The quality of causal evidence presented in this report is low. This means we are not confident that the estimated effects are attributable to the Accelerate New Mexico Math Camp program; other factors are likely to have contributed.","the Accelerate New Mexico Math Camp","Science, Technology, Engineering, and Math (STEM) programs Community college education and other classroom training Youth programs","Youth, Other barriers, Female",,"United States",2013,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "The link between pensions and retirement timing: Lessons from California teachers.","Brown, K. M. (2013). The link between pensions and retirement timing: Lessons from California teachers. Journal of Public Economics, 98(C), 1-14.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study examined the impact of pension reform under the California State Teachers’ Retirement System (CalSTRS) on retirement timing. The author used a statistical model and data from retirement-eligible employees in Los Angeles Unified School District from 1997 to 2000 to estimate the impact. The study found public school employees were more likely to work an extra year in response to changes in pension plans that provided additional bonuses tied to age and tenure. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the changes in CalSTRS. This means we are not confident that the estimated effects are attributable to the changes in CalSTRS; other factors are likely to have contributed.","CalSTRS Defined Benefit Program","Older workers' programs Other wages and benefits","Adult, Older worker",,"United States",2013,https://eml.berkeley.edu//~saez/course/brown_jpube13.pdf,"Employment and Training Review Protocol" "Early college, early success: Early college high school initiative impact study","Berger, A., Turk-Bicakci, L., Garet, M., Song, M., Knudson, J., Haxton, C., Zeiser, K., Hoshen, G., Ford, J., Stephan, J., Keating, K., & Cassidy, L. (2013). Early college, early success: Early college high school initiative impact study. Washington, DC: American Institutes for Research.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the effect of Early Colleges, which exposed high school students to college classes, on students’ high school achievement, persistence, and graduation; college enrollment; and college degree attainment. The study compared outcomes for students who participated in the Early Colleges’ admissions lotteries and were offered enrollment with the outcomes for students who participated in the lotteries but were not offered enrollment. The study found that Early Colleges had positive and statistically significant effects on high school and college achievement. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to being offered admission in an Early College, and not to other factors.","Early Colleges",,"Other barriers",,"United States, Urban",2013,http://www.air.org/sites/default/files/downloads/report/ECHSI_Impact_Study_Repo…,"Community College Review Protocol" "Predictors of financial self-sufficiency among Social Security beneficiaries with psychiatric disabilities","Russinova, Zlatka, Rogers, E. Sally, Langer Ellison, Marsha, Bloch, Philippe, Lyass, Asya, & Wewiorski, Nancy. (2013). Predictors of financial self-sufficiency among Social Security beneficiaries with psychiatric disabilities. Journal of Vocational Rehabilitation, 38, 49–66.","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: This study explored factors associated with the capacity of Social Security recipients with psychiatric disabilities to leave the Social Security disability rolls due to substantial gainful work activity. Data were from a survey conducted from May 2004 to January 2005 as part of a subsequent study of 213 participants in an earlier intervention that offered mental health treatment and assistance in finding competitive jobs to adults with psychiatric disabilities. Results suggested that people with higher occupational status, higher levels of proactive coping skills, and without medical comorbidities were more likely than other beneficiaries with psychiatric disabilities to terminate Social Security disability benefits and achieve financial self-sufficiency due to gainful employment.",,"Health Disability insurance Supplemental security income (SSI) Job search assistance and supportive services",Disability,,"United States",2013,,"Disability Employment Policy Review Protocol" "Do stronger age discrimination laws make Social Security reforms more effective?","Neumark, D., & Song, J. (2013). Do stronger age discrimination laws make Social Security reforms more effective? Journal of Public Economics, 108, 1-16.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Mixed impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study examined whether the strength of state age discrimination protections affected rates of Social Security benefit claiming and employment outcomes of older workers. The study used a nonexperimental design and the data on Social Security claiming and employment outcomes from the Health and Retirement Study (HRS) to estimate the impacts. The study found that among older men affected by the 1983 Social Security reform, age discrimination protections were associated with increases in employment rates between age 62 and the full retirement age and delayed benefit claiming. The quality of casual evidence presented in this report is moderate because the study was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to state age discrimination laws, but other factors might also have contributed.","The 1983 Social Security Reform","Older workers' programs Other disparities or discrimination in employment and earnings","Adult, Older worker, Male",,"United States",2013,https://ideas.repec.org/a/eee/pubeco/v108y2013icp1-16.html,"Employment and Training Review Protocol" "Training and retirement patterns.","Montizaan, R., Cörvers, F., & de Grip, A. (2013). Training and retirement patterns. Applied Economics, 45(15), 1991-1999. doi:10.1080/00036846.2011.646066","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Unfavorable impacts Employment","Summary: The study’s objective was to examine the impact of firm-specific training and general training on older men’s retirement decisions The study used a nonexperimental design and data from the U.S. National Longitudinal Survey of Older Men for 1966 to 1983 to estimate impacts. The study found that workers with firm-specific training were more likely to retire within the time period studied and to have jobs with a mandatory retirement age than workers without firm-specific training. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before receiving training and did not account for self-selection into training. This means we are not confident that the estimated effects are attributable to firm-specific or general training; other factors are likely to have contributed.","Firm-specific & General Training","Work based and other occupational training","Adult, Older worker, Male",,"United States",2013,https://www.researchgate.net/publication/236021967_Training_and_retirement_patt…,"Employment and Training Review Protocol" "The impact of a written benefits analysis by Utah benefit counseling/WIPA program on vocational rehabilitation outcomes","Wilhelm, S., and McCormick, S. (2013). The impact of a written benefits analysis by Utah benefit counseling/WIPA program on vocational rehabilitation outcomes. Journal of Vocational Rehabilitation 39, 219–222.","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: This report examined whether a written benefits analysis provided as part of the Utah Benefits Planning Assistance & Outreach Program Vocational Rehabilitation (VR) program was associated with the employment and earnings outcomes and closure status of VR clients that received the benefits analysis compared with those who did not. For people who had at least one change in employment status over the study period, a multivariate analysis tested the difference in employment between the two groups. On average, those who received a written analysis were 18.4 percent more likely to be employed than those who did not. However, for those employed at least one of the quarters, having a written analysis was not associated with an increase in their earnings.",,"Vocational rehabilitation",Disability,,"United States",2013,,"Disability Employment Policy Review Protocol" "Initial impacts of the Ticket to Work program for young new Social Security disability awardees: Estimates based on randomly assigned mail months","Stapleton, D., Mamun, A., & Page, J. (2013). Initial impacts of the Ticket to Work program for young new Social Security disability awardees: Estimates based on randomly assigned mail months. Princeton, NJ: Mathematica Policy Research, Center for Studying Disability Policy.","Disability Employment Policy, Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment","Summary: This study examined impacts of the Ticket to Work (TTW) program, a work incentive program for Social Security disability recipients, on achieving Social Security Disability Insurance (SSDI) return-to-work earnings benchmarks and SSDI benefit suspension or termination for work. The study sample included SSDI recipients who entered the rolls from July 1999 to October 2003, were ages 18 to 39, and were not concurrently receiving Supplemental Security Income (SSI). The authors used data from the Ticket Research File (TRF), a Social Security administrative data file, for the analysis. The study found that TTW did not have a statistically significant impact on SSDI return to work earnings benchmarks or the number of SSDI recipients who had their benefits suspended or terminated due to work. The quality of the causal evidence presented in this report is moderate, the highest possible rating for a nonexperimental study. This means we are somewhat confident that the estimated effects are attributable to TTW, but other factors might have contributed.","Ticket to Work","Disability insurance Supplemental security income (SSI) Supported employment or other employment supports","Disability, Low income",,"United States",2013,http://www.mathematica-mpr.com/~/media/publications/pdfs/disability/ttw_initial…,"Disability Employment Policy, Low-Income Adults Review Protocol" "Perfectionism moderates stereotype threat effects on STEM majors’ academic performance","Rice, K., Lopez, F., Richardson, C., & Stinson, J. (2013). Perfectionism moderates stereotype threat effects on STEM majors’ academic performance. Journal of Counseling Psychology, 60(2), 287-293.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of “stereotype threat priming” on students’ grades in postsecondary science, technology, engineering, and mathematics (STEM) courses and on self-reported feelings of self-efficacy in science. The authors argued that women and racial minorities perform worse in certain fields, such as STEM, when they feel threatened by stereotypes implying that their gender or race makes them inferior to their male or white peers. For this study, the authors primed treatment students to think about their gender, race, and ethnicity before completing a survey to measure self-efficacy in science. This priming was intended to make feelings of stereotype threat more acute. The study randomly assigned students majoring in a STEM field to either the treatment group, which received stereotype threat priming before taking the survey, or the control group, which took the same survey but did not receive stereotype threat priming. The authors collected data from an author-generated online survey on feelings of self-efficacy and from academic records for course grades. The study found that the stereotype threat priming had no significant effects by gender when comparing outcomes for the treatment and control groups. The quality of causal evidence presented in this report is low because this is a randomized controlled trial with unknown attrition, and the authors did not control for background characteristics likely to affect the outcomes of interest. This means we are not confident that the estimated effects would have been attributable to stereotype threat priming; other factors are likely to have contributed.","the Evaluation of Stereotype Threat Priming","Science, Technology, Engineering, and Math (STEM) programs Other disparities or discrimination in employment and earnings","Other barriers, Female, STEM professional",,"United States",2013,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Return-to-Work Outcomes among Social Security Disability Insurance Program Beneficiaries","Ben-Shalom, Yonatan, and Mamun, Arif. (2013). Return-to-Work Outcomes among Social Security Disability Insurance Program Beneficiaries. Princeton, NJ: Mathematica Policy Research, Center for Studying Disability Policy.","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: This study followed a sample of working-age Social Security Disability Insurance (DI) program recipients for five years after their first benefit award to describe how certain factors helped or hindered their return-to-work outcomes. The study used linear probability models to estimate how individual and environmental factors were associated with achieving return-to-work milestones, across seven primary impairment groups: affective disorders, other psychiatric disorders, intellectual disability, sensory impairments, back disorders, other musculoskeletal disorders, and other physical disorders. The study found that the probability of achieving employment milestones increased with sensory impairments, being black, years of education, and DI award at initial adjudication level. It decreased with age at DI award, back and other musculoskeletal disorders, higher levels of DI benefits at award, receipt of Supplemental Security Income or Medicare at time of DI award, age, and higher state unemployment rates, among other factors. The study also found that differences across age and impairment group persisted after accounting for other characteristics.",,"Disability insurance Supplemental security income (SSI)",Disability,,"United States",2013,,"Disability Employment Policy Review Protocol" "The impact of uncapping of mandatory retirement on postsecondary institutions.","Weinberg, S. L., & Scott, M. A. (2013). The impact of uncapping of mandatory retirement on postsecondary institutions. Educational Researcher, 42(6), 338-348.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study examined the impact of uncapping mandatory retirement on retirement ages at postsecondary institutions The study used a statistical model to examine the age of retirement before and after the policy change in 1993. It used data on faculty’s employment and retirement from a research university with multiple schools. The study found that uncapping was associated with a statistically significant increase in the retirement age among those who retired from the university. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar nor did they control for differences between the groups. This means we are not confident that the estimated effects are attributable to the federal Age Discrimination in Employment Act (ADEA); other factors are likely to have contributed.","Age Discrimination Employment Act (ADEA)","Federal retirement benefits Older workers' programs","Adult, Older worker",,"United States",2013,https://www.researchgate.net/publication/258134776_The_Impact_of_Uncapping_of_M…,"Employment and Training Review Protocol" "Trends in the Composition and Outcomes of Young Social Security Disability Awardees","Ben-Shalom, Yonatan, and Stapleton, David. (2013). Trends in the Composition and Outcomes of Young Social Security Disability Awardees. Michigan Retirement Research Center (MRRC) working paper, WP 2013-284. Retrieved from http://www.mrrc.isr.umich.edu/publications/papers/pdf/wp284.pdf.","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: A large share of new Social Security Disability (SSD) recipients—workers with disabilities and adult children with disabilities—are younger than 40. Better information on the backgrounds, impairments, personal characteristics, and employment outcomes of these recipients would help policymakers develop programs tailored to the needs and circumstances of various subgroups of such recipients. This study used administrative data on young SSD awardees first awarded benefits from 1996 to 2007 to examine trends in their composition and outcomes. Most of the data come from the 2009 version of the Disability Analysis File, a data file originally constructed to support analysis of the effects of the Ticket to Work program. The study found that the composition of young SSD awardees changed substantially during this period. It also found that young awardees differed from older SSD awardees along many dimensions other than age. The findings raised several important policy issues. Most important, policymakers have to consider other options for the support of youth and young adults with disabilities—options that do not discourage work while promoting dependence.",,"Disability insurance Supplemental security income (SSI)","Disability, Youth",,"United States",2013,,"Disability Employment Policy Review Protocol" "Does retiree health insurance encourage early retirement?","Nyce, S., Schieber, S. Shoven, J. B., Slavov, S., & Wise, D. A. (2013). Does retiree health insurance encourage early retirement? Journal of Public Economics, 104, 40-51.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Unfavorable impacts Employment","Summary: The study’s objective was to examine the impact of employer-provided retiree health insurance on early retirement. The authors used a nonexperimental design to compare early retirement outcomes of employees who are eligible for retiree health insurance with that of those who have no coverage. The study found that people who were employed at age 57 and eligible for employer-subsidized retiree health coverage were significantly more likely to retire at ages 62 to 64 (before becoming eligible for Medicare at age 65) compared with those with no coverage. The quality of causal evidence presented in this report is low because the authors did not account for other factors that could have affected the difference between the treatment and comparison groups. This means we are not confident that the estimated effects are attributable to retiree health insurance; other factors are likely to have contributed.","Retiree Health Insurance","Employer provided retirement benefits Older workers' programs","Adult, Older worker",,"United States",2013,https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3770310/,"Employment and Training Review Protocol" "A randomized controlled trial to improve health among women receiving welfare in the U.S.: The relationship between employment outcomes and the economic recession.","Kneipp, S., Kairalla, J. & Sheely, A. (2013). A randomized controlled trial to improve health among women receiving welfare in the U.S.: The relationship between employment outcomes and the economic recession. Social Science & Medicine, 80, 130-140.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the Public Health Nurse (PHN) intervention on employment outcomes. The authors conducted a randomized controlled trial. Researchers used self-reported job beginning and ending dates to determine whether a participant was employed over a nine-month period. The authors found no statistically significant effect of PHN on any employment in the first nine months after random assignment. The quality of causal evidence presented in this study is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects would be attributable to PHN and not to other factors. However, the study did not find statistically significant effects.","Public Health Nurse Intervention","Other employment and reemployment","Disability, Low income",,"United States",2013,,"Employment and Training Review Protocol" "BOND implementation and evaluation: First-year snapshot of earnings and benefit impacts for Stage 1","Stapleton, D., Wittenburg, D., Gubits, D., Judkins, D., Mann, D.R., & McGuirk, A. (2013). BOND implementation and evaluation: First-year snapshot of earnings and benefit impacts for Stage 1. Cambridge, MA: Abt Associates, Inc.; Princeton, NJ: Mathematica Policy Research.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Public benefits receipt-Mod/high-No impacts Public benefit receipt Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to measure eight-month impacts for Stage 1 of the Benefit Offset National Demonstration (BOND), which tested whether a more-generous work incentive for Social Security Disability Insurance (SSDI) recipients affected their employment rates, earnings, and reliance on benefits.  The study was a randomized controlled trial; eligible SSDI recipients were randomly assigned to the treatment group, which was eligible for the benefit offset, or a control group that was not. The authors analyzed data from the Master Earnings File (MEF), Master Beneficiary Record (MBR), and Supplemental Security Record (SSR). The study found that the BOND intervention had no significant impact on total earnings or total SSDI benefits paid over the eight-month follow-up period. The quality of causal evidence presented in this report is high because it is based on a well-conducted randomized controlled trial. This means we are confident that the effects estimated in the study are attributable solely to the BOND, and not to other factors.","the Benefit Offset National Demonstration","Disability insurance Other wages and benefits Supplemental security income (SSI)",Disability,,"United States",2013,http://www.ssa.gov/disabilityresearch/documents/BOND_Deliverable%2024c1_DRAFT_S…,"Disability Employment Policy Review Protocol" "Learning communities’ impact on student success in developmental English","Barnes, R., & Piland, W. (2013). Learning communities’ impact on student success in developmental English. Community College Journal of Research and Practice, 37(12), 954-965.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Mixed impacts Education and skills gains","Summary: The study’s objective was to evaluate the impact of learning communities (linked courses coupled with special services, such as in-course tutoring) on course passage rates for students enrolled in developmental English courses at an urban community college in Southern California. The authors used administrative data to compare outcomes of students enrolled in learning community developmental English courses with those of students enrolled in traditional developmental English courses in the same semesters.  The study found that students enrolled in the higher-level developmental English learning community, consisting of the linked courses English 051/056, were more likely to pass English 051 than their counterparts who took the course in the traditional format. Students enrolled in the lower-level developmental English learning community (English 042/043) were less likely to pass English 043 than their counterparts in the traditional version of the course. The quality of causal evidence provided in this study is low because the authors did not include sufficient controls in their analysis. This means we are not confident that the estimated effects are attributable to learning communities. Other factors are likely to have contributed.","Learning Communities","Basic skills Community college education and other classroom training","Adult, Other barriers",,"United States, Urban",2013,,"Community College Review Protocol" "Acceleration through a holistic support model: An implementation and outcomes analysis of FastStart@CCD","Edgecombe, N., Jaggers, S., Baker, E., & Bailey, T. (2013). Acceleration through a holistic support model: An implementation and outcomes analysis of FastStart@CCD. Community College Research Center Report. New York: Teachers College, Columbia University.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: This study’s objective was to examine the impact of the FastStart developmental math program on college persistence, credit accumulation, and course completion. This study used transcript data from students at the Community College of Denver to compare outcomes of students who chose to participate in the FastStart developmental math program with the outcomes of students who participated in the standard developmental math program. The study found that students in the FastStart program were significantly more likely than students in the comparison group to complete the highest-level developmental math course and to enroll in and complete a gatekeeper math class. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to FastStart, but other factors might also have contributed.","the FastStart Program","Community college education and other classroom training","Adult, Other barriers",,"United States",2013,http://files.eric.ed.gov/fulltext/ED539910.pdf,"Community College Review Protocol" "Income tax and older American workers’ job transition into self-employment.","Choi, S. (2012). Income tax and older American workers’ job transition into self-employment. Korea and the World Economy, 13(2), 189-214.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Unfavorable impacts Employment","Summary: The study examined the effect of a progressive income tax on the likelihood of transitioning to self-employment among older workers. The study used a nonexperimental approach (the exponential hazard model) that compared the likelihood of transitioning from a wage job to self-employment based on the marginal taxes a worker would expect to pay. The author used the data from the Health and Retirement Study in 1992 matched to the Social Security Administration Master Earnings File from 1980 to 1991, which contains W-2 records of earnings from both wage work and self-employment. The study found that a more progressive tax (that is, a tax schedule that increases sharply toward the higher end) or higher marginal tax rates reduces the likelihood of entering self-employment. The quality of causal evidence presented in this report is low because the author did not ensure that the groups with higher or lower marginal tax rates were similar before a change in the tax schedule. This means we are not confident that the estimated effects are attributable to changes in marginal taxes; other factors are likely to have contributed.","Progressive Income Tax","Other employment and reemployment","Adult, Older worker, Employed",,"United States",2012,,"Employment and Training Review Protocol" "Demonstration to Maintain Independence and Employment (DMIE): Final report","Whalen, D., Gimm, G., Ireys, H., Gilman, B., & Croake, S. (2012). Demonstration to Maintain Independence and Employment (DMIE): Final report. Princeton, NJ: Mathematica Policy Research.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The report’s objective was to examine the impacts of the Demonstration to Maintain Independence and Employment (DMIE). DMIE was implemented in Hawaii, Kansas, Minnesota, and Texas with the aim of preventing or delaying people with disabilities from leaving the workforce and applying for Social Security Disability Insurance (SSDI) and Supplemental Security Income (SSI) benefits.  The study was a randomized controlled trial examining DMIE’s impact on employment, earnings, benefit applications and receipt, and health status. Study data sources included the Ticket Research File (TRF), Master Earnings File (MEF), and survey data. Because DMIE recruitment methods, participant populations, and services offered varied substantially across states, the authors reported impacts separately for each state and for Minnesota and Texas pooled together. With few exceptions, DMIE did not achieve statistically significant impacts on employment, annual earnings, or disability benefit applications. In Hawaii, DMIE participants worked fewer hours and reported fewer instrumental activities of daily living limitations. In Minnesota and Texas, the program reduced federal disability benefit receipt. The quality of the causal evidence is high for most outcomes examined, which means that we are confident that the estimated impacts are attributable solely to the DMIE. However, for some outcomes, including the hours worked in Hawaii, the quality of the causal evidence is moderate, which means that factors other than DMIE might have contributed to the estimated effects.","Demonstration to Maintain Independence and Employment (DMIE)","Health Disability insurance Supplemental security income (SSI) Vocational rehabilitation",Disability,,"United States",2012,http://www.mathematica-mpr.com/~/media/publications/PDFs/disability/dmie_final…,"Disability Employment Policy Review Protocol" "The impact of curricular learning communities on furthering the engagement and persistence of academically underprepared students at community colleges","McIntosh, J. (2012). The impact of curricular learning communities on furthering the engagement and persistence of academically underprepared students at community colleges (Doctoral dissertation). Retrieved from ProQuest Dissertation and Theses database. (UMI No. 3509985)","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of basic skills curricular learning communities on the persistence of underprepared community college students at 13 community colleges in eight states. Curricular learning communities enroll cohorts of students in sets of two or three linked courses. The study used student survey and administrative enrollment data in a quasi-experimental design in which the treatment group enrolled in the basic skills curricular learning communities and the comparison group did not enroll in the learning communities but took other, similar courses. The study found that students enrolled in the basic skills curricular learning communities were 1.27 times more likely to be enrolled in a postsecondary educational institution in the year following program enrollment, compared with students not enrolled in learning communities. The quality of causal evidence presented in this report is low because the author did not include sufficient controls in the analysis. This means we are not confident that the estimated effects are attributable to basic skills curricular learning communities. Other factors are likely to have contributed.","Basic Skills Curricular Learning Communities","Community college education and other classroom training","Adult, Other barriers",,"United States",2012,,"Community College Review Protocol" "The efficacy of supported employment for middle-aged and older people with schizophrenia.","Twamley, E. W., Vella, L., Burton, C. Z., Becker, D. R., Bell, M. D., & Jeste, D. V. (2012). The efficacy of supported employment for middle-aged and older people with schizophrenia. Schizophrenia Research, 135(1-3), 100-104.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study examined the impact of Individual Placement and Support (IPS) on competitive employment for older people with schizophrenia The study was a randomized controlled trial (RCT) conducted at a community mental health clinic and used weekly work logs cross-referenced with pay stubs to measure employment outcomes over a 12-month period. The study found that IPS was positively associated with employment and earnings. The quality of causal evidence presented in this report is low because the RCT has a confounding factor. This means we are not confident that the estimated effects are attributable to the IPS program; other factors are likely to have contributed.","Individual Placement and Support and Vocational Rehabilitation Program","Health Individuals facing barriers to employment Job search assistance and supportive services","Adult, Older worker, Disability",,"United States",2012,https://psycnet.apa.org/record/2011-30184-001,"Employment and Training Review Protocol" "What can a multifaceted program do for community college students? Early results from an evaluation of Accelerated Study in Associate Programs (ASAP) for developmental education students","Scrivener, S., Weiss, M., & Sommo, C. (2012). What can a multifaceted program do for community college students? Early results from an evaluation of Accelerated Study in Associate Programs (ASAP) for developmental education students. New York: MDRC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Accelerated Study in Associate Programs (ASAP) on full-time enrollment, credits attempted, and credits earned.  The study was a randomized controlled trial. Data sources included a baseline information form (BIF), which collected demographic and background characteristics and students’ records from the City University of New York (CUNY), including students’ transcripts and CUNY assessment test data. The study found that ASAP had significant impacts on full-time enrollment, credits attempted, and credits earned during the first, second, and third semesters following random assignment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to ASAP, and not to other factors.","the Accelerated Study in Associate Program (ASAP)","Basic skills Community college education and other classroom training","Adult, Other barriers, Low income",,"United States",2012,http://files.eric.ed.gov/fulltext/ED532840.pdf,"Community College Review Protocol" "An evaluation of the effect of correctional education programs on post-release recidivism and employment: An empirical study in Indiana","Nally, J., Lockwood, S., Knutson, K., & Ho, T. (2012). An evaluation of the effect of correctional education programs on post-release recidivism and employment: An empirical study in Indiana. The Journal of Correctional Education, 63(1), 69-89.",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Mod/high-No impacts Employment","Summary: The study examined the effect of Indiana’s correctional education program on individuals’ employment, earnings, and recidivism outcomes after release from prison. The authors used administrative data from the Indiana Department of Corrections (IDOC) and Indiana Department of Workforce Development to compare individuals who participated in correctional education programs while in custody with those who did not. The study found that participation in correctional education programs was associated with a lower likelihood of recidivism. The quality of causal evidence presented in this study is low because the authors did not ensure that the groups being compared were similar before the intervention.","Indiana’s Correctional Education Programs","Job search assistance and supportive services Other employment and reemployment Reentry",Justice-involved,,"United States",2012,https://www.thefreelibrary.com/An+evaluation+of+the+effect+of+correctional+educ…,"Employment and Training Review Protocol" "Tax elasticity of labor earnings for older individuals","Alpert, A. & Powell, D. (2012). Tax elasticity of labor earnings for older individuals. (Report no. 2012-272). Ann Arbor, MI: University of Michigan Retirement Research Center, University of Michigan.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study examined the impact of tax changes on people’s employment, retirement, and labor income outcomes. The study uses a nonexperimental approach and the data from the Health and Retirement Study to estimate the effect. The study found positive statistically significant relationships between increases in after-tax labor income and the employment of men and women as well as the delay in retirement for men. The study also found a positive statistically significant relationship between increases in the marginal net-of-tax rate and earnings for women. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to tax changes from the Economic Growth and Tax Relief Reconciliation Act (EGTRRA), the Jobs and Growth Tax Relief Reconciliation Act (JGTRRA), and their marriage tax penalty relief provision, but other factors might also have contributed.","Tax Changes","Older workers' programs Other employment and reemployment","Adult, Older worker",,"United States",2012,https://deepblue.lib.umich.edu/bitstream/handle/2027.42/94533/wp272.pdf?sequenc…,"Employment and Training Review Protocol" "Learning communities for students in developmental English: Impact studies at Merced College and the Community College of Baltimore County","Weissman, E., Cullinan, D., Cerna, O., Safran, S., & Richman, P. (2012). Learning communities for students in developmental English: Impact studies at Merced College and the Community College of Baltimore County. New York: MDRC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of learning communities on academic progression among students in need of developmental English courses at Merced Community College in Merced, California, and the Community College of Baltimore County (CCBC), in Maryland. The study was a randomized controlled trial that compared outcomes of the treatment and control groups during the program semester and the subsequent semester. The primary data source was transcript data from the colleges. The study found that students assigned to the Learning Communities Demonstration at Merced attempted and earned more developmental English credits in the program semester than students in the control group. The study did not find any statistically significant impacts of the learning communities at CCBC. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Learning Communities Demonstration, and not to other factors.","the Learning Communities Demonstration","Basic skills Community college education and other classroom training","Adult, Other barriers",,"United States",2012,http://files.eric.ed.gov/fulltext/ED529251.pdf,"Community College Review Protocol" "The efficacy of learning communities in assisting developmental students in achieving graduation and accumulation of credit hours in a southern metropolitan community college","Ashley, W. (2012). The efficacy of learning communities in assisting developmental students in achieving graduation and accumulation of credit hours in a southern metropolitan community college (Doctoral dissertation). Retrieved from ProQuest Dissertations and Theses database. (UMI No. 3522188)","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of learning communities on college credits earned and the completion of a college degree at Hinds Community College in Raymond, Mississippi. The study used school records to compare a treatment group of developmental education students who were living on campus and assigned to a learning community with a comparison group of students who lived off campus and did not participate in a learning community. The study found no significant differences in outcomes between the treatment and comparison groups. The quality of causal evidence presented in this report is low because the author did not control for preexisting differences between the treatment and comparison groups. This means we would not be confident that any estimated effects would be attributable to learning communities. However, the study found no statistically significant effects.","Learning Communities","Basic skills Community college education and other classroom training","Adult, Other barriers",,"United States",2012,,"Community College Review Protocol" "Does trade adjustment assistance make a difference?","Reynolds, K. M., & Palatucci, J. S. (2012). Does trade adjustment assistance make a difference? Contemporary Economic Policy, 30(1), 43-59. [TAA versus no TAA]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of Trade Adjustment Assistance (TAA) on the employment and earnings of displaced manufacturing workers. The authors investigated similar research questions in another study, examining the impact of TAA services including training relative to TAA services not including training, the profile of which is available [here]. The study uses a nonexperimental design to compare the outcomes of workers displaced from manufacturing jobs from 2003 to 2005 who received services through TAA with the outcomes of a comparison group of workers displaced during the same period who likely did not receive assistance. The authors collected data on the treatment and comparison groups from different sources. Data for program participants were based on U.S. Department of Labor Trade Act Participant reports. Data for the comparison group were based on the Displaced Worker Survey from the Current Population Survey. The study did not find statistically significant relationships between receiving TAA and the employment or earnings of participants compared with those who did not receive assistance from the program. The quality of causal evidence provided in this study is low because the study uses a nonexperimental design, and the authors did not demonstrate that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to TAA; other factors are likely to have contributed.","Trade Adjustment Assistance (TAA)-Funded Training","Adult and Dislocated Worker programs Job search assistance and supportive services Work based and other occupational training","Other barriers",,"United States",2012,http://faculty.smu.edu/Millimet/classes/eco7377/papers/reynolds%20palatucci%202…,"Employment and Training Review Protocol" "Effectiveness of supported employment for veterans with spinal cord injuries: Results from a randomized multisite study","Ottomanelli, L., Goetz, L. L., Suris, A., McGeough, C., Sinnott, P. L., Toscano, R., … Thomas, F. P. (2012). Effectiveness of supported employment for veterans with spinal cord injuries: Results from a randomized multisite study. Archives of Physical Medicine and Rehabilitation, 93(5), 740-747.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The study aimed to examine the impact of supported employment on the employment outcomes of veterans with spinal cord injuries. The study included a randomized controlled trial and collected self-reported data directly from veterans and chart review data from the spinal cord injury centers in six Veterans Affairs Medical Centers (VAMCs) to obtain demographic information. The study found statistically significant positive impacts on employment as a result of supported employment compared to treatment as usual. The quality of causal evidence presented in the report is high because it used a well-implemented experimental design. This means that we are confident that the estimated effects are attributable to supported employment and not to other factors.","Individual Placement and Support (IPS) model of supported employment","Veterans' reemployment","Disability, Veteran or military",,"United States",2012,https://doi.org/10.1016/j.apmr.2012.01.002,"Employment and Training Review Protocol" "The impact of work incentive benefits counseling on employment outcomes: Evidence from two return-to-work demonstrations","Delin, Barry S., Hartman, Ellie C., & Sell, Christopher W. (2012). The impact of work incentive benefits counseling on employment outcomes: Evidence from two return-to-work demonstrations. Journal of Vocational Rehabilitation, 36, 97-107. DOI:10.3233/JVR-2012-0585.","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: This study investigated the influence that different amounts of work incentive benefits counseling had on employment outcomes for people receiving Social Security disability benefits. The study used data from two similar Social Security Administration (SSA) sponsored return-to-work projects implemented in Wisconsin since 1999 to address two research questions: (1) Does the amount (dosage) of work incentive benefits counseling influence employment outcomes? and (2) What factors, including prior employment outcomes, influence the dosage of work incentive benefits counseling services received? Although conclusions based on data from two relatively small projects located in a single state cannot fully settle the issue, results from linear regression models suggested that receiving higher dosages of benefits counseling services led to better employment outcomes. The study also showed that participants with stronger pre-enrollment employment outcomes received more service (a higher dosage of benefits counseling) than those who had weaker ones.",,"Disability insurance Other wages and benefits Supplemental security income (SSI)",Disability,,"United States",2012,,"Disability Employment Policy Review Protocol" "Exploring bias in math teachers’ perceptions of students’ ability by gender and race/ethnicity","Riegle-Crumb, C., & Humphries, M. (2012). Exploring bias in math teachers’ perceptions of students’ ability by gender and race/ethnicity. Gender & Society, 26(2), 290-322.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: This study aimed to inform the literature on gender stereotypes in classrooms by studying whether teachers displayed bias by underestimating the ability of 10th-grade female and minority students in high school math classes, even after taking into account students’ grades and test scores. The study analyzed survey data from students and teachers across the United States who were part of the Educational Longitudinal Study of 2002, which followed 15,000 10th-grade students through college and into the labor force. The authors estimated multinomial logistic regression models to determine whether teachers were more likely to underestimate the academic ability of female, black, and Hispanic students compared to white male students, controlling for grade point average (GPA), test scores, and student, teacher, and school characteristics. Results were generated separately for students in low-level, average-level, and advanced-level high school math courses. The study found that in low-level and advanced-level math classes, teachers were less likely to say that the course was too easy for white female students as compared to white male students. In average-level math classes, teachers were both less likely to say that the course was too easy and more likely to say that it was too difficult for white female students, compared to white male students. These findings did not extend to minority female students nor to minority male students, who, after controlling for GPA and test scores, were just as likely to be rated by teachers as being in a course that was too easy or too difficult for them as white male students.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Other barriers, Female",,"United States",2012,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "The Social Security Administration’s Youth Transition Demonstration Projects: Interim report on West Virginia Youth Works","Fraker, T., Mamun, A., Manno, M., Martinez, J., Reed, D., Thompkins, A., & Wittenburg, D. (2012). The Social Security Administration’s Youth Transition Demonstration Projects: Interim report on West Virginia Youth Works. Princeton, NJ: Mathematica Policy Research.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-No impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to measure 12-month impacts of the West Virginia Youth Works project, one of six project sites of the larger Social Security Administration (SSA)-sponsored Youth Transition Demonstration (YTD) that used a randomized evaluation. Youth Works provided services to help youth with disabilities improve their education and employment outcomes and become more economically self-sufficient. Data were collected from a baseline survey and 12-month follow-up survey, the Ticket Research File (TRF), and the Master Earnings File (MEF). The authors estimated program impacts on measures of paid employment, educational attainment, and Social Security disability benefit receipt. The study found that Youth Works had positive impacts on employment, earnings, and total income after one year of implementation. There were no impacts on educational attainment and Social Security disability benefit receipt. The quality of causal evidence presented in the study is high for the education, employment, and SSA benefit receipt outcomes because they are based on a well-implemented randomized controlled trial with low attrition. However, the quality of causal evidence is moderate for earnings and total income because sample attrition for these outcomes was high.","the Youth Transition Demonstration Projects, West Virginia Youth Works Program","Disability insurance Supplemental security income (SSI) Youth programs","Youth, Disability",,"United States",2012,http://www.mathematica-mpr.com/~/media/publications/pdfs/disability/ytd_wv_inte…,"Disability Employment Policy Review Protocol" "Exploring the impact of learning communities at a community college: An effort to support students enrolled in a developmental math course (Doctoral dissertation)","VonHandorf, T. (2012). Exploring the impact of learning communities at a community college: An effort to support students enrolled in a developmental math course (Doctoral dissertation). Retrieved from ProQuest Dissertations and Theses database. (UMI No. 3504070)","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of a learning community consisting of linked courses (a developmental math course and a student success course) on students’ retention and persistence in community college. The author compared mean outcomes for students enrolled in the learning community (the treatment group) and students enrolled in the same nonlearning community developmental math course in previous semesters (the comparison group). The study used administrative data to measure retention in the developmental math course and persistence into the next semester. The study found no statistically significant differences in outcomes between the treatment and comparison groups. The quality of the causal evidence presented in this report is low because the author did not control for relevant student characteristics in the analysis. This means we are not confident that the estimated effects are attributable to the learning community. Other factors are likely to have contributed.","Learning Communities","Basic skills Community college education and other classroom training","Adult, Other barriers",,"United States",2012,,"Community College Review Protocol" "Effectiveness of supported employment for veterans with spinal cord injuries: Results from a randomized multisite study","Ottomanelli, L., Goetz, L. L., Suris, A., McGeough, C., Sinnott, P. L., Toscano, R., … Thomas, F. P. (2012). Effectiveness of supported employment for veterans with spinal cord injuries: Results from a randomized multisite study. Archives of Physical Medicine and Rehabilitation, 93(5), 740-747. [CONTRAST 1: Non-experimental study]",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study examined the impact of supported employment on the employment outcomes for veterans with spinal cord injuries. The authors used statistical comparisons in a non-experimental analysis to estimate the relationship between supported employment services and employment, drawing on self-reported data for employment information and chart review data from the spinal cord injury centers in six Veterans Affairs Medical Centers to obtain demographic information . The study found statistically significant positive relationships between supported employment and veterans’ employment outcomes compared to treatment as usual. The quality of causal evidence presented in the report is low because there are preexisting differences between the intervention and comparison groups. This means we are not confident that the estimated effects are attributable to supported employment; other factors are likely to have contributed.","Individual Placement and Support (IPS) model of supported employment","Veterans' reemployment","Disability, Veteran or military",,"United States",2012,https://doi.org/10.1016/j.apmr.2012.01.002,"Employment and Training Review Protocol" "Minnesota’s Affordable Homes Program: Evaluating the effects of a prison work program on recidivism, employment and cost avoidance","Northcutt Bohmert, M., & Duwe, G. (2012). Minnesota’s Affordable Homes Program: Evaluating the effects of a prison work program on recidivism, employment and cost avoidance. Criminal Justice Policy Review, 23(3), 327-351. [Study 1, Contrast 1: Affordable Homes Program participants versus matched nonparticipants].",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The authors examine the impact of participation in Minnesota’s Affordable Homes Program (AHP) on post-release employment, earnings, and recidivism outcomes for people who were previously incarcerated. The authors also investigated whether completion of the program impacted similar outcomes, the profile of which is available here. The authors used a nonexperimental design (propensity score matching) to create a comparison group of nonparticipants who were similar to program participants. The authors used data from the Minnesota Department of Employee and Economic Development, the Minnesota Bureau of Criminal Apprehension, and the Minnesota Department of Corrections to compare these groups’ post-release employment, earnings, and recidivism. • Participation in AHP was not associated with statistically significant effects on employment, earnings, or the recidivism as measured by rearrest, felony reconviction, or re-incarceration for a new crime. The quality of causal evidence presented in this report for program participants compared with nonparticipants is low for post-release employment and earnings but moderate for outcomes related to recidivism. This means we are not confident in the report’s employment and earnings outcomes, but we are somewhat confident in its recidivism outcomes.","Minnesota’s Affordable Homes Program (AHP)",Reentry,Justice-involved,,"United States",2012,https://journals.sagepub.com/doi/pdf/10.1177/0887403411411911,"Employment and Training Review Protocol" "Cash transfers and children's education and labour among Malawi's poor","Miller, C., & Tsoka, M. (2012). Cash transfers and children's education and labour among Malawi's poor. Development Policy Review, 30(4), 499-522. doi:10.1111/j.1467-7679.2012.00586.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The purpose of the study was to assess the effects of an unconditional cash transfer program, the Malawi Social Cash Transfer Scheme (SCTS), on child school participation and child labor. To assess the program’s effects, the authors used a randomized controlled trial in which villages were randomly assigned to the treatment group, which would receive the intervention, and the control group, which would not. Child labor was assessed using household surveys, and schooling outcomes were assessed using household surveys and school records. To understand the program’s impact on child school and work participation, the authors compared change in these outcomes over the first year of the program. The study found that children participating in the intervention had significantly greater decreases in school absences over one year, relative to the comparison group. In addition, over one year there was a significantly lower increase in the percent of both boys and girls who worked for income if they were in the intervention group rather than the comparison group. The quality of causal evidence presented in this study is moderate because, although it was based on a randomized controlled trial with high attrition, the treatment and control groups were similar before the intervention. This means we are somewhat confident that the estimated effects are attributable to the Malawi Social Cash Transfer Scheme, but other factors might also have contributed.","Malawi Social Cash Transfer Scheme","Child labor","Other barriers, Other, Low income",,International,2012,http://interactions.eldis.org/sites/interactions.eldis.org/files/database_sp/Ma…,"Child Labor Review Protocol" "The Social Security Administration’s Youth Transition Demonstration projects: Interim report on Broadened Horizons, Brighter Futures","Fraker, T., Honeycutt, T., Mamun, A., Manno, M., Martinez, J., O’Day, B., Reed, D., & Thompkins, A. (2012). The Social Security Administration’s Youth Transition Demonstration projects: Interim report on Broadened Horizons, Brighter Futures. Princeton, NJ: Mathematica Policy Research.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Mod/high-No impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: This study’s objective was to measure 12-month impacts of the Florida Broadened Horizons, Brighter Futures (BHBF) program, one of six project sites of the larger Youth Transition Demonstration (YTD) projects that used randomized evaluations.  The Social Security Administration (SSA) sponsored the evaluation. BHBF provided services to help youth with severe disabilities improve their employment outcomes and become more economically self-sufficient. Data were collected from baseline and 12-month follow-up surveys, the Ticket Research File (TRF), and Master Earnings File (MEF). The authors estimated program impacts on measures of paid employment, educational attainment, and Social Security disability benefit receipt. The study found that BHBF had statistically significant impacts on employment and Social Security disability benefit receipt at the 12-month follow-up. There were no impacts on educational attainment or earnings. The quality of causal evidence presented in this report is high because it is based on a well-conducted randomized controlled trial. This means we are confident that the effects estimated in the study are attributable solely to BHBF, and not to other factors.","the Youth Transition Demonstration Projects, Broadended Horizons, Brighter Futures","Disability insurance Supplemental security income (SSI) Youth programs","Youth, Disability",,"United States",2012,http://www.mathematica-mpr.com/~/media/publications/pdfs/disability/ytd_miami_i…,"Disability Employment Policy Review Protocol" "More than a job: Final results from the evaluation of the Center for Employment Opportunities (CEO) transitional job program","Redcross, C., Millenky, M., & Rudd, T. (2012). More than a job: Final results from the evaluation of the Center for Employment Opportunities (CEO) transitional job program. New York: MDRC.",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine the impact of the Center for Employment Opportunities (CEO) transitional job program on earnings and employment outcomes. The authors conducted a randomized controlled trial. They used administrative data from New York State and New York City, along with data from the National Directory of New Hires and the CEO program itself, to measure earnings and employment outcomes. The study did not find any significant differences between CEO program participants and the control group in Year 2 or Year 3 on any employment or earnings outcomes. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to CEO program, and not to other factors.","The Center for Employment Opportunities (CEO) Transitional Job Program","Job search assistance and supportive services Other employment and reemployment",Justice-involved,,"United States",2012,http://www.mdrc.org/sites/default/files/full_451.pdf,"Review Protocol" "The Social Security Administration’s Youth Transition Demonstration projects: Interim report on West Virginia Youth Works","Fraker, T., Mamun, A., Manno, M., Martinez, J., Reed, D., Thompkins, A., & Wittenburg, D. (2012). The Social Security Administration’s Youth Transition Demonstration projects: Interim report on West Virginia Youth Works. Report submitted to the Social Security Administration. Washington, DC: Mathematica Policy Research.","Disability Employment Policy","Study Type: Implementation Analysis",,,"Summary: This report presented an interim implementation and impact analysis on the West Virginia Youth Works Youth Transition Demonstration (YTD) project. The program sought to help youth with disabilities ages 14 through 25 who lived in 19 specific West Virginia counties to maximize their economic self-sufficiency. The study examined implementation of Youth Works, focusing on major aspects of service delivery, including the background, local context, and service environment. It provided information on participants’ characteristics and satisfaction with the program. The authors conducted qualitative analysis of staff and participant interviews, including data collected from site visits, and descriptive quantitative analysis of participants’ baseline and follow-up survey data and service utilization data from a management information system. Overall, the study found that Youth Works faced some substantial challenges, but that all participants received some project services and most received at least one contact for each of the four types of service: benefits planning, employment, education, and case management. Study findings related to implementation challenges and solutions are potentially applicable to other current or future projects that provide employment-related services to youth with disabilities.","the Youth Transition Demonstration Projects, West Virginia Youth Works Program","Supplemental security income (SSI) Youth programs Vocational rehabilitation","Youth, Disability",,"United States",2012,http://www.mdrc.org/sites/default/files/WV%20YTD%20Report%2012-3-2012.pdf,"Disability Employment Policy Review Protocol" "New evidence of success for community college remedial English students: Tracking the outcomes of students in the Accelerated Learning Program (ALP)","Cho, S. W., Kopko, E., Jenkins, D., & Jaggars, S.S. (2012). New evidence of success for community college remedial English students: Tracking the outcomes of students in the Accelerated Learning Program (ALP) (CCRC Working Paper No. 53). New York: Columbia University, Community College Research Center.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Education and skills gains-Mod/high-Mixed impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Community College of Baltimore County’s Accelerated Learning Program (ALP) on course progression, persistence, and completion outcomes. In this program, students who otherwise would have taken a developmental English course instead took English 101, as well as an eight-person companion course designed to help the students pass English 101. With student-level, college administrative data, the authors used regression models and propensity score matching to compare outcomes of ALP students to those of comparison students in traditional courses. The study found that ALP students were more likely than comparison students to attempt and complete college-level English courses, persist to the next year, and attempt and complete more credits. However, ALP students were less likely to earn a certificate degree than comparison students. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the ALP, but other factors might also have contributed.","the Accelerated Learning Program","Community college education and other classroom training","Adult, Other barriers",,"United States",2012,http://files.eric.ed.gov/fulltext/ED538995.pdf,"Community College Review Protocol" "More than a job: Final results from the evaluation of the Center for Employment Opportunities (CEO) transitional jobs program","Redcross, C., Millenky, M., Rudd, T., and Levshin, V. (2012). More than a job: Final results from the evaluation of the Center for Employment Opportunities (CEO) transitional jobs program. OPRE Report 2011-18. Washington, DC: Office of Planning, Research, and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of a comprehensive employment program on ex-offenders’ employment and wages. The authors randomly assigned former prisoners to an employment program offering transitional job placement and other services or to a control condition providing a more limited set of services. Employment and earnings data were collected quarterly for three years and compared between the two groups, controlling for characteristics before random assignment. The study found that treatment group members were 24.5 percentage points more likely to be employed during the first year after random assignment than control group members. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the employment program, and not to other factors.","the Center for Employment Opportunities (CEO) Transitional Jobs Program","Job search assistance and supportive services Other employment and reemployment Reentry",Justice-involved,,"Urban, United States",2012,http://www.acf.hhs.gov/sites/default/files/opre/more_than_job.pdf,"Employment and Training Review Protocol" "Inspiring girls and their female after school educators to pursue computer science and other STEM careers","Koch, M., & Gorges, T. (2012). Inspiring girls and their female after school educators to pursue computer science and other STEM careers. International Journal of Gender, Science and Technology, 4(3), 294-312.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Attitudes-Low-No impacts Attitudes","Summary: The study’s objective was to examine the impact of facilitating Build IT, an extracurricular information technology (IT) program for middle-school girls, on the facilitators’ interest in STEM education and careers. The authors also described outcomes for girls who participated in the facilitator-led program. The study relied on a survey administered to 31 program facilitators after they had been involved with the program for one year. The study found no statistically significant relationships between facilitating Build IT and interest in STEM education and careers. The quality of causal evidence presented in this report is low because the authors did not use a research design that supported causal inference or control for factors other than Build IT that could contribute to the observed outcomes.","Build IT","Science, Technology, Engineering, and Math (STEM) programs Youth programs","Youth, Other barriers, Female",,"United States",2012,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Minnesota’s Affordable Homes Program: Evaluating the effects of a prison work program on recidivism, employment and cost avoidance","Northcutt Bohmert, M., & Duwe, G. (2012). Minnesota’s Affordable Homes Program: Evaluating the effects of a prison work program on recidivism, employment and cost avoidance. Criminal Justice Policy Review, 23(3), 327-351. [Study 1, Contrast 2: Affordable Homes Program completers versus matched nonparticipants]",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The authors examine the impact of completing Minnesota’s Affordable Homes Program (AHP) on post-release employment, earnings, and recidivism outcomes for people who were previously incarcerated. The authors also investigated whether participation in the program impacted similar outcomes, the profile of which is available here. The authors used a nonexperimental design (propensity score matching) to create a comparison group of nonparticipants who were similar to program completers. The authors used data from the Minnesota Department of Employee and Economic Development, the Minnesota Bureau of Criminal Apprehension, and the Minnesota Department of Corrections to compare these groups’ post-release employment, earnings, and recidivism. Completion of AHP was associated with lower recidivism, higher employment, and higher earnings; these results were statistically significant. The quality of causal evidence presented in this report for program completers compared with nonparticipants is low because the authors did not fully account for possible existing differences between the study groups. This means we are not confident that estimated effects between program completers and nonparticipants are attributable to AHP; other factors are likely to have contributed.","Minnesota’s Affordable Homes Program (AHP)",Reentry,Justice-involved,,"United States",2012,https://journals.sagepub.com/doi/pdf/10.1177/0887403411411911,"Employment and Training Review Protocol" "Effect of the Mchinji Social Cash Transfer Pilot Scheme on children's schooling, work and health outcomes: A multilevel study using experimental data","Luseno, W. K. (2012). Effect of the Mchinji Social Cash Transfer Pilot Scheme on children's schooling, work and health outcomes: A multilevel study using experimental data (Doctoral dissertation). University of North Carolina at Chapel Hill, Chapel Hill, North Carolina. Retrieved from ProQuest Dissertations & Theses A&I (Accession No. 1240627043).","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Mixed impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The objective of the study was to examine the impact of the Mchinji Social Cash Transfer Pilot Scheme (SCTPS) on child labor and school outcomes.  The study was a randomized controlled trial conducted in the Mchinji district of Malawi. Within the district, eight villages were randomly assigned to either the treatment or control groups. Using survey data, the author compared the child labor and school outcomes of children ages 6-17 in households that received the cash transfer with those that did not receive the cash transfer. The study found that when compared to the control group, children in the Mchinji SCTPS program had significantly: 1) increased school enrollment; 2) fewer school absences; and 3) worked fewer hours outside of the home. An unexpected finding was that children participating in the Mchinji SCTPS also had significantly higher rates of domestic work when compared to children in the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Mchinji Social Cash Transfer Pilot Scheme and not to other factors.","Mchinji Social Cash Transfer Pilot Scheme (SCTPS)","Child labor","Other barriers, Other, Low income",,International,2012,https://cdr.lib.unc.edu/indexablecontent/uuid:7052544c-df44-46b5-aa01-500991b72…,"Child Labor Review Protocol" "A randomized controlled trial of supported employment among veterans with posttraumatic stress disorder","Davis, L., Leon, A., Toscano, R., Drebing, C., Ward, L., Parker, P., ..., & Drake, R. (2012). A randomized controlled trial of supported employment among veterans with posttraumatic stress disorder. Psychiatric Services, 63(5), 464-470.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of individual placement and support (IPS) on competitive employment, earnings, and income for U.S. military veterans with posttraumatic stress disorder (PTSD). The study was a randomized controlled trial conducted at the Tuscaloosa Veterans Affairs (VA) Medical Center. Treatment group members received IPS services, whereas the control group received standard Vocational Rehabilitation Program (VRP) services. Data sources included patients’ records from the clinical research coordinator and daily logs completed by participants. The study found that IPS had positive impacts on competitive employment and gross income. The quality of causal evidence presented in this report is high because it is based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to IPS, and not other factors.","Individual Placement and Support and Vocational Rehabilitation Program","Vocational rehabilitation Veterans' reemployment Supported employment or other employment supports","Disability, Veteran or military",,"United States",2012,,"Disability Employment Policy Review Protocol" "The effects of hiring tax credits on employment of disabled veterans","Heaton, P. (2012). The effects of hiring tax credits on employment of disabled veterans. Santa Monica, CA: Rand Corporation. Occasional Paper. Retrieved from https://www.rand.org/content/dam/rand/pubs/occassional papers/2012/RAND_OP 366.pdf.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study examined the impact of the 2007 Work Opportunity Tax Credit (WOTC) on the employment and earnings outcomes among veterans with disabilities. The authors used a nonexperimental approach and data from the American Community Survey Public Use Microdata Sample to compare the employment and earnings outcomes of veterans who were eligible for the WOTC with those of veterans who were not. The study found an approximately 2 percentage point increase in employment, a 0.58 hour increase in weekly hours, and a 40 percent increase in wage income among veterans with disabilities who were eligible for WOTC compared to veterans and nonveterans with other characteristics. The quality of causal evidence presented in this report is moderate because it relied on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the WOTC program, but other factors might also have contributed to the findings.","Work Opportunity Tax Credit","Veterans' reemployment Work Opportunity Tax Credit (WOTC)","Disability, Veteran or military",,"United States",2012,https://www.rand.org/pubs/occasional_papers/OP366.html,"Employment and Training Review Protocol" "The Social Security Administration’s Youth Transition Demonstration Projects: Interim report on the Career Transitions Program","Fraker, T., Baird, P., Mamun, A., Manno, M., Martinez, J., Reed, D., & Thompkins, A. (2012). The Social Security Administration’s Youth Transition Demonstration Projects: Interim report on the Career Transitions Program. Princeton, NJ: Mathematica Policy Research.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: This study’s objective was to measure 12-month impacts of the Maryland Career Transitions Program (CTP), one of six project sites of the larger Social Security Administration (SSA)-sponsored Youth Transition Demonstration (YTD) projects that used a randomized evaluation. CTP provided services to help youth with severe emotional disturbances or significant mental illness improve their education and employment outcomes and become more self-sufficient. Data were collected from a baseline survey and 12-month follow-up survey, the Ticket Research File (TRF), and the Master Earnings File (MEF). The authors estimated program impacts on measures of paid employment, educational attainment, and Social Security disability benefit receipt. The study found that CTP did not achieve any statistically significant impacts on employment, earnings, total income, or Social Security disability benefit receipt during the 12-month follow-up period. However, CTP participants were more likely to enroll in postsecondary education than members of the control group. The quality of causal evidence presented in the study is high for the education and SSA benefit receipt outcomes because they are based on a well-implemented randomized controlled trial with low attrition. However, the quality of causal evidence is moderate for employment, earnings, and total income because sample attrition for these outcomes was high.","the Youth Transition Demonstration Projects, Career Transitions Program","Disability insurance Supplemental security income (SSI) Youth programs",Disability,,"United States",2012,http://www.mathematica-mpr.com/~/media/publications/PDFs/disability/YTD_CTP_Int…,"Disability Employment Policy Review Protocol" "The Social Security Administration’s Youth Transition Demonstration Projects: Interim report on Broadened Horizons, Brighter Futures","Fraker, T., Honeycutt, T., Mamun, A., Manno, M., Martinez, J., O’Day, B., Reed, D., & Thompkins. A. (2012). The Social Security Administration’s Youth Transition Demonstration Projects: Interim report on Broadened Horizons, Brighter Futures. Report submitted to the Social Security Administration. Washington, DC: Mathematica Policy Research.","Disability Employment Policy","Study Type: Implementation Analysis",,,"Summary: This report presented an interim implementation and impact analysis on the Broadened Horizons, Brighter Futures (BHBF) Youth Transition Demonstration (YTD) project. The program sought to help youth with disabilities ages 16 through 22 who received Supplemental Security Income and resided in Miami-Dade County maximize their self-sufficiency. The study examined implementation of BHBF, focusing on major aspects of service delivery, including the background, local context and service environment. It also provided information on participants’ characteristics and satisfaction with the program. The authors conducted qualitative analysis of staff and participant interviews, including data collected from site visits; and descriptive quantitative analysis of participants’ baseline and follow-up survey data and service utilization data from a management information system. The study found that participants began receiving services soon after enrollment. Some services were more challenging to implement than others, but all participants received some project services and most received at least one of the four major types of service: benefits planning, employment, education, and case management.  Study findings related to implementation challenges and solutions are potentially applicable to other current or future projects that provide employment-related services to youth with disabilities.","the Youth Transition Demonstration Projects, Broadended Horizons, Brighter Futures","Supplemental security income (SSI) Youth programs Vocational rehabilitation","Youth, Disability",,"United States",2012,http://www.mdrc.org/sites/default/files/interim_report_broadened_horizons.pdf,"Disability Employment Policy Review Protocol" "Returning to work after prison: Final results from the Transitional Jobs Reentry Demonstration","Jacobs, E. (2012). Returning to work after prison: Final results from the Transitional Jobs Reentry Demonstration. New York: MDRC.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Transitional Jobs Reentry Demonstration (TJRD) on ex-offenders’ employment and wages. The author used a randomized controlled trial to assign former prisoners to the transitional jobs program or to a group that was offered job search assistance and compared the two groups’ employment and earnings outcomes two years after random assignment, controlling for participants’ characteristics before random assignment. The study found that members of the transitional jobs group were significantly more likely (by 29 percentage points) than control group members to be employed at any point during the two years after random assignment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the TJRD, and not to other factors.","the Transitional Jobs Reentry Demonstration (TJRD)","Job search assistance and supportive services Other employment and reemployment Reentry","Justice-involved, Unemployed, Male",,"United States",2012,http://www.mdrc.org/sites/default/files/full_626.pdf,"Employment and Training Review Protocol" "Transformative graduate education programs: An analysis of impact on STEM and non-STEM Ph.D. completion","Kniola, D., Chang, M., & Olsen, D. (2012). Transformative graduate education programs: An analysis of impact on STEM and non-STEM Ph.D. completion. Higher Education, 63(4), 473–495. doi:10.1007/s10734-011-9453-8","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to determine whether universities participating in Transformative Graduate Education Programs (TGPs) conferred a greater number of science, technology, engineering, and mathematics (STEM) doctoral degrees, particularly to women and underrepresented candidates of color. The study also examined whether TGPs resulted in a greater number of non-STEM doctoral degrees, but that is not the focus of this review. The authors analyzed data from the Integrated Postsecondary Education Data System to estimate the impact of a university’s participation in one of seven TGPs during the 2003–2005 period, controlling for institutional characteristics. The study found that TGPs were associated with a higher number of doctoral degrees awarded in STEM fields to women across all institutions. The quality of causal evidence presented in this report is low. This means we are not confident that the estimated effects are attributable to universities’ participation in TGPs. Other factors are likely to have contributed.","Transformative Graduate Education Programs (TGPs)","Science, Technology, Engineering, and Math (STEM) programs","Other barriers, Female, STEM professional",,"United States",2012,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "The effects of learning communities for students in developmental education: A synthesis of findings from six community colleges","Visher, M., Weiss, M., Weissman, E., Rudd, T., & Wathington, H. (2012). The effects of learning communities for students in developmental education: A synthesis of findings from six community colleges. New York: National Center for Postsecondary Research.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of developmental education learning communities at six community colleges across the United States on enrollment, credits attempted, and credits earned over the program semester and two follow-up semesters. Students in the learning communities took a developmental course that was linked to either a college-level course or a student success course, depending on the specific school, during one semester. One community college also provided students in the learning communities with tutoring and case management services. The study pooled data from six randomized controlled trials, in which eligible students were randomly assigned to either the treatment group, which was offered the opportunity to participate in the learning community program, or the control group, which could not participate in the learning community program. The primary data sources were a baseline survey on background characteristics and student transcripts. The study found that the treatment group had significantly higher full-time registration rates and earned significantly more total cumulative credits during the program semester than the control group, but these differences were not significant in the two follow-up semesters. In addition, the study found no significant impacts on course enrollment rates or total cumulative credits attempted in the program semester or the two follow-up semesters. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the learning communities, and not to other factors.","Learning Communities","Basic skills Community college education and other classroom training","Adult, Other barriers",,"United States",2012,http://www.mdrc.org/sites/default/files/LC%20A%20Synthesis%20of%20Findings%20FR…,"Community College Review Protocol" "Disability Benefits Suspended or Terminated Because of Work","Schimmel, Jody, & Stapleton, David C. (2011). Disability Benefits Suspended or Terminated Because of Work. Social Security Bulletin, 71(3).","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: This study produced statistics on the first month of suspension or termination for work for Social Security Disability Insurance (DI) and Supplemental Security Income (SSI)-only recipients. It also estimated the number of months people spent in nonpayment status following suspension or termination for work (NSTW) before their return to the rolls, attainment of the full retirement age, or death—in each year from 2002 through 2006. Data came from a compilation of multiple administrative data sources containing information on all DI and adult SSI disability recipients with at least one month in current pay status from 1996 onward, created for the Ticket to Work (TTW) evaluation. The study found that less than 1 percent of all recipients, or about 70,000 each year, experienced their first month of benefit suspension or termination for work in each year from 2002 through 2006. However, the cumulative effect was much more substantial because many recipients remained in NSTW for a sustained period. Slightly more than 400,000 recipients or former recipients had at least one NSTW month in 2006. TTW participants were more likely to have a first STW than nonparticipants, but most of those who had an STW were not TTW participants, reflecting low use of TTW.",,"Disability insurance Supplemental security income (SSI)",Disability,,"United States",2011,http://www.ssa.gov/policy/docs/ssb/v71n3/v71n3p83.html,"Disability Employment Policy Review Protocol" "Learning communities for students in developmental math: Impact studies at Queensborough and Houston Community Colleges","Weissman, E., Butcher, K. Schneider, E., Teres, J., Collado, H., Greenberg, D., & Welbeck, R. (2011). Learning communities for students in developmental math: Impact studies at Queensborough and Houston Community Colleges. New York: National Center for Postsecondary Research.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of learning communities on academic progression, persistence, and credit accumulation among students in need of developmental math courses at Queensborough and Houston Community Colleges. This study was a randomized controlled trial that compared the course passage rates, registration rates, and number of credits earned for the treatment and control groups during the program semester and one (Houston) or two (Queensborough) post-program semesters. The primary data source was transcript data from the colleges. The study found that at Queensborough, learning community students were significantly more likely than control group students to pass developmental math in the program semester and the second math class in their sequence during the next semester. At Houston, students in the treatment group were significantly more likely than control group students to pass any developmental math course in the program or first post-program semester.  The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Learning Communities Demonstration at Queensborough Community College and at Houston Community College, and not to other factors.","the Learning Communities Demonstration","Basic skills Community college education and other classroom training","Adult, Other barriers",,"United States",2011,http://files.eric.ed.gov/fulltext/ED516646.pdf,"Community College Review Protocol" "Inside the double bind: A synthesis of empirical research on undergraduate and graduate women of color in science, technology, engineering, and mathematics","Ong, M., Wright, C., Espinosa, L., & Orfield, G. (2011). Inside the double bind: A synthesis of empirical research on undergraduate and graduate women of color in science, technology, engineering, and mathematics. Harvard Educational Review, 81(2), 172-208.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study examined existing empirical research on the challenges that minority women have faced in science, technology, engineering, and mathematics (STEM) disciplines at the undergraduate and graduate levels, emphasizing factors that promote or discourage retention and transition to employment or further study. The authors analyzed 116 empirical studies conducted from 1970 to 2008 that examine aspects of the academic and career experiences of minority women in STEM disciplines, identifying the findings of each study and synthesizing these features to pinpoint trends and opportunities for further investigation. The authors summarized the studies’ conclusions regarding the effects of academic climate, enrichment programs, self-confidence, and relationships with faculty, peers, and family on minority women’s persistence in undergraduate STEM majors, highlighting lack of recognition from peers and faculty members and complex family expectations and dynamics as factors that hinder them from completing STEM degrees. At the graduate level, many of the same influences, particularly family expectations and fraught relationships with peers and professors, present challenges for minority women in STEM disciplines. Academic and social transitions from minority-serving institutions to predominantly white institutions and the financial demands of graduate study also represent cross-cutting obstacles.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Other barriers, Female",,"United States",2011,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "The Accelerated Benefits Demonstration and Evaluation Project: Impacts on health and employment at twelve months","Michalopoulos, C., Wittenburg, D., Israel, D., Schore, J., Warren, A., Zutshi, A., Freedman, S., & Schwartz, L. (2011). The Accelerated Benefits Demonstration and Evaluation Project: Impacts on health and employment at twelve months. New York: MDRC.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-No impacts Employment Health and safety-Mod/high-Favorable impacts Health and safety Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: This is the 12-month survey impact report of the Accelerated Benefits Demonstration (ABD), an effort to provide immediate health insurance and employment and benefits counseling to new, uninsured Social Security Disability Insurance (SSDI) recipients during the 24 month Medicare eligibility waiting period.  About 2,000 volunteers were randomly assigned as part of the demonstration; this report focuses on approximately 1,500 of them. Study data sources included Social Security Administration (SSA) administrative records, a baseline telephone survey, a follow-up 12-month survey, health claims data, and a case management information system. ABD health insurance increased health care utilization, reduced unmet medical care needs, and improved self-reported health. However, ABD employment supports did not increase employment in the first 12 months of follow-up. The quality of the causal evidence presented in this report is high because the study is a well-implemented randomized controlled trial. This means we can be confident that the outcome differences between research groups are attributable to ABD, and not other factors.","Accelerated Benefits Demonstration","Disability insurance Health insurance Supplemental security income (SSI) Job search assistance and supportive services",Disability,,"United States",2011,http://www.mdrc.org/sites/default/files/full_528.pdf,"Disability Employment Policy Review Protocol" "The Social Security Administration’s Youth Transition Demonstration Projects: Interim report on Transition WORKS","Fraker, T., Black, A., Mamun, A., Manno, M., Martinez, J., O’Day, B., O’Toole, M., Rangarajan, A., & Reed, D. (2011). The Social Security Administration’s Youth Transition Demonstration Projects: Interim report on Transition WORKS. Princeton, NJ: Mathematica Policy Research.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-No impacts Education and skills gains Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: This study’s objective was to measure 12-month impacts of the Transition WORKS, one of six project sites of the larger Social Security Administration (SSA)–sponsored Youth Transition Demonstration (YTD) projects that used a randomized evaluation.  Transition WORKS provided services to help youth with severe disabilities improve their education and employment outcomes and become more economically self-sufficient. Data were collected from a baseline survey and 12-month follow-up survey, the Ticket Research File (TRF), and Master Earnings File (MEF). The authors estimated program impacts on measures of paid employment, educational attainment, and Social Security disability benefit receipt.  The study found that Transition WORKS did not achieve any statistically significant impacts on paid employment, educational attainment, or Social Security disability benefit during the 12-month follow-up period. The quality of causal evidence presented in this report is high because it is based on a well-conducted randomized controlled trial. This means we are confident that the effects estimated in the study would be attributable solely to Transition WORKS, and not to other factors.","the Youth Transition Demonstration Projects, Transition WORKS","Disability insurance Supplemental security income (SSI) Youth programs","Youth, Disability",,"United States",2011,http://www.ssa.gov/disabilityresearch/documents/Erie%20Final%20Interim%20Report…,"Disability Employment Policy Review Protocol" "Serving community college students on probation: Four-year findings from Chaffey College’s Opening Doors Program","Weiss, M., Brock, T., Sommo, C., Rudd, T., & Turner, M.C. (2011). Serving community college students on probation: Four-year findings from Chaffey College’s Opening Doors Program. New York: MDRC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the two-semester Enhanced Opening Doors program at Chaffey Community College near Los Angeles, California. Students in the Enhanced Opening Doors program took a college success course that covered personal goals, study skills, and college rules; students also had to attend a student success center for tutoring sessions. The study was a randomized controlled trial. Eligible students were randomly assigned to either the treatment group, which was required to participate in the Enhanced Opening Doors program, or the control group, which was not required to participate in the program. The primary data sources were a baseline survey on the background characteristics of students, students’ transcripts, and degree-attainment information from the National Student Clearinghouse. The study reported outcomes for the four years following random assignment. The study found that in any of the follow-up years and cumulatively from the first through fourth follow-up years, the program did not have a significant impact on the number of semesters enrolled in college, the number of cumulative credits earned, enrollment in a four-year college, or earning a degree or certificate. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects would be attributable to the Enhanced Opening Doors program, and not to other factors.","the Enhanced Opening Doors Program at Chaffey Community College","Community college education and other classroom training","Adult, Other barriers",,"United States",2011,http://www.mdrc.org/sites/default/files/full_506.pdf,"Community College Review Protocol" "The Social Security Administration’s Youth Transition Demonstration Projects: Interim report on the City University of New York’s Project","Fraker, T., Black, A., Broadus, J., Mamun, A., Manno, M., Martinez, J., McRoberts, R., Rangarajan, A., & Reed, D. (2011). The Social Security Administration’s Youth Transition Demonstration Projects: Interim report on the City University of New York’s Project. Report submitted to the Social Security Administration. Washington, DC: Mathematica Policy Research.","Disability Employment Policy","Study Type: Implementation Analysis",,,"Summary: This report presents an interim implementation and impact analysis on the City University of New York (CUNY) Youth Transition Demonstration Project (YTDP). The program sought to maximize economic self-sufficiency and independence for youth disability insurance beneficiaries by improving their employment and educational opportunities. The program targeted youth ages 14 through 18 who received Supplemental Security Income (SSI) and resided in Bronx County. The study examined implementation of YTDP at two CUNY campuses, focusing on major aspects of service delivery, including the background, local context, and service environment of YTDP. It also provided information on beneficiaries’ characteristics and satisfaction with the program. The study used qualitative analysis of staff and beneficiary interviews, including data collected from site visits; and descriptive quantitative analysis of beneficiaries’ baseline and follow-up survey data and service utilization data from a management information system. The study found that youth beneficiaries had access to all of the services in the conceptual framework. Many began receiving individualized services before participating in structured workshops. However, education-related and person-centered services were among the less-intensive service offerings. Study findings related to implementation challenges and solutions are potentially applicable to other current or future projects that provide employment-related services to youth with disabilities.","the Youth Transition Demonstration Projects, The City University of New York","Supplemental security income (SSI) Youth programs Vocational rehabilitation","Youth, Disability",,"United States",2011,http://www.mdrc.org/sites/default/files/full_579.pdf,"Disability Employment Policy Review Protocol" "Supporting work effort of SSDI beneficiaries: Implementation of Benefit Offset Pilot Demonstration.","Chambless, C., Julnes, G., McCormick, S., & Reither, A. (2011). Supporting work effort of SSDI beneficiaries: Implementation of Benefit Offset Pilot Demonstration. Journal of Disability Policy Studies, 22(3), 179-188.","Disability Employment Policy","Study Type: Implementation Analysis",,,"Summary: This report presented an implementation and impact analysis of the Utah Benefits Offset Pilot Demonstration Project (BOPD). The study examined pilot procedures and potential challenges for national implementation of the Benefit Offset National Demonstration (BOND), which intended to reduce barriers confronting SSDI recipients wishing to increase their earnings by offering a benefit offset. The study focused on how to effectively implement and administer the benefit offset and whether work incentives counseling and other employment supports would encourage beneficiaries to take advantage of the offset program. The authors used administrative data about recruitment and service use, focus groups, and surveys. The study found that recruitment for the demonstration was challenging because of perceived threats to benefits status from participating. Effective communication through multiple modes was crucial to successful recruitment. In addition, staff found the start and end dates of benefits changes difficult to communicate to participants, and so developed tools, including time lines, to do so. Due to limitations in the study’s discussions of its research methods, it is unclear whether findings are potentially applicable to other projects for SSDI beneficiaries.","the Utah Benefits Offset Pilot Demonstration Project","Disability insurance Vocational rehabilitation",Disability,,"United States",2011,,"Disability Employment Policy Review Protocol" "Working toward Wellness: Telephone care management for Medicaid recipients with depression, thirty-six months after random assignment","Kim, S., LeBlanc, A., Morris, P., Simon, G., & Walter, J. (2011). Working toward Wellness: Telephone care management for Medicaid recipients with depression, thirty-six months after random assignment. OPRE report 2011-21. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.  ","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine the impacts of a telephone care management program, Working toward Wellness (WtW), on low-income depressed parents’ employment and earnings. The study used a randomized controlled trial design, assigning eligible parents to either the WtW program or existing services. The authors used data from a 36-month follow-up survey to estimate program impacts, adjusting for sample members’ characteristics before random assignment. The study did not find any statistically significant effects of the WtW program on employment or earnings. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects would be attributable to WtW and not to other factors. However, the study did not find statistically significant effects.","Working toward Wellness (WtW)","Health Behavioral Interventions","Other barriers",,"United States",2011,http://www.acf.hhs.gov/sites/default/files/opre/medicaid_depression.pdf,"Employment and Training Review Protocol" "Longitudinal Statistics on Work Activity and Use of Employment Supports for New Social Security Disability Insurance Beneficiaries","Liu, Su, & Stapleton, David C. (2011). Longitudinal Statistics on Work Activity and Use of Employment Supports for New Social Security Disability Insurance Beneficiaries. Social Security Bulletin, 71(3).","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: This study used administrative data files constructed for the Ticket to Work (TTW) evaluation. These files contained extensive information on the more than 20 million Disability Insurance or Supplemental Security Income recipients who received a benefit in at least one month from January 1996 through December 2007. They included data on benefits, earnings, and enrollment in vocational rehabilitation services for 100 percent of the Disability Insurance population, with a few exceptions, over this time period. For the first (1996) cohort, the study documented the different pathways that led recipients to benefit termination. It presented longitudinal statistics on employment, earnings, and use of work incentives, and showed variation in work incentive statistics by state. It then compared selected statistics for more recent cohorts, and considered policy implications of all findings, including implications for TTW and other employment initiatives. These longitudinal statistics painted a somewhat more optimistic picture of the efforts of recipients to find work compared with the Social Security Administration’s then-published cross-sectional statistics. The authors also concluded that changing the Disability Insurance program to help recipients increase earnings might not produce program savings even if the changes increased exits from Disability Insurance, because the program might have provided additional support to those who would exit anyway.",,"Disability insurance Supplemental security income (SSI) Supported employment or other employment supports",Disability,,"United States",2011,,"Disability Employment Policy Review Protocol" "Person-centered planning in a transition program for Bronx youth with disabilities","Croke, Erin E., & Thompson, Ashleigh B. (2011). Person-centered planning in a transition program for Bronx youth with disabilities. Children and Youth Services Review. DOI:10.1016/j.childyouth.2010.11.025.","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: This report used qualitative and quantitative methods to explore findings of a 2003–2010 Youth Transition Demonstration (YTD) project. YTD offered a series of interventions, including Social Security Administration benefits counseling, education and employment assistance, and person-centered planning (PCP) to transition-age youth with disabilities. The study found that the PCP component was linked to improved educational and employment outcomes for youth. The study also found that although 65 percent of youth enrolled in the project participated in at least one PCP session, youth from lower-income families were less likely to participate in PCP, as were youth with mood disorders. Youth focused on relationships, personal strengths, and goals during these sessions, which proved an important part of their transition process. The study also described the intervention and made recommendations for the future use of PCP.",,"Disability insurance Supplemental security income (SSI) Youth programs","Youth, Disability",,"United States",2011,,"Disability Employment Policy Review Protocol" "A pilot study connecting youth with emotional or behavioral difficulties to summer work experiences.","Carter, E.W., Trainor, A.A., Ditchman, N., & Owens, L. (2011). A pilot study connecting youth with emotional or behavioral difficulties to summer work experiences. Career Development for Exceptional Individuals, 34(2), 95-106. doi:10.1177/0885728810395745","Job Search Assistance, Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of providing summer employment support on the employment of youth with emotional and behavioral difficulties. The authors used a randomized controlled trial to assign eligible youth with emotional and behavioral difficulties (63 in total) to either the treatment group, which received additional support finding and retaining summer employment, or the control group, which did not receive any additional support. The authors used data from telephone interviews with youth or parents to measure outcomes. The study found that, compared with youth randomly assigned to the control group, youth offered support finding and retaining summer employment were 27 percentage points more likely to be employed at the end of the summer. The quality of causal evidence presented in this report is low because attrition was high and the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to summer employment support; other factors are likely to have contributed.","a Package of Employment Services for Youth","Job search assistance and supportive services Other employment and reemployment","Youth, Other barriers",,"United States",2011,,"Job Search Assistance, Opportunities for Youth Review Protocol" "Who wants to have a career in science or math? Exploring adolescents’ future aspirations by gender and race/ethnicity","Riegle-Crumb, C., Moore, C., & Ramos-Wada, A. (2011). Who wants to have a career in science or math? Exploring adolescents’ future aspirations by gender and race/ethnicity. Science Education, 95(3), 458-476.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study's objective was to examine whether different gender and racial/ethnic subgroups of 8th-grade students in the United States varied in their aspirations of pursuing a career in science or math. The study further sought to observe how students’ attitudes toward and achievement in science and math helped explain any disparities in career aspirations by gender and race/ethnicity. The authors conducted a regression analysis that estimated the likelihood of different gender and race/ethnicity subgroups stating that they “would like a job that involves using science/math,” controlling for their attitudes toward and achievement in science/math. Career aspirations for groups traditionally underrepresented in science, technology, engineering, and mathematics—including white, black, and Hispanic girls and black and Hispanic boys—were compared to those of white boys. The study used data from the 2003 Trends in International Mathematics and Science Study, specifically looking at a nationally representative sample of 8th-grade students in the United States. In the primary analysis of science aspirations, no female and/or racial minorities had a statistically different likelihood of aspiring to a career in science than white boys. Black boys had comparable career aspirations to white boys even before controlling for any other factors, and Hispanic and white boys were similar after controlling for socioeconomic factors. Both white and Hispanic girls had similar career aspirations to white boys after controlling for enjoyment of science. In the primary analysis of math aspirations, all female subgroups were significantly less likely to aspire to a math career than white boys, even after controlling for general school attitudes, test scores, enjoyment in the subject, and belief in their own math ability. Black and Hispanic boys were as likely as white boys to be interested in pursuing a career in math before controlling for any of those factors.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs Other disparities or discrimination in employment and earnings","Youth, Other barriers, Female, Male",,"United States",2011,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "The Social Security Administration’s Youth Transition Demonstration Projects: Interim report on the City University of New York’s project","Fraker, T., Black, A., Broadus, J., Mamun, A., Manno, M., Martinez, J., McRoberts, R., Rangarajan, A., & Reed, D. (2011). The Social Security Administration’s Youth Transition Demonstration Projects: Interim report on the City University of New York’s project. Princeton, NJ: Mathematica Policy Research.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Mod/high-No impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: This study’s objective was to measure 12-month impacts of the City University of New York (CUNY) Youth Transition Demonstration Project (YTDP) in the Bronx, one of six project sites of the larger Social Security Administration (SSA)-sponsored YTD projects that used a randomized evaluation.  CUNY YTDP provided services to help youth with severe disabilities improve their employment outcomes and become more economically self-sufficient. Data were collected from a baseline survey and 12-month follow-up survey, the Ticket Research File (TRF), and the Master Earnings File (MEF). The authors estimated program impacts on measures of paid employment, educational attainment, and Social Security disability benefit receipt. The study found that CUNY YTDP had positive and statistically significant impacts on employment during the 12-month follow-up period. The study found no statistically significant impacts on earnings, educational attainment, total income, or Social Security disability benefit receipt. The quality of causal evidence presented in this report is high because it is based on a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to CUNY YTDP, and not to other factors.","the Youth Transition Demonstration Projects, The City University of New York","Disability insurance Supplemental security income (SSI) Youth programs","Youth, Disability",,"United States",2011,http://www.ssa.gov/disabilityresearch/documents/CUNY%20Final%20Interim%20Report…,"Disability Employment Policy Review Protocol" "Labor market rigidities and the employment behavior of older workers.","Blau, D., & Shvydko, T. (2011). Labor market rigidities and the employment behavior of older workers. Industrial and Labor Relations Review, 64(3), 464-484.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of flexibility in hours of work on the likelihood that older workers separate from an employer. The study used a statistical model to compare the job exit behavior of older and younger workers in firms with different shares of women younger than age 30. The analysis used monthly data on workers ages 45 to 69 in the Survey of Income and Program Participation from 1990 to 2001 matched to employers in the Longitudinal Employment and Household Dynamics data. The study found that workers in their sixties who work for employers with a higher share of women younger than age 30 are less likely to experience job separations compared with workers in their late 40s to mid-50s. The quality of causal evidence presented in this report is low because the groups being compared might not be similar before leaving their employer. This means we are not confident that the estimated effects are attributable to employment flexibility, other factors are likely to have contributed.","Employment flexibility","Other employer services","Adult, Older worker",,"United States",2011,https://www.jstor.org/stable/41149475?seq=1#page_scan_tab_contents,"Employment and Training Review Protocol" "The Impact of Changing Financial Work Incentives on the Earnings of Social Security Disability Insurance (SSDI) Beneficiaries","Weathers, R., & Hemmeter, J. (2011). The impact of changing financial work incentives on the earnings of Social Security Disability Insurance (SSDI) beneficiaries. Journal of Policy Analysis and Management, 30(4), 708-728.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-Unfavorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Benefit Offset Pilot Demonstration (BOPD), which provided a more-generous work incentive for Social Security Disability Insurance (SSDI) recipients, on recipients’ employment status, earnings, and reliance on benefits.  The analysis used data from the Master Earnings File (MEF) and Master Beneficiary Record (MBR). The authors reported unadjusted and regression-adjusted program impacts. The study found that the BOPD had no earnings impacts but increased the probability of earning above the annualized SGA amount one and two years after baseline. The intervention also increased the average SSDI benefit payment to participants. The quality of the evidence presented in this study is high because it is based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the BOPD, and not to other factors.","the Benefit Offset Pilot Demonstration","Disability insurance Other wages and benefits Supplemental security income (SSI)",Disability,,"United States",2011,,"Disability Employment Policy Review Protocol" "Influencing the disability trajectory for workers with serious mental illness: Lessons from Minnesota’s Demonstration to Maintain Independence and Employment","Linkins, K. W., Brya, J. J., Oelschlaeger, A., Simonson, B., Lahiri, S., McFeeters, J., Schutze, M., Jonas, J., & Mowry, M. A. (2011). Influencing the disability trajectory for workers with serious mental illness: Lessons from Minnesota’s Demonstration to Maintain Independence and Employment. Journal of Vocational Rehabilitation, 34(2), 107-118.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-No impacts Employment Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The report’s objective was to examine the impacts of the Demonstration to Maintain Independence and Employment (DMIE) in the Minnesota site. The DMIE was designed to prevent or delay people with disabilities from leaving the workforce and applying for Social Security Disability Insurance (SSDI) and Supplemental Security Income (SSI) benefits. The study was a randomized controlled trial examining DMIE’s impacts on earnings, benefits applications, and activities of daily living (ADLs). Data sources included participant surveys and health care and employment service utilization information. Impacts were evaluated 12 months after sample members’ enrollment. The study found that program participants did not work more hours per month or earn more over the follow-up period than control group members, but were less likely to apply for SSDI or SSI benefits. The program also decreased the number of ADL limitations. The quality of causal evidence provided in this study is low. This means that we cannot be confident that the estimated effects are attributable to Minnesota’s DMIE; other factors are likely to have contributed.","Demonstration to Maintain Independence and Employment (DMIE) in Minnesota","Health Disability insurance Supplemental security income (SSI) Vocational rehabilitation",Disability,,"United States",2011,,"Disability Employment Policy Review Protocol" "Mental Health Treatment Study: Final Report","Frey, W., Drake, R., Bond, G., Miller, A., Goldman, H., Salkever, D., & Holsenbeck, S. (2011). Mental Health Treatment Study: Final Report. Baltimore, MD: Westat.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Health and safety-Low-Favorable impacts Health and safety Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Mental Health Treatment Study (MHTS), which provided supported employment services to Social Security Disability Insurance (SSDI) recipients with psychiatric disabilities. The study was a randomized controlled trial with 2,238 participants. The analysis used data from nine surveys administered over the two-year intervention period. The study found that MHTS had positive impacts on earnings measured 12 and 24 months after random assignment and on health outcomes 24 months after random assignment. There were no statistically significant impacts on disability benefits receipt. The quality of the evidence presented in this study is moderate for earnings and SSDI benefit receipt outcomes. This means we are somewhat confident that the estimated effects are attributable to the MHTS, but other factors might also have contributed. For the health outcomes, the quality of evidence presented in this study is low. This means we are not confident that the estimated effects are attributable to MHTS; other factors are likely to have contributed.","the Mental Health Treatment Study (MHTS)","Health Disability insurance Job search assistance and supportive services Vocational rehabilitation",Disability,,"United States",2011,http://socialsecurity.gov/disabilityresearch/documents/MHTS_Final_Report_508.pdf,"Disability Employment Policy Review Protocol" "Working Well—the Texas Demonstration to Maintain Independence and Employment: 18-month outcomes","Bohman, T.M., Wallisch, L., Christensen, K., Stoner, D., Pittman, A., Reed, B., & Ostermeyer, B. (2011). Working Well—the Texas Demonstration to Maintain Independence and Employment: 18-month outcomes. Journal of Vocational Rehabilitation, 34, 97–106.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The report’s objective was to examine the impacts of the Demonstration to Maintain Independence and Employment (DMIE) in the Texas site. The DMIE was designed to prevent or delay people with disabilities from leaving the workforce and applying for Social Security Disability Insurance (SSDI) and Supplemental Security Income (SSI) benefits. The study was a randomized controlled trial examining DMIE’s impacts on employment, earnings, Social Security disability benefit receipt, and health status and access. Impacts were evaluated 18 months after sample members’ enrollment. The study found no statistically significant impacts on employment or earnings. However, there was evidence of modest reductions in SSDI and SSI receipt among treatment group members, as well as improvements in health care access, utilization, and satisfaction with health care. The quality of the causal evidence presented in this report is high because it was a well-implemented randomized controlled trial. This means we can be confident that the estimated impacts are attributable to Texas’s DMIE, and not other factors.","Demonstration to Maintain Independence and Employment (DMIE) in Texas","Health Disability insurance Supplemental security income (SSI) Vocational rehabilitation",Disability,,"United States",2011,,"Disability Employment Policy Review Protocol" "The Accelerated Benefits Demonstration and Evaluation project: Impacts on health and employment at twelve months","Michalopoulos, C., Wittenburg, D., Israel, D., Schore, J., Warren, A., Zutshi, A., Freedman, S., & Schwartz, L. (2011). The Accelerated Benefits Demonstration and Evaluation project: Impacts on health and employment at twelve months, volume 1. New York: MDRC.","Disability Employment Policy","Study Type: Implementation Analysis",,,"Summary: This report presented an interim implementation and impact analysis on the Accelerated Benefits Demonstration (ABD), an effort to provide immediate health insurance and employment and benefits counseling to new, uninsured Social Security Disability Insurance (SSDI) recipients during the 24-month Medicare eligibility waiting period. This profile focused on the implementation analysis. The study examined implementation of ABD in 53 qualifying U.S. metropolitan areas, focusing on service delivery and use, and challenges and solutions to implementation. The authors conducted qualitative analysis of interviews with program staff, discussions from regular team meetings, and a document review, along with quantitative analysis of health plan claims and service use data from the AB Plus management information system. Overall, the study found that almost all program group members used the AB health plan. Most members of the AB Plus group, which had access to additional programming, completed intake and a substantial proportion used services. Under the AB Plus plan, the behavioral motivational coaching and employment and benefits counseling were largely implemented as designed, but the intake process and medical case management were refined over time. Because of limitations in the study’s discussion of its research methods, it is unclear whether findings are potentially applicable to other projects that provide employment-related services to people with disabilities.","Accelerated Benefits Demonstration","Disability insurance Health insurance",Disability,,"United States",2011,,"Disability Employment Policy Review Protocol" "Employment of Individuals in the Social Security Disability Programs","O’Leary, Paul, Livermore, Gina A., & Stapleton, David C. (2011). Employment of Individuals in the Social Security Disability Programs. Social Security Bulletin, 71(3).","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: This article introduced an issue of the Social Security Bulletin that featured articles drawn from the 2010 Ticket to Work (TTW) evaluation report and provided more expansive information than that report. As background, this article described both work incentive programs offered to Social Security disability recipients. It used longitudinal and cross-sectional data to provide Supplemental Security Income and Social Security Disability Income program statistics. It described the variation in employment outcomes across states and over time, the occurrence and duration of employment of disability recipients, and factors affecting recipients’ ability to sustain high earnings.",,"Disability insurance Supplemental security income (SSI) Supported employment or other employment supports",Disability,,"United States",2011,http://www.ssa.gov/policy/docs/ssb/v71n3/v71n3p1.html,"Disability Employment Policy Review Protocol" "Stemming inequality? Employment and pay of female and minority scientists and engineers in the federal and private sectors","Oh, S., & Lewis, G. (2011). Stemming inequality? Employment and pay of female and minority scientists and engineers in the federal and private sectors. Social Science Journal, 48(2), 397-403.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study investigated the relationships among sector (federal or private); science, technology, engineering, and mathematics (STEM) occupation; gender or racial minority status; and earnings to determine whether federal- or private-sector STEM positions offer the greatest financial opportunities for female and racial minority STEM professionals. The authors compared the earnings of male and female STEM and non-STEM public sector employees in 1983 and 2003 using a 1 percent sample of the Office of Personnel Management’s Central Personnel Data File. To compare public- and private-sector outcomes, the authors also analyzed a 5 percent sample of the 2000 U.S. Census, examining differences in STEM and non-STEM public and private employees’ salaries by gender and race. The study found that women in public sector STEM positions earned 7.2 percent less than men in comparable public sector positions in 1983 even after controlling for education, STEM field, tenure, age, and race. This gender pay gap disappeared in the 2003 sample. Race and gender pay disparities, measured as the average difference in pay between racial minorities or women and white men, are smaller in the federal than the private sector and for STEM relative to non-STEM occupations. For example, in 1999, black male federal STEM employees earned 8.3 percent less than white men, compared to a pay gap of 10.9 percent for black male private sector STEM employees. For black men in non-STEM occupations, the pay gap relative to white men was 11.1 percent in the public sector and 20.6 percent in the private sector.",,"Science, Technology, Engineering, and Math (STEM) programs Other disparities or discrimination in employment and earnings","Other barriers, Female, STEM professional","Professional, scientific, and technical services","United States",2011,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Mental Health Treatment Study: Final report. Report submitted to the Social Security Administration.","Frey, W., Drake, R., Bond, G., Miller, A., Goldman, H., Salkever, D., & Holsenbeck, S. (2011) Mental Health Treatment Study: Final report. Report submitted to the Social Security Administration. Rockville, MD: Westat.","Disability Employment Policy","Study Type: Implementation Analysis",,,"Summary: The study’s objective was to examine the implementation and impact of the Mental Health Treatment Study, which provided individual placement and support (IPS, an evidence-based model of supported employment services) and systematic medication management to Social Security Disability Insurance (SSDI) recipients with psychiatric disabilities. This profile focuses on the implementation study; see CLEAR’s profile of the impact study here. The implementation study focused on fidelity to the program model, consistency in service delivery, where services occurred, and the relationship between fidelity and employment rates. The authors collected data from regular telephone calls with program staff, site visits, participants’ medical records, follow-up interviews, and service use data. To measure fidelity, the study used a 15-point IPS fidelity scale; each scale item reflected a specific element in the IPS practice. Overall, the study found that 77 percent of sites achieved high fidelity in the first year of implementation and 86 percent of sites achieved high fidelity in the second and third years. More than 90 percent of participants engaged in some type of supported employment service in the first reporting period and almost 90 percent did so in the second reporting period. Study findings related to implementation challenges and solutions are potentially applicable to other current or future projects that provide employment-related services to people with psychiatric disabilities.","the Mental Health Treatment Study (MHTS)","Disability insurance Health",Disability,,"United States",2011,http://www.ssa.gov/disabilityresearch/documents/MHTS_Final_Report_508.pdf,"Disability Employment Policy Review Protocol" "Employment Among Social Security Disability Program Beneficiaries, 1996–2007","Mamun, Arif, O’Leary, Paul, Wittenburg, David C., & Gregory, Jesse. (2011). Employment Among Social Security Disability Program Beneficiaries, 1996–2007. Social Security Bulletin, 71(3).","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: This article described the variation in employment rates of Social Security Disability Insurance (DI) and Supplemental Security Income recipients over time and across states using a consistent measure of earnings from administrative data. It also examined the extent to which observable demographic and disability characteristics of recipients could explain the variation in employment rates. One purpose of the analysis was to assess then-current policies and provide benchmarks for ongoing demonstration projects and future return-to-work initiatives. The study characterized more than 10 million working-age adult disability recipients. Authors found that the overall employment rate—defined for the study as annual earnings over $1,000—was 12 percent in 2007. Substantial variation existed within the population. DI recipients and those younger than 40 were much more likely to work relative to other Social Security recipients. Additionally, substantial regional variation existed across states; employment rates ranged from 7 percent (West Virginia) to 23 percent (North Dakota). The analysis also found that the employment rates among recipients were sensitive to the business cycle and persistent over time.",,"Disability insurance Supplemental security income (SSI)",Disability,,"United States",2011,http://www.ssa.gov/policy/docs/ssb/v71n3/v71n3p11.html,"Disability Employment Policy Review Protocol" "The Social Security Administration’s Youth Transition Demonstration projects: Interim report on Colorado Youth WINS","Fraker, T., Baird, P., Black, A., Mamun, A., Manno, M., Martinez, J., Rangarajan, A., & Reed, D. (2011). The Social Security Administration’s Youth Transition Demonstration projects: Interim report on Colorado Youth WINS. Princeton, NJ: Mathematica Policy Research.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-No impacts Education and skills gains Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: This study’s objective was to measure 12-month impacts of the Colorado Youth Work Incentive Network of Supports (WINS) project, sponsored by the Social Security Administration (SSA), one of six project sites of the larger Youth Transition Demonstration (YTD) projects that used a randomized evaluation. Youth WINS provided services to help youth with disabilities improve their education and employment outcomes and become more economically self-sufficient and less reliant on disability benefits. Data were collected from a baseline survey and 12-month follow-up survey, the Ticket Research File (TRF), and the Master Earnings File (MEF). The authors estimated program impacts on measures of paid employment, educational attainment, and Social Security disability benefit receipt. The study found that Youth WINS did not achieve any statistically significant impacts on the outcomes examined during the 12-month follow-up period. The quality of causal evidence in this study is high because it was a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to Colorado Youth WINS and not to other factors.","the Youth Transition Demonstration Projects, Colorado Youth WINS Program","Disability insurance Supplemental security income (SSI) Youth programs","Youth, Disability",,"United States",2011,https://www.socialsecurity.gov/disabilityresearch/documents/CO%20Final%20Interi…,"Disability Employment Policy Review Protocol" "Pipelines and pathways: Women of color in undergraduate STEM majors and the college experiences that contribute to persistence","Espinosa, L. (2011). Pipelines and pathways: Women of color in undergraduate STEM majors and the college experiences that contribute to persistence. Harvard Educational Review, 81(2), 209-240.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study's objective was to examine how undergraduate women of color’s precollege characteristics and college experiences and the characteristics of their undergraduate institutions affected their persistence in STEM majors throughout college compared with white women. The author used data from the Higher Education Research Institute Cooperative Institutional Research Program at the University of California, Los Angeles, to model whether college experiences mediated some of the effect of precollege characteristics and institutional settings on persistence in STEM majors, as hypothesized. Survey data were collected when students entered college in 2004 and again in the spring of 2008, during students’ fourth year of college. The study included a sample of 1,250 women of color and 891 white women at four-year colleges and universities across the United States who were first-time, full-time students. Results were estimated separately for women of color and white women. The study found that both white women and women of color persisted in STEM at a rate of 57 percent from the time they stated an intent to major in STEM at college entrance to the spring semester of their fourth year, and that high school grade point average was a significant predictor of persistence for both groups. As hypothesized, college experiences had a significant effect on the persistence of women of color in STEM: those who found satisfaction with their curriculum, engaged in peer discussion on course content outside the classroom, joined a major-related club, tutored another student, participated in research programs, and intended to major in engineering were more likely to persist in a STEM major; the same factors were significant for white women, with the exception of joining a major-related club. In addition, women of color who attended a private college and an institution with a higher percentage of students majoring in STEM were more likely to stay in a STEM major; the opposite was true for women of color who attended a highly selective institution. For white women, these institutional factors were not significant predictors of persistence in STEM.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Other barriers, Female",,"United States",2011,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Longitudinal Outcomes of an Early Cohort of Ticket to Work Participants","Livermore, Gina A., & Roche, Allison. (2011). Longitudinal Outcomes of an Early Cohort of Ticket to Work Participants. Social Security Bulletin, 71(3).","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: This study followed a cohort of working-age Supplemental Security Income and Social Security Disability Insurance recipients participating in the Ticket to Work (TTW) program for several years to assess their service use, health status, employment, and income. The study used a longitudinal sample of 767 TTW participants who were followed in each of the 2004, 2005, and 2006 rounds of the National Beneficiary Survey, conducted as part of the TTW evaluation. The sample was representative of TTW participants who were enrolled in the program at some point from January to June 2003 and resided in the 13 states where TTW was first implemented in 2002. The findings showed that about 20 percent of TTW participants achieved employment at levels that would significantly reduce their disability benefits. Another 40 percent achieved some employment success, but the remaining 40 percent reported no earnings during 2003–2005. Many participants experienced significant changes in their health status across survey rounds, which might have affected their ability to actively participate in TTW and to become employed. Many also experienced significant employment and income instability. The findings suggested that employment among TTW participants was associated with reduced poverty.",,"Health Disability insurance Supplemental security income (SSI) Supported employment or other employment supports",Disability,,"United States",2011,http://www.ssa.gov/policy/docs/ssb/v71n3/v71n3p105.html,"Disability Employment Policy Review Protocol" "Impact of early intervention programs for working adults with potentially disabling conditions: evidence from the national DMIE evaluation","Gimm, G., Ireys, H., Gillman, B., & Croake, S. (2011). Impact of early intervention programs for working adults with potentially disabling conditions: evidence from the national DMIE evaluation. Journal of Vocational Rehabilitation, 34, 71–81.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-No impacts Employment Earnings and wages-Mod/high-No impacts Earnings and wages Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: This study’s objective was to examine short-term (that is, 6- to 12-month) impacts of the Demonstration to Maintain Independence and Employment (DMIE). DMIE was implemented in Hawaii, Kansas, Minnesota, and Texas with the aim of preventing or delaying people with disabilities from leaving the workforce and applying for Social Security Disability Insurance (SSDI) and Supplemental Security Income (SSI) benefits. The study was a randomized controlled trial examining DMIE’s impact on employment, hours worked, and benefits applications. Study data sources included the Ticket Research File (TRF), 831 File, and Uniform Data Set (UDS). Because DMIE recruitment methods, participant populations, and services offered varied substantially across states, the authors reported impacts separately for each state and for Minnesota and Texas pooled together. With few exceptions, DMIE did not achieve statistically significant impacts on employment, hours worked, or disability benefit applications. The quality of causal evidence is high for most outcomes, which means that we are confident that the estimated impacts are attributable solely to the DMIE. However, for some outcomes including employment in Kansas and Hawaii, the quality of the causal evidence is moderate, which means that we have confidence that the estimated effects are attributable at least in part to the DMIE, though other factors might also have contributed.","Demonstration to Maintain Independence and Employment (DMIE)","Health Disability insurance Supplemental security income (SSI) Vocational rehabilitation",Disability,,"United States",2011,,"Disability Employment Policy Review Protocol" "Employment and Earnings Growth Among Transition-Age Supplemental Security Income Program Participants","Berry, Hugh G., & Caplan, Leslie J. (2010). Employment and Earnings Growth Among Transition-Age Supplemental Security Income Program Participants. Journal of Disability Policy Studies, 21(152). Originally published online October 7, 2010.","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: The purpose of this study was to examine individual demographic, disability, and vocational rehabilitation (VR) service factors related to (1) employment status and (2) earnings growth for Supplemental Security Income (SSI) recipients who have participated in the VR program.  The VR program offered eligible people with disabilities services such as assessment, counseling and guidance, restoration, training, job development, and job placement to prepare for and obtain employment. The study merged administrative data from the Ticket Research File maintained by the Social Security Administration with data from the Case Service Report (RSA-911) database maintained by the U.S. Department of Education. Findings showed that SSI participants with mental retardation exhibited the highest odds of employment among other disability groups two years after exiting the VR program. College or university training and job placement services decreased the odds of employment, whereas supported employment demonstrated increased odds. For SSI participants with sustained employment, African American VR consumers showed higher earnings compared with other race groups. Among selected VR services, only college or university training was positively associated with earnings growth over time.","the Vocational Rehabilitation (VOC) Programs","Disability insurance Supplemental security income (SSI) Vocational rehabilitation",Disability,,"United States",2010,,"Disability Employment Policy Review Protocol" "Anne Arundel County juvenile treatment court outcome and cost evaluation","Mackin, J., Lucas, L., Waller, M., Carey, S., & Finigan, M. (2010). Anne Arundel County juvenile treatment court outcome and cost evaluation. Portland OR: NPC Research.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence",,"Summary: The study’s objective was to examine the impact of a juvenile treatment court in Anne Arundel County, Maryland, on recidivism. The authors used a nonexperimental design, matching youth who participated in the juvenile treatment court with similar court-involved youth who did not participate in the juvenile treatment court. The authors used administrative data to compare the mean number of juvenile rearrests for the study groups over a two-year follow-up period. The study found that 53 percent of the treatment court group, compared with 73 percent of the comparison group, had a juvenile rearrest within 24 months. The study also found differences of a similar magnitude at three intermediate follow-ups (6-, 12-, and 18-month follow-ups). The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the juvenile treatment court, but other factors might also have contributed.","Anne Arundel Juvenile Treatment Court","Other training and education Substance abuse recovery Youth programs Behavioral Interventions","Youth, Justice-involved, Disconnected youth",,"United States",2010,http://www.courts.state.md.us/opsc/dtc/pdfs/evaluationsreports/annearundelcount…,"Opportunities for Youth Review Protocol" "Work after prison: One-year findings from the Transitional Jobs Reentry Demonstration","Redcross, C., Bloom, D., Jacobs, E., Manno, M., Muller-Ravett, S., Seefeldt, D., Yahner, J., Young Jr., A., & Zweig, J. (2010). Work after prison: One-year findings from the Transitional Jobs Reentry Demonstration. New York: MDRC.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Transitional Jobs Reentry Demonstration (TJRD) on ex-offenders’ employment and wages. The study used a randomized controlled trial to assign former prisoners to either the transitional jobs program or to a control group that was offered job search assistance. The authors compared the two groups’ employment and earnings outcomes one year after random assignment, controlling for participants’ characteristics before random assignment. The study found that members of the transitional jobs group were 8.6 percentage points more likely than control group members to be employed during all four quarters of the year after random assignment, but 8.9 percentage points less likely to have unsubsidized employment during the year after random assignment. Transitional jobs group members’ total earnings from all jobs were $1,419 higher, on average, than those of control group members during the year after random assignment, but their total earnings from unsubsidized jobs were $625 lower. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the TJRD, and not to other factors.","the Transitional Jobs Reentry Demonstration (TJRD)","Job search assistance and supportive services Other employment and reemployment Reentry","Justice-involved, Male, Low income",,"United States",2010,http://files.eric.ed.gov/fulltext/ED514698.pdf,"Employment and Training Review Protocol" "The effects of changes in state SSI supplements on preretirement labor supply","Neumark, D., & Powers, E. T. (2005). The effects of changes in state SSI supplements on preretirement labor supply. Public Finance Review, 33(1), 3-35.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study examined the impact of a theoretical increase in Supplemental Security Income (SSI) benefits on the preretirement employment outcomes for likely SSI participants ages 60 to 64. Using data from the annual Current Population Survey from 1979 to 2001 and state-level SSI receipt data, the authors used regression methods in a nonexperimental analysis of likely SSI participants to compare the outcomes of workers ages 62 to 64 with those of workers ages 60 to 61. The study found that an increase in monthly SSI benefits was associated with a statistically significant decrease in the employment rate and number of hours worked for likely SSI recipients ages 62 to 64 compared with those ages 60 to 61. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to changes in SSI benefits; other factors are likely to have contributed.","Supplemental Security Income (SSI) benefits","Older workers' programs Other employment and reemployment","Adult, Older worker",,"United States",2010,https://journals.sagepub.com/doi/pdf/10.1177/1091142104270655,"Employment and Training Review Protocol" "Evaluation of the Ridge House residential program: Final report.","Willison, J. B., Roman, C. G., Wolff, A., Correa, V., & Knight, C. R. (2010). Evaluation of the Ridge House residential program: Final report. Washington, DC: Urban Institute",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence",,"Summary: The study’s objective was to examine the impact of Ridge House, a faith-based halfway house program, on recidivism outcomes. The authors used a nonexperimental design (propensity-score matching) to create a comparison group of nonparticipants who were similar to program participants. The authors estimated the program’s effects by comparing these groups’ post-release recidivism outcomes using administrative data from the National Crime Information Center at the Federal Bureau of Investigation. The authors found that the odds of rearrest or reconviction were 75 percent higher for those who participated in the Ridge House program than those in the comparison group. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the Ridge House program, but other factors might also have contributed.","Ridge House program","Substance abuse recovery Other employment and reemployment Reentry",Justice-involved,,"United States",2010,https://www.ncjrs.gov/pdffiles1/nij/grants/230741.pdf,"Employment and Training Review Protocol" "Learning communities for students in developmental reading: An impact study at Hillsborough Community College","Weiss, M., Visher, M., & Wathington, M. (2010). Learning communities for students in developmental reading: An impact study at Hillsborough Community College. New York: MDRC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of learning communities on credits earned, persistence, and course completion among students in need of developmental reading courses at Hillsborough Community College. This study was a randomized controlled trial that used student transcript data to compare the outcomes of treatment and control groups in the program semester and two subsequent semesters. The study found that students assigned to the learning community treatment group were more likely to enroll in and complete a college success course in the program semester than those in the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Learning Communities Demonstration at Hillsborough Community College, and not to other factors.","the Learning Communities Demonstration","Basic skills Community college education and other classroom training","Adult, Other barriers",,"United States",2010,http://files.eric.ed.gov/fulltext/ED510961.pdf,"Community College Review Protocol" "Testing a SSDI Benefit Offset: Evaluations of the Wisconsin SSDI Employment Pilot","Delin, B., Hartman, E., Sell, C., & Brown-Reither, A. (2010). Testing a SSDI Benefit Offset: Evaluations of the Wisconsin SSDI Employment Pilot. Menomonie, WI: University of Wisconsin-Stout.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of Wisconsin’s Benefit Offset Pilot Demonstration (BOPD), which provided a more-generous work incentive for Social Security Disability Insurance (SSDI) recipients, on recipients’ employment status, earnings, and reliance on benefits. The study was a randomized controlled trial; eligible volunteers were randomly assigned to either a treatment group, which was eligible for the more-generous work incentive, or a control group that was not. Data sources included state and federal administrative data on Wisconsin SSDI recipients who were enrolled in BOPD. The study found no statistically significant differences between treatment and control group members on employment status, earnings, or reliance on benefits in the eight quarters of follow-up. The quality of the causal evidence presented in this study is high for results through the fifth quarter of follow-up, but moderate for subsequent periods because of high attrition in those periods. This means we would be confident that estimated impacts through the fifth quarter of follow-up were attributable to the BOPD and not other factors. However, the study found no such statistically significant impacts.","the Benefit Offset Pilot Demonstration","Disability insurance Other wages and benefits Supplemental security income (SSI)",Disability,,"United States",2010,http://www.ssa.gov/disabilityresearch/documents/WI%20SSDI-EP%20EVAL%20Final%207…,"Disability Employment Policy Review Protocol" "Does prison-based adult basic education improve postrelease outcomes for male prisoners in Florida?","Cho, R. M., & Tyler, J. H. (2010). Does prison-based adult basic education improve postrelease outcomes for male prisoners in Florida? Crime & Delinquency, 59(7), 975-1005. [Comparison 3: participation in adult basic education vs. involuntary dropout of adult basic education.]",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study examined the impact of prison-based adult basic education courses on post-release employment and earnings for incarcerated people who read below the 9th-grade level. The authors also investigated similar research questions for other contrasts, the profiles of which are available here. The authors used a statistical model to compare outcomes for treatment and comparison group members, drawing on data from the Florida Department of Corrections, The Florida Department of Law Enforcement, and the Florida Education and Training Placement Information Program. The study found statistically significant, positive relationships between participation in an adult basic education course and post-release employment and earnings. Those who participated in adult basic education tended to have higher employment rates and earnings than did those who involuntarily dropped out of adult basic education. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to adult basic education; other factors are likely to have contributed.","Adult basic education","Basic skills Reentry","Justice-involved, Male",,"United States",2010,https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4288462/,"Employment and Training Review Protocol" "Effect of job skills training on employment and job seeking behaviors in an American Indian substance abuse treatment sample.","Foley, K., Pallas, D., Forcehimes, A., Houck, J., Bogenschutz, M., Keyser-Marcus, L., & Svikis, D. (2010). Effect of job skills training on employment and job seeking behaviors in an American Indian substance abuse treatment sample. Journal of Vocational Rehabilitation, 33(2010), 181-192.","Job Search Assistance","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Unfavorable impacts Education and skills gains Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine the impact of workshops for job seekers on employment and training outcomes. The study used a randomized controlled trial (RCT) design, in which eligible participants were randomly assigned to the treatment group, which could participate in the job seeker workshops, or the control group, which could not participate. The authors used follow-up surveys three and six months after random assignment to measure self-reported employment and training outcomes. The study found that three months after workshop participation, the treatment group spent fewer hours on training activities than the control group; the study did not find any significant impacts of the job seekers’ workshop on the number of hours spent on work or percentage of each group who were employed at the three-month follow-up. The quality of causal evidence presented in this report is high for the percentage employed and hours spent on work and training outcomes collected at the three-month follow-up because those outcomes were based on a well-implemented RCT with low attrition. This means we are confident that the estimated effects are attributable to the job seekers’ workshop, and not to other factors. However, the quality of causal evidence presented in this report is low for the days to employment outcomes at the three-month follow-up and all outcomes at the six-month follow-up. This means we are not confident that the estimated effects are attributable to the job seekers’ workshop; other factors are likely to have contributed.","Job Seekers’ Workshop","Job search assistance and supportive services","Other barriers, Unemployed, American Indian or Alaska Native",,"United States",2010,,"Employment and Training Review Protocol" "Veterans Health Administration transitional work experience vs. job placement in veterans with co-morbid substance use and non-psychotic psychiatric disorders","Penk, W., Drebing, C.E., Rosenheck, R.A., Krebs, C., Van Ormer, A., & Mueller, L. (2010). Veterans Health Administration transitional work experience vs. job placement in veterans with co-morbid substance use and non-psychotic psychiatric disorders. Psychiatric Rehabilitation Journal, 33(4), 297-307.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study ’s objective was to examine the impact of a transitional work experience (TWE) program, within the Veterans Health Administration’s (VHA’s) Compensated Work Therapy (CWT) program, on outcomes related to employment and earnings for veterans with certain psychiatric diagnoses and substance use disorders. The study used a randomized controlled trial design and compared treatment and control groups on self-reported employment and earnings outcomes, which were collected 6 and 12 months after enrollment in the study. The study found that those who participated in TWE (the treatment group) worked more total hours and more weeks, and earned more income, over the 12-month period than the control group. The quality of causal evidence presented in this report is low for employment and earnings outcomes because the randomized controlled trial design was compromised and authors did not account for existing differences between the treatment and control groups. This means we are not confident that the estimated effects are attributable to the transitional work experience program; other factors are likely to have contributed.","the Compensated Work Therapy transitional work experience program","Other health and safety Substance abuse recovery Veterans' reemployment","Other barriers, Veteran or military",,"United States",2010,https://psycnet.apa.org/record/2010-08280-008,"Employment and Training Review Protocol" "Prisoner reentry experiences of adult females: Characteristics, Service Receipt, and Outcomes of Participants in the SVORI multi-site evaluation.","Lindquist, C. H., Lattimore, K. B., & Visher C. A. (2009) Prisoner reentry experiences of adult females: Characteristics, Service Receipt, and Outcomes of Participants in the SVORI multi-site evaluation. Research Triangle Park, NC: RTI International.",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Low-Favorable impacts Employment Public benefits receipt-Low-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of a violent prisoner reentry program, the Serious and Violent Offender Reentry Initiative (SVORI), on several outcomes of female prisoners reentering society, including employment, public benefit receipt, and recidivism. The authors used a matched comparison group design, using propensity-score weights, to analyze impacts of the SVORI program for females released from prison. The authors collected four waves of survey data to analyze impacts from before release up to 15 months after release. In addition, the authors obtained state administrative data describing recidivism at 24 months after release. The study found that people in the SVORI group were more likely to be employed after release than those in the comparison group, but it found no significant differences between the groups in public benefit receipt or recidivism outcomes. The quality of causal evidence presented in this report for the recidivism outcomes based on survey data is moderate because it was based on a well-implemented nonexperimental design. This means we are confident that any estimated effects would have been attributable to SVORI and not to other factors had the study found statistically significant effects. The quality of causal evidence presented in this report for the recidivism outcomes based on administrative data and for the employment and public benefit receipt outcomes is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects on employment are attributable to SVORI; other factors are likely to have contributed.","the Serious and Violent Offender Reentry Initiative (SVORI)",Reentry,"Justice-involved, Female",,"United States",2010,https://www.ncjrs.gov/App/AbstractDB/AbstractDBDetails.aspx?id=252453,"Employment and Training Review Protocol" "Climate for retention to graduation: A mixed methods investigation of student perceptions of engineering departments and programs","Wao, H., Lee, R., & Borman, K. (2010). Climate for retention to graduation: A mixed methods investigation of student perceptions of engineering departments and programs. Journal of Women and Minorities in Science and Engineering, 16(4), 293-317.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study's objective was to determine what characteristics of a college department (referred to as the climate) were conducive to retaining women and underrepresented minorities enrolled in an engineering program through graduation. The study took place at four engineering programs in Florida universities during the 2007–2008 academic year. The authors administered a Likert scale survey to a convenience sample of undergraduate students enrolled in engineering programs that measured nine aspects of the department’s climate (for example, faculty involvement or support, diversity, and student integration with department) as well as the student’s intent to leave the program. The authors then used regression analysis to determine which of the nine aspects of climate predicted a student’s intent to leave the program. In-person interviews and six focus groups supplemented survey findings. The study found that the aspects of college department climate predictive of a student’s intent to leave the program were institutional support (or the level of support and services provided by the institution to help students succeed), social and academic fit (or how well the student felt he or she was a part of the department), and personal agency and peer support (or one’s own involvement in the learning process and a peer atmosphere that encouraged success). There were no statistically significant differences in findings by gender or ethnicity, although interview and focus group data point toward complexities in how women and minorities experienced climate, suggesting that they might be more inclined than majority groups to rely on social support and fit than institutional support.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Other barriers, Female",,"United States",2010,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Veterans Health Administration transitional work experience vs. job placement in veterans with co-morbid substance use and non-psychotic psychiatric disorders","Penk, W., Drebing, C. E., Rosenheck, R, A., Krebs, C., Van Ormer, A., & Mueller, L. (2010). Veterans Health Administration transitional work experience vs. job placement in veterans with co-morbid substance use and non-psychotic psychiatric disorders. Psychiatric Rehabilitation Journal, 33(4), 297-307.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Veterans Health Administration (VHA) Transitional Work Experience (TWE) program on employment and income for veterans with substance abuse and non-psychotic psychiatric disorders, compared with job placement (JP) services only. The study was a randomized controlled trial carried out at one VHA medical center site over four years. Eligible veterans were randomly assigned to either the treatment group, which could participate in the TWE program, or to the control group, which could not participate in TWE but could receive JP services. The authors used data from participant surveys to measure impacts. The study found that members of the treatment group worked significantly more hours in paid employment (including employment sponsored by the TWE program itself) and significantly more total weeks in paid employment, compared with the control group. The study also found that the treatment group earned significantly higher total income for the year (including noncompetitive TWE employment income) than the control group. The quality of causal evidence presented in this report is low because the authors did not provide enough information to calculate attrition and did not include sufficient controls in their analysis to establish that treatment and control groups were similar on observable characteristics at baseline for the analytic sample. This means we are not confident that the estimated effects are attributable to TWE. Other factors are likely to have contributed.","the Transitional Work Experience (TWE) Program","Vocational rehabilitation Veterans' reemployment","Disability, Veteran or military",,"United States",2010,,"Disability Employment Policy Review Protocol" "Does prison-based adult basic education improve postrelease outcomes for male prisoners in Florida?","Cho, R. M., & Tyler, J. H. (2010). Does prison-based adult basic education improve postrelease outcomes for male prisoners in Florida? Crime & Delinquency, 59(7), 975-1005. [Comparison #2: completion of adult basic education vs. no participation in adult basic education.]",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Unfavorable impacts Earnings and wages Employment-Low-Mixed impacts Employment","Summary: The study examined the impact of prison-based adult basic education courses on post-release employment, earnings, and recidivism for incarcerated people who read below the 9th-grade level. The authors also investigated similar research questions for other contrasts, the profiles of which are available here. The authors used a statistical model to compare outcomes for treatment and comparison group members, drawing on data from the Florida Department of Corrections, The Florida Department of Law Enforcement, and the Florida Education and Training Placement Information Program. The study found statistically significant relationships between completing an adult basic education course and post-release earnings and employment, where those who completed adult basic education tended to have lower earnings and lower employment over the full study period, but higher employment in the first year after release compared than did those who did not participate in adult basic education while incarcerated. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups compared were similar before the intervention. This means we are not confident that the estimated relationships are attributable to the completion of an adult basic education course; other factors are likely to have contributed.","Adult basic education","Basic skills Reentry","Justice-involved, Male",,"United States",2010,https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4288462/,"Employment and Training Review Protocol" "Rapid employment model evaluation: Update #2","Smith, T. C., King, C. T., & Schroeder, D. G. (2010). Rapid employment model evaluation: Update #2. Austin, TX: Ray Marshall Center for the Study of Human Resources.",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Unfavorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Unfavorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Rapid Employment Model (REM) program on participants’ employment, earnings, and Unemployment Insurance (UI) benefit claims. (See the CLEAR review of the 2008 report here.) Using program data and state UI records, the authors matched treatment to comparison group cases and conducted regression analyses to estimate the effect of the intervention. The study found that participation in the REM program was associated with an increase in the likelihood that jobseekers were employed in the 10 quarters following program participation among the 2006 cohort. Participation in the REM program was also associated with an increase in the likelihood that jobseekers were employed, a decrease in quarterly earnings, and an increase in the likelihood jobseekers filed UI claims in the six quarters following program participation among the 2007 cohort. The quality of causal evidence presented in this report is moderate for earnings outcomes in both cohorts and for employment outcomes for the 2006 cohort because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects on employment and earnings are attributable to the REM program, but other factors might also have contributed. The quality of causal evidence presented for the UI benefit claiming outcome for both cohorts and the employment outcome for the 2007 cohort is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects on UI benefit claiming outcome are attributable to the REM program; other factors are likely to have contributed.","Rapid Employment Model (REM) Program","Job search assistance and supportive services Other training and education Unemployment Insurance","Justice-involved, Low-skilled, Low income",,"United States",2010,http://raymarshallcenter.org/files/2006/01/REM_eval_update_Jan2010.pdf,"Review Protocol" "Reentry experiences of confined juvenile offenders: Characteristics, service receipt and outcomes of juvenile male participants in the SVORI multi-site evaluation. The multi-site evaluation of the Serious and Violent Offender Reentry Initiative.","Hawkins, S., Lattimore, P., Dawes, D., & Visher, C. (2010). Reentry experiences of confined juvenile offenders: Characteristics, service receipt and outcomes of juvenile male participants in the SVORI multi-site evaluation. The multi-site evaluation of the Serious and Violent Offender Reentry Initiative. NCJ 230423. Research Triangle Park, NC: RTI.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Education and skills gains-Mod/high-Mixed impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment","Summary: The study examined the impact of the Serious and Violent Offender Reentry Initiative (SVORI) on employment, education, and recidivism among juvenile incarcerated males. The study used propensity scores to match participants in SVORI to nonparticipants who were similar on observed characteristics. The study used data from interviews collected at multiple time points through 15 months after release. The study found that SVORI participants were more likely than nonparticipants to be enrolled in school 3 months post-release (68 and 52 percent, respectively) and were more likely than nonparticipants to have a job with benefits 15 months post-release (69 and 40 percent, respectively). The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the SVORI program, but other factors might also have contributed.","Serious and Violent Offender Reentry Initiative (SVORI)","Other employment and reemployment Other health and safety Reentry Substance abuse recovery Youth programs","Youth, Justice-involved, Disconnected youth, Male",,"United States",2010,https://www.ncjrs.gov/pdffiles1/nij/grants/230423.pdf,"Opportunities for Youth Review Protocol" "Retiree health insurance and disengagement from a career job.","Robinson, C., & Clark, R. (2010). Retiree health insurance and disengagement from a career job. Journal of Labor Research, 31(3), 247-262.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-No impacts Employment","Summary: The study examined the effect of availability of retiree health insurance (RHI) on a person’s decision to leave a career job (a measure of retirement). Using data from the Health and Retirement Study (HRS), the authors used a nonexperimental approach to estimate the likelihood of retirement for those who worked at firms with RHI compared with those who worked at firms without RHI. The study found that workers at firms that offer RHI are more likely to retire than those at firms that do not offer RHI. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we would be somewhat confident that any estimated effects would be attributable to the availability at RHI, but other factors might also have contributed.","Retiree Health Insurance","Other health and safety Older workers' programs","Adult, Older worker",,"United States",2010,https://link.springer.com/article/10.1007/s12122-010-9091-4,"Employment and Training Review Protocol" "Persistence of women and minorities in STEM field majors: Is it the school that matters?","Griffith, A. (2010). Persistence of women and minorities in STEM field majors: Is it the school that matters? Economics of Education Review, 29, 911-922.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study examined institutional and student factors that had the greatest effect on students’ decisions to persist in STEM majors, emphasizing factors promoting STEM degree completion for female and minority students. The author analyzed STEM persistence to the fourth year of undergraduate study in two data sets: the 1988 National Education Longitudinal Study and the 1999 National Longitudinal Survey of Freshmen (NLSF). In each data set, the author separately examined factors that predicted STEM degree completion for male, female, minority, and nonminority students who indicated at matriculation that they intended to pursue STEM majors. Students’ academic backgrounds were most likely to predict persistence in STEM. For both women and minorities in both data sets, a higher ratio of first-year STEM grade point average to total first-year grade point average was associated with a statistically significantly higher probability of completing a STEM degree. For minority students in the NLSF sample, taking more STEM Advanced Placement courses in high school also promoted persistence in postsecondary STEM study. No institutional factors were statistically significant predictors of STEM degree completion for either women or minorities.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Other barriers, Female",,"United States",2010,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Baltimore County Juvenile Drug Court outcome and cost evaluation","Mackin, J., Lucas, L., Lambarth, C., Herrera, T., Waller, M., Carey, S., & Finigan, M. (2010). Baltimore County Juvenile Drug Court outcome and cost evaluation. Portland, OR: NPC Research.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence",,"Summary: The study examined the impact of participation in the Baltimore County Juvenile Drug Court on drug use and recidivism. The authors used a nonexperimental design, matching youth who participated in the juvenile drug court with a comparison group of similar youth who were eligible to participate in juvenile drug court, but instead participated in the traditional juvenile justice system. The authors used administrative data to compare the mean number of juvenile rearrests over a two-year follow-up period. The study found that drug court participants had significantly fewer juvenile rearrests, both overall and specifically for drug charges, than comparison youth. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the Baltimore County Juvenile Drug Court, but other factors might also have contributed.","the Baltimore County Juvenile Drug Court","Substance abuse recovery Youth programs","Youth, Disability, Disconnected youth",,"United States",2010,http://www.ndcrc.org/sites/default/files/baltimore_co_juv_dc_outcome-cost_0110…,"Opportunities for Youth Review Protocol" "Does prison-based adult basic education improve postrelease outcomes for male prisoners in Florida?","Cho, R. M., & Tyler, J. H. (2010). Does prison-based adult basic education improve postrelease outcomes for male prisoners in Florida? Crime & Delinquency, 59(7), 975-1005. [Comparison 1: completion of adult basic education course vs. involuntary dropout of adult basic education course.]",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study examined the impact of prison-based adult basic education courses on post-release employment and earnings for incarcerated people who read below the 9th-grade level. The authors also investigated similar research questions for other contrasts, the profiles of which are available here. The authors used a statistical model to compare outcomes for treatment and comparison group members, drawing on data from the Florida Department of Corrections, the Florida Department of Law Enforcement, and the Florida Education and Training Placement Information Program. The study found statistically significant relationships between completing an adult basic education course and post-release employment, where those who completed an adult basic education course tended to have higher employment rates after release from incarceration than did those who dropped out of adult basic education. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the completion of an adult basic education course; other factors are likely to have contributed.","Adult basic education","Basic skills Reentry","Justice-involved, Male",,"United States",2010,https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4288462/,"Employment and Training Review Protocol" "Youth Transition Demonstration Project, City University of New York, Bronx, NY, Final Report.","The City University of New York. (2010). Youth Transition Demonstration Project, City University of New York, Bronx, NY, Final Report. New York: City University of New York.","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: This report described the Youth Transition Demonstration project implemented by the City University of New York. The project enrolled 400 youth ages 15 to 18 in the Bronx who had disabilities and were receiving Social Security Administration (SSA) benefits. The main components of the project were (1) a Saturday college program for youth and their parents, (2) provision of counseling on SSA benefits, (3) person-centered life and employment planning, (4) summer and after-school jobs, and (5) referrals to other services. The report described participants’ receipt of SSA benefits, employment and education outcomes, participants’ use of benefit advisement, and agency partnerships formed to implement the project.",,"Disability insurance Supplemental security income (SSI) Youth programs","Youth, Disability",,"United States",2010,http://www.google.com/url?sa=t&rct=j&q=&esrc=s&frm=1&source=web&cd=1&cad=rja&ua…,"Disability Employment Policy Review Protocol" "St. Mary’s County juvenile drug court outcome and cost evaluation","Mackin, J., Lucas, L., Lambarth, C., Waller, M., Herrera, A., Carey, S., & Finigan, M. (2010). St. Mary’s County juvenile drug court outcome and cost evaluation. Portland, OR: NPC Research.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence",,"Summary: The study’s objective was to examine the impact of participation in a juvenile drug court program in St. Mary’s County, Oregon, on recidivism. The study used administrative data from the departments of Juvenile Services, Public Safety and Correctional Services, and Health and Mental Hygiene to compare outcomes of youth who participated in juvenile drug court with outcomes from a group of similar, drug court-eligible youth who did not participate. The study found no statistically significant effects on recidivism, including total number of rearrests, rearrests for drug charges, and rearrest rates over a two-year period. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we would be somewhat confident that any estimated effects would be attributable to participation in the juvenile drug court, but other factors might also have contributed. However, the study did not find any statistically significant effects.","St. Mary's County Juvenile Drug Court","Substance abuse recovery Youth programs Behavioral Interventions","Youth, Justice-involved, Disconnected youth",,"United States",2010,http://www.courts.state.md.us/opsc/dtc/pdfs/evaluationsreports/stmaryscountyjuv…,"Opportunities for Youth Review Protocol" "Employment services utilization and outcomes among substance abusing offenders participating in California’s Proposition 36 drug treatment initiative","Evans E., Hser Y.-I., Huang D. (2010). Employment services utilization and outcomes among substance abusing offenders participating in California's proposition 36 drug treatment initiative. Journal of Behavioral Health Services and Research, 37 (4), 461-476.",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-Favorable impacts Employment Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the effect of California’s Proposition 36 employment services on employment, earnings, receipt of public benefits, and recidivism. The authors used a nonexperimental design to compare outcomes of people in drug treatment programs who have a criminal conviction and who received Proposition 36-funded employment services with outcomes of people in the same programs who did not receive proposition-funded employment services. The authors found that receipt of Proposition 36 employment services was associated with an increase in employment in the year after program participation. The authors also found that Proposition 36 was positively associated with the receipt of certain public benefits (public assistance and the Supplemental Nutrition Assistance Program) at three months and negatively associated with the receipt of Supplemental Security Income at three months. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to receipt of Proposition 36 employment services; other factors are likely to have contributed.","California’s Proposition 36 employment services","Substance abuse recovery Other employment and reemployment Reentry",Justice-involved,,"United States",2010,https://doi.org/10.1007/s11414-009-9185-z,"Employment and Training Review Protocol" "Elderly immigrants’ labor supply response to supplemental security income.","Kaushal, N. (2010). Elderly immigrants’ labor supply response to supplemental security income. Journal of Policy Analysis and Management, 29(1), 137-162.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study objective is to examine the impact of the Personal Responsibility and Work Opportunity Reconciliation Act (PRWORA) of 1996 on employment outcomes of foreign-born people and noncitizens ages 60 to 74 The study used a statistical model and the data from the Current Population Survey’s monthly outgoing rotation group and the March Current Population Survey from 1994 to 2005 to estimate the impact. The study found that the PRWORA is associated with increased employment and decreased retirement for foreign-born men compared with U.S.-born men, but it found no statistically significant association with the employment for foreign-born women. The quality of the causal evidence presented in this report is low because the study is a nonexperimental analysis that does not demonstrate that the groups were similar before the policy change. This means we are not confident that the estimated effects are attributable to PRWORA; other factors are likely to have contributed.","Personal Responsibility and Work Opportunity Reconciliation Act of 1996","Federal retirement benefits Foreign and temporary workers","Adult, Older worker, Immigrant",,"United States",2010,https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4222576/,"Employment and Training Review Protocol" "Framing Social Security Reform: Behavioral responses to changes in the full retirement age","Behaghel, L., & Blau, D. M. (2010) Framing Social Security Reform: Behavioral responses to changes in the full retirement age. (IZA Discussion Paper No. 5310). Bonn, Germany: IZA.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The study examined the impact of changes to the Full Retirement Age (FRA) on labor force exit, Old Age and Survivor’s Insurance (OASI) claims, and retirement. The study uses a statistical model and the data from the Health and Retirement Study (HRS) to compare outcomes of people in birth cohorts who were affected by the change in FRA with those of a comparison group of people who were not. The study found that the change in the FRA was associated with significant increases in the likelihood of claiming OASI and exiting the labor force at the new, later full retirement age. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the change in FRA, but other factors might also have contributed.","changes to the Full Retirement Age (FRA)","Older workers' programs Other employment and reemployment","Older worker",,"United States",2010,https://www.aeaweb.org/articles?id=10.1257/pol.4.4.41,"Employment and Training Review Protocol" "The impact of course delivery systems on student achievement and sense of community: A comparison of learning community versus stand-alone classroom settings in an open-enrollment inner city public community college","Bandyopadhyay, P. (2010). The impact of course delivery systems on student achievement and sense of community: A comparison of learning community versus stand-alone classroom settings in an open-enrollment inner city public community college (Doctoral dissertation). Retrieved from ProQuest Dissertations and Theses database. (UMI No. 3390450)","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Education and skills gains-Mod/high-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of a learning community on the retention of community college students enrolled in developmental reading and writing and a social science course at an open-enrollment inner city public community college in the United States. The author used a nonexperimental study design, analyzing school records of students enrolled in the highest level of developmental reading and writing and either a learning community or stand-alone version of one of two social science courses (Introduction to Psychology or Principles of Sociology). The study found no statistically significant difference in the fall 2008 to spring 2009 retention rates between the students in the learning community and the students in stand-alone courses. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we would be somewhat confident that any estimated effects would be attributable to the learning community. However, the study did not find statistically significant effects.","Learning Communities","Basic skills Community college education and other classroom training","Adult, Other barriers",,"United States, Urban",2010,,"Community College Review Protocol" "Can Social Security explain trends in labor force participation of older men in the United States?","Blau, D. M., & Goodstein, R. M. (2010). Can Social Security explain trends in labor force participation of older men in the United States? Journal of Human Resources, 45(2), 328-363.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The study examined the impact of changes in Social Security Administration (SSA) retirement rules on men’s labor force participation rates in the 1960s–1980s and 1990s–2000s. The study used regression analyses to predicted labor force participation rates using actual and counterfactual SSA retirement rules. These analyses use data from the Current Population Survey (CPS) and the Survey of Income and Program Participation (SIPP) for the period from 1962 to 2005 merged with data from SSA on taxable earnings. The study found that changes in the delayed retirement credit and full retirement age in 1983 could explain one-quarter to one-half of the increase in labor force participation in the early 2000s. The quality of causal evidence presented in this report is moderate, because it is a well-implemented nonexperimental study. This means we are somewhat confident that the estimated effects are attributable to SSA reforms, but other factors might also have contributed.","Social Security Administration Reforms","Federal retirement benefits Older workers' programs","Adult, Older worker, Male",,"United States",2010,http://jhr.uwpress.org/content/45/2/328.abstract,"Employment and Training Review Protocol" "Workforce development program: A pilot study of its impact in the U.S. Probation Office, District of Delaware.","Visher, C. A., Smolter, N., & O’Connell, D. (2010). Workforce development program: A pilot study of its impact in the U.S. Probation Office, District of Delaware. Federal Probation, 74(3), 16-21.",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The authors examined the impact of the U.S. Probation Office, District of Delaware’s pilot workforce development program on employment, earnings, and recidivism outcomes for adult offendprobationers. The authors used a nonexperimental design to create a matched comparison group of nonparticipants who were similar to program participants. The authors’ estimated the program’s effects by comparing these groups’ employment, earnings, and recidivism outcomes one year after the program. Data were collected from probationer case files;, the Probation and Pretrial Services Automated Case Tracking System (PACTS) database;, and, for the treatment group, program records. The authors found that individuals people who participated in vocational training were employed for more months in the first year after program enrollment than were participants who received no vocational training. The authors found that individuals people in the program group were less likely to be rearrested or have their probation revoked than were members of the matched comparison group. The quality of causal evidence presented in this study is low. The authors did not account adequately for potential differences between the program and comparison groups before implementing the intervention was implemented. This means we are not confident that the estimated effects are attributable to the workforce development program; other factors are likely to have contributed.","the U.S. Probation Office, District of Delaware’s workforce development program","Job search assistance and supportive services Reentry",Justice-involved,,"United States",2010,https://www.uscourts.gov/sites/default/files/74_3_4_0.pdf,"Employment and Training Review Protocol" "A model for accelerating academic success of community college remedial English students: Is the Accelerated Learning Program (ALP) effective and affordable?","Jenkins, D., Speroni, C., Belfield, C., Jaggars, S., & Edgecombe, N. (2010). A model for accelerating academic success of community college remedial English students: Is the Accelerated Learning Program (ALP) effective and affordable? (CCRC Working Paper No. 21). New York: Columbia University, Community College Research Center.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Accelerated Learning Program (ALP) at the Community College of Baltimore County (CCBC) on success in college-level English courses (ENGL 101 and 102). In this program, students who otherwise would have taken a developmental English course instead took ENGL 101, as well as an eight-person companion course designed to help the students pass ENGL 101. This nonexperimental study used college administrative data to measure impacts on courses attempted and passed, student persistence, and credits accrued. Multivariate linear regressions were used to measure impacts. The study found that ALP students were significantly more likely to pass ENGL 101 and 102. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the ALP, but other factors might also have contributed.","the Accelerated Learning Program","Basic skills Community college education and other classroom training","Adult, Other barriers",,"United States",2010,http://files.eric.ed.gov/fulltext/ED512398.pdf,"Community College Review Protocol" "The influences on bridge employment decisions.","Pengcharoen, C., & Shultz, K. S. (2010). The influences on bridge employment decisions. International Journal of Manpower, 31(3), 322-336. doi:10.1108/01437721011050602","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Unfavorable impacts Employment","Summary: The study examined the impact of work schedule flexibility on retirement outcomes among older workers, where work schedule flexibility was measured as the ability to reduce hours from one’s regular work schedule. The study used a statistical model (multinomial logit regression) and the longitudinal data from the Health and Retirement Study (HRS) from 1992 and 2002 to examine the relationship between reporting work schedule flexibility or inflexibility during the baseline survey and reporting complete retirement, partial retirement, or continued employment at the follow-up survey 10 years later among older workers. The study found that individuals who reported work schedule inflexibility in the 1992 were more likely to report completely retired than partially retired in 2002, but when comparing the likelihood of reporting continued employment to complete or partial retirement, there was no difference between older workers reported work schedule flexibility and those who reported inflexibility in 1992. The quality of causal evidence presented in this study is low because the authors did not demonstrate that the participants reporting work schedule flexibility were similar to the participants reporting work schedule inflexibility in 1992. This means we are not confident that the estimated effects are attributable to work schedule flexibility; other factors are likely to have contributed.",,"Other wages and benefits","Adult, Older worker",,"United States",2010,https://www.researchgate.net/publication/46545640_The_influences_on_bridge_empl…,"Employment and Training Review Protocol" "Microenterprise options for people with intellectual and developmental disabilities: An outcome evaluation.","Conroy, J., Ferris, C., & Irvine, R. (2010). Microenterprise options for people with intellectual and developmental disabilities: An outcome evaluation. Journal of Policy and Practice in Intellectual Disabilities, 7(4), 269-277.","Entrepreneurship and Self-Employment","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Mixed impacts Earnings and wages Education and skills gains-Low-No impacts Education and skills gains Employment-Low-Mixed impacts Employment","Summary: The study’s objective was to examine the impact of a microenterprise intervention from Network180, an agency serving people with intellectual and developmental disabilities, on employment, earnings, and education of 27 people with disabilities. The study defined microenterprise as a very small business, employing 10 or fewer people, with start-up costs less than $500. As part of the intervention, vocational staff at Network180 provided information about microenterprises to people already receiving services at Network180. Staff supported those interested in microenterprises with tasks such as small business loans and talking to community stakeholders. The authors used a pre-post design, collecting survey data measuring hours worked and earnings from several types of employment, as well as the number of hours spent on educational activities, before and after participation in the intervention. Data were collected at one point in time; respondents were asked to estimate pre-intervention data from memory. The authors summed the reported outcomes for all 27 participants and performed statistical tests on the totals rather than the means of each outcome. The study found that hours spent per week engaged in self-employment, as well as earnings from self-employment, were significantly higher after the intervention than before it. In contrast, earnings and weekly hours spent in sheltered or workshop employment decreased significantly after the intervention, compared with before it. There were no significant differences before or after the intervention on hours spent on educational activities.","Network180 microenterprise intervention","Other training and education",Disability,"Small business","United States",2010,,"Employment and Training Review Protocol" "Impact of learning communities in developmental English on community college student retention and persistence","Barnes, R., & Piland, W. (2010). Impact of learning communities in developmental English on community college student retention and persistence. Journal of College Student Retention: Research, Theory, & Practice, 12(1), 7-24.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: This study’s objective was to evaluate the effectiveness of learning communities as an alternative pedagogical format for students enrolled in developmental reading and English composition courses at an urban community college. The authors employed a quasi-experimental design to compare average retention and persistence rates of students enrolled in learning community developmental English courses with those of students enrolled in traditional developmental English courses in the same semester. The study found that retention rates were higher for students who enrolled in learning community developmental courses compared with their counterparts who took the same courses but in the traditional format. Furthermore, for the four semesters studied, learning community students were more likely to enroll in courses the following semester than were students who were not enrolled in learning communities.  The quality of causal evidence provided in this study is low because authors did not use sufficient controls in the analysis. This means we are not confident that the estimated effects are attributable to the learning communities. Other factors are likely to have contributed.","Learning Communities","Basic skills Community college education and other classroom training","Adult, Other barriers",,"United States, Urban",2010,,"Community College Review Protocol" "Do disability laws impair firm performance?","Bird, R., & Knopf, J. (2010). Do disability laws impair firm performance? American Business Law Journal, 47(1), 145-190.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Unfavorable impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the effect of state disability laws—those related to antidiscrimination and reasonable accommodation for employees with disabilities—on commercial banks’ number of full-time equivalent employees and their average salary. The authors estimated the impact of antidiscrimination and reasonable accommodation laws using a differences-in-differences regression model with state- and year-fixed effects. Data were obtained from the Federal Reserve Bank of Chicago’s Commercial Bank Database and from Global Insight. The study found that neither antidiscrimination nor reasonable accommodation laws had a statistically significant effect on bank employment levels during the year the law went into effect or during the subsequent three years. Antidiscrimination laws led to a statistically significant 1.3 percent decline in bank employees’ average salary in the third year after enactment, but not in any other time period. The quality of causal evidence presented in this report is low. This means we are not confident that the estimated effects are attributable to state disability laws. Other factors are likely to have contributed.","State Disability Laws","Americans with Disabilities Act (ADA)",Disability,"Finance and insurance","United States",2010,,"Employer Compliance Review Protocol" "Does prison-based adult basic education improve postrelease outcomes for male prisoners in Florida?","Cho, R. M., & Tyler, J. H. (2010). Does prison-based adult basic education improve postrelease outcomes for male prisoners in Florida? Crime & Delinquency, 59(7), 975-1005. [Study 1, Contrast 4: participation in adult basic education vs. no participation in adult basic education.]",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Unfavorable impacts Earnings and wages Employment-Low-Mixed impacts Employment","Summary: The study examined the impact of participation in prison-based adult basic education on post-release employment, earnings, and recidivism for incarcerated people who read below the 9th-grade level. The authors also investigated similar research questions for other contrasts, the profiles of which are available here. The authors used a statistical model to compare outcomes for treatment and comparison group members, drawing on data from the Florida Department of Corrections, The Florida Department of Law Enforcement, and the Florida Education and Training Placement Information Program. The study found statistically significant relationships between participation in an adult basic education course and post-release employment and earnings. Compared with people who did not participate in adult basic education, those who did had lower earnings and both lower and higher employment depending on the statistical model used. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups compared were similar before the intervention. This means we are not confident that the estimated relationships are attributable to participated in an adult basic education program; other factors are likely to have contributed.","Adult basic education","Basic skills Reentry","Justice-involved, Male",,"United States",2010,https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4288462/,"Employment and Training Review Protocol" "Evaluation of the YouthBuild Youth Offender Grants","Abrazaldo, W., Adefuin, J., Henderson-Frakes, J., Lea, C., Leufgen, J., Lewis-Charp, H., … Wiegand, A. (2009). Evaluation of the YouthBuild Youth Offender Grants. Oakland, CA: SPR Associates.","Opportunities for Youth","Study Type: Implementation Analysis",,,"Summary: This report summarizes the findings of an implementation and outcomes analysis of Young Offender grants. These grants, which were awarded to 30 YouthBuild USA sites in 2004 and 2005, were to provide academic instruction, vocational training, leadership opportunities, and counseling and other support services to young offenders. The objective was to understand how YouthBuild programming for young offenders was designed and implemented; identify the strategies and approaches associated with positive outcomes; and gain insight into the contextual factors influencing program implementation and participant performance. The authors collected and analyzed qualitative information gathered during two rounds of site visits—which included interviews with program staff, instructors and trainers, grantee partners, employers, and program participants—and quantitative management information systems data.  The implementation analysis found that the extent to which Young Offender grantees implemented the YouthBuild model varied, though all attempted to adhere to the model. In general, grantees had mature organizational structures and were able to form partnerships with workforce development agencies and the juvenile justice system. Young offenders tended to have better educational, employment, and social outcomes in grantee sites where teachers invested time in getting to know them on a personal level, the teacher-to-student ratio was low, academic work and vocational training were linked, and leadership opportunities were available.",Youthbuild,"Youth programs Other training and education Work based and other occupational training","Youth, Justice-involved, Low-skilled, Low income",,"United States",2009,http://wdr.doleta.gov/research/FullText_Documents/Evaluation%20of%20the%20Youth…,"Opportunities for Youth Review Protocol" "An Evaluation of the Latino Coalition’s Reclamando Nuestro Futuro (Reclaiming our Future) Program","Monsma, S., & Smidt, C. (2009). An Evaluation of the Latino Coalition’s Reclamando Nuestro Futuro (Reclaiming our Future) Program. Paul Henry Institute for the Study of Christianity and Politics,","Opportunities for Youth","Study Type: Implementation Analysis",,,"Summary: This report presents an implementation analysis of the Latino Coalition’s Reclamando Nuestro Futuro (RNF) program. The program provided skills training, case management, and follow-up services to at risk youth and those with previous criminal justice experience between the ages of 14 and 21. The study examined RNF programs in 19 sites, focusing on program organization, sub-grantee characteristics, and participant characteristics and outcomes. The study utilized management information system (MIS) data, staff interviews, site visits, participant focus groups, and interviews with community partners. The program was successful in reaching and retaining minority youth and those with previous criminal justice experience, largely because program subgrantees were located in and matched the neighborhoods they served, and had staff members who seemed similar to, and accessible to, their target population. The Latino Coalition, the intermediary organization, played a critical role in the program’s success by establishing a robust organizational and oversight structure and providing capacity-building assistance to the relatively new and small faith-based and community organizations delivering program services.","Reclamando Nuestro Futuro (Reclaiming Our Future)","Basic skills Community college education and other classroom training Job search assistance and supportive services Mentoring Substance abuse recovery Work based and other occupational training Youth programs","Youth, Justice-involved, Hispanic of any race",,"United States",2009,http://wdr.doleta.gov/research/FullText_Documents/An%20Evaluation%20of%20the%20…,"Opportunities for Youth Review Protocol" "The repeal of the retirement earnings test and the labor supply of older men.","Engelhardt, G. V., & Kumar, A. (2009). The repeal of the retirement earnings test and the labor supply of older men. Journal of Pension Economics & Finance, 8(4), 429-450.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study examined the impact of the repeal of the earnings test under the Senior Citizens Freedom to Work Act of 2000 on the labor supply and earnings of older men ages 62 to 72. The authors used a nonexperimental approach and data from the Health and Retirement Study to compare labor force participation, annual hours of work, retirement behavior, and earnings of men who were and were not subject to the repeal of the earnings test. The study found that the policy change was associated with a significant increase in older men’s average annual hours of work. The policy change was also associated with a change in the distribution of real earnings in that a smaller proportion of older men had earnings at or below the earnings test threshold. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Senior Citizens Freedom to Work Act of 2000; other factors are likely to have contributed.","Senior Citizens Freedom to Work Act of 2000","Older workers' programs Other disparities or discrimination in employment and earnings","Adult, Older worker, Male",,"United States",2009,,"Employment and Training Review Protocol" "Benefit Offset Pilot Demonstration: Connecticut final report","State of Connecticut (2009). Benefit Offset Pilot Demonstration: Connecticut final report.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: This study’s objective was to examine 24-month impacts for Connecticut’s Benefit Offset Pilot Demonstration (BOPD), which provided a more-generous work incentive for Social Security Disability Insurance (SSDI) recipients, on recipients’ employment status, earnings, and reliance on benefits. Participants were randomly assigned to a treatment group, which was eligible for the more generous work incentive, or a control group that was not. The authors examined impacts on employment and earnings using state unemployment insurance (UI) wage records. The study found that, although BOPD achieved no statistically significant impacts on being employed, it did generate some positive impacts on earnings at the first year after random assignment. The quality of the causal evidence presented in this report is high for the year two impacts. This means we are confident that those estimated effects are attributable to the BOPD. However, the quality of the causal evidence for the year one impacts is moderate. This means we have confidence that the effects are attributable at least in part to the BOPD, but other factors might also have contributed.","the Benefit Offset Pilot Demonstration","Disability insurance Supplemental security income (SSI)",Disability,,"United States",2009,http://www.google.com/url?sa=t&rct=j&q=&esrc=s&frm=1&source=web&cd=1&cad=rja&ua…,"Disability Employment Policy Review Protocol" "Interim report on the Demonstration to Maintain Independence and Employment","Gimm, G., Denny-Brown, N., Gilman, B., Ireys, H.T., & Anderson, T. (2009). Interim report on the Demonstration to Maintain Independence and Employment. Washington, DC: Mathematica Policy Research.","Disability Employment Policy","Study Type: Implementation Analysis",,,"Summary: This report summarized the results of the first round of the evaluation of the Demonstration to Maintain Independence and Employment (DMIE), under which the Centers for Medicare & Medicaid Services (CMS) offered funding to four states and the District of Columbia to design, implement, and test health care coverage and employment support programs for workers with potentially disabling conditions. This CLEAR profile focuses on the process study component of the evaluation. Other components of the evaluation included an overview of beneficiaries’ characteristics and an impact analysis. This study sought to gain insight into successes, challenges, and lessons related to program outreach and recruitment—drawing relevant information on all five sites from interviews, program documents, state-level evaluation reports, and enrollment data. Key findings indicated that most state DMIE programs faced challenges in recruitment—given delays in designing program processes and obtaining approvals, low interest from eligible beneficiaries, and poor access to data needed for outreach and screening—but eventually met enrollment targets. The authors also found that state DMIE programs that were designed around existing health programs were most successful in implementing streamlined recruitment, strategically supplementing available health benefits, and conducting swift program roll-out through existing provider networks.","Demonstration to Maintain Independence and Employment (DMIE)",,Disability,,"United States",2009,http://www.mathematica-mpr.com/~/media/publications/PDFs/disability/dmie-es.pdf,"Disability Employment Policy Review Protocol" "MS Model Youth Transition Innovation; Youth Transition Process Demonstration Grant Final Summary","Doyle, Rebecca, Horton, Patty, Ladner, Lisa, & Mississippi Department of Rehabilitation Services (2009). MS Model Youth Transition Innovation; Youth Transition Process Demonstration Grant Final Summary.","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: The Mississippi Model Youth Transition Innovation (MYTI) project assisted young people with severe disabilities to become involved in the working community through targeted, school-to-work transition interventions. It exposed students and their families to the concept that all students were employable, then provided employment and benefits information, preparation, and support services tailored to four age ranges of (10–13, 14–18, 19–21, and 22–25 years of age). MYTI served 210 youths ages 10 to 25with significant disabilities, such as mental retardation, developmental disabilities, deafness, blindness, severe emotional disturbances, or multiple disabilities. There was no comparison group. Services included work experience, employment and job planning and support, One-Stop Career Center assistance, and individualized development accounts. Descriptive analyses suggested potential lessons from the project, such as the importance of helping students formulate a vision of work at a young age, and of helping students and their families understand whether and how work affects Social Security benefits.",,"Disability insurance Supplemental security income (SSI) Vocational rehabilitation Supported employment or other employment supports","Youth, Disability",,"United States",2009,http://www.google.com/url?sa=t&rct=j&q=&esrc=s&frm=1&source=web&cd=1&cad=rja&ua…,"Disability Employment Policy Review Protocol" "The relative importance of selected variables on the employment consistency of Virginia ex-offenders","Onyewu, C. C. (2009). The relative importance of selected variables on the employment consistency of Virginia ex-offenders. (Doctoral dissertation). Retrieved from VTechWorks: http://hdl.handle.net/10919/26264.",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: This study examines the effectiveness of prison-based career and technical education (CTE) on post-incarceration employment among males released from Virginia prisons from July 2000 to June 2001. The author used a nonexperimental design to estimate the employment impacts of prison-based CTE four years after people were released from prison. The author used administrative data from the Virginia Employment Commission and the Virginia Department of Corrections. The study found that participation in CTE was associated with greater employment after release from prison than nonparticipation in CTE. The quality of causal evidence presented in this report is low because the author did not ensure that the groups compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the CTE; other factors are likely to have contributed.","Career and Technical Education (CTE)","Reentry Work based and other occupational training",Justice-involved,,"United States",2009,http://hdl.handle.net/10919/26264,"Employment and Training Review Protocol" "An empirical study of the effects of Social Security reforms on benefit claiming behavior and receipt using public-use administrative microdata.","Benítez-Silva, H., & Yin, N. (2009). An empirical study of the effects of Social Security reforms on benefit claiming behavior and receipt using public-use administrative microdata. Social Security Bulletin, 69(3), 77-95.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study examined the impact of three policy changes to the Social Security program that went into effect in 2000 on average monthly benefits and the proportion of new claimants by age. The study was a nonexperimental analysis that examined outcomes for older workers by age and year using data from the 2004 Old Age, Survivors, and Disability Insurance program public-use microdata files. The study found that the changes were associated with lower average monthly benefits for individuals ages 66 to 69 after the year 2000 relative to individuals of the same ages in 1994. The quality of the causal evidence presented in this report is low because the authors did not demonstrate that the groups were similar before the intervention. This means we are not confident that the estimated effects are attributable to the intervention program; other factors are likely to have contributed.","Policy Changes to the Social Security Program","Federal retirement benefits Older workers' programs","Adult, Older worker",,"United States",2009,https://papers.ssrn.com/sol3/papers.cfm?abstract_id=1480653,"Employment and Training Review Protocol" "Essays on incarceration and labor market outcomes.","Jung, H. (2009). Essays on incarceration and labor market outcomes. (Doctoral dissertation.) Retrieved from ProQuest. Accession No. 305059182.",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of participating in the Adult Transition Centers (ATC) work-release program on employment and earnings outcomes for ex-prisoners in Cook County, Illinois. Prisoners in minimum-security prisons who are nearing their release date and meet certain conditions of criminal history are eligible to apply to transfer to ATCs. The study used a nonexperimental design that compared changes in outcomes over time between the treatment group and a matched comparison group. The study used administrative data on prison admission and exit dates from the Illinois Department of Corrections and earnings data from the Illinois Department of Employment Security. The study found no statistically significant relationships between the ATC work-release program and employment or earnings. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we would not be confident that any estimated effects would have been attributable to the ATC work-release program; other factors would likely have contributed, though the study did not find statistically significant effects.","Adult Transition Center Program",Reentry,Justice-involved,,"United States",2009,,"Employment and Training Review Protocol" "Leading them to water: A study of the efficacy of a Mandatory Placement Project in first-year academic courses at a community college","Emmerson, J. (2009). Leading them to water: A study of the efficacy of a Mandatory Placement Project in first-year academic courses at a community college. Graduate Theses and Dissertations, paper 10661. Retrieved from http://lib.dr.iastate.edu/etd/10661","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: This study’s objective was to examine the effects of Des Moines Area Community College’s Mandatory Placement Project on credit completion and fall-to-spring semester persistence. The intervention included intensive counseling and developmental courses for first-time, full-time community college students whose late registration suggested a high risk of not persisting. The study used administrative records to compare outcomes of a group of 270 students who were required to meet with an advisor and strongly encouraged to participate in one of six developmental courses with those of a comparison group of 174 students who received no counseling and were not advised to take developmental courses. The study found that participation in one of the six developmental courses was significantly and positively associated with fall-to-spring semester persistence. The quality of causal evidence presented in this report is low because the author did not adequately account for existing differences between the treatment and comparison groups. This means we are not confident that the estimated effects are attributable to the Mandatory Placement Project. Other factors are likely to have contributed.","the Mandatory Placement Project","Basic skills Community college education and other classroom training","Adult, Other barriers",,"United States",2009,http://lib.dr.iastate.edu/cgi/viewcontent.cgi?article=1685&context=etd,"Community College Review Protocol" "Transitional jobs for ex-prisoners: Implementation, two-year impacts, and costs of the Center for Employment Opportunities (CEO) prisoner reentry program","Redcross, C., Bloom, D., Azurdia, G., Zweig, J., and Pindus, N. (2009). Transitional jobs for ex-prisoners: Implementation, two-year impacts, and costs of the Center for Employment Opportunities (CEO) prisoner reentry program. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine the impact of a comprehensive employment program on ex-offenders’ employment and wages. The authors randomly assigned former prisoners to an employment program offering transitional job placement and other services or to a control condition providing a more limited set of services. Employment and earnings data were collected quarterly for three years and compared between the two groups, controlling for characteristics before random assignment. The study did not find any statistically significant effects on employment in the sixth or eighth quarters after random assignment, nor on earnings in the sixth quarter or second year after random assignment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects would be attributable to the employment program and not to other factors. However, the study did not find statistically significant effects.","the Center for Employment Opportunities (CEO) Transitional Jobs Program","Job search assistance and supportive services Other employment and reemployment Reentry",Justice-involved,,"Urban, United States",2009,http://www.acf.hhs.gov/sites/default/files/opre/ex_prisoners.pdf,"Employment and Training Review Protocol" "Pennsylvania Certified Peer Specialist Initiative: Training, employment and work satisfaction outcomes.","Salzer, M. S., Katz, J., Kidwell, B., Federici, M., & Ward-Colasante, C. (2009). Pennsylvania Certified Peer Specialist Initiative: Training, employment and work satisfaction outcomes. Psychiatric Rehabilitation Journal, 32(4), 301-305.","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study examined the relationship between Certified Peer Specialist training and employment for training participants. The authors compared employment rates for participants before and after the training program using training program records and data from a survey administered one year after the training program. The study found that a higher percentage of training participants were employed after the Certified Peer Specialist training than before the training. The quality of causal evidence presented in this report is low because the authors did not account for trends in outcomes before the intervention. This means we are not confident that the estimated effects are attributable to the Certified Peer Specialist training; other factors are likely to have contributed.","Certified Peer Specialist training","Substance abuse recovery Other training and education","Other barriers",,"United States",2009,https://psycnet.apa.org/doi/10.2975/32.4.2009.301.305,"Employment and Training Review Protocol" "SSDI '1 for 2:' Benefit Offset Pilot Demonstration Vermont Pilot Final Report","Porter, A., Smith, J., Payette, A., Tremblay, T., & Burt, P. (2009). SSDI '1 for 2:' Benefit Offset Pilot Demonstration Vermont Pilot Final Report. Waterbury, VT: Vermont Division of Vocational Rehabilitation.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: This study’s objective was to examine 24-month impacts for Vermont’s Benefit Offset Pilot Demonstration (BOPD), which provided a more generous work incentive for Social Security Disability Insurance (SSDI) recipients, on recipients’ employment status and earnings. Participants were randomly assigned to a treatment group, which was eligible for the more generous work incentive, or a control group that was not. The authors examined impacts on employment and earnings using state unemployment insurance (UI) wage records. The study found that the BOPD in Vermont had statistically significant, positive impacts on treatment group members’ employment and earnings in the three quarters after random assignment. However, the effects generally did not persist over the full two-year follow-up period. The quality of the causal evidence presented in this report is high because it was a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the BOPD, and not to other factors.","Benefit Offset Pilot Demonstration","Disability insurance Supplemental security income (SSI) Other employment and reemployment",Disability,,"United States",2009,http://www.ssa.gov/disabilityresearch/documents/Vt1for2FinalReport091223.pdf,"Disability Employment Policy Review Protocol" "Work Activity and Use of Em-ployment Supports Under the Original Ticket to Work Regulations: Characteristics, Employment, and Sources of Support Among Working-Age SSI and DI Beneficiaries","Livermore, Gina, Stapleton, David, & Roche, Allison. (2009). Work Activity and Use of Em-ployment Supports Under the Original Ticket to Work Regulations: Characteristics, Employment, and Sources of Support Among Working-Age SSI and DI Beneficiaries. Washington, DC: Mathematica Policy Research.","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: This report presented a profile of all working-age (ages 18 to 64) Supplemental Security Income (SSI) and Disability Income (DI) recipients, using data from the 2004, 2005, and 2006 rounds of the National Beneficiary Survey. Findings indicated that many SSI and DI recipients were working and engaging in work preparation activities, or saw themselves working in the future. But their jobs did not pay well in general, or offer much in the way of benefits. Although many recipients were working, there was a high prevalence of characteristics, circumstances, and experiences making employment difficult. Few were aware of work incentive provisions then available in SSI and DI, and many relied on means-tested public programs for which earnings could jeopardize eligibility. In addition to activity limitations and poor health associated with their disabling health conditions, many recipients had limited education and experienced obstacles to employment, such as a lack of reliable transportation and inaccessible workplaces. Findings indicated that only changing economic incentives inherent in the disability programs would be insufficient to bring about a successful return to work for many recipients; other supports would be needed as well.",,"Disability insurance Supplemental security income (SSI) Supported employment or other employment supports",Disability,,"United States",2009,http://www.ssa.gov/disabilityresearch/documents/TTW5_2_BeneChar.pdf,"Disability Employment Policy Review Protocol" "Getting back on track: Effects of a community college program on probationary students","Scrivener, S., Sommo, C., & Collado, H. (2009). Getting back on track: Effects of a community college program on probationary students. New York: MDRC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Opening Doors and Enhanced Opening Doors programs at Chaffey Community College in California on progress toward completing a degree. Students in the Opening Doors and Enhanced Opening Doors programs took a college success course that covered topics such as personal goals, study skills, and college rules, and had to visit the college’s student success centers for tutoring sessions. The study was a randomized controlled trial. Eligible students were randomly assigned to either the treatment or control group. In the original Opening Doors program, students assigned to the treatment group were offered the opportunity to participate in the program. In the Enhanced Opening Doors program, students in the treatment group were required to participate in the program. The control groups for both the original and Enhanced Opening Doors programs were not required to participate in the program. The primary data sources were a baseline survey on the background characteristics of students, students’ transcripts, and degree attainment information from the National Student Clearinghouse. The study found no significant impacts on students’ course registration, the number of semesters enrolled, or regular credits accumulated for the original Opening Doors program. For the Enhanced Opening Doors program, the study found that the treatment group earned significantly more nondegree credits and developmental credits during each of the two program semesters and cumulatively across both program semesters, compared with the control group. Additionally, at the end of both program semesters, a higher proportion of students in the Enhanced Opening Doors program were in good academic standing (that is, earned a grade point average of 2.0 or higher and were not on probation due to attempting fewer than 12 credits or completing fewer than half of attempted credits) compared with students in the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Enhanced Opening Doors program, and not to other factors.","the Opening Doors and Enhanced Opening Doors Programs at Chaffey Community College","Community college education and other classroom training","Adult, Other barriers",,"United States",2009,http://www.mdrc.org/sites/default/files/full_379.pdf,"Community College Review Protocol" "Utah SSDI '1 for 2:' Benefit Offset Pilot Demonstration Final Report","Chambless, C., Julnes, G., McCormick, S., & Brown-Reither, A. (2009). Utah SSDI '1 for 2:' Benefit Offset Pilot Demonstration Final Report. Salt Lake City, UT: University of Utah Center for Public Policy & Administration.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment","Summary: This study’s objective was to examine 24-month impacts for Utah’s Benefit Offset Pilot Demonstration (BOPD), which provided a more-generous work incentive for Social Security Disability Insurance (SSDI) recipients, on recipients’ employment status and earnings. Participants were randomly assigned to a treatment group, which was eligible for the more generous work incentive, or a control group that was not. The authors examined impacts on employment and earnings using state unemployment insurance (UI) wage records. The study found that the BOPD in Utah did not have a statistically significant impact on employment or earnings. It did significantly increase the proportion of participants with earnings above the substantial gainful activity (SGA) amount by the end of the second year of follow-up. The quality of the causal evidence presented in this report is high because it was a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the BOPD, and not to other factors.","Benefit Offset Pilot Demonstration","Disability insurance Supplemental security income (SSI) Other employment and reemployment",Disability,,"United States",2009,http://www.ssa.gov/disabilityresearch/documents/Final-UBOPD-Master_5-13-10.doc,"Disability Employment Policy Review Protocol" "New evidence on the labor supply effects of the Social Security earnings test.","Friedberg, L., & Webb, A. (2009). New evidence on the labor supply effects of the Social Security earnings test. Tax Policy and the Economy, 23(1), 1-36.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study examined the impact of changes to the Social Security earnings test in 1996 and 2000 on employment outcomes. The authors used a nonexperimental design and the data from the Current Population Survey (CPS) and the Health and Retirement Study (HRS) to compare outcomes before and after the changes in earning test rules for those between the ages of 62 and 74 who faced different earnings test thresholds at different ages and years. The study found that upcoming anticipated earnings test between ages 62 to 69 was associated with a significantly lower likelihood of having a job last week. A higher present value of upcoming anticipated earnings threshold between ages 62 to 69 was associated with a significantly higher likelihood of having a job last week. The quality of causal evidence presented in this study is low because the study is a nonexperimental analysis that did not demonstrate that the groups being compared were similar and did not account for possible differences in the analysis. This means we are not confident that the estimated effects are attributable to the changes in the earnings test decision. Other factors are likely to have contributed.","Social Security Earnings Test","Older workers' programs Other employment and reemployment","Adult, Older worker",,"United States",2009,,"Employment and Training Review Protocol" "Mentoring formerly incarcerated adults: Insights from the Ready4Work reentry initiative.","Bauldry, S., Korom-Djakovic, D., McClanahan, W. S., McMaken, J., & Kotloff, L. J. (2009). Mentoring formerly incarcerated adults: Insights from the Ready4Work reentry initiative. New York, NY: Public Private Ventures.",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the relationships between the Ready4Work mentoring program and post-release employment and recidivism outcomes among previously incarcerated adults. The study uses a nonexperimental design to compare outcomes of Ready4Work participants who did and did not voluntarily participate in mentoring, based on data from states’ public incarceration records and a follow-up questionnaire given to study participants at their program site. The study found statistically significant favorable relationships between Ready4Work mentoring and employment and recidivism outcomes. The quality of causal evidence presented in this report is low because the authors did not account for the fact that study members in the intervention group chose to participate in mentoring and study members in the comparison group chose not to participate in mentoring. This means we are not confident that findings can be attributed to Ready4Work mentoring; other factors are likely to have contributed.","Ready4Work mentoring","Other employment and reemployment Reentry Mentoring",Justice-involved,,"United States",2009,https://www.issuelab.org/resource/mentoring-formerly-incarcerated-adults-insigh…,"Employment and Training Review Protocol" "McNeil Education, Training and Evaluation (2008). Process evaluation of the Demand-Side Youth Offender Demonstration Project (Phase II).","McNeil Education, Training and Evaluation (2008). Process evaluation of the Demand-Side Youth Offender Demonstration Project (Phase II). Chapel Hill, NC: McNeil Education.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of being matched to employment through the Demand-Side Youth Offender Demonstration Project (DSYODP) Phase I on youths’ average weekly earnings. The study compared the wages of employed youth who were matched to employment through DSYODP with the wages of employed youth who were eligible for the DSYODP but had secured employment through other means. The study found that average weekly wages of youth matched to employment through DSYODP were significantly higher than wages of youth who secured employment through other means. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the DSYODP; however, other factors might also have contributed.","Demand-Side Youth Offender Demonstration Project (DSYODP)","Job search assistance and supportive services Youth programs","Youth, Justice-involved, Disconnected youth",,"United States",2008,https://wdr.doleta.gov/research/FullText_Documents/Process%20Evaluation%20of%20…,"Opportunities for Youth Review Protocol" "The outcomes of policies designed to eliminate discrimination","Choe, C. (2008). The outcomes of policies designed to eliminate discrimination (Doctoral dissertation). University of Arizona.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Unfavorable impacts Earnings and wages Employment-Low-Unfavorable impacts Employment","Summary: The study’s objective was to examine the impact of the Americans with Disabilities Act (ADA) of 1990 on the employment and wages of men with disabilities relative to men without disabilities. The study used data from the Survey of Income and Program Participation (SIPP) from 1984, 1990, 1996, and 2001. The analysis attempted to determine how much of the difference in wages between men with and without disabilities was explained by background characteristics and how much was not; the portion that was not was interpreted as the effect of discrimination. The study found that neither the employment nor wages of men with disabilities improved relative to men without disabilities following passage of the ADA. Instead, employment and wage differentials both increased. However, the unexplained portion of the wage gap narrowed significantly after the ADA, consistent with a decrease in discrimination, among other explanations. The quality of causal evidence presented in this report is low because the author did not establish the comparability of men with and without disabilities before passage of the ADA. This means we are not confident that the estimated effects are attributable to the ADA. Other factors are likely to have contributed.","the Americans with Disabilities Act of 1990","Americans with Disabilities Act (ADA)","Disability, Male",,"United States",2008,,"Employer Compliance Review Protocol" "State age protection laws and the Age Discrimination in Employment Act.","Lahey, J. State age protection laws and the Age Discrimination in Employment Act. (2008). The Journal of Law and Economics, 51(3), 433-460.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-Unfavorable impacts Employment","Summary: The study examined the impact of enforcement of age discrimination laws on the employment and earnings of older male workers The author used a nonexperimental regression model and data from the Current Population Survey to estimate the impact. The study found that males older than 50 in states with age discrimination laws were 0.2 percentage points less likely to be hired compared with those in states without their own age discrimination laws. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the state laws on age discrimination, but other factors might also have contributed.","Age Discrimination Employment Act (ADEA)","Older workers' programs Other disparities or discrimination in employment and earnings","Adult, Older worker, Male",,"United States",2008,https://www.jstor.org/stable/10.1086/589670?seq=1#page_scan_tab_contents,"Employment and Training Review Protocol" "Rehabilitation of traumatic brain injury in active duty military personnel and veterans: Defense and Veterans Brain Injury Center randomized controlled trial of two rehabilitation approaches","Vanderploeg, R., Schwab, K., Walker, W., Fraser, J., Sigford, B., Date, E., . . . Warden, D. (2008). Rehabilitation of traumatic brain injury in active duty military personnel and veterans: Defense and Veterans Brain Injury Center randomized controlled trial of two rehabilitation approaches. Archives of Physical Medicine and Rehabilitation, 89(12), 2227-2237.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-No impacts Employment Education and skills gains-Mod/high-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of two treatments—cognitive-didactic rehabilitation and functional-experiential rehabilitation—on return to work/school and functional independence among veterans and active military with traumatic brain injury (TBI). The study used a randomized controlled trial design in which 366 active duty military service members or veterans with moderate-to-severe TBI were randomly assigned to receive either cognitive-didactic rehabilitation, which focuses on addressing cognitive deficits, or functional-experiential rehabilitation, which emphasizes performance of real-life tasks. Primary outcomes were measured using in-person evaluations or structured telephone interviews. The study found no significant differences in return to work or school or functional independence between the two types of rehabilitation. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects would be attributable to the difference between the cognitive-didactic and functional-experiential treatments and not to other factors. However, the study did not find statistically significant effects between the two treatments.","Cognitive-Didactic and Functional-experiential rehabilitation","Vocational rehabilitation Veterans' reemployment","Disability, Veteran or military",,"United States",2008,,"Disability Employment Policy Review Protocol" "The effect of the social security earnings test on male labor supply: New evidence from survey and administrative data.","Haider, S. J., & Loughran, D. S. (2008). The effect of the social security earnings test on male labor supply: New evidence from survey and administrative data. Journal of Human Resources, 43(1), 57-87.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Mixed impacts Earnings and wages Employer benefits receipt-Low-Favorable impacts Employer benefits receipt","Summary: The study’s objective is to examine the impact of 1983 and 2000 policy changes that removed the Social Security earnings test for certain age groups on the earnings and employment outcomes of affected men The study is a nonexperimental analysis that examines the correlations between the 1983 and 2000 policy changes and earnings and employment status. The study compares the outcomes of men affected by the policy changes with the outcomes of men of similar ages not affected by the policy changes. The study finds that the 1983 policy change is associated with few changes to the observed outcomes and that the 2000 policy change is associated with higher earnings and hours worked per week for affected men. The quality of causal evidence presented in this report is low because the study does not demonstrate that men affected by the policy changes are similar to the men not affected by the policy change, nor does it control for possible differences. This means we are not confident that the estimated effects are attributable to the 1983 and 2000 policy changes; other factors are likely to have contributed.","Social Security Earnings Test","Federal retirement benefits Older workers' programs","Adult, Older worker, Male",,"United States",2008,http://jhr.uwpress.org/content/43/1/57.refs,"Employment and Training Review Protocol" "Supported employment for middle-aged and older people with schizophrenia.","Twamley, E., Narvaez, J., Becker, D., Bartels, S., & Jeste, D. (2008). Supported employment for middle-aged and older people with schizophrenia. American Journal of Psychiatric Rehabilitation, 11(1), 76-89.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study examined the impact of Individual Placement and Support (IPS) on competitive employment for older people with schizophrenia The study was a randomized controlled trial (RCT) and used weekly work logs cross-referenced with pay stubs to measure employment outcomes over a 12-month period. The study found that IPS increased competitive employment and earnings compared with conventional services. The quality of causal evidence presented in this report is low because the RCT has a confounding factor. This means we are not confident that the estimated effects are attributable to the IPS program; other factors are likely to have contributed.","Individual Placement and Support and Vocational Rehabilitation Program","Health Individuals facing barriers to employment Job search assistance and supportive services","Adult, Older worker, Disability",,"United States",2008,https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2638571/,"Employment and Training Review Protocol" "Improving employment outcomes of individuals with disabilities through short-term postsecondary training","Flannery, K. B., Yovanoff, P., Benz, M. R., & Kato, M. M. (2008). Improving employment outcomes of individuals with disabilities through short-term postsecondary training. Career Development for Exceptional Individuals, 31(1), 26-36.","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of an occupational skills training program on employment and earnings outcomes. The study used statistical methods to compare the outcomes of people who successfully completed the occupational skills training program with the outcomes of a comparison group of people who dropped out of the program during the same period. The authors used data from the Oregon State Employment Division, the Oregon Office of Vocational Rehabilitation Services, and a database housed at the occupational skills training site. The study found that participants who successfully completed the occupational skills training program had a higher employment rate, worked more hours, and had higher earnings than those who dropped out of the program. The quality of causal evidence provided in this study is low because the authors did not ensure that the groups being compared were similar before the intervention.","the occupational skills training program","Work based and other occupational training",Disability,,"United States",2008,https://doi.org/10.1177%2F0885728807313779,"Employment and Training Review Protocol" "An experimental evaluation of teen courts","Stickle, W., Connell, N., Wilson, D., & Gottfredson, D. (2008). An experimental evaluation of teen courts. Journal of Experimental Criminology, 4(2), 137-163.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence",,"Summary: The study’s objective was to examine the impact of participation in a teen court on youth offenders’ rates of recidivism. The study was a randomized controlled trial in which eligible youth were randomly assigned to either the treatment group, which participated in a teen court, or to the control group, which participated in the traditional juvenile justice system. The authors compared outcomes for the two groups using administrative data. The study reported no differences in recidivism outcomes for teen court youth and those in the traditional juvenile justice system. The quality of causal evidence presented in this report is moderate for some outcomes and low for other outcomes. This means we have little confidence that any estimated effects would be attributable to the teen court program. However, the study did not find statistically significant effects.","Teen Court","Youth programs","Youth, Justice-involved, Disconnected youth",,"United States",2008,,"Opportunities for Youth Review Protocol" "Rapid employment model evaluation: Update","Smith, T. C., King, C. T., & Schroeder, D. G. (2008). Rapid employment model evaluation: Update. Austin, TX: Ray Marshall Center for the Study of Human Resources.",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Rapid Employment Model (REM) program on participants’ employment, earnings, and Unemployment Insurance (UI) benefit claims. (See the CLEAR review of the 2010 report here.) Using program data and state UI records, the authors matched treatment group cases to comparison group cases and conducted regression analyses to estimate the effect of the intervention. The study found that participation in the REM program was associated with an increase in the likelihood that jobseekers were employed in quarters following program participation. The quality of causal evidence presented in this report is moderate for employment and earnings outcomes because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects on employment and earnings are attributable to the REM program, but other factors might also have contributed. The quality of causal evidence presented for the UI benefit claiming outcome is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects on UI benefit claiming outcome are attributable to REM program; other factors are likely to have contributed.","Rapid Employment Model (REM) Program","Job search assistance and supportive services Other training and education Unemployment Insurance","Justice-involved, Low-skilled, Low income",,"United States",2008,http://sites.utexas.edu/raymarshallcenter/files/2008/12/REM_eval_update_01-28-0…,"Review Protocol" "Workforce program performance indicators for the Commonwealth of Virginia. (Upjohn Institute Technical Report No. 08-024). [DBVI]","Hollenbeck, K., & Huang, W-J. (2008). Workforce program performance indicators for the Commonwealth of Virginia. (Upjohn Institute Technical Report No. 08-024). Kalamazoo, MI: W.E. Upjohn Institute for Employment Research. [DBVI]",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Vocational Rehabilitation program administered by the Department for Blind and Vision Impaired (DBVI) on participants’ employment and credential completion. The study used administrative records to compare the outcomes of low-income adults who took part in the DBVI program with outcomes of a nonexperimental matched group of adults who did not take part in the program. The study found that DBVI participants had higher employment and credential completion rates compared with those of people who did not participate in the program. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups compared were similar before program participation. This means we are not confident that the estimated effects are attributable to DBVI; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Vocational Rehabilitation (VOC) Programs","Supported employment or other employment supports Vocational rehabilitation","Disability, Low income",,"United States",2008,http://research.upjohn.org/cgi/viewcontent.cgi?article=1027&context=up_technica…,"Review Protocol" "Evaluation of seven Second Chance Act Adult Demonstration Programs: Impact findings at 30 months","D'Amico, R., & Kim, H. (2008). Evaluation of seven Second Chance Act Adult Demonstration Programs: Impact findings at 30 months. Oakland, CA: Social Policy Research Associates. Retrieved from the National Criminal Justice Reference Service website: https://www.ncjrs.gov/pdffiles1/nij/grants/251702.pdf.",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine the impact of the Second Chance Act (SCA) Adult Demonstration Program on employment, earnings, and recidivism. The study was a randomized controlled trial involving a sample of people recently or soon to be released from incarceration. The primary data sources included administrative data on employment and earnings from the National Directory of New Hires, state and local corrections records of recidivism, and 18-month follow-up survey data on employment, earnings, and recidivism. The authors used a statistical model to compare the outcomes of treatment and control group members, both overall and among groups with higher and lower risk of recidivism. The study found that the SCA program had no impacts on earnings, employment, or recidivism. Further, several recidivism outcomes from the administrative data sources demonstrated an increase in crime or crime-related activities. Among those in the sample at lower risk for recidivism, the study found that the program was associated with a larger number of reconvictions 30 months after random assignment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects for the full sample would have been attributable to the SCA Adult Demonstration Program and not to other factors had the study found statistically significant effects. The quality of causal evidence of the analyses by risk-level is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects for the risk subgroups are attributable to the SCA Adult Demonstration Program; other factors are likely to have contributed.","the Second Chance Act (SCA) Adult Demonstration Program","Health Reentry Other training and education",Justice-involved,,"United States",2008,https://www.ncjrs.gov/pdffiles1/nij/grants/251702.pdf,"Employment and Training Review Protocol" "The impact of reentry services on juvenile offenders’ recidivism","Bouffard, J., & Bergseth, K. (2008). The impact of reentry services on juvenile offenders’ recidivism. Youth Violence and Juvenile Justice, 6(3), 295-318.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: The study examined the impact of structured after-care and reentry services for justice-involved youth on their recidivism rates. The study used a nonexperimental design to compare youth who received reentry services to a comparison group of youth who received traditional services in a neighboring county. Data came from the local juvenile court databases, probation and transitional coordinator files, and electronic records used by case managers to track client contacts. The study found that there were no statistically significant differences between study groups in time to first reoffense or in number of criminal contacts with the justice system. The quality of causal evidence presented in this report is low because all treated youth were in one county and all comparison youth were in another. This means we are not confident that the estimated effects are attributable to the after-care and reentry program; other factors are likely to have contributed.","After-care and Reentry Services","Mentoring Reentry Youth programs","Youth, Justice-involved, Disconnected youth",,"United States, Rural",2008,,"Opportunities for Youth Review Protocol" "Evaluation of the Suffolk County juvenile treatment court: Process and impact findings","Kralstein, D. (2008). Evaluation of the Suffolk County juvenile treatment court: Process and impact findings. New York: Center for Court Innovation.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: The study’s objective was to examine the impact of Suffolk County’s juvenile drug court on recidivism. The study used propensity scores based on state and county administrative records to match juveniles who participated in the drug court to similar juveniles in the year before the introduction of the drug court. The author used regression analysis to estimate the relationship between participation in the juvenile drug court and the number and rate of arrests 18 and 24 months following the initial petition. The study found no statistically significant relationship between the juvenile drug court and recidivism. The quality of causal evidence presented in this report is low because the study did not account for other changes that could have taken place at the same time as the introduction of the drug court and affected juvenile recidivism. This means we are not confident that any estimated effects would be attributable to the juvenile drug court, and not other factors. However, the study found no statistically significant effects.","Suffolk County’s Juvenile Drug Court","Reentry Substance abuse recovery Youth programs","Youth, Justice-involved, Disconnected youth",,"United States",2008,http://www.courtinnovation.org/sites/default/files/Suffolk_JTC.pdf,"Opportunities for Youth Review Protocol" "Effectiveness of supported employment for individuals with schizophrenia: Results of a multi-site, randomized trial","Cook, J., Blyler, C., Burke-Miller, J., McFarlane, W., Leff, H., Mueser, K., Gold, P., Goldberg, R., Shafer, M., Onken, S., Donegan, K., Carey, M., Razzano, L., Grey, D., Pickett-Schenk, S., & Kaufmann, C. (2008). Effectiveness of supported employment for individuals with schizophrenia: Results of a multi-site, randomized trial. Clinical Schizophrenia & Related Psychoses, 37-46.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to estimate the 24-month employment effects of supported employment interventions on people with severe mental illness, focusing on those with schizophrenia. Supported employment interventions use a combination of employment and health services and supports to improve employment and other outcomes. The authors analyzed data from seven sites, each of which implemented a distinct supported employment intervention using a randomized controlled trial. At each site, researchers interviewed participants in person twice yearly and collected weekly employment data. The study found that the programs were effective at improving 24-month employment outcomes for people with severe mental illness. Relative to treatment group members with different severe mental illnesses, people with a diagnosis of schizophrenia who received supported employment services were more likely to be employed after receiving those services. The quality of causal evidence provided in this study is moderate. This means we are somewhat confident that the estimated effects are attributable to the supported employment interventions, but other factors might also have contributed.","Supported Employment Programs","Health Job search assistance and supportive services Supported employment or other employment supports",Disability,,"United States",2008,,"Disability Employment Policy Review Protocol" "Learning better together: The impact of learning communities on the persistence of low-income students","Engstrom, C., & Tinto, V. (2008). Learning better together: The impact of learning communities on the persistence of low-income students. Opportunity Matters: A Journal of Research Informing Educational Opportunity Practice and Programs, 1(1), 5-21.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of learning communities on community college students’ persistence from freshman to sophomore year, an outcome in the progress toward degree completion domain. The authors used a nonrandom approach to select treatment and comparison students to include in their analysis. To measure the relationship between participation in a learning community and persistence, the authors used survey and administrative data from 13 community colleges to estimate a logistic regression. The study found that 62 percent of learning community students persisted from freshman to sophomore year, compared with 57 percent of comparison group students. This difference was statistically significant. The quality of causal evidence presented in this report is low because the authors did not use sufficient controls in their analysis. This means we are not confident that the estimated effects are attributable to learning communities. Other factors are likely to have contributed.","Learning Communities","Community college education and other classroom training Basic skills","Adult, Other barriers, Low income",,"United States",2008,,"Community College Review Protocol" "Evaluation of customized employment in building the capacity of the workforce development system","Elinson, L., Frey, W. D., Li, T., Palan, M. A., & Horne, R. L. (2008). Evaluation of customized employment in building the capacity of the workforce development system. Journal of Vocational Rehabilitation, 28(3), 141-158.","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Unfavorable impacts Earnings and wages Employment-Low-Unfavorable impacts Employment","Summary: The study’s objective was to examine the impact of customized employment services for disabled adults on earnings and employment. Using administrative data, the authors compared employment and earnings outcomes of people who participated in a customized employment intervention with outcomes of people who participated in a Working for Freedom, Opportunity, and Real Choice through Community Employment (WorkForce) intervention. The study found that those in the customized employment intervention were more likely to be employed for at least 12 months and to earn at least $8.15 per hour after participating in the intervention compared with the WorkForce group. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the WorkForce intervention; other factors are likely to have contributed.","the customized employment services","Job search assistance and supportive services Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA)",Disability,,"United States",2008,https://content.iospress.com/articles/journal-of-vocational-rehabilitation/jvr0…,"Employment and Training Review Protocol" "Workforce program performance indicators for the Commonwealth of Virginia. (Upjohn Institute Technical Report No. 08-024). [DRS]","Hollenbeck, K., & Huang, W-J. (2008). Workforce program performance indicators for the Commonwealth of Virginia. (Upjohn Institute Technical Report No. 08-024). Kalamazoo, MI: W.E. Upjohn Institute for Employment Research. [DRS]",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Vocational Rehabilitation program administered by Department of Rehabilitative Services (DRS) on participants’ employment and credential completion. The study used administrative records to compare the outcomes of low-income adults who took part in the DRS program with outcomes of a nonexperimental matched group of adults who did not take part in the program. The study found that DRS participants had higher employment and credential completion rates compared with those of people who did not participate in the program. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups compared were similar before program participation. This means we are not confident that the estimated effects are attributable to DRS; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies","the Vocational Rehabilitation (VOC) Programs","Job search assistance and supportive services Vocational rehabilitation","Disability, Low-skilled, Low income",,"United States",2008,http://research.upjohn.org/cgi/viewcontent.cgi?article=1027&context=up_technica…,"Review Protocol" "Evaluation of the Boys & Girls Clubs of America Targeted Re-Entry Initiative","Barton, W., Jarjoura, G., & Rosay, A. (2008). Evaluation of the Boys & Girls Clubs of America Targeted Re-Entry Initiative. Indianapolis: Indiana University School of Social Work, and Anchorage: Justice Center, University of Alaska Anchorage.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: The study’s objective was to examine the impact of the Boys & Girls Clubs of America’s Targeted Re-Entry Initiative on youth’s recidivism. The authors used administrative data to match Initiative participants to a comparison group of nonparticipants released from the same rehabilitation facilities. The authors compared recidivism rates among program participants and the comparison group. The authors reported a statistically significant relationship between participation in the Targeted Re-Entry Initiative and higher rates of re-arrest at one of the three sites studied, and no statistically significant correlations at the other two sites. The quality of causal evidence presented in this report is low because the authors did not include sufficient controls for pre-existing differences between the study groups in their analysis. This means we are not confident that the estimated effects are attributable to the Boys & Girls Clubs of America Targeted Re-Entry Initiative; other factors are likely to have contributed.","the Boys & Girls Clubs of America Targeted Re-Entry Initiative","Basic skills Health Job search assistance and supportive services Other training and education Reentry Substance abuse recovery Youth programs Behavioral Interventions","Youth, Justice-involved, Disconnected youth",,"United States",2008,http://justice.uaa.alaska.edu/research/2000/0411.targeted_reentry/0411.05.targe…,"Opportunities for Youth Review Protocol" "How did the elimination of the US earnings test above the normal retirement age affect labour supply expectations?","Michaud, P., & Van Soest, A. (2008). How did the elimination of the US earnings test above the normal retirement age affect labour supply expectations? Fiscal Studies, 29(2), 197-231. doi:10.1111/j.1475-5890.2008.00073.x","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The authors used a nonexperimental approach and the data from Health and Retirement Study data from 1996 to 2002 and Social Security earnings history to estimate the impact. The study examined the impact of repealing the earnings test from Social Security recipients between full retirement age and age 70 on older workers’ subjective probability of retirement. The authors used a nonexperimental approach and the data from Health and Retirement Study data from 1996 to 2002 and Social Security earnings history to estimate the impact. The study found that after the repeal of the earnings test, the subjective probability of working of full-time past age 65 for older male workers who were likely to have most of their projected Social Security benefits reduced under the earnings test has increased their expected probability of working relative to those who were not likely to be affected. •The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design.This means we are somewhat confident that the estimated effects are attributable to the repeal of the earnings test, but other factors might also have contributed.","Social Security Earnings Test","Federal retirement benefits Older workers' programs","Adult, Older worker, Male",,"United States",2008,,"Employment and Training Review Protocol" "Labor market shocks and retirement: Do government programs matter?","Coile, C., & Levine, P. (2007). Labor market shocks and retirement: Do government programs matter? Journal of Public Economics, 91(10), 1902-1919.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-No impacts Employment Public benefits receipt-Low-No impacts Public benefit receipt","Summary: The study examined the impact of the generosity of unemployment insurance (UI) benefits on retirement decisions. The study used a statistical model and data from the March Current Population Survey for 1980–2004 to estimate impacts. The study found no relationship between the generosity of UI benefits and the likelihood of retirement or receipt of UI. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before changes in the generosity of UI benefits were observed. This means we are not confident that the estimated effects are attributable to changes in the generosity of UI benefits; other factors are likely to have contributed.","Unemployment Insurance (UI)","Unemployment Insurance","Adult, Older worker, Unemployed",,"United States",2007,http://academics.wellesley.edu/Economics/Coile/PDF%20files/coile-levine%20JPubE…,"Employment and Training Review Protocol" "Initial impacts of the Ticket to Work program on Social Security disability beneficiary service enrollment, earnings, and bene","Wittenburg, D., Fraker, T., Stapleton, D., Thornton, C., Gregory, J., & Mamun, A. (2007). Initial impacts of the Ticket to Work program on Social Security disability beneficiary service enrollment, earnings, and benefits. Journal of Vocational Rehabilitation, 27, 129–140.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages","Summary: The study’s objective was to determine the effectiveness of Ticket to Work (TTW), a program designed to enhance the employment services available to Supplemental Security Income (SSI) and Social Security Disability Insurance (SSDI) recipients. The authors analyzed the outcomes of a nationwide sample of 4.7 million SSI and SSDI recipients ages 18 to 57 who would have been eligible for TTW in 2001. The authors used administrative records through 2004 from the Social Security Administration (SSA) and Rehabilitation Services Administration (RSA). The study found that enrollment in employment services increased 0.1 to 0.4 percent in states where TTW was in effect. However, the authors found no evidence of increased earnings as a result of TTW. The quality of the causal evidence presented in this study is moderate, the highest possible rating for nonexperimental designs. This means we have some confidence that the observed effects represent the impact of TTW, although other factors might also have contributed.","Ticket to Work","Disability insurance Supplemental security income (SSI) Vocational rehabilitation",Disability,,"United States",2007,,"Disability Employment Policy Review Protocol" "Evaluation of LA’s HOPE: Ending chronic homelessness through employment and housing—Final report.","Burt, M. (2007). Evaluation of LA’s HOPE: Ending chronic homelessness through employment and housing—Final report. Washington, DC: U.S. Department of Housing and Urban Development and U.S. Department of Labor.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: The study’s objective was to examine the impact of Los Angeles’ Homeless Opportunity Providing Employment (HOPE) program on employment, housing, and income. The study used a quasi-experimental design in which the authors compared participants in the HOPE program with participants in other programs that provided many of the same services but not its specialized housing and employment resources. The authors presented direct comparisons, as well as comparisons that adjusted for the groups’ differences in age, race, mental health diagnoses, and recent experience of homelessness and incarceration. This review was conducted in collaboration with the Employment Strategies for Low-Income Adults Evidence Review (ESER). Because ESER did not report findings for studies that received a low causal evidence rating, the CLEAR profile does not report the findings either. The quality of causal evidence presented in this report is low because the author did not account for differences between members of the program and comparisons groups or show that they were similar when they joined the study. This means we are not confident that the estimated effects are attributable to Los Angeles’ HOPE program; other factors are likely to have contributed.","Los Angeles’ Homeless Opportunity Providing Employment (HOPE)","Other employment and reemployment","Low income, Homeless, Disability",,"United States",2007,http://www.urban.org/sites/default/files/alfresco/publication-pdfs/411631-Evalu…,"Employment and Training Review Protocol" "Prison-based education and reentry into the mainstream labor market","Tyler, J. H., & Kling, J. R. (2007). Prison-based education and reentry into the mainstream labor market. In D. Weiman & S. D. Bushway (Eds.), Barriers to reentry?: The labor market for released prisoners in post-industrial America (pp. 227-256). New York: Russell Sage Foundation.",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of obtaining a general education diploma (GED) while in prison from 1994 to 2000 in Florida on male prisoners’ post-incarceration employment, earnings, and recidivism. The authors used a nonexperimental design to compare outcomes for those who obtained a prison-based GED (the treatment group) with those that did not (the comparison group). Drawing on administrative data from the state of Florida and Unemployment Insurance (UI) records, the authors estimated impacts on earnings and compared the means of the two groups for the employment and recidivism outcomes. The study reported no statistically significant findings on earnings in the first and third years after release or on recidivism or employment outcomes. The study found that, in the second year after release, people who obtained a GED in prison earned $114 more per quarter than those who did not; this was a significant difference. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the program and did not eliminate concerns about self-selection into the prison-based GED program. This means we are not confident that the estimated effects are attributable to the prison-based GED program; other factors are likely to have contributed.","Prison-based program to obtain general education diploma (GED)","Reentry Other training and education",Justice-involved,,"United States",2007,https://www.nber.org/papers/w12114,"Employment and Training Review Protocol" "Reentry services: An evaluation of a pilot project in Clay County, MN","Bergseth, K., & McDonald, T. (2007). Reentry services: An evaluation of a pilot project in Clay County, MN. Fargo, ND: North Dakota State University, Department of Criminal Justice and Political Science.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: The study’s objective was to examine the impact of the Reentry Services Project (RSP) on juvenile recidivism. The authors estimated regression models comparing the number of criminal and official contacts with police or the courts, pulled from an electronic Court Services Tracking System, between RSP and comparison group members, controlling for differences in demographics and number of prior charges. The study found that RSP group members had significantly fewer official and criminal contacts than the comparison group one year after release from out-of-home placement. The quality of causal evidence presented in this report is low because the program was implemented in only one county and there was no variation in the implementation of the program over time. This means we are not confident that the estimated effects are attributable to the RSP; other factors are likely to have contributed.","the Reentry Services Project (RSP)","Health Job search assistance and supportive services Reentry Substance abuse recovery Youth programs Behavioral Interventions","Youth, Justice-involved, Disconnected youth",,"United States",2007,http://www.claycountycollaborative.org/projects/RSP%20Final%20Report%202007.pdf,"Opportunities for Youth Review Protocol" "Transitional jobs for ex-prisoners: Early impacts from a random assignment evaluation of the Center for Employment Opportunities (CEO) prisoner reentry program.","Bloom, D., Redcross, C., Zweig, J. & Azurdia, G. (2007). Transitional jobs for ex-prisoners: Early impacts from a random assignment evaluation of the Center for Employment Opportunities (CEO) prisoner reentry program. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the effect of the Neighborhood Work Project (NWP) sponsored by the Center for Employment Opportunities (CEO) on the employment outcomes of former prisoners. The study was a randomized controlled trial. The authors used administrative data from the program and state data systems to compare the outcomes of former prisoners who had been randomly assigned to the NWP with those of former prisoners who were randomly assigned to a control group that received basic employment services. The study found that those assigned to the NWP were more likely than the control group to be employed in all four quarters during the year after the program and were more likely to be employed in the program’s worksite project in the fourth quarter after the program. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the CEO NWP’s transitional job services and not to other factors.","the Center for Employment Opportunities’ Neighborhood Work Project (NWP)","Other employment and reemployment Reentry",Justice-involved,,"United States",2007,http://www.acf.hhs.gov/sites/default/files/opre/transitional_jobs.pdf,"Employment and Training Review Protocol" "Long-Term Employment Trajectories Among Participants With Severe Mental Illness in Supported Employment","Becker, Deborah, Whitley, Rob, Bailey, Edward, & Drake, Robert. (2007). Long-Term Employment Trajectories Among Participants With Severe Mental Illness in Supported Employment. Psychiatric Services, 58, 922-928.","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: This exploratory study reinterviewed 38 participants in two supported employment studies 8 to 12 years later to examine their long-term employment trajectories. Both groups were adults with psychiatric disabilities who had participated in one of the earlier studies of individual placement and support services. Quantitative and qualitative analyses of data from the semistructured surveys were conducted, using a grounded theory approach. The study found positive employment trajectories; all 38 participants worked at least one job during the follow-up period, a great majority in competitive jobs, and 71 percent worked for more than half of the follow-up years. A great majority also continued to receive benefits at the time of the follow-up: 34 (89 percent) were receiving Social Security, 10 (26 percent) received Supplemental Security Insurance, and 28 (74 percent) received Social Security Disability Income. Three themes emerged from the qualitative analysis: (1) the persistent and pervasive nature of participants’ psychiatric problems, the importance of successful management of symptoms, and the deployment of appropriate coping skills in finding and maintaining work; (2) a strong preference by participants for part-time work because of the lesser demands and the ability to maintain Social Security and health care entitlements; and (3) the importance expressed by participants of ongoing individual placement and support services.",,"Disability insurance Supplemental security income (SSI) Supported employment or other employment supports",Disability,,"United States",2007,,"Disability Employment Policy Review Protocol" "The effects of an experimental intensive juvenile probation program on self-reported delinquency and drug use","Lane, J., Turner, S., Fain, T., & Sehgal, A. (2007). The effects of an experimental intensive juvenile probation program on self-reported delinquency and drug use. Journal of Experimental Criminology, 3(3), 201-219.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence",,"Summary: The study’s objective was to examine the impact of the South Oxnard Challenge Project (SOCP), an alternative juvenile probation program, on delinquency and drug use. The study was a randomized controlled trial. Eligible youth were randomly assigned to either a treatment group, which could participate in SOCP, or a control group, which had routine juvenile probation. The study found that significantly more SOCP youth than youth in the control group reported committing a violent crime in the 12 months after starting probation (67.6 versus 55.6 percent). However, SOCP youth indicated they used ecstasy/MDMA less frequently than control youth in the past 30 days (1.8 versus 4.2 days). The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the SOCP, and not to other factors.","South Oxnard Challenge Project (SOCP)","Substance abuse recovery Youth programs Behavioral Interventions","Youth, Justice-involved, Disconnected youth",,"United States",2007,,"Opportunities for Youth Review Protocol" "Can SSDI and SSI beneficiaries with mental illness benefit from evidence-based supported employment?","Bond, G., Xie, H., & Drake, R. (2007). Can SSDI and SSI beneficiaries with mental illness benefit from evidence-based supported employment? Psychiatric Services, 58(11), 1412-1420.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to determine whether supported employment programs improved employment outcomes for Social Security Disability Insurance (SSDI) and Supplemental Security Income (SSI) recipients with psychiatric disabilities. Supported employment interventions use a combination of employment and health services and supports to improve employment and other outcomes. This study aggregated data from randomized controlled trials in four sites: New Hampshire, Connecticut, Illinois, and Washington, D.C. Study data sources included baseline interviews and 18-month follow-up data from each site. The study found that, across all recipient types, the programs increased the probability of employment, the number of weeks worked, and the number of weeks worked at a single job by a statistically significant margin. The quality of causal evidence provided in this study is low. This means that we cannot be confident that the estimated effects are attributable to the support employment interventions; other factors are likely to have contributed.","Supported Employment Programs","Disability insurance Supplemental security income (SSI) Supported employment or other employment supports",Disability,,"United States",2007,,"Disability Employment Policy Review Protocol" "Compensation of veterans with psychiatric or substance abuse disorders and employment and earnings","Greenberg, G. A., & Rosenheck, R. A. (2007). Compensation of veterans with psychiatric or substance abuse disorders and employment and earnings. Military Medicine, 172(2), 162-168.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Unfavorable impacts Employment","Summary: The study’s objective was to examine the impact of the Veterans Affairs (VA) Compensation Program on employment for veterans with service-connected disabilities. This study compared employment outcomes for two groups of veterans: (1) disabled veterans receiving VA compensation and (2) nondisabled veterans not receiving disability compensation. To do this, the study team combined data from two national surveys: the Survey of Disabled Veterans and the National Survey of Veterans. Veterans receiving benefits of more than $800 per month from the VA Compensation Program were significantly less likely to be employed than were nondisabled veterans. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the VA Compensation Program; other factors likely contributed to the findings.","the VA Compensation Program","Disability insurance Veterans' reemployment","Disability, Veteran or military",,"United States",2007,https://academic.oup.com/milmed/article/172/2/162/4578021,"Employment and Training Review Protocol" "A tax on work for the elderly: Medicare as a secondary payer.","Goda, G. S., Shoven, J. B., & Slavov, S. N. (2007). A tax on work for the elderly: Medicare as a secondary payer. (NBER Working Paper No. 13383). Cambridge, MA: National Bureau of Economic Research.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of Medicare as a Secondary Payer (MSP) on older workers’ labor force participation and full-time employment The study used a nonexperimental regression design. The authors used data from the 1980 to 2006 March Supplement of the Current Population Survey. The study found that labor force participation for older males increased following the enforcement of the MSP policy, and that older males and females in the labor force were more likely to be employed full time after the policy was enforced. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention, and confounding factors could have impacted older workers differentially during the time periods examined. This means we are not confident that the estimated effects are attributable to MSP; other factors are likely to have contributed.","Medicare as a Secondary Payer","Federal retirement benefits Older workers' programs","Adult, Older worker",,"United States",2007,https://www.nber.org/papers/w13383,"Employment and Training Review Protocol" "Developing core skills in the major","Arcario, P., Clark, J., & Klages, M. (2007). Developing core skills in the major. In M. Smith & B. Williams (Eds.), Learning communities and student affairs: Partnering for powerful learning. Olympia, WA: Washington Center for Improving the Quality of Undergraduate Education, Evergreen State College.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of participation in one of three first-year academies (Allied Health, Business/Technology, or Liberal Arts) on course failure rates and course attrition rates at LaGuardia Community College in New York City. The study design was unclear: the authors might have used a pre-post design or a simple mean comparison. The authors did not specify the data source.  The study found that failure rates in basic skills and discipline-area courses declined by 7.7 percent for academy students, and attrition in basic skills and discipline-area courses declined by 8 percent for academy students. The authors did not report information on the statistical significance of these findings. The quality of causal evidence presented in this report is low because the authors did not establish that there were no observable differences between the treatment and comparison groups at baseline nor did they adjust for any differences. This means we are not confident that the estimated effects are attributable to first-year academies. Other factors are likely to have contributed.","First-Year Academies","Basic skills Community college education and other classroom training","Adult, Other barriers",,"United States",2007,,"Community College Review Protocol" "Implementation of supported employment for homeless veterans with psychiatric or addiction disorders: Two-year outcomes","Rosenheck, R. A., & Mares, A. S. (2007). Implementation of supported employment for homeless veterans with psychiatric or addiction disorders: Two-year outcomes. Psychiatric Services, 58(3), 325-333.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study examined the impact a newly implemented Individual Placement and Support (IPS) program had on employment and earnings outcomes of homeless veterans who were diagnosed with a psychiatric or substance abuse problem. The study team compared raw and adjusted outcome data for veterans who received IPS services and veterans who did not. The team used study participant interviews, activity logs, and employer contacts as data sources. The study found a statistically significant relationship between participation in the IPS program and competitive employment. The quality of causal evidence presented in this report is low because the data on the two groups were not collected at the same time. This means we are not confident that the estimated effects are attributable to the IPS program; other factors are likely to have contributed.","Individual Placement and Support (IPS)","Substance abuse recovery Job search assistance and supportive services Veterans' reemployment","Other barriers, Veteran or military, Homeless",,"United States",2007,https://ps.psychiatryonline.org/doi/full/10.1176/ps.2007.58.3.325,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: Results from the Personal Roads to Individual Development and Employment (PRIDE) program in New York City","Bloom, D., Miller, C., and Azurdia, G. (2007). The Employment Retention and Advancement project: Results from the Personal Roads to Individual Development and Employment (PRIDE) program in New York City. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Unfavorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Personal Roads to Individual Development and Employment (PRIDE) welfare-to-work program in New York City on the employment, earnings, and public benefits receipt of low-income single parents with physical or mental health problems that limited their ability to work. The study was a randomized controlled trial that used data from administrative records for the two years following assignment and a survey conducted with a random subset of the sample to assess outcomes one year after assignment. The study found that treatment group participants were significantly more likely than control group participants to have had a job and had higher average earnings. The treatment group was significantly less likely to receive cash assistance and received lower amounts of cash assistance benefits than the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to PRIDE and not to other factors.","Personal Roads to Individual Development and Employment (PRIDE)","Other employment and reemployment","Disability, Low income, Parent",,"United States, Urban",2007,http://www.acf.hhs.gov/sites/default/files/opre/era_pride.pdf,"Employment and Training Review Protocol" "Correctional industries preparing inmates for re-entry: Recidivism & post-release employment","Smith, C. J., Bechtel, J., Patrick, A., Smith, R. R., & Wilson-Gentry, L. (2006). Correctional industries preparing inmates for re-entry: Recidivism & post-release employment. (Report No. 214608). Washington, DC: U.S. Department of Justice. [Comparison between PIECP and other-than-work activities]",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: This study examines the effectiveness of a specific prison work program called Prison Industry Enhancement Certification Program (PIECP) on employment, earnings, and recidivism after release. The authors investigated similar research questions for another contrast, the profile of which is available here. The authors used a nonexperimental study design and administrative data to compare employment, earnings, and recidivism outcomes of the PIECP group with those of a comparison group of similar people who did not participate in prison work activities. The study found that PIECP was associated with more employment, greater earnings, and less recidivism compared with the outcomes of those who did not participate in prison work activities. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the PIECP; other factors are likely to have contributed.","Prison Industry Enhancement Certification Program (PIECP)","Reentry Other training and education",Justice-involved,,"United States",2006,https://emoglen.law.columbia.edu/twiki/pub/AmLegalHist/SaarWarnerProject/214608…,"Employment and Training Review Protocol" "Final evaluation report of the SSI Work Incentives Demonstration Project","Kregel, J. (2006). Final evaluation report of the SSI Work Incentives Demonstration Project. Richmond, VA: State Partnership Systems Change Initiative Project Office, Virginia Commonwealth University.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The study’s objective was to measure employment and earnings impacts for the four State Partnership Initiative (SPI) sites that implemented the Supplemental Security Income (SSI) Work Incentives Demonstration Project, also known as the SSI Waiver Demonstration Project. The author compared the outcomes of SSI Waiver Demonstration Project participants with those of nonparticipants using data from SPI project offices and Unemployment Insurance (UI) administrative records. The study found that during the intervention delivery period, SSI Waiver Demonstration Project participants’ earnings increased relative to (1) people at the same sites who chose not to participate in the demonstration and (2) people at other SPI sites that did not implement the demonstration. The quality of the causal evidence presented in this report is low because the study was a nonexperimental analysis that did not include adequate controls for underlying differences between the groups being compared. This means we are not confident that the estimated effects are attributable to the SSI Waiver Demonstration Project. Other factors are likely to have contributed.","the SSI Work Incentives Demonstration Project","Supplemental security income (SSI)",Disability,,"United States",2006,http://www.google.com/url?sa=t&rct=j&q=&esrc=s&frm=1&source=web&cd=1&cad=rja&ua…,"Disability Employment Policy Review Protocol" "Juvenile drug court: Enhancing outcomes by integrating evidence-based treatments.","Henggeler, S., Halliday-Boykins, C., Cunningham, P., Randall, J., Shapiro, S., & Chapman, J. (2006). Juvenile drug court: Enhancing outcomes by integrating evidence-based treatments. Journal of Consulting and Clinical Psychology, 74(1), 42-54.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Health and safety-Mod/high-Favorable impacts Health and safety","Summary: The study’s objective was to examine the marginal impacts of three layered treatments—drug court hearings, substance abuse therapy, and contingency management counseling—on criminal justice outcomes and positive drug screens among youth in Charleston, South Carolina, diagnosed with substance abuse or dependence. The authors randomly assigned eligible youth to one of three treatment groups—drug court, drug court with multisystemic therapy, or drug court with multisystemic therapy enhanced by contingency management—or to a control group that received typical family court services. The study found no statistically significant differences between the groups on measures of recidivism after one year. However, the study found that participants in the treatment groups reported committing fewer delinquent acts than those in the control groups. Effects on drug screens were mixed. The quality of causal evidence presented in this report is high for recidivism outcomes because they are based on a well-implemented randomized controlled trial but moderate for self-reported delinquency and drug screen outcomes because they had high attrition and the authors demonstrated that the groups being compared had similar baseline characteristics.","the Treatments","Substance abuse recovery Youth programs Behavioral Interventions","Youth, Justice-involved, Disconnected youth",,"United States",2006,,"Opportunities for Youth Review Protocol" "Net impact and benefit-cost estimates of the workforce development system in Washington State. Upjohn Institute technical report no. TR06-020. [Dept. of Services for the Blind]","Hollenbeck, K., & Huang, W. (2006). Net impact and benefit-cost estimates of the workforce development system in Washington State. Upjohn Institute technical report no. TR06-020. Kalamazoo, MI: W. E. Upjohn Institute for Employment Research. [Dept. of Services for the Blind]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Department of Services for the Blind (DSB) program on the employment rate and earnings of low-income adults who are blind. The authors used a nonexperimental method to compare the short-term (3 quarters after program exit) and long-term (9 to 12 quarters after program exit) employment and earnings between those who took part in the DSB program relative to those who were eligible but did not receive these services. The study found that, compared with those who did not receive these services, DSB program participants had significantly higher employment and earnings. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups compared were similar before program participation. This means we are not confident that the estimated effects are attributable to the DSB program; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Department of Services for the Blind (DSB) Program","Unemployment Insurance Vocational rehabilitation",Disability,,"United States",2006,http://research.upjohn.org/cgi/viewcontent.cgi?article=1023&context=up_technica…,"Employment and Training Review Protocol" "Recidivism findings for the Juvenile Rehabilitation Administration’s mentoring program: Final report","Drake, E. (2006). Recidivism findings for the Juvenile Rehabilitation Administration’s mentoring program: Final report. Olympia, WA: Washington State Institute for Public Policy.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence",,"Summary: The study’s objective was to examine the impact of the Washington State Juvenile Rehabilitation Administration’s mentoring program on recidivism. The author estimated the effect of the mentoring program using administrative data to compare outcomes among youth released from a juvenile rehabilitation facility who applied to participate in the program with the outcomes of similar youth who did not apply. The study did not find any statistically significant effects of the mentoring program on recidivism. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that any estimated effects would be attributable to the Washington State Juvenile Rehabilitation Administration’s mentoring program, but other factors might also have contributed. However, the study did not find statistically significant effects.","the Juvenile Rehabilitation Administration’s Mentoring Program","Mentoring Youth programs","Youth, Justice-involved, Disconnected youth",,"United States",2006,http://www.wsipp.wa.gov/ReportFile/947/Wsipp_Recidivism-Findings-for-the-Juveni…,"Opportunities for Youth Review Protocol" "Measuring recidivism in a juvenile drug court: Systematic outcome study of a juvenile drug court using historical information","Pitts, W. (2006). Measuring recidivism in a juvenile drug court: Systematic outcome study of a juvenile drug court using historical information. The Southwest Journal of Criminal Justice, 3(1), 17-34.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: The study’s objective was to evaluate the effect of participating in a juvenile drug court in Farmington, New Mexico, on recidivism. The author used historical data from official court records to compare the recidivism outcomes of youth who participated in the drug court with a comparison group of drug court-eligible youth who did not become drug court clients. The study found that participation in the juvenile drug court program was associated with lower overall recidivism 16 months or later after completion of the program. The quality of causal evidence presented in this report is low because the analysis did not include controls for existing differences between the study groups. This means we are not confident that the estimated effects are attributable to the drug court; other factors likely contributed.","the Juvenile Drug Court Program","Substance abuse recovery Youth programs","Youth, Justice-involved",,"United States",2006,,"Opportunities for Youth Review Protocol" "New evidence on earnings and benefit claims following the changes in the retirement earnings test in 2000.","Song, J. G., & Manchester, J. (2006). New evidence on earnings and benefit claims following the changes in the retirement earnings test in 2000. (ORES Working Paper 107). Washington, DC: Social Security Administration, Office of Policy, Office of Research, Evaluation, and Statistics. Also available in Journal of Public Economics, 91(3–4), 669–700 (2007).","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Low-No impacts Employment Public benefits receipt-Mod/high-Unfavorable impacts Public benefit receipt","Summary: The study examined the impact of the Senior Citizens Freedom to Work Act of 2000 on employment, earnings, and public benefit receipt outcomes of workers ages 65 to 69. The study was a nonexperimental analysis and used Social Security Administrative data to estimate the impacts. The study found that the Senior Citizens Freedom to Work Act of 2000 was associated with significant increases in the rate of Social Security claims for both sets of individuals affected by the law. The study found no statistically significant relationship between the Senior Citizens Freedom to Work Act of 2000 and earnings. The quality of casual evidence presented in this report for Social Security claims and earnings outcomes is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the Senior Citizens Freedom to Work Act of 2000, but other factors might also have contributed. The quality of causal evidence presented in this report on employment is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Senior Citizens Freedom to Work Act of 2000; other factors are likely to have contributed.","Senior Citizens Freedom to Work Act of 2000","Older workers' programs Other disparities or discrimination in employment and earnings","Adult, Older worker",,"United States",2006,,"Employment and Training Review Protocol" "A process and site-specific outcome evaluation of Maine’s adult drug treatment court programs","Ferguson, A., McCole, B., & Raio, J. (2006). A process and site-specific outcome evaluation of Maine’s adult drug treatment court programs. Portland, ME: University of Southern Maine. Retrieved from https://www1.maine.gov/dhhs/samhs/osa/pubs/correct/2006/adultdc06.pdf",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: The study’s objective was to examine the impact of participation in Maine’s adult drug treatment court programs on recidivism. The authors compared the recidivism rates of drug treatment court program participants in five Maine counties with those of adult offenders adjudicated through the traditional process in those same counties. The study generally found that rearrest rates for adults who were assigned to the drug court were lower than those for adults adjudicated through the traditional process. However, the study did not report any tests of the statistical significance of these differences. The quality of causal evidence presented in this report is low because the authors did not control for existing differences between the study groups. This means we are not confident that the estimated effects are attributable to Maine’s adult drug court programs; other factors are likely to have contributed.","Maine’s Adult Drug Treatment Court Programs","Substance abuse recovery",Justice-involved,,"United States",2006,https://www1.maine.gov/dhhs/samhs/osa/pubs/correct/2006/Mjv0306.pdf,"Employment and Training Review Protocol" "Effect of benefits counseling services on employment outcomes for people with psychiatric disabilities","Tremblay, T., Smith, J., Xie, H., & Drake, R. (2006). Effect of benefits counseling services on employment outcomes for people with psychiatric disabilities. Psychiatric Services, 57(6), 816-821.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages","Summary: The studies’ objective was to measure the earnings impacts of the Vermont Work Incentive Initiative (VWII), which provided customized benefits counseling to Social Security disability benefit recipients who were receiving vocational rehabilitation (VR) services. Services offered by the VWII participants varied, but could consist of benefits screening, explanations of work incentives, and case management. The studies used earnings data collected from the Vermont Department of Employment and Training. The treatment groups received VWII services and possibly other VR services, whereas the comparison groups received VR services excluding benefits counseling services. The quasi-experimental evaluation employed matched comparison groups and measured impacts using a mixed-effects linear model. VWII was correlated with significant increases in mean earnings for the treatment group—averaging about $1,250 per year among participants with psychiatric disabilities and about $760 to $900 per year among all participants. These studies receive a low causal evidence rating because they did not adequately demonstrate baseline equivalence between the treatment and comparison groups or control in the analysis for key factors. A low causal evidence rating means that we are not confident that the estimated effects are attributable to the VWII and other factors likely played a role.","the Vermont Work Incentive Initiative","Disability insurance Supplemental security income (SSI) Vocational rehabilitation",Disability,,"United States",2006,,"Disability Employment Policy Review Protocol" "Correctional industries preparing inmates for re-entry: Recidivism & post-release employment","Smith, C. J., Bechtel, J., Patrick, A., Smith, R. R., & Wilson-Gentry, L. (2006). Correctional industries preparing inmates for re-entry: Recidivism & post-release employment. (Report No. 214608). Washington, DC: U.S. Department of Justice. [Comparison between PIECP and traditional prison industries employment]",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: This study examines the effectiveness of a specific prison work program called Prison Industry Enhancement Certification Program (PIECP) on employment and recidivism after release. The authors investigated similar research questions for another contrast, the profile of which is available here. The authors used a nonexperimental study design and administrative data to compare employment and recidivism outcomes of the PIECP group with the outcomes of a comparison group of similar people who worked in traditional prison industries. The study found that PIECP was associated with more employment and less recidivism compared with the outcomes of people who worked in traditional prison industries. The quality of causal evidence presented in this report is low because the authors did not demonstrate that the groups being compared were similar before the program began. This means we are not confident that the estimated effects are attributable to PIECP; other factors are likely to have contributed.","Prison Industry Enhancement Certification Program (PIECP)","Reentry Other training and education",Justice-involved,,"United States",2006,https://emoglen.law.columbia.edu/twiki/pub/AmLegalHist/SaarWarnerProject/214608…,"Employment and Training Review Protocol" "Harford County juvenile drug court performance evaluation: Final report","Crumpton, D., Carey, S., Mackin, J., Finigan, M., Pukstas, K., Weller, J., and Brekhus, J. (2006). Harford County juvenile drug court performance evaluation: Final report. Portland, Oregon. NPC Research, 1-104.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence",,"Summary: The study’s objective was to examine the impact of the Harford County (Maryland) Juvenile Drug Court on recidivism. The authors used administrative records to estimate the impact of the drug court by comparing the outcomes of youth who participated in the drug court with those of similar youth who did not. The study found that drug court participants had significantly fewer rearrests (36 percent fewer) and fewer days (59 percent fewer) on probation than youth who were eligible for the program but did not participate. Participants spent fewer days in secure and community detention in the first year after program entry than youth in the comparison group. However, the study found no significant effects on the number of adjudication hearings, days in residential treatment, or days in a group home. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the Harford County Juvenile Drug Court, but other factors might also have contributed.","Harford County Juvenile Drug Court","Substance abuse recovery Youth programs Behavioral Interventions","Youth, Justice-involved, Disconnected youth",,"United States",2006,http://npcresearch.com/wp-content/uploads/HCJDC_Process_Outcome-Cost-FINAL-repo…,"Opportunities for Youth Review Protocol" "Employment outcomes and PTSD symptom severity","Smith, M., Schnurr, P., & Rosenheck, R. (2005). Employment outcomes and PTSD symptom severity. Mental Health Services Research, 7(2), 89-101.","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: The authors assessed the relationship between male Vietnam-era veterans’ scores on the Clinician-Administered Post-Traumatic Stress Disorder (PTSD) Scale (CAPS), a clinically administered scale of PTSD severity, and their employment and earnings. The authors analyzed a data set containing demographic characteristics, PTSD symptom severity, employment status, and earnings for 325 male Vietnam-era veterans ages 18 to 54. The authors used a multinomial logistic regression framework to estimate the marginal effect of PTSD severity on three categories of employment—no employment, part-time employment, and full-time employment—and a Heckman selection model to estimate effects on earnings. The study found that a 10-point increase in the CAPS score was associated with a 5.9 percentage point increase in the probability of unemployment, a 2.1 percentage point decrease in the probability of part-time employment, and a 3.8 percentage point decrease in the probability of full-time work.",,,"Disability, Veteran or military",,"United States",2005,,"Disability Employment Policy Review Protocol" "Implementation and outcome evaluation of the Intensive Aftercare Program: Final report","Wiebush, R., Wagner, D., McNulty, B., Wang, Y., & Le, T. (2005). Implementation and outcome evaluation of the Intensive Aftercare Program: Final report. National Council on Crime and Delinquency. Washington, DC: U.S. Department of Justice, Office of Justice Programs.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence",,"Summary: The study’s objective was to measure the impact of participation in an Intensive Aftercare Program (IAP) for high-risk youth from juvenile justice facility placements on recidivism. The authors used a random assignment design and multivariate regression analysis to estimate impacts on aggregate recidivism scores, the sum of all subsequent offenses, weighted by severity. Data for the study were collected from standardized forms, surveys, risk assessment tests, and state agency and police records. The study found no statistically significant effects of the program on participants’ aggregate recidivism scores. The quality of causal evidence presented in this report is moderate for some outcomes and low for other outcomes. This means we have little confidence that any estimated effects would be attributable to the IAP. However, the study found few statistically significant effects.","the Intensive Aftercare Program (IAP)","Reentry Youth programs","Youth, Justice-involved, Disconnected youth, Male",,"United States",2005,http://files.eric.ed.gov/fulltext/ED484683.pdf,"Opportunities for Youth Review Protocol" "State Partnership Initiative: Selection of comparison groups for the evaluation and selected impact estimates: Final report","Peikes, D., Orzol, S., Moreno, L., & Paxton, N. (2005). State Partnership Initiative: Selection of comparison groups for the evaluation and selected impact estimates: Final report. Princeton, NJ: Mathematica Policy Research.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Unfavorable impacts Earnings and wages Employment-Mod/high-Unfavorable impacts Employment","Summary: The study’s objective was to measure short-term impacts for the three State Partnership Initiative (SPI) sites whose effectiveness was evaluated using a randomized controlled trial. SPI was meant to increase employment and earnings for Supplemental Security Income (SSI) and Social Security Disability Insurance (SSDI) beneficiaries through the provision of direct services. The study’s data were collected from Social Security Administration (SSA) administrative data and the Summary Earnings Record (SER). The authors estimated program impacts on employment and earnings. The study found that SPI had negative and statistically significant impacts on employment and earnings, contrary to the initiative’s intent. The quality of causal evidence presented in this report is high because it is based on a well-conducted randomized controlled trial. This means we are confident that the effects estimated in the study are attributable solely to the SPI, and not to other factors.","the State Partnership Initiative","Supplemental security income (SSI) Disability insurance",Disability,,"United States",2005,http://www.mathematica-mpr.com/~/media/publications/PDFs/SPIselectimpact.pdf,"Disability Employment Policy Review Protocol" "Participation in Programs Designed to Improve Employment Outcomes for Persons with Psychiatric Disabilities: Evidence from the New York WORKS Demonstration Project","Ruiz-Quintanilla, Antonio S., Weathers II, Robert R., Melburg, Valerie, Campbell, Kimberly, & Madi, Nawaf. (2005). Participation in Programs Designed to Improve Employment Outcomes for Persons with Psychiatric Disabilities: Evidence from the New York WORKS Demonstration Project. Social Security Bulletin, 66(2), 49–79.","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: This study used a sequential response model of conditional probabilities to examine the impact of characteristics of Supplemental Security Income (SSI) recipients on participation in the New York WORKS project. The analysis showed how individual characteristics were related to responses at each of four stages of the program recruitment process and how they contributed to the overall likelihood of enrollment. New York WORKS targeted people with a primary medical diagnosis of psychiatric illness. Characteristics examined in the study for their relationship to completion of enrollment included demographics, psychiatric diagnosis, and past employment and earnings. The study found that the relationship between the characteristics of SSI recipients and the outcomes at each stage of the recruitment process contributed to the overall likelihood of enrollment.",,"Disability insurance Supplemental security income (SSI)",Disability,,"United States",2005,,"Disability Employment Policy Review Protocol" "Results of a multisite randomized trial of supported employment interventions for individuals with severe mental illness","Cook, J., Leff, H., Blyler, C., Gold, P., Goldberg, R., Mueser, K., Toprac, M., McFarlane, W., Shafer, M., Blankertz, L., Dudek, K., Razzano, L., Grey, D., & Burke-Miller, J. (2005). Results of a multisite randomized trial of supported employment interventions for individuals with severe mental illness. Archives of General Psychiatry, 62, 505-512.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to estimate the 24-month employment effects of supported employment on people with severe mental illness. Supported employment interventions use a combination of employment and health services and supports to improve employment and other outcomes.  The authors analyzed data from seven sites, each of which implemented a distinct supported employment intervention using a randomized controlled trial. At each site, researchers interviewed participants in person twice yearly and collected weekly employment data. The supported employment interventions had a significant and positive impact on employment, working for 40 or more hours in a single month, and monthly earnings from paid employment. The quality of causal evidence provided in this study is moderate. This means we are somewhat confident that the estimated effects are attributable to the supported employment interventions, but other factors might also have contributed.","Supported Employment Programs","Health Supported employment or other employment supports Vocational rehabilitation",Disability,,"United States",2005,,"Disability Employment Policy Review Protocol" "An experimental study of the Los Angeles County repeat offender program: Its implementation and evaluation","Zhang, S.X., & Zhang, L. (2005). An experimental study of the Los Angeles County repeat offender program: Its implementation and evaluation. Criminology and Public Policy, 4(2):205–236.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Education and skills gains-Mod/high-Mixed impacts Education and skills gains","Summary: The study examined the impact of the Los Angeles County Repeat Offender Prevention Program (ROPP) on youths’ recidivism and educational outcomes. The authors randomly assigned eligible youth to either the treatment group that received ROPP or a control group that received standard probation services. Using data from the Los Angeles Unified School District and probation records, the authors compared the educational outcomes and average recidivism rates of the two groups. The study found that ROPP had some early positive impacts on educational outcomes, but many of these gains faded after the first six months of the program. The study also found initial improvements (reductions) in recidivism for the treatment group during the first six months. There were no statistically significant effects of participation in the program on violations of probation. The quality of causal evidence presented in this report is moderate because it was based on a randomized controlled trial with high attrition that sufficiently accounted for other relevant factors. This means we are somewhat confident that the estimated effects are attributable to the Los Angeles County ROPP, but other factors might also have contributed.","The Los Angeles County Repeat Offender Prevention Program (ROPP)","Other training and education Youth programs","Youth, Justice-involved",,"United States",2005,,"Opportunities for Youth Review Protocol" "Evaluating an experimental intensive juvenile probation program: Supervision and official outcomes","Lane, J., Turner, S., Fain, T., & Sehgal, A. (2005). Evaluating an experimental intensive juvenile probation program: Supervision and official outcomes. Crime & Delinquency, 51(1), 26-52.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence",,"Summary: The study’s objective was to examine the impact of the South Oxnard Challenge Project (SOCP), an alternative juvenile probation program, on recidivism outcomes. The study was a randomized controlled trial. The authors used administrative data from the program and probation records to compare the outcomes of youth randomly assigned to the SOCP with those of youth randomly assigned to a control group that received standard probation services. The study found no statistically significant effects of SOCP on arrests or referrals to probation, convictions, or incarceration. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects would be attributable to SOCP and not to other factors. However, the study did not find statistically significant effects.","South Oxnard Challenge Project (SOCP)","Substance abuse recovery Youth programs Behavioral Interventions","Youth, Justice-involved, Disconnected youth",,"United States",2005,,"Opportunities for Youth Review Protocol" "The effect of the SSI program on labor supply: Improved evidence from Social Security administrative files","Neumark, D., & Powers, E. T. (2005). The effect of the SSI program on labor supply: Improved evidence from Social Security administrative files. Social Security Bulletin, 65(3), 45-60.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study examined the relationship between generous state Supplemental Security Income (SSI) benefits and the employment of older worker nearing SSI eligibility age. The authors used a regression model and data from the Survey of Income and Program Participants (SIPP) and Social Security Administration (SSA) to estimate the effect. The study found that older males who were likely SSI participants in generous states worked significantly fewer hours and had lower employment rates compared with those living in less generous states. The authors, using the SSA administrative records, also found that likely older participants (ages 60 to 64) worked significantly fewer hours than younger ones. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to generosity of state SSI benefits; other factors are likely to have contributed.","state Supplemental Security Income (SSI) benefits","Older workers' programs Other employment and reemployment","Adult, Older worker",,"United States",2005,https://www.ssa.gov/policy/docs/ssb/v65n3/v65n3p45.html,"Employment and Training Review Protocol" "A Ten-Year Follow-Up of a Supported Employment Program","Salyers, Michelle P, Becker, DR, Drake RE, Torrey WC, and Wyzick PF (2004). A Ten-Year Follow-Up of a Supported Employment Program. Psychiatric Services, 55(3), 302–308.","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: The objective of this study was to examine the outcomes of supported employment 10 years after an initial demonstration project. Authors interviewed 36 of 62 clients who had participated in 1990 or 1992 in a supported employment program at one of two mental health centers located in rural areas. Although few of the 36 clients made the transition to full-time employment with health benefits, 75 percent of them worked beyond the initial study period and 35 percent worked during at least 5 years of the 10-year follow-up period. Current and recent jobs tended to be competitive (that is, not reserved for people with disabilities), with an average tenure of 32 months. Clients reported that employment led to substantial benefits in diverse areas, such as improvements in self-esteem, hope, relationships, and control of substance abuse.",,"Supported employment or other employment supports",Disability,,"United States",2004,,"Disability Employment Policy Review Protocol" "The effects of the Americans with Disabilities Act: A longitudinal model analysis","Moon, S., Chung, K, & Yang, D. (2003). The effects of the Americans with Disabilities Act: A longitudinal model analysis. Clinical Research and Regulatory Affairs, 20(4), 433-445.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Mixed impacts Employment","Summary: The study’s objective was to examine the impact of the Americans with Disabilities Act (ADA), both the original 1992 legislation and its 1994 extension, on working hours and employment among men with disabilities.  The authors applied a multiple regression model to panel data from the 1989–1995 Survey of Income and Program Participation (SIPP). The study found that working hours and employment decreased on average among all men with disabilities, regardless of their labor force participation, relative to men without disabilities after the ADA was first implemented in 1992. In contrast, relative working hours and employment increased for labor force participants who self-reported a disability after the law’s 1994 extension went into effect. The quality of causal evidence presented in this report is low because the authors did not control for possible disparities in pre-intervention trends in working hours and employment among men with and without disabilities. This means we are not confident that the estimated effects are attributable to the ADA; other factors are likely to have contributed.","the Americans with Disabilities Act of 1990","Americans with Disabilities Act (ADA)","Disability, Male",,"United States",2003,,"Employer Compliance Review Protocol" "Impact of public support payments, intensive psychiatric community care, and program fidelity on employment outcomes for people with severe mental illness","Resnick, S., Neale, M., & Rosenheck, R. (2003). Impact of public support payments, intensive psychiatric community care, and program fidelity on employment outcomes for people with severe mental illness. The Journal of Nervous and Mental Disease, 191(3), 139-144.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Unfavorable impacts Employment","Summary: The study evaluated the one-year impacts of a U.S. Department of Veterans Affairs (VA) model of assertive community treatment for veterans with serious mental illnesses known as Intensive Psychiatric Community Care (IPCC) on employment. The study conducted a randomized controlled trial (RCT); those randomly assigned to the treatment group were eligible to receive the IPCC services, whereas those randomly assigned to the control group could not access IPCC services but could use other available health- and workforce-related services from the VA. The authors analyzed outcomes based on self-reported employment data collected from participants one year after random assignment. The study found that 7 percent of veterans in the IPCC group were employed one year after random assignment compared to 11 percent of veterans in the control group. The authors did not report the statistical significance of this difference. The quality of the causal evidence presented in this report is high because it was based on a well-conducted RCT. This means we have confidence that the estimated effects are attributable to the IPCC program and not other factors.","Intensive Psychiatric Community Care (IPCC)","Health Job search assistance and supportive services Veterans' reemployment Basic skills","Disability, Veteran or military",,"United States",2003,https://journals.lww.com/jonmd/Abstract/2003/03000/IMPACT_OF_PUBLIC_SUPPORT_PAY…,"Employment and Training Review Protocol" "Impact of public support payments, intensive psychiatric community care, and program fidelity on employment outcomes for people with severe mental illness","Resnick, S., Neale, M., & Rosenheck, R. (2003). Impact of public support payments, intensive psychiatric community care, and program fidelity on employment outcomes for people with severe mental illness. The Journal of Nervous and Mental Disease, 191(3), 139-144.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to evaluate the one-year impacts of a Department of Veterans Affairs (VA) model of assertive community treatment for veterans with serious mental illnesses known as Intensive Psychiatric Community Care (IPCC). The study was based on a randomized controlled trial. Roughly half of the 528 veterans participating in the study were randomly assigned to receive the IPCC treatment while the other half received standard VA services. The authors analyzed self-reported employment data collected from participants one year after random assignment. The study found that veterans in the IPCC group were three times more likely to be employed one year after random assignment than veterans in the control group. The quality of the causal evidence presented in this report is high because it is based on a well-conducted randomized controlled trial. This means we have confidence that the estimated effects are attributable to the IPCC program, and not other factors.","Intensive Psychiatric Community Care (IPCC)","Veterans' reemployment Vocational rehabilitation","Disability, Veteran or military",,"United States",2003,,"Disability Employment Policy Review Protocol" "Career Academies: Additional evidence of positive student outcomes","Elliott, M., Hanser, L., & Gilroy, C. (2002). Career Academies: Additional evidence of positive student outcomes. Journal of Education for Students Placed at Risk, 7(1), 71–90.","Career Academies","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Mixed impacts Education and skills gains","Summary: The study examines the effect of the Junior Reserve Officers Training Corps Career Academies (JROTCCA) on student attendance, grade point average (GPA), and high school graduation. Using school administrative records, the study reports the four-year impacts for students who entered a JROTCCA in the 1994–1995 school year, and one-year impacts for the students who entered a JROTCCA in the 1995–1996 school year, compared with one of three control groups: (1) students in other academy or magnet programs, (2) students in regular non-Career Academy (CA) Junior Reserve Officers’ Training Corps (JROTC) programs, and (3) students in a general academic program. About 27,500 students from eight schools in five urban high school districts participated in the study. The authors reported several positive impacts of the JROTCCA program, including a reduction in the failure to graduate, substantial increases in the proportion of graduates with high GPAs, and a reduction in the proportion of students with low GPAs, compared with students in non-CA JROTC programs and general academic programs. However, some JROTCCA groups had statistically significantly higher first-year absenteeism rates than their magnet school counterparts. The quality of the causal evidence presented in this study is low because the analysis did not adequately control for characteristics of the students before their entry into JROTCCA. This means that we are not confident that the results estimated in the study are attributable to JROTCCA; other factors are likely to be responsible.","Junior Reserve Officers Training Corps Career Academies","Youth programs Community college education and other classroom training Other training and education","Youth, Other barriers",,"United States",2002,,"Career Academies Review Protocol" "Consequences of employment protection? The case of the Americans with Disabilities Act.","Acemoglu, D., & Angrist, J. (2001). Consequences of employment protection? The case of the Americans with Disabilities Act. Journal of Political Economy, 109(5), 915-957.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-Unfavorable impacts Employment","Summary: The study’s objective was to examine the consequences of the Americans with Disabilities Act (ADA) on the employment and wages of people with disabilities. The main analysis estimated regression models of weeks worked and weekly earnings as a function of self-reported work disability status, allowing effects to differ each year and controlling for factors relating to demographics, region, and time. Data came from the 1988–1997 March Current Population Survey. The study found that a year after the ADA came into effect (1993), the employment of men and women ages 21 to 39 with disabilities declined and this change could not be explained by potential changes in how individuals reported disability status or by increases in Supplemental Security Income (SSI) or Old-Age, Survivors, and Disability Income (OASDI). The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the ADA, but other factors might also have contributed.","the Americans with Disabilities Act of 1990","Americans with Disabilities Act (ADA)",Disability,,"United States",2001,,"Employer Compliance Review Protocol" "Changes in wage discrimination against people with disabilities.","DeLeire, T. (2000). Changes in wage discrimination against people with disabilities: 1984–93. The Journal of Human Resources, 37(1), 144-158.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Unfavorable impacts Earnings and wages","Summary: The study’s objective was to estimate changes in wage discrimination against people with disabilities before and after the Americans with Disabilities Act of 1990 (ADA).  The author used data from the 1984, 1992, and 1993 panels of the Survey of Income and Program Participation to compare earnings for people who reported functional and work limitations, people who reported only functional limitations, and people who reported no limitations. The percentage of the gap between the first two groups that was not explained by control variables and self-reported health status was attributed to discrimination, and that percentage was compared between 1984 and 1993 to estimate the effect of the ADA. The study found earnings gaps between people with no disabilities and those with work limitations and/or functional limitations in each year, and the share of the gap explained by discrimination rose slightly after passage of the ADA. The quality of causal evidence provided in this study is low. This means that we are not confident that the estimated effects were attributable to the passage of the ADA; other factors are likely to have contributed.","the Americans with Disabilities Act of 1990","Americans with Disabilities Act (ADA)",Disability,,"United States",2000,,"Employer Compliance Review Protocol" "A mixed-method approach to evaluating learning communities for underprepared community college students: The Integrated Studies Communities at Parkland College","Moore, L.H. (2000). A mixed-method approach to evaluating learning communities for underprepared community college students: The Integrated Studies Communities at Parkland College (Doctoral dissertation). Retrieved from ProQuest Dissertations and Theses database. (UMI No. 9971142)","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Integrated Studies Community (ISC) at Parkland College in Champaign, Illinois, on credit hours earned, course completion, and persistence during the 1998–1999 academic year. The study used a matched comparison group design to compare ISC participants with nonparticipants. Data sources included administrative data from Parkland College and interview and survey data. This study found that ISC students earned significantly more credit hours than comparison students. The quality of causal evidence presented in this report is low because the study did not include sufficient controls in the analysis. This means we are not confident that the estimated effects are attributable to the ISC. Other factors are likely to have contributed.","the Integrated Studies Community (ISC) at Parkland College","Basic skills Community college education and other classroom training","Adult, Other barriers",,"United States",2000,http://files.eric.ed.gov/fulltext/ED457936.pdf,"Community College Review Protocol" "The unintended consequences of the Americans with Disabilities Act","DeLeire, T. (2000). The unintended consequences of the Americans with Disabilities Act. Regulation 23(1), 21–24.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Unfavorable impacts Employment","Summary: The study’s objective was to examine the effect of the Americans with Disabilities Act (ADA) on the employment rate for men with disabilities. Using data from the Survey of Income and Program Participation from 1985 to 1995, the author compared the change in employment for men with disabilities ages 18 to 65 pre- and post-ADA with the change in employment for men without disabilities over the same period. The study found that the employment rate for men with disabilities was 8 percentage points lower relative to men without disabilities after ADA, with particularly large differences for those with mental disabilities or low education levels. The quality of causal evidence provided in this study is low. This means that we are not confident that the estimated effects are attributable to the ADA; other factors are likely to have contributed.","the Americans with Disabilities Act of 1990","Americans with Disabilities Act (ADA)","Disability, Male",,"United States",2000,,"Employer Compliance Review Protocol" "Cognitive rehabilitation for traumatic brain injury: A randomized trial","Salazar, A., Warden, D., Schwab, K., Spector, J., Braverman, S., Walter, J., . . . Ellenbogen, R. (2000). Cognitive rehabilitation for traumatic brain injury: A randomized trial. Journal of American Medical Association, 283(23), 3075-3081.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine the impact of in-hospital and home rehabilitation programs on the employment and health status of active duty military members with severe traumatic brain injuries (TBIs). The study was a randomized controlled trial conducted at the Walter Reed Army Medical Center, where 120 active duty military members with TBI were randomly assigned to receive either in-hospital rehabilitation or home rehabilitation. Researchers collected outcome data 8 weeks and 6, 12, and 24 months after randomization. Although the study authors originally hypothesized that in-hospital rehabilitation would increase the rates of patients who were able to return to work or able to return to active duty, the study found no statistically significant difference between the two groups on these outcomes. The quality of the causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any differences in outcomes would be attributable to the more effective program; however, there were no statistically significant differences between the programs.","the In-hospital and Home Rehabilitation Programs Studied","Vocational rehabilitation","Disability, Veteran or military",,"United States",2000,,"Disability Employment Policy Review Protocol" "Case management for dually diagnosed individuals involved in the criminal justice system","Godley, S. H., Finch, M., Dougan, L., McDonnell, M., McDermeit, M., & Carey, A. (2000). Case management for dually diagnosed individuals involved in the criminal justice system. Journal of Substance Abuse Treatment, 18(2), 137–148.",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Unfavorable impacts Education and skills gains Employment-Low-Unfavorable impacts Employment Public benefits receipt-Low-Unfavorable impacts Public benefit receipt","Summary: The study’s objective was to examine the relationship between the Treatment Alternatives for Safe Communities/Mental Illness Substance Abuse (TASC/MISA) program and a range of outcomes, including education and training, employment, public benefit receipt, and recidivism outcomes. The authors used a nonexperimental interrupted time series (ITS) study design to compare the outcomes of people with prior justice-system contact and mental health and substance abuse issues, before and after participating in the TASC/MISA program. Using survey data, the authors looked at the change in participants’ Addiction Severity Index (ASI) scores, incarceration, and other outcomes between baseline and six months following program intake. The study found that program participation was associated with less favorable employment and education outcomes but favorable recidivism outcomes. Associations between participation and public benefit receipt outcomes were mixed. The quality of causal evidence presented in this report is low. This means we are not confident that the estimated effects on education and training, employment, public benefit receipt, and recidivism outcomes are attributable to the program; other factors are likely to have contributed.","the Treatment Alternatives for Safe Communities/Mental Illness Substance Abuse (TASC/MISA) program","Substance abuse recovery Reentry","Justice-involved, Other barriers",,"United States",2000,https://doi.org/10.1016/S0740-5472(99)00027-6,"Employment and Training Review Protocol" "Impacts of the Project NetWork Demonstration: Final Report","Kornfeld R.., Wood M. L., Orr L. L., & Long D. A. (1999). Impacts of the Project NetWork Demonstration: Final Report. Cambridge, MA: Abt Associates, Inc.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Health and safety-Mod/high-No impacts Health and safety Public benefits receipt-Low-No impacts Public benefit receipt","Summary: This study’s objective was to report impacts for Project NetWork. Created by the Social Security Administration (SSA), Project NetWork tested specific approaches to improving employment among Social Security Disability Insurance (SSDI) recipients and Supplemental Security Income (SSI) applicants and recipients, with a particular focus on case and referral management systems.  The study used multiple data sources, including the Master Earnings File (MEF), Master Beneficiary Record (MBR), Supplemental Security Record (SSR), and survey data collected 25 to 36 months after enrollment. The study found that Project NetWork increased earnings one and two years after enrollment, but these effects did not persist in the third follow-up year. The program led to a slight increase in the average number of months employed, but no changes in participants’ Social Security disability benefit receipt, health, or well-being. The quality of causal evidence presented in this study is considered high for the annual earnings, proportion of months receiving SSI/SSDI benefits, and average monthly SSI/SSDI benefits outcomes measured through administrative data because they are based on a well-implemented randomized controlled trial with low attrition. However, the quality of causal evidence is moderate for annual earnings, hours and months worked, and mental and physical health outcomes due to high attrition for these domains.","Project NetWork","Health Disability insurance Supplemental security income (SSI) Vocational rehabilitation Health Disability insurance Supplemental security income (SSI) Vocational rehabilitation",Disability,,"United States",1999,http://www.abtassociates.com/reports/19994080203411.pdf,"Disability Employment Policy Review Protocol" "The effects of enrollment in the Transportation Career Academy Program on student outcomes","Hanser, L., & Stasz, C. (1999). The effects of enrollment in the Transportation Career Academy Program on student outcomes. Paper presented at the American Educational Research Association (Unpublished).","Career Academies","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to examine the effects of enrolling in a Transportation Career Academy Program (TCAP) on students’ academic outcomes. The authors used school district administrative records of students in the six high schools included in the evaluation in school year 1996–1997. TCAP students achieved higher grade point averages, earned more credits, and had higher attendance rates than students in general academic programs. Outcomes for TCAP students were not statistically significantly different, however, from those for magnet school students. The quality of causal evidence in this study is low because the authors did not adequately control for the academic achievement of students before they enrolled in TCAP. This means we are not confident that the results estimated in the study are attributable to TCAP; other factors are likely responsible.","Transportation Career Academy Program (TCAP)","Youth programs Community college education and other classroom training Work based and other occupational training","Youth, Other barriers",,"Urban, United States",1999,,"Career Academies Review Protocol" "An evaluation of an urban community college Single Parent and Displaced Homemaker Program (Doctoral dissertation)","Rice, L. M. (1999). An evaluation of an urban community college Single Parent and Displaced Homemaker Program (Doctoral dissertation). Old Dominion University. DOI: 10.25777/tqh7-3c76","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study's objective was to examine the impact of the Single Parent and Displaced Homemaker Program on education outcomes by students at an urban community college. The study used a nonexperimental design to compare the outcomes of program participants to those on the waiting list. Using data from the community college’s Students Information System, the author conducted statistical tests to examine the differences between groups. The study found that participation in the Single Parent and Displaced Homemaker Program was significantly related to increased retention rates and number of credits taken. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Single Parent and Displaced Homemaker Program; other factors are likely to have contributed.","the Single Parent and Displaced Homemaker Program","Employment and Training Services Training and Education Capacity building programs Community college education and other classroom training Other training and education","Adult, Other barriers, Female, Parent",,"Urban, United States",1999,https://digitalcommons.odu.edu/urbanservices_education_etds/50/,"Community College Review Protocol" "The employment and training outcomes of a job training partnership act program in a community college setting","Carter, D. L. (1999). The employment and training outcomes of a job training partnership act program in a community college setting (Unpublished doctoral dissertation). University of Florida.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages","Summary: The study's objective was to examine the impact of a Job Training Partnership Act (JTPA) funded vocational training program at a community college in North Florida on earnings outcomes. The author used an interrupted time series design to compare outcomes of participants before and after they participated in the JTPA program. Data for the study were compiled from the community college's existing JTPA records. The study found that participation in JTPA funded training was significantly related to higher post-training wages. The quality of causal evidence presented in this report is low because the author did not observe outcomes for multiple periods before or after the program nor account for selection into the intervention. This means we are not confident that the estimated effects are attributable to the JTPA funded vocational training program; other factors are likely to have contributed.","Job Training Partnership Act","Employment and Training Services Training and Education Basic skills Capacity building programs Community college education and other classroom training","Youth, Adult, Other barriers, Dislocated or displaced worker, Low income",,"Rural, United States",1999,,"Community College Review Protocol" "Addressing literacy needs at work: Implementation and impact of workplace literacy programs","Moore, M., Myers, D., & Silva, T. (1998). Addressing literacy needs at work: Implementation and impact of workplace literacy programs. Washington, DC: Mathematica Policy Research, Inc.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Mod/high-No impacts Education and skills gains Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine the impact of workplace literacy programs on workers’ literacy and career and educational attainment. The authors randomly assigned workers in three sites to either the treatment group, which could participate in the workplace literacy program, or the control group, which was barred from participating in the program for a period of time. The authors estimated impacts of the program by comparing outcomes of the two groups, controlling for the probability of their participation. The study did not find any statistically significant effects of the workplace literacy programs on GED attainment, employment, average weekly earnings, or standardized literacy assessments. The quality of causal evidence presented in this report is high for most outcomes because it was based on a well-implemented randomized controlled trial. This means we have confidence that any estimated effects would be attributable to the workplace literacy programs studied and not to other factors; however, the study found no statistically significant effects.","the Workplace Literacy Programs Studied","Other employment and reemployment Other training and education","Other barriers",,"United States",1998,http://www.mathematica-mpr.com/~/media/publications/PDFs/education/workplace_li…,"Employment and Training Review Protocol" "Case management at work for SSA disability beneficiaries: process results of the Project NetWork","Leiter, V., & Wood, M.L. (1997). Case management at work for SSA disability beneficiaries: process results of the Project NetWork. Social Security Bulletin, 60 (1), 29–57.","Disability Employment Policy","Study Type: Implementation Analysis",,,"Summary: This article summarized the results of a process evaluation of Project NetWork, a demonstration launched by the Social Security Administration (SSA) to test various strategies for providing vocational rehabilitation (VR) services to its disability insurance beneficiaries as well as blind and disabled applicants for and recipients of Supplemental Security Income benefits. The study, which was part of an evaluation that also included impact and cost analyses, assessed the feasibility of providing VR services to SSA beneficiaries with severe disabilities. It drew on interviews with program staff, management information system data, and a variety of program documents to examine the roll-out and implementation of four models of service delivery, each implemented at two sites. The authors determined that it was feasible to recruit people with severe disabilities for a rehabilitation program and provide the range of required services. Models with varying institutional arrangements were equally successful in attracting the interest of this population and arranging for the services they needed to meet their vocational goals.","Project NetWork","Disability insurance Supplemental security income (SSI) Vocational rehabilitation",Disability,,"United States",1997,http://www.ssa.gov/policy/docs/ssb/v60n1/v60n1p29.pdf,"Disability Employment Policy Review Protocol" "An exploratory cost-benefit analysis of natural support strategies in the employment of people with severe disabilities","Zivolich, S., Shueman, S.A., & Weiner, J.S. (1997). An exploratory cost-benefit analysis of natural support strategies in the employment of people with severe disabilities. Journal of Vocational Rehabilitation, 8, 211–221.","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: Natural support programs use existing job-site routines, people, and methods, rather than job coaches, to assist workers with severe disabilities. This exploratory cost-benefit analysis used data from the first 59 of 110 people employed through a grant program using natural supports to estimate costs and benefits to participants, taxpayers, and society. Benefits were estimated from relevant combinations of earnings, taxes, Supplemental Security Income benefits (transfers) and administrative costs, and savings from a most likely alternative program, rather than from impact estimates derived from experimental evaluation. Under this approach, results suggested substantive benefits to participants, taxpayers, and society for a natural support approach, and the superiority of this approach over the traditional sheltered workshop (job coaching) model.",,"Disability insurance Supplemental security income (SSI) Supported employment or other employment supports",Disability,,"United States",1997,,"Disability Employment Policy Review Protocol" "Effective employment services for persons with mental retardation","Decker, Paul T., and Thornton, Craig. (1996). Effective employment services for persons with mental retardation. Journal of Vocational Rehabilitation 7, 29-40.","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: This study combined data from an impact evaluation and an associated process study of the Transitional Employment Intervention (TEI) to identify effective supported employment services for people with mental retardation. TEI randomly assigned eligible Supplemental Security Income recipients to a treatment or control group at eight training agencies serving 13 communities in seven states. All eight agencies implemented the basic demonstration model successfully, although their methods of providing basic services differed, as did their results. Overall, average earnings were substantially higher for people who were enrolled in the demonstration. However, agency-specific estimates varied from large and statistically significant to small and not statistically significant. By comparing the implementing agencies across multiple characteristics identified in the process study, this study found that the most successful programs tailored their services to the needs of each participant, developed jobs in a wide array of occupations, and kept people in the program for a longer period than the other agencies. The implementing agencies persisted in placing participants who lost a job into second, third, or fourth jobs. The study also found cost implications of the successful strategies. Average costs for the three high-impact agencies were approximately $7,000 per enrolled participant, and approximately $6,000 per participant for the three low-impact agencies.",,"Disability insurance Supplemental security income (SSI) Supported employment or other employment supports",Disability,,"United States",1996,,"Disability Employment Policy Review Protocol" "Enhancing substance abuse treatment with case management: Its impact on employment","Siegal, H. A., Fisher, J. H., Rapp, R. C., & Kelliher, C. W. (1996). Enhancing substance abuse treatment with case management: Its impact on employment. Journal of Substance Abuse Treatment, 13(2), 93-98.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study aimed to examine the impact of a strengths-based case management intervention on veterans’ employment and earnings. Even though the treatment and control groups were randomly assigned, the study used a pre/post analysis design to compare all participants before the study to all participants six months after the study began. The study collected data using the Addiction Severity Index (ASI-5) and study-created measures including levels of drug use, substance abuse treatment history, health and psychiatric status, occupational and education functioning, living situation, relationship with family and peers, and HIV risk status. The study found all study participants, including those in the intervention and control groups, increased earnings and days employed at the six-month follow-up. The quality of causal evidence presented in this report is low because the authors did not account for trends in outcomes before the intervention. This means we are not confident that the estimated effects are attributable to strengths-based case management; other factors are likely to have contributed.","the strengths-based case management","Substance abuse recovery Job search assistance and supportive services Veterans' reemployment","Other barriers, Veteran or military",,"United States",1996,https://doi.org/10.1016/0740-5472(96)00029-3,"Employment and Training Review Protocol" "The long-term effects of transitional employment services","Decker, P., & Thornton, C. (1995). The long-term effects of transitional employment services. Social Security Bulletin, 58(4), 71–81.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to determine the long-term effects of an intervention designed to improve employment and earnings outcomes among Supplemental Security Income (SSI) recipients with intellectual disabilities. The study was a component of the Transitional Employment Training Demonstration (TETD). The authors examined data from the Supplemental Security Record (SSR) maintained by the Social Security Administration (SSA) and demographic information from intake data collection forms. They estimated impacts on employment, earnings, total income, amount of SSI benefits received, and probability of receiving Social Security Disability Insurance (SSDI) benefits for the six years following enrollment. The study found statistically significant, positive impacts on employment, earnings, and total income over the follow-up period. There were also modest declines in the amount of SSI benefits received. The quality of causal evidence presented in this study is high because it is a well-conducted randomized controlled trial. This means that we are confident that the estimated effects in this study are attributable to the intervention, and not to other factors.","Transitional Employment Training Demonstration","Disability insurance Other training and education Supplemental security income (SSI) Vocational rehabilitation",Disability,,"United States",1995,http://www.ssa.gov/policy/docs/ssb/v58n4/v58n4p71.pdf,"Disability Employment Policy Review Protocol" "Pay and participation in work activity: Clinical benefits for clients with schizophrenia","Bell, M.D., & Milstein, R.M. (1993). Pay and participation in work activity: Clinical benefits for clients with schizophrenia. Psychosocial Rehabilitation Journal, 17(2), 173-176.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of a paid supported work program for veterans diagnosed with schizophrenia or schizoaffective disorder on their employment, earnings, wages, and health outcomes. The authors used a randomized controlled trial to compare outcomes of veterans assigned to the paid supported work condition with those assigned to the unpaid work condition using data collected through interviews at baseline and five months later. The authors found that the paid group had higher employment and earnings and fewer depressive symptoms five months after random assignment compared with the unpaid group. The quality of causal evidence presented in this report is low because it was based on a randomized controlled trial in which the analytic sample sizes are unknown, and the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to paid supported work; other factors are likely to have contributed to the findings.","the Paid Supported Work Program","Health Veterans' reemployment","Disability, Veteran or military",,"United States",1993,https://psycnet.apa.org/doi/10.1037/h0095590,"Employment and Training Review Protocol" "Schizophrenic symptoms, work adjustment, and behavioral family therapy","Glynn, S. M., Randolph, E. T., Eth, S., Paz, G. G., Leong, G. B., Shaner, A. L., & Vort, W. V. (1992). Schizophrenic symptoms, work adjustment, and behavioral family therapy. Rehabilitation Psychology, 37(4), 323-338.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-No impacts Employment","Summary: This study examined the impact of behavioral family therapy on male veterans’ employment. The study conducted a randomized controlled trial using data from self-reported responses to the Social Adjustment Scale, Version I. The study showed that behavioral family therapy did not have statistically significant effects on employment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects are attributable to behavioral family therapy and not to other factors. However, the study did not show any statistically significant effects.","Behavioral Family Therapy","Health Veterans' reemployment","Disability, Veteran or military",,"United States",1992,,"Employment and Training Review Protocol" "Disability beneficiaries who work and their experience under program work incentives","Muller, L. Scott. (1992). Disability beneficiaries who work and their experience under program work incentives. Social Security Bulletin, 55(2), 2–42.","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: This study used data from the New Beneficiary Survey and claims folders to describe the experiences of recipients’ experiences under Social Security Disability Insurance (DI) work incentive provisions. The analysis found that relatively few DI recipients worked while in benefit status, and considerably smaller numbers had benefit terminations. About 10 percent of people initially entitled to benefits from mid-1980 to mid-1981 were found to have worked while in benefit status over the approximately 10-year period under study. The vast majority (84 percent) of those who worked were granted a trial work period (TWP). Nearly 75 percent of those granted a TWP successfully completed nine months of trial work, yet fewer than half of those who completed the TWP were eventually terminated from the program for substantial gainful activity (SGA). Overall, fewer than 3 percent of this cohort of initial entitlements had SGA terminations and, among this small number, nearly one-third had returned to the rolls by 1990. Recipients most likely to make a work attempt were young and had high levels of education.",,"Disability insurance Supplemental security income (SSI) Other employment and reemployment",Disability,,"United States",1992,http://www.ssa.gov/policy/docs/ssb/v55n2/v55n2p2.pdf,"Disability Employment Policy Review Protocol" "Transitional employment training for SSI recipients with intellectual disabilities.","Prero, A.J., & Thornton, C. (1991). Transitional employment training for SSI recipients with intellectual disabilities. Social Security Bulletin, 54(11), 2-25.","Disability Employment Policy","Study Type: Implementation Analysis",,,"Summary: This article summarized the findings of a process evaluation of the Transitional Employment Training Demonstration, which aimed to transition Supplemental Security Income (SSI) recipients with intellectual disabilities to permanent employment. To achieve this goal, the demonstration provided participants with short-term training for potentially permanent jobs in which they would conduct tasks for their employers and interact with nondisabled colleagues. The study developed findings on recruitment, training, placement, and the provision of other services by collecting data from all eight program sites. It drew on several qualitative sources, such as program staff interviews, observations of service provision, and program documents, as well as a few quantitative sources, including program, survey, and SSI administrative data. The study found that it was feasible to successfully place a wide variety of SSI recipients with intellectual disabilities in mainstream jobs using transitional employment services. However, the programs faced several challenges in program design and implementation. Recruitment and job placement could be difficult, given opinions among caregivers and employers that people with intellectual disabilities cannot perform well in competitive jobs. Job placement was hampered further by the lack of suitable transportation options.","Transitional Employment Training Demonstration","Supplemental security income (SSI) Basic skills Job search assistance and supportive services",Disability,,"United States",1991,http://www.ssa.gov/policy/docs/ssb/v54n11/v54n11p2.pdf,"Disability Employment Policy Review Protocol" "Impacts of transitional employment for mentally retarded young adults: Results of the STETS demonstration","Kerachsky, S., Thornton, C., Bloomenthal, A., Maynard, R. & Stephens, S. (1985). Impacts of transitional employment for mentally retarded young adults: Results of the STETS demonstration. New York: Manpower Demonstration Research Corporation.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Structured Training and Employment Transitional Services (STETS) program on employment rates, earnings, and Social Security Disability Income (SSDI) and Supplemental Security Income (SSI) receipt. The STETS program included a suite of work-readiness training, transitional jobs, and postplacement support services for young adults with intellectual disabilities. The study was a randomized controlled trial that randomly assigned young adults to the treatment group, which could participate in the STETS program, or to the control group, which could not. The study drew on data from in-person interviews conducted 6, 15, and 22 months after the start of the program. The study found that young adults in the treatment group were employed at significantly higher rates and, on average, earned more than the control group 15 and 22 months after the program began. The study also found that 15 months after random assignment, the young adults in the treatment group were significantly less likely than those in the control group to receive SSI or SSDI benefits. The quality of causal evidence presented in this report is high because it is based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the STETS program, and not to other factors.","Structured Training and Employment Transitional Services","Job search assistance and supportive services Other employment and reemployment","Disability, Low income",,"United States",1985,http://www.mdrc.org/sites/default/files/impacts_of_transitional_employment_fr.p…,"Employment and Training Review Protocol" "Evaluating the Vocational Rehabilitation Program using longitudinal data: Evidence for a quasi-experimental research design","Dean, D., Dolan, R., & Schmidt, R. (1999). Evaluating the Vocational Rehabilitation Program using longitudinal data: Evidence for a quasi-experimental research design. Evaluation Review, 23(2), 162–189","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages","Summary: The study’s objective was to determine the impact of participation in Vocational Rehabilitation (VR), a state and federal program, on earnings for people with disabilities. VR provides services and supports to people with disabilities to help them achieve their employment goals. The authors analyzed linked Rehabilitation Services Administration (RSA) and Social Security Administration (SSA) data for about 29,000 people whose VR cases were closed in 1980. The linked data contained annual earnings histories, service expenditures, and disability and demographic information. By the eighth year after first receiving VR services, women in six of seven disability categories and men in four of seven disability categories earned significantly more than their counterparts who had not received VR services. The quality of the causal evidence presented in this study is moderate. This means we have some confidence that the observed effects represent the impact of VR, although other factors might also have contributed.","the Vocational Rehabilitation (VOC) Programs","Disability insurance Supplemental security income (SSI) Vocational rehabilitation",Disability,,"United States",,,"Disability Employment Policy Review Protocol"