Title,Citation,Topic_area,Study_type,Study_evidence_rating,Outcome_effectiveness,Findings,Intervention_program,Topics,Target_population,Firm_characteristics,Geographic_setting,Original_publication_date,Original_publication_link,"Review Protocol"
"Synthesis Report: Behavioral Finance Synthesis: Findings",,"Behavioral Finance: Retirement",,,,"Findings:

  
  
  

  
  
  

  
  
  

          People have relatively limited knowledge about saving for retirement and can be induced to save more when provided with additional information.

          Making retirement more salient, by having people think of themselves in retirement or providing a target retirement date, can increase intentions to save and alter investment choices.

          People can become overwhelmed by the number of investment options they face; when this occurs, they tend to use simple rules to make decisions.",,"Employer provided retirement benefits","Adult, Older worker",,"United States",,,"Behavioral Finance: Retirement Review Protocol"
"Synthesis Report: Research Synthesis: Opportunities for Youth",,"Opportunities for Youth",,,,"Findings:

  
  
  

  
  
  

  
  
  

          Successful programs often involved a substantial time commitment from participating youth.

          Many successful programs involved a job placement component or job search assistance.

          Positive impacts tended to be realized in the short term and fade over time.

          More information is needed on the replicability of some programs.",,"Youth programs","Youth, Disconnected youth",,,,,"Opportunities for Youth Review Protocol"
"Does protecting older workers from discrimination make it harder to get hired? Evidence from disability discrimination laws.","Neumark, D., Song, J., & Button, P. (2017). Does protecting older workers from discrimination make it harder to get hired? Evidence from disability discrimination laws. Research on Aging, 39(1), 29-63.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Mixed impacts
      
    
  
              


      
            Employment","Summary:

The study examined the impact of the strength of state disability discrimination laws on hiring rates of older men.
The study used statistical models and data from the Health and Retirement Study and the Survey of Income and Program Participation to estimate the impacts.
The study found no relationship between the strength of disability discrimination laws and the hiring rate for older unemployed disabled and nondisabled men.
The quality of casual evidence presented in this report is low because the study is a nonexperimental analysis that did not demonstrate that the groups being compared were similar and did not account for possible differences in the analysis. This means we are not confident that the estimated effects are attributable to state disability discrimination laws; other factors are likely to have contributed.","Disability discrimination laws","Health Older workers' programs","Adult, Older worker, Male",,"United States",2017,https://journals.sagepub.com/doi/full/10.1177/0164027516656142,"Employment and Training Review Protocol"
"The effect of the Affordable Care Act on labor transitions among older workers.","Camilleri, S. E. (2017). The effect of the Affordable Care Act on labor transitions among older workers. In Three papers on the Affordable Care Act (Doctoral dissertation). North Carolina State University, Raleigh, NC.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-No impacts
      
    
  
              


      
            Employment","Summary:

The study examined the impact of the Affordable Care Act (ACA) on the employment outcomes of older workers.
The author used data from the Current Population Survey for 2011–2016 and regression analyses to estimate impacts.
The study found that the ACA was not associated with employment outcomes among older workers.
The quality of causal evidence presented in this report is moderate because the study is based on a well-implemented nonexperimental design. This means we are somewhat confident that any estimated effects are attributable to the ACA, but other factors might also have contributed.","Affordable Care Act (ACA)","Older workers' programs Health insurance","Adult, Older worker",,"United States",2017,,"Employment and Training Review Protocol"
"The impact of Medicare Part D on self-employment.","Moulton, J. G., Diebold, J. C., & Scott, J. C. (2017). The impact of Medicare Part D on self-employment. Research on Aging, 39(1), 64-85.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study examined the effect of the introduction of Medicare Part D on self-employment. The authors used a nonexperimental approach and data from the American Community Survey to estimate the impact.
The authors found that self-employment significantly increased by 0.5 percentage points after the program began.
The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects on self-employment are attributable to the introduction of Medicare Part D, although other factors might also have contributed.","Medicare Part D","Federal retirement benefits Older workers' programs","Adult, Older worker",,"United States",2017,,"Employment and Training Review Protocol"
"The effects of youth employment: Evidence from New York City lotteries.","Gelber, A., Isen, A., & Kessler, J. B. (2016). The effects of youth employment: Evidence from New York City lotteries. The Quarterly Journal of Economics, 131(1), 423-460.",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Mixed impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Education and skills gains-Mod/high-No impacts
      
    
  
              


      
            Education and skills gains
      


  
      
            Employment-Mod/high-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study’s objective was to examine the impact of the Summer Youth Employment Program (SYEP) on the employment rate, earnings, and college enrollment of New York City youth 14 to 21 years old.
The authors compared the employment rate, earnings, and college enrollment of the treatment group, youth who won a random lottery for the SYEP program and chose to participate in it, with those of the control group, youth who applied to the program but were not randomly selected to participate. The study used data from the Internal Revenue Service to measure outcomes over a five-year period.
The study found that, compared with earnings of the control group, the treatment group had significantly higher earnings in the year of participation in SYEP, but significantly lower earnings in the following three years. The treatment group also had a significantly higher probability of being employed in any job during the year of participation in SYEP and the first follow-up year compared with the employment probability of the control group.
The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the SYEP program, and not to other factors.","Summer Youth Employment Program (SYEP)","Youth programs","Youth, Disconnected youth",,"United States",2016,,"Review Protocol"
"Job insecurity, unemployment insurance and on-the-job search. Evidence from older American workers.","Gutierrez, I. A. (2016). Job insecurity, unemployment insurance and on-the-job search. Evidence from older American workers. Labour Economics, 41, 228-245. doi:10.1016/j.labeco.2016.05.011","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-No impacts
      
    
  
              


      
            Employment","Summary:

The study examined the impact of the potential wage replacement rate through Unemployment Insurance (UI) on the probability of transitioning to non-employment.
The study used a nonexperimental design and data from the Health and Retirement Study (HRS) from 1996–2006 and 2010–2012 to identify workers who expected job loss during the baseline survey and who experienced job transitions by the follow-up survey two years later.
The study found no statistically significant relationships between potential wage replacement rates and transitions to non-employment.
The quality of causal evidence presented in this report is low because the analyses do not sufficiently account for other factors that might contribute to the estimated effects. This means we are not confident that the estimated effects are attributable to the potential wage replacement rate through UI; other factors are likely to have contributed.","Unemployment Insurance (UI)","Older workers' programs Unemployment Insurance","Adult, Older worker, Employed",,"United States",2016,,"Employment and Training Review Protocol"
"Spousal labor market effects from government health insurance: Evidence from a veterans affairs expansion.","Boyle, M. A. & Lahey, J. N. (2016). Spousal labor market effects from government health insurance: Evidence from a veterans affairs expansion. Journal of Health Economics, Elsevier, 45(C), 63-76.","Older Workers, Veterans","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Low-Favorable impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Mod/high-No impacts
      
    
  
              


      
            Employment","Summary:

The study examined the impact of the expansion of health insurance for veterans through the U.S. Department of Veterans Affairs (VA) in the mid-1990s (as a result of the implementation of the Veteran’s Health Care Eligibility Reform Act) on the employment and earnings of non-covered spouses.
The authors used a statistical model and data from the Census Bureau’s March Current Population Survey and the Health and Retirement Study to compare the employment and earnings of wives of male veterans with wives of non-veterans of the same ages before and after the expansion of health insurance for veterans through the VA.
The study found no statistically significant associations between the expansion of health insurance for veterans and the employment of their wives and mixed evidence on associations between the expansion of health insurance for veterans and the earnings of their wives.
The quality of causal evidence presented in this report is moderate for the employment outcomes because it was based on a well-implemented nonexperimental design. This means we would be somewhat confident that any estimated effects would be attributable to the expansion of health insurance for veterans through the VA, but other factors might also have contributed. The quality of causal evidence presented in this report is low for earnings outcomes because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the expansion of health insurance for veterans through the VA; other factors are likely to have contributed.","Veteran Health Insurance Expansion","Health Older workers' programs Veterans' reemployment","Adult, Older worker, Veteran or military",,"United States",2016,,"Older Workers, Veterans Review Protocol"
"The effect of Social Security information on the labor supply and savings of older Americans.","Armour, P., & Lovenheim, M. F. (2016). The effect of Social Security information on the labor supply and savings of older Americans. (Working paper no. 361). Ann Arbor, MI: University of Michigan, Michigan Retirement Research Center.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Mixed impacts
      
    
  
              


      
            Employment","Summary:

The study examined the impact of the Social Security statements issued by the Social Security Administration (SSA) on older men’s annual hours worked.
The authors used a nonexperimental design and data from Health and Retirement Study surveys and Social Security administrative records to estimate the impacts.
The study found that receiving the first Social Security Statement is associated with a decrease in self-reported annual hours worked and receiving the second Social Security Statement is associated with an increase in self-reported annual hours worked.
The quality of casual evidence presented in this report is moderate because that the study was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to Social Security statements, but other factors might also have contributed.","Social Security statements","Older workers' programs Other disparities or discrimination in employment and earnings","Adult, Older worker, Male",,"United States",2016,,"Employment and Training Review Protocol"
"Men and women expecting to work longer: Do changing work conditions matter?","Moen, P., Kojola, E., Kelly, E.L., & Karakaya, Y. (2016). Men and women expecting to work longer: Do changing work conditions matter? Work, Aging and Retirement, 2(3), 321-344.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study’s objective was to examine the impact of a work flexibility intervention called STAR (Support. Transform. Achieve. Results) on workers’ expectations of retirement age and bridge jobs.
The study is a randomized controlled trial that uses surveys of workers before the intervention and five years post-intervention.
The study found that receiving STAR was associated with higher expectations of working at age 65 and retiring at age 67 or older.
The quality of causal evidence presented in this report is low because, although it was based on a randomized controlled trial, it had unknown attrition and the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to STAR; other factors are likely to have contributed.","STAR (Support. Transform. Achieve. Results.)","Work based and other occupational training Other employer services","Adult, Older worker",,"United States",2016,https://experts.umn.edu/en/publications/men-and-women-expecting-to-work-longer-…,"Employment and Training Review Protocol"
"The effect of health reform on retirement.","Levy, H., Buchmueller, T. C., & Nikpay, S. (2015). The effect of health reform on retirement (Research Paper 329). Ann Arbor, MI: Michigan Retirement Research Center.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-No impacts
      
    
  
              


      
            Employment","Summary:

The study’s objective was to examine the impact of the expansion of Medicaid to low-income adults in 2014 on retirement rates of workers ages 55 to 64.
The authors used a nonexperimental analysis to compare those who lived in an expansion state to those who lived in other states. The study used data from the monthly Current Population Survey from January 2005 through July 2015.
The study found no statistically significant relationships between Medicaid expansion and retirement.
The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the expansion of Medicaid; other factors are likely to have contributed.","Medicaid expansion","Health insurance Older workers' programs","Adult, Older worker, Low income",,"United States",2015,https://deepblue.lib.umich.edu/handle/2027.42/116062,"Employment and Training Review Protocol"
"The impact of a randomly assigned time and place management initiative on work and retirement expectations.","Cahill, K. E., James, J. B., & Pitt-Catsouphes, M. (2015). The impact of a randomly assigned time and place management initiative on work and retirement expectations. Work, Aging and Retirement, 1(4), 350-368.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Unfavorable impacts
      
    
  
              


      
            Employment","Summary:

	The study examined the impact of a time and place management (TPM) initiative at a medical provider on retirement expectations among workers ages 50 and older.
	The study was a randomized control trial and used a series of surveys and administrative data to estimate the impact.
	The study found that, when surveyed 12 months after randomization, employees in the treatment group were statistically significantly more likely to expect to directly exit their job as opposed to staying in their current job within the next five years.
	The quality of causal evidence presented in this report is moderate because the study was a randomized controlled trial with high attrition, but the authors did demonstrate that the treatment and control groups were similar before the intervention. This means we are somewhat confident that the estimated effects are attributable to TPM, but other factors might also have contributed.","Time and Placement Management (TPM)","Older workers' programs","Older worker","Health care and social assistance",,2015,https://hrs.isr.umich.edu/publications/biblio/8231,"Employment and Training Review Protocol"
"Employment outcomes among African American and white women with disabilities: Examining the inequalities.","Balcazar, F. E., & Suarez-Balcazar, Y. (2015). Employment outcomes among African American and white women with disabilities: Examining the inequalities. Women, Gender, and Families of Color, 3(2), 144-164.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-No impacts
      
    
  
              


      
            Employment","Summary:

The study examined the impact of adult vocational rehabilitation (VR) services on employment outcomes for African American and white women.
The authors used a statistical model and data from a Midwestern state VR system to compare the odds of employment after completing VR services for older versus younger women.
The study found no significant difference in employment outcomes between older and younger women who completed VR services.
The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before receiving VR services. This means we are not confident that the estimated effects are attributable to participation in VR services; other factors are likely to have contributed.","Vocational Rehabilitation (VR) Services","Vocational rehabilitation","Adult, Older worker, Female, Black or African American, White, Disability",,"United States",2015,,"Employment and Training Review Protocol"
"Becoming adults: One year impact findings from the youth villages’ Transitional Living evaluation","Valentine, E.J., Skemer, M., & Courtney, M.E. (2015). Becoming adults: One year impact findings from the youth villages’ Transitional Living evaluation. New York: MDRC.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Education and skills gains-Low-No impacts
      
    
  
              


      
            Education and skills gains","Summary:

The study’s objective was to examine the impact of the Transitional Living program on education, earnings, and recidivism outcomes.
The authors used a randomized controlled trial and estimated impacts by comparing the means of the treatment and control groups. Outcome data on education, earnings, and criminal involvement came from a 12-month survey conducted by the authors.
The study found a statistically significant impact on earnings only. Youth in the treatment group earned an average $611 more than youth in the control group.
The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Transitional Living, and not to other factors.","Transitional Living","Basic skills Other training and education Youth programs","Youth, Justice-involved, Disconnected youth",,"United States",2015,http://www.mdrc.org/sites/default/files/Becoming_Adults_FR.pdf,"Opportunities for Youth Review Protocol"
"The effect of a severe health shock on work behavior: Evidence from different health care regimes.","Datta Gupta, N., Kleinjans, K. J., & Larsen, M. (2015). The effect of a severe health shock on work behavior: Evidence from different health care regimes. Social Science and Medicine, 136-137, 44-51.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study’s objective was to examine the impact of the national health policies of the United States and Denmark on employment of older workers after a health shock, defined as a new cancer or cardiovascular disease diagnosis.
The authors used a nonexperimental approach to compare the impact of a health shock on the likelihood of nonemployment in the United States’ private multipayer system with Denmark’s nationalized universal health care model. The authors used the data from the RAND Health and Retirement Study survey from 1994 to 2002 and Danish population registers for 1993 to 2001.
The study found no differences between the United States and Denmark in the relationship between a health shock and employment for older workers.
The quality of causal evidence presented in this report is low because the authors did not account for unobserved differences between the countries. This means we are not confident that differences in the association between health shocks and employment in the United States and Denmark are attributable to the national health care policies; other factors are likely to have contributed.","National Healthcare Policy","Health Older workers' programs","Adult, Older worker",,"International, United States",2015,https://www.sciencedirect.com/science/article/pii/S0277953615002816,"Employment and Training Review Protocol"
"How much does access to health insurance influence the timing of retirement?","Coe, N. B., & Goda, G. S. (2015). How much does access to health insurance influence the timing of retirement? (SIEPR Discussion Paper No. 14-007). Stanford, CA: Stanford Institute for Economic Policy Research. City, ST: Publisher.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Unfavorable impacts
      
    
  
              


      
            Employment
      


  
      
            Public benefits receipt-Low-No impacts
      
    
  
              


      
            Public benefit receipt","Summary:

The study examined the impact of state-level reforms of health insurance on early retirement and Social Security retirement benefit claims.
The authors used 1996–2010 data from the Health and Retirement Study (HRS) and statistical models to compare the outcomes of individuals in states with state-level reforms of health insurance with those in non-reform states.
The study found that employed individuals in states with non-group health insurance reform were significantly more likely to retire at age 63.
The quality of causal evidence presented in this report is low because the authors did not demonstrate that individuals in states with state-level reforms of health insurance were similar to those in non-reform states. This means we are not confident that the estimated effects are attributable to the non-group health insurance reform; other factors are likely to have contributed.","Retiree Health Insurance","Health insurance Older workers' programs","Adult, Older worker",,"United States",2015,,"Employment and Training Review Protocol"
"Did age discrimination protections help older workers weather the Great Recession?","Neumark, D., & Button, P. (2014). Did age discrimination protections help older workers weather the Great Recession? Journal of Policy Analysis and Management, 33(4), 566-601. doi:10.1002/pam.21762","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Unfavorable impacts
      
    
  
              


      
            Employment","Summary:

The study examined whether the strong age discrimination laws moderated the impact of the Great Recession on employment outcomes of older workers.
The study used statistical models and the data from the 2003–2011 Current Population Survey (CPS) and 2004–2011 Quarterly Workforce Indicators to estimate impacts.
The study found that states with stronger age discrimination laws had experienced increases in unemployment rates, longer unemployment durations, and decreases in hiring rates for some types of older workers relative to younger workers in the months during and following the Great Recession.
The quality of causal evidence presented in this study is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the differential effect of the Great Recession on older workers in states with strong age discrimination laws, but other factors might also have contributed.","Age Discrimination Laws","Older workers' programs Other disparities or discrimination in employment and earnings","Adult, Older worker, Female, Male",,"United States",2014,https://www.nber.org/papers/w19216,"Employment and Training Review Protocol"
"The economics of federal tax and employment laws: Empirical evidence from three studies.","Figinski, T. F. (2013). The economics of federal tax and employment laws: Empirical evidence from three studies. (Doctoral dissertation). Retrieved from ProQuest. Accession No. 1415455735.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Low-Favorable impacts
      
    
  
              


      
            Employment
      


  
      
            Public benefits receipt-Low-Unfavorable impacts
      
    
  
              


      
            Public benefit receipt","Summary:

The study examined the impact of removing the Social Security earnings test on Social Security claims, earnings, and labor force participation for female beneficiaries.
The study used a statistical model and the data from the Social Security Administration’s Benefit and Earnings Public Use File to estimate impacts.
The study found that removing the earnings test was associated with an increase in Social Security claims among women who were primary or spousal beneficiaries and with an increase in average earnings and in labor force participation among women who were primary beneficiaries.
The qaulity of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the change in Social Security earings test. This means we are not confident that the estimated effects are attributable to the removal of the Social Security earnings test; other factors are likely to have contributed.","Social Security 2000 Earnings Test Removal","Federal retirement benefits Older workers' programs","Adult, Older worker, Female",,"United States",2014,,"Employment and Training Review Protocol"
"Retiree health insurance for public school employees: Does it affect retirement?","Fitzpatrick, M. D. (2014). Retiree health insurance for public school employees: Does it affect retirement? Journal of Health Economics, 38, 88-98.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Mixed impacts
      
    
  
              


      
            Employment","Summary:

The study’s objective was to examine the impact of an Illinois Public Schools retiree health insurance program on the retirement rates of eligible staff ages 55 to 75.
The study used a nonexperimental approach to compare the retirement rates of eligible staff with those of staff who were not eligible and staff in years prior to the introduction of the health insurance program who would have been eligible. The author used data from the Illinois Public Schools' Teacher Service Record database from 1970 to 1992.
The study found that eligibility for the program was associated with an overall decrease in retirement age, with eligible staff more likely to retire at ages 55 or 56, but less likely to retire after age 65 compared with those who were not eligible for the program.
The quality of the causal evidence presented in this report is low because the study is a nonexperimental analysis that does not account for possible differences in the groups. This means we are not confident that the estimated effects are attributable to the Illinois Public Schools Teachers Retirement Health Insurance Plan; other factors are likely to have contributed.","Illinois Public Schools Teachers Retirement Health Insurance Plan","Employer provided retirement benefits Health insurance Older workers' programs","Adult, Older worker",,"United States",2014,https://www.nber.org/papers/w19524,"Employment and Training Review Protocol"
"Who pays the high health costs of older workers? Evidence from prostate cancer screening mandates.","Bailey, J. (2014). Who pays the high health costs of older workers? Evidence from prostate cancer screening mandates. Applied Economics, 46(32), 3931-3941. doi:10.1080/00036846.2014.948673","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Unfavorable impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Mod/high-Unfavorable impacts
      
    
  
              


      
            Employment","Summary:

The study examined the impact of state mandates that health insurance plans cover prostate cancer screenings on the earnings and employment of men older than age 50
The study used nonexperimental regression analyses to compare older men in states that had enacted a mandate with women, younger men, and older men living in states without a mandate. The author used data from the Current Population Survey(CPS) between 1990 and 2009.
The study found that older men in states with mandates had lower wages and were less likely than the comparison group to be employed.
The quality of causal evidence presented in this study is moderate, because it is a well-implemented nonexperimental study. This means we are somewhat confident that the estimated effects are attributable to the prostrate screening mandate, but other factors might also have contributed.","Prostate cancer screening mandates","Health insurance Older workers' programs","Adult, Older worker, Male",,"United States",2014,https://sites.temple.edu/jamesbailey/files/2013/08/Who-Pays-the-High-Health-Cos…,"Employment and Training Review Protocol"
"Preventing youth violence and dropout: A randomized field experiment (No. w19014)","Heller, S., Pollack, H. A., Ander, R., & Ludwig, J. (2013). Preventing youth violence and dropout: A randomized field experiment (No. w19014). Cambridge, MA: National Bureau of Economic Research.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts
      
    
  
              


      
            Education and skills gains","Summary:


The study’s objective was to examine the impact of the Becoming a Man program on arrest and educational outcomes.
The study was a randomized controlled trial. Eligible male youth from 18 public schools in disadvantaged neighborhoods were screened for eligibility. The 2,740 who met requirements were randomly assigned to one of three treatment groups or a control group.
The study found that being offered the opportunity to participate in the program reduced violent crime arrests during the program year and improved schooling outcomes in both the program and follow-up years.
The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Becoming a Man program, and not to other factors.","Becoming a Man","Other training and education Safety Youth programs Behavioral Interventions","Youth, Disconnected youth, Male, Low income",,"United States, Urban",2013,http://faculty.chicagobooth.edu/workshops/AppliedEcon/past/pdf/jensludwigyouthv…,"Opportunities for Youth Review Protocol"
"Youth Initiated Mentoring: Investigating a new approach to working with vulnerable adolescents","Schwartz, S., Rhodes, J., Spencer, R., & Grossman, J. (2013). Youth Initiated Mentoring: Investigating a new approach to working with vulnerable adolescents. American Journal of Community Psychology, 52, 155–169.","Opportunities for Youth","Study Type: Descriptive Analysis",,,"Summary:
The study examined Youth Initiated Mentoring (YIM) within the context of the National Guard Youth ChalleNGe Program (NGYCP). Unlike a traditional mentoring program in which mentors are assigned to youth, under YIM, youth nominate their own mentors.

The authors conducted a quantitative analysis using data from the 9-, 21- and 38-month follow-up surveys administered as part of a national evaluation of NGYCP, along with qualitative analysis of interviews with a subsample of NGYCP participants.
The study found that YIM mentors included family friends, extended family members and godparents, school and extracurricular staff, and religious leaders. By the 38-month follow-up survey, 56 percent of youth reported still being in contact with their mentors.
In addition, NGYCP youth who were in contact with their mentors at the 38-month follow-up showed significant benefits on a range of outcomes compared with the control group.","Youth Initiated Mentoring in the National Guard Youth ChalleNGe","Mentoring Youth programs","Youth, Disconnected youth",,"United States",2013,,"Opportunities for Youth Review Protocol"
"The link between pensions and retirement timing: Lessons from California teachers.","Brown, K. M. (2013). The link between pensions and retirement timing: Lessons from California teachers. Journal of Public Economics, 98(C), 1-14.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study examined the impact of pension reform under the California State Teachers’ Retirement System (CalSTRS) on retirement timing.
The author used a statistical model and data from retirement-eligible employees in Los Angeles Unified School District from 1997 to 2000 to estimate the impact.
The study found public school employees were more likely to work an extra year in response to changes in pension plans that provided additional bonuses tied to age and tenure.
The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the changes in CalSTRS. This means we are not confident that the estimated effects are attributable to the changes in CalSTRS; other factors are likely to have contributed.","CalSTRS Defined Benefit Program","Older workers' programs Other wages and benefits","Adult, Older worker",,"United States",2013,https://eml.berkeley.edu//~saez/course/brown_jpube13.pdf,"Employment and Training Review Protocol"
"The impact of uncapping of mandatory retirement on postsecondary institutions.","Weinberg, S. L., & Scott, M. A. (2013). The impact of uncapping of mandatory retirement on postsecondary institutions. Educational Researcher, 42(6), 338-348.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study examined the impact of uncapping mandatory retirement on retirement ages at postsecondary institutions
The study used a statistical model to examine the age of retirement before and after the policy change in 1993. It used data on faculty’s employment and retirement from a research university with multiple schools.
The study found that uncapping was associated with a statistically significant increase in the retirement age among those who retired from the university.
The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar nor did they control for differences between the groups. This means we are not confident that the estimated effects are attributable to the federal Age Discrimination in Employment Act (ADEA); other factors are likely to have contributed.","Age Discrimination Employment Act (ADEA)","Federal retirement benefits Older workers' programs","Adult, Older worker",,"United States",2013,https://www.researchgate.net/publication/258134776_The_Impact_of_Uncapping_of_M…,"Employment and Training Review Protocol"
"Training and retirement patterns.","Montizaan, R., Cörvers, F., & de Grip, A. (2013). Training and retirement patterns. Applied Economics, 45(15), 1991-1999. doi:10.1080/00036846.2011.646066","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Unfavorable impacts
      
    
  
              


      
            Employment","Summary:

The study’s objective was to examine the impact of firm-specific training and general training on older men’s retirement decisions
The study used a nonexperimental design and data from the U.S. National Longitudinal Survey of Older Men for 1966 to 1983 to estimate impacts.
The study found that workers with firm-specific training were more likely to retire within the time period studied and to have jobs with a mandatory retirement age than workers without firm-specific training.
The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before receiving training and did not account for self-selection into training. This means we are not confident that the estimated effects are attributable to firm-specific or general training; other factors are likely to have contributed.","Firm-specific & General Training","Work based and other occupational training","Adult, Older worker, Male",,"United States",2013,https://www.researchgate.net/publication/236021967_Training_and_retirement_patt…,"Employment and Training Review Protocol"
"Does retiree health insurance encourage early retirement?","Nyce, S., Schieber, S. Shoven, J. B., Slavov, S., & Wise, D. A. (2013). Does retiree health insurance encourage early retirement? Journal of Public Economics, 104, 40-51.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Unfavorable impacts
      
    
  
              


      
            Employment","Summary:

The study’s objective was to examine the impact of employer-provided retiree health insurance on early retirement.
The authors used a nonexperimental design to compare early retirement outcomes of employees who are eligible for retiree health insurance with that of those who have no coverage.
The study found that people who were employed at age 57 and eligible for employer-subsidized retiree health coverage were significantly more likely to retire at ages 62 to 64 (before becoming eligible for Medicare at age 65) compared with those with no coverage.
The quality of causal evidence presented in this report is low because the authors did not account for other factors that could have affected the difference between the treatment and comparison groups. This means we are not confident that the estimated effects are attributable to retiree health insurance; other factors are likely to have contributed.","Retiree Health Insurance","Employer provided retirement benefits Older workers' programs","Adult, Older worker",,"United States",2013,https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3770310/,"Employment and Training Review Protocol"
"Do stronger age discrimination laws make Social Security reforms more effective?","Neumark, D., & Song, J. (2013). Do stronger age discrimination laws make Social Security reforms more effective? Journal of Public Economics, 108, 1-16.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Mixed impacts
      
    
  
              


      
            Employment
      


  
      
            Public benefits receipt-Mod/high-Favorable impacts
      
    
  
              


      
            Public benefit receipt","Summary:

The study examined whether the strength of state age discrimination protections affected rates of Social Security benefit claiming and employment outcomes of older workers.
The study used a nonexperimental design and the data on Social Security claiming and employment outcomes from the Health and Retirement Study (HRS) to estimate the impacts.
The study found that among older men affected by the 1983 Social Security reform, age discrimination protections were associated with increases in employment rates between age 62 and the full retirement age and delayed benefit claiming.
The quality of casual evidence presented in this report is moderate because the study was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to state age discrimination laws, but other factors might also have contributed.","The 1983 Social Security Reform","Older workers' programs Other disparities or discrimination in employment and earnings","Adult, Older worker, Male",,"United States",2013,https://ideas.repec.org/a/eee/pubeco/v108y2013icp1-16.html,"Employment and Training Review Protocol"
"Income tax and older American workers’ job transition into self-employment.","Choi, S. (2012). Income tax and older American workers’ job transition into self-employment. Korea and the World Economy, 13(2), 189-214.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Unfavorable impacts
      
    
  
              


      
            Employment","Summary:

The study examined the effect of a progressive income tax on the likelihood of transitioning to self-employment among older workers.
The study used a nonexperimental approach (the exponential hazard model) that compared the likelihood of transitioning from a wage job to self-employment based on the marginal taxes a worker would expect to pay. The author used the data from the Health and Retirement Study in 1992 matched to the Social Security Administration Master Earnings File from 1980 to 1991, which contains W-2 records of earnings from both wage work and self-employment.
The study found that a more progressive tax (that is, a tax schedule that increases sharply toward the higher end) or higher marginal tax rates reduces the likelihood of entering self-employment.
The quality of causal evidence presented in this report is low because the author did not ensure that the groups with higher or lower marginal tax rates were similar before a change in the tax schedule. This means we are not confident that the estimated effects are attributable to changes in marginal taxes; other factors are likely to have contributed.","Progressive Income Tax","Other employment and reemployment","Adult, Older worker, Employed",,"United States",2012,,"Employment and Training Review Protocol"
"The efficacy of supported employment for middle-aged and older people with schizophrenia.","Twamley, E. W., Vella, L., Burton, C. Z., Becker, D. R., Bell, M. D., & Jeste, D. V. (2012). The efficacy of supported employment for middle-aged and older people with schizophrenia. Schizophrenia Research, 135(1-3), 100-104.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study examined the impact of Individual Placement and Support (IPS) on competitive employment for older people with schizophrenia
The study was a randomized controlled trial (RCT) conducted at a community mental health clinic and used weekly work logs cross-referenced with pay stubs to measure employment outcomes over a 12-month period.
The study found that IPS was positively associated with employment and earnings.
The quality of causal evidence presented in this report is low because the RCT has a confounding factor. This means we are not confident that the estimated effects are attributable to the IPS program; other factors are likely to have contributed.","Individual Placement and Support and Vocational Rehabilitation Program","Health Individuals facing barriers to employment Job search assistance and supportive services","Adult, Older worker, Disability",,"United States",2012,https://psycnet.apa.org/record/2011-30184-001,"Employment and Training Review Protocol"
"Tax elasticity of labor earnings for older individuals","Alpert, A. & Powell, D. (2012). Tax elasticity of labor earnings for older individuals. (Report no. 2012-272). Ann Arbor, MI: University of Michigan Retirement Research Center, University of Michigan.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Mod/high-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study examined the impact of tax changes on people’s employment, retirement, and labor income outcomes.
The study uses a nonexperimental approach and the data from the Health and Retirement Study to estimate the effect.
The study found positive statistically significant relationships between increases in after-tax labor income and the employment of men and women as well as the delay in retirement for men. The study also found a positive statistically significant relationship between increases in the marginal net-of-tax rate and earnings for women.
The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to tax changes from the Economic Growth and Tax Relief Reconciliation Act (EGTRRA), the Jobs and Growth Tax Relief Reconciliation Act (JGTRRA), and their marriage tax penalty relief provision, but other factors might also have contributed.","Tax Changes","Older workers' programs Other employment and reemployment","Adult, Older worker",,"United States",2012,https://deepblue.lib.umich.edu/bitstream/handle/2027.42/94533/wp272.pdf?sequenc…,"Employment and Training Review Protocol"
"Labor market rigidities and the employment behavior of older workers.","Blau, D., & Shvydko, T. (2011). Labor market rigidities and the employment behavior of older workers. Industrial and Labor Relations Review, 64(3), 464-484.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study’s objective was to examine the impact of flexibility in hours of work on the likelihood that older workers separate from an employer.
The study used a statistical model to compare the job exit behavior of older and younger workers in firms with different shares of women younger than age 30. The analysis used monthly data on workers ages 45 to 69 in the Survey of Income and Program Participation from 1990 to 2001 matched to employers in the Longitudinal Employment and Household Dynamics data.
The study found that workers in their sixties who work for employers with a higher share of women younger than age 30 are less likely to experience job separations compared with workers in their late 40s to mid-50s.
The quality of causal evidence presented in this report is low because the groups being compared might not be similar before leaving their employer. This means we are not confident that the estimated effects are attributable to employment flexibility, other factors are likely to have contributed.","Employment flexibility","Other employer services","Adult, Older worker",,"United States",2011,https://www.jstor.org/stable/41149475?seq=1#page_scan_tab_contents,"Employment and Training Review Protocol"
"Evaluation of the Massachusetts Adolescent Outreach Program for Youths in Intensive Foster Care: Final Report","Courtney, M., Zinn, A., Johnson, H., and Malm, K. (2011). Evaluation of the Massachusetts Adolescent Outreach Program for Youths in Intensive Foster Care: Final Report. OPRE Report #2011-14. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Education and skills gains-Mod/high-Favorable impacts
      
    
  
              


      
            Education and skills gains
      


  
      
            Employment-Mod/high-No impacts
      
    
  
              


      
            Employment
      


  
      
            Public benefits receipt-Mod/high-No impacts
      
    
  
              


      
            Public benefit receipt","Summary:


The study’s objective was to examine the impact of the Massachusetts Adolescent Outreach Program for Youths in Intensive Foster Care (Outreach) on youths’ education, employment, earnings, and public benefit receipt.
Using a randomized controlled trial design, the authors estimated the program’s impact by comparing survey responses and college records for youth randomly selected to receive the Outreach program with those of youth randomly assigned to the control group.
The study found that the Outreach program significantly increased college enrollment and persistence.
The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Massachusetts Adolescent Outreach Program for Youths in Intensive Foster Care, and not to other factors.","the Massachusetts Adolescent Outreach Program for Youths in Intensive Foster Care","Job search assistance and supportive services Other training and education Youth programs Behavioral Interventions","Youth, Disconnected youth",,"United States",2011,http://www.acf.hhs.gov/sites/default/files/opre/eval_mass.pdf,"Opportunities for Youth Review Protocol"
"Adolescent perspectives of the ecological impact of a summer youth employment program.","Grant, N. (2011). Adolescent perspectives of the ecological impact of a summer youth employment program. Doctoral dissertation. Wichita, KS: Wichita State University. Available at http://soar.wichita.edu/handle/10057/5056.","Opportunities for Youth","Study Type: Descriptive Analysis",,,"Summary:

Using personal stories of youth who participated in the Area IV Kansas Summer Youth Employment Program (SYEP), the author sought to describe the ecosystems of urban youth, their relationships with adults, and the impacts of their participation in SYEP.
SYEP was a summer program funded as part of the American Recovery and Reinvestment Act of 2009. It provided disadvantaged youth with summer employment and job skills training over two summers.
The author interviewed 10 participating youth and analyzed their personal stories using ecological systems theory and a social capital framework. The author also analyzed documents containing the youths’ demographic and employment records.
The author concluded that programs such as SYEP helped disadvantaged youth to make networking connections, learn ways of interacting in the workplace, and open doors to job opportunities that historically have not been available to those with lower socioeconomic status.","Summer Youth Employment Programs (Area IV Kansas)","Basic skills Work based and other occupational training Youth programs","Youth, Disconnected youth, Low-skilled, Low income",,"United States",2011,http://www.workforce-ks.com/modules/showdocument.aspx?documentid=2206,"Opportunities for Youth Review Protocol"
"Beyond a summer work experience: The Recovery Act 2009 Post-Summer Youth Employment Initiative.","Holcomb, P., Ziegler, J., & Laird, E. (2011). Beyond a summer work experience: The Recovery Act 2009 Post-Summer Youth Employment Initiative. Princeton, NJ: Mathematica Policy Research.","Opportunities for Youth","Study Type: Implementation Analysis",,,"Summary:

Funded by the American Recovery and Reinvestment Act of 2009, the Summer Youth Employment Initiative (SYEI) aimed to reverse the steep decline in youth employment during the recession by providing employment opportunities for youth in the summer of 2009. The 2009 Post-SYEI allowed states and local workforce investment areas to provide extended work experiences to older disconnected youth ages 18 to 24 from October 2009 through March 2010.
The authors conducted in-depth site visits to eight selected study sites and analyzed the data using qualitative methods.
The authors reported that the study sites effectively built upon the implementation of the SYEI by using the same service delivery structure and extending the work experiences of those youth who had already participated in the summer program. The longer time frame for the work experiences was seen as a benefit by participants and employers. Post-SYEI programs also focused on ensuring the alignment between participants’ interests and their work experiences.
The authors recommended three considerations for the design of similar policies targeting older out-of-school youth in the future: allowing sufficient time to design such programs, because the needs of older out-of-school youth differ from those of younger youth who are traditionally served by these types of programs; supporting a year-round, not only summer, work experience; and incorporating a transition strategy from the work experience into future opportunities.","Summer Youth Employment Initiative (SYEI)","Basic skills Job search assistance and supportive services Work based and other occupational training Youth programs","Youth, Disconnected youth, Low-skilled, Low income",,"United States",2011,http://wdr.doleta.gov/research/FullText_Documents/ETAOP_201_03.pdf,"Opportunities for Youth Review Protocol"
"Reentry experiences of confined juvenile offenders: Characteristics, service receipt and outcomes of juvenile male participants in the SVORI multi-site evaluation. The multi-site evaluation of the Serious and Violent Offender Reentry Initiative.","Hawkins, S., Lattimore, P., Dawes, D., & Visher, C. (2010). Reentry experiences of confined juvenile offenders: Characteristics, service receipt and outcomes of juvenile male participants in the SVORI multi-site evaluation. The multi-site evaluation of the Serious and Violent Offender Reentry Initiative. NCJ 230423. Research Triangle Park, NC: RTI.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Education and skills gains-Mod/high-Mixed impacts
      
    
  
              


      
            Education and skills gains
      


  
      
            Employment-Mod/high-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study examined the impact of the Serious and Violent Offender Reentry Initiative (SVORI) on employment, education, and recidivism among juvenile incarcerated males.
The study used propensity scores to match participants in SVORI to nonparticipants who were similar on observed characteristics. The study used data from interviews collected at multiple time points through 15 months after release.
The study found that SVORI participants were more likely than nonparticipants to be enrolled in school 3 months post-release (68 and 52 percent, respectively) and were more likely than nonparticipants to have a job with benefits 15 months post-release (69 and 40 percent, respectively).
The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the SVORI program, but other factors might also have contributed.","Serious and Violent Offender Reentry Initiative (SVORI)","Other employment and reemployment Other health and safety Reentry Substance abuse recovery Youth programs","Youth, Justice-involved, Disconnected youth, Male",,"United States",2010,https://www.ncjrs.gov/pdffiles1/nij/grants/230423.pdf,"Opportunities for Youth Review Protocol"
"Framing Social Security Reform: Behavioral responses to changes in the full retirement age","Behaghel, L., & Blau, D. M. (2010) Framing Social Security Reform: Behavioral responses to changes in the full retirement age. (IZA Discussion Paper No. 5310). Bonn, Germany: IZA.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study examined the impact of changes to the Full Retirement Age (FRA) on labor force exit, Old Age and Survivor’s Insurance (OASI) claims, and retirement.
The study uses a statistical model and the data from the Health and Retirement Study (HRS) to compare outcomes of people in birth cohorts who were affected by the change in FRA with those of a comparison group of people who were not.
The study found that the change in the FRA was associated with significant increases in the likelihood of claiming OASI and exiting the labor force at the new, later full retirement age.
The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the change in FRA, but other factors might also have contributed.","changes to the Full Retirement Age (FRA)","Older workers' programs Other employment and reemployment","Older worker",,"United States",2010,https://www.aeaweb.org/articles?id=10.1257/pol.4.4.41,"Employment and Training Review Protocol"
"St. Mary’s County juvenile drug court outcome and cost evaluation","Mackin, J., Lucas, L., Lambarth, C., Waller, M., Herrera, A., Carey, S., & Finigan, M. (2010). St. Mary’s County juvenile drug court outcome and cost evaluation. Portland, OR: NPC Research.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence",,"Summary:

The study’s objective was to examine the impact of participation in a juvenile drug court program in St. Mary’s County, Oregon, on recidivism.
The study used administrative data from the departments of Juvenile Services, Public Safety and Correctional Services, and Health and Mental Hygiene to compare outcomes of youth who participated in juvenile drug court with outcomes from a group of similar, drug court-eligible youth who did not participate.
The study found no statistically significant effects on recidivism, including total number of rearrests, rearrests for drug charges, and rearrest rates over a two-year period.
The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we would be somewhat confident that any estimated effects would be attributable to participation in the juvenile drug court, but other factors might also have contributed. However, the study did not find any statistically significant effects.","St. Mary's County Juvenile Drug Court","Substance abuse recovery Youth programs Behavioral Interventions","Youth, Justice-involved, Disconnected youth",,"United States",2010,http://www.courts.state.md.us/opsc/dtc/pdfs/evaluationsreports/stmaryscountyjuv…,"Opportunities for Youth Review Protocol"
"Can Social Security explain trends in labor force participation of older men in the United States?","Blau, D. M., & Goodstein, R. M. (2010). Can Social Security explain trends in labor force participation of older men in the United States? Journal of Human Resources, 45(2), 328-363.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study examined the impact of changes in Social Security Administration (SSA) retirement rules on men’s labor force participation rates in the 1960s–1980s and 1990s–2000s.
The study used regression analyses to predicted labor force participation rates using actual and counterfactual SSA retirement rules. These analyses use data from the Current Population Survey (CPS) and the Survey of Income and Program Participation (SIPP) for the period from 1962 to 2005 merged with data from SSA on taxable earnings.
The study found that changes in the delayed retirement credit and full retirement age in 1983 could explain one-quarter to one-half of the increase in labor force participation in the early 2000s.
The quality of causal evidence presented in this report is moderate, because it is a well-implemented nonexperimental study. This means we are somewhat confident that the estimated effects are attributable to SSA reforms, but other factors might also have contributed.","Social Security Administration Reforms","Federal retirement benefits Older workers' programs","Adult, Older worker, Male",,"United States",2010,http://jhr.uwpress.org/content/45/2/328.abstract,"Employment and Training Review Protocol"
"Baltimore County Juvenile Drug Court outcome and cost evaluation","Mackin, J., Lucas, L., Lambarth, C., Herrera, T., Waller, M., Carey, S., & Finigan, M. (2010). Baltimore County Juvenile Drug Court outcome and cost evaluation. Portland, OR: NPC Research.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence",,"Summary:


The study examined the impact of participation in the Baltimore County Juvenile Drug Court on drug use and recidivism.
The authors used a nonexperimental design, matching youth who participated in the juvenile drug court with a comparison group of similar youth who were eligible to participate in juvenile drug court, but instead participated in the traditional juvenile justice system. The authors used administrative data to compare the mean number of juvenile rearrests over a two-year follow-up period.
The study found that drug court participants had significantly fewer juvenile rearrests, both overall and specifically for drug charges, than comparison youth.
The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the Baltimore County Juvenile Drug Court, but other factors might also have contributed.","the Baltimore County Juvenile Drug Court","Substance abuse recovery Youth programs","Youth, Disability, Disconnected youth",,"United States",2010,http://www.ndcrc.org/sites/default/files/baltimore_co_juv_dc_outcome-cost_0110…,"Opportunities for Youth Review Protocol"
"Elderly immigrants’ labor supply response to supplemental security income.","Kaushal, N. (2010). Elderly immigrants’ labor supply response to supplemental security income. Journal of Policy Analysis and Management, 29(1), 137-162.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study objective is to examine the impact of the Personal Responsibility and Work Opportunity Reconciliation Act (PRWORA) of 1996 on employment outcomes of foreign-born people and noncitizens ages 60 to 74
The study used a statistical model and the data from the Current Population Survey’s monthly outgoing rotation group and the March Current Population Survey from 1994 to 2005 to estimate the impact.
The study found that the PRWORA is associated with increased employment and decreased retirement for foreign-born men compared with U.S.-born men, but it found no statistically significant association with the employment for foreign-born women.
The quality of the causal evidence presented in this report is low because the study is a nonexperimental analysis that does not demonstrate that the groups were similar before the policy change. This means we are not confident that the estimated effects are attributable to PRWORA; other factors are likely to have contributed.","Personal Responsibility and Work Opportunity Reconciliation Act of 1996","Federal retirement benefits Foreign and temporary workers","Adult, Older worker, Immigrant",,"United States",2010,https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4222576/,"Employment and Training Review Protocol"
"The effects of changes in state SSI supplements on preretirement labor supply","Neumark, D., & Powers, E. T. (2005). The effects of changes in state SSI supplements on preretirement labor supply. Public Finance Review, 33(1), 3-35.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study examined the impact of a theoretical increase in Supplemental Security Income (SSI) benefits on the preretirement employment outcomes for likely SSI participants ages 60 to 64.
Using data from the annual Current Population Survey from 1979 to 2001 and state-level SSI receipt data, the authors used regression methods in a nonexperimental analysis of likely SSI participants to compare the outcomes of workers ages 62 to 64 with those of workers ages 60 to 61.
The study found that an increase in monthly SSI benefits was associated with a statistically significant decrease in the employment rate and number of hours worked for likely SSI recipients ages 62 to 64 compared with those ages 60 to 61.
The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to changes in SSI benefits; other factors are likely to have contributed.","Supplemental Security Income (SSI) benefits","Older workers' programs Other employment and reemployment","Adult, Older worker",,"United States",2010,https://journals.sagepub.com/doi/pdf/10.1177/1091142104270655,"Employment and Training Review Protocol"
"The influences on bridge employment decisions.","Pengcharoen, C., & Shultz, K. S. (2010). The influences on bridge employment decisions. International Journal of Manpower, 31(3), 322-336. doi:10.1108/01437721011050602","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Unfavorable impacts
      
    
  
              


      
            Employment","Summary:

The study examined the impact of work schedule flexibility on retirement outcomes among older workers, where work schedule flexibility was measured as the ability to reduce hours from one’s regular work schedule.
The study used a statistical model (multinomial logit regression) and the longitudinal data from the Health and Retirement Study (HRS) from 1992 and 2002 to examine the relationship between reporting work schedule flexibility or inflexibility during the baseline survey and reporting complete retirement, partial retirement, or continued employment at the follow-up survey 10 years later among older workers.
The study found that individuals who reported work schedule inflexibility in the 1992 were more likely to report completely retired than partially retired in 2002, but when comparing the likelihood of reporting continued employment to complete or partial retirement, there was no difference between older workers reported work schedule flexibility and those who reported inflexibility in 1992.
The quality of causal evidence presented in this study is low because the authors did not demonstrate that the participants reporting work schedule flexibility were similar to the participants reporting work schedule inflexibility in 1992. This means we are not confident that the estimated effects are attributable to work schedule flexibility; other factors are likely to have contributed.",,"Other wages and benefits","Adult, Older worker",,"United States",2010,https://www.researchgate.net/publication/46545640_The_influences_on_bridge_empl…,"Employment and Training Review Protocol"
"Anne Arundel County juvenile treatment court outcome and cost evaluation","Mackin, J., Lucas, L., Waller, M., Carey, S., & Finigan, M. (2010). Anne Arundel County juvenile treatment court outcome and cost evaluation. Portland OR: NPC Research.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence",,"Summary:


The study’s objective was to examine the impact of a juvenile treatment court in Anne Arundel County, Maryland, on recidivism.
The authors used a nonexperimental design, matching youth who participated in the juvenile treatment court with similar court-involved youth who did not participate in the juvenile treatment court. The authors used administrative data to compare the mean number of juvenile rearrests for the study groups over a two-year follow-up period.
The study found that 53 percent of the treatment court group, compared with 73 percent of the comparison group, had a juvenile rearrest within 24 months. The study also found differences of a similar magnitude at three intermediate follow-ups (6-, 12-, and 18-month follow-ups).
The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the juvenile treatment court, but other factors might also have contributed.","Anne Arundel Juvenile Treatment Court","Other training and education Substance abuse recovery Youth programs Behavioral Interventions","Youth, Justice-involved, Disconnected youth",,"United States",2010,http://www.courts.state.md.us/opsc/dtc/pdfs/evaluationsreports/annearundelcount…,"Opportunities for Youth Review Protocol"
"Retiree health insurance and disengagement from a career job.","Robinson, C., & Clark, R. (2010). Retiree health insurance and disengagement from a career job. Journal of Labor Research, 31(3), 247-262.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-No impacts
      
    
  
              


      
            Employment","Summary:

The study examined the effect of availability of retiree health insurance (RHI) on a person’s decision to leave a career job (a measure of retirement).
Using data from the Health and Retirement Study (HRS), the authors used a nonexperimental approach to estimate the likelihood of retirement for those who worked at firms with RHI compared with those who worked at firms without RHI.
The study found that workers at firms that offer RHI are more likely to retire than those at firms that do not offer RHI.
The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we would be somewhat confident that any estimated effects would be attributable to the availability at RHI, but other factors might also have contributed.","Retiree Health Insurance","Other health and safety Older workers' programs","Adult, Older worker",,"United States",2010,https://link.springer.com/article/10.1007/s12122-010-9091-4,"Employment and Training Review Protocol"
"Reinvesting in America’s youth: Lessons from the 2009 Recovery Act Summer Youth Employment Initiative.","Bellotti, J., Rosenberg, L., Sattar, S., Esposito, A., & Ziegler, J. (2010). Reinvesting in America’s youth: Lessons from the 2009 Recovery Act Summer Youth Employment Initiative. Princeton, NJ: Mathematica Policy Research.","Opportunities for Youth","Study Type: Implementation Analysis",,,"Summary:

The research examines the implementation of the Summer Youth Employment Initiative (SYEI). Funded by the American Recovery and Reinvestment Act of 2009, SYEI aimed to reverse the steep decline in youth employment during the recession by providing employment opportunities for youth in the summer of 2009. Through the initiative, youth were placed in summer work experiences with local employers and their wages were paid with Recovery Act funds. The work experiences were fairly flexible, but had to be age appropriate and lead to youth meeting work readiness goals.
The authors analyzed state performance data through December 31, 2009, and data from in-depth site visits to 20 selected sites during July and August 2009.
The authors reported that it took a large effort to get the program up and running in such a short amount of time (about four months). Some sites reported having to make compromises along the way, given the quick time frame, but all reported satisfaction with their accomplishments. The initiative was implemented successfully in all the studied sites, with all sites able to recruit a sufficient number of participants and place them in employment. Youth participants and the employers interviewed were very positive about the initative.
Although the implementation of SYEI was considered a success, it was not without some initial challenges, including handling the large volume of applicants and determining their eligibility, reaching older youth ages 22 to 24 and veterans and their spouses, and appropriately matching youth to employers.","Summer Youth Employment Initiative (SYEI)","Basic skills Job search assistance and supportive services Work based and other occupational training Youth programs","Youth, Disconnected youth, Low-skilled, Low income",,"United States",2010,http://files.eric.ed.gov/fulltext/ED510398.pdf,"Opportunities for Youth Review Protocol"
"Youth work and learn at Our Piece of the Pie (OPP): Findings of the formative evaluation of Connecticut's youth development model","Britner, P., Buch, R., Colon, R., Milan, S., Singer, M., & Snow, S. (2009). Youth work and learn at Our Piece of the Pie (OPP): Findings of the formative evaluation of Connecticut's youth development model. Storrs, CT: Center for Health, Intervention and Prevention, University of Connecticut.","Opportunities for Youth","Study Type: Descriptive Analysis",,,"Summary:

	This report describes the work of Our Piece of the Pie (OPP), an organization that gives young people in Hartford, CT, access to a range of services, including academic assistance, vocational training, and guidance from caring adults trained to provide mentorship and other support.
	The study aimed to gather information on the characteristics of the youth served by OPP, their participation in program activities, and the progress they made in reaching academic and employment goals.
	The evaluation team conducted direct observations of intervention activities, interviews with program staff and participants, and surveys of participating youth. It also drew on program data collected by OPP.
	The study found that most participants spent a considerable amount of time with their mentors each week, with some also taking advantage of career advancement and educational preparation services. Although participating youth were making progress on their goals at the time of the evaluation, particularly in achieving educational milestones, the authors suggested that the program could benefit by strengthening participant-mentor relationships, adapting programming for special populations, and improving the quality of program data.","Our Piece of the Pie (OPP)","Job search assistance and supportive services Youth programs Mentoring Other training and education Work based and other occupational training","Youth, Disconnected youth",,"United States",2009,,"Opportunities for Youth Review Protocol"
"New evidence on the labor supply effects of the Social Security earnings test.","Friedberg, L., & Webb, A. (2009). New evidence on the labor supply effects of the Social Security earnings test. Tax Policy and the Economy, 23(1), 1-36.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study examined the impact of changes to the Social Security earnings test in 1996 and 2000 on employment outcomes.
The authors used a nonexperimental design and the data from the Current Population Survey (CPS) and the Health and Retirement Study (HRS) to compare outcomes before and after the changes in earning test rules for those between the ages of 62 and 74 who faced different earnings test thresholds at different ages and years.
The study found that upcoming anticipated earnings test between ages 62 to 69 was associated with a significantly lower likelihood of having a job last week. A higher present value of upcoming anticipated earnings threshold between ages 62 to 69 was associated with a significantly higher likelihood of having a job last week.
The quality of causal evidence presented in this study is low because the study is a nonexperimental analysis that did not demonstrate that the groups being compared were similar and did not account for possible differences in the analysis. This means we are not confident that the estimated effects are attributable to the changes in the earnings test decision. Other factors are likely to have contributed.","Social Security Earnings Test","Older workers' programs Other employment and reemployment","Adult, Older worker",,"United States",2009,,"Employment and Training Review Protocol"
"The repeal of the retirement earnings test and the labor supply of older men.","Engelhardt, G. V., & Kumar, A. (2009). The repeal of the retirement earnings test and the labor supply of older men. Journal of Pension Economics & Finance, 8(4), 429-450.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study examined the impact of the repeal of the earnings test under the Senior Citizens Freedom to Work Act of 2000 on the labor supply and earnings of older men ages 62 to 72.
The authors used a nonexperimental approach and data from the Health and Retirement Study to compare labor force participation, annual hours of work, retirement behavior, and earnings of men who were and were not subject to the repeal of the earnings test.
The study found that the policy change was associated with a significant increase in older men’s average annual hours of work. The policy change was also associated with a change in the distribution of real earnings in that a smaller proportion of older men had earnings at or below the earnings test threshold.
The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Senior Citizens Freedom to Work Act of 2000; other factors are likely to have contributed.","Senior Citizens Freedom to Work Act of 2000","Older workers' programs Other disparities or discrimination in employment and earnings","Adult, Older worker, Male",,"United States",2009,,"Employment and Training Review Protocol"
"An empirical study of the effects of Social Security reforms on benefit claiming behavior and receipt using public-use administrative microdata.","Benítez-Silva, H., & Yin, N. (2009). An empirical study of the effects of Social Security reforms on benefit claiming behavior and receipt using public-use administrative microdata. Social Security Bulletin, 69(3), 77-95.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Public benefits receipt-Low-Favorable impacts
      
    
  
              


      
            Public benefit receipt","Summary:

The study examined the impact of three policy changes to the Social Security program that went into effect in 2000 on average monthly benefits and the proportion of new claimants by age.
The study was a nonexperimental analysis that examined outcomes for older workers by age and year using data from the 2004 Old Age, Survivors, and Disability Insurance program public-use microdata files.
The study found that the changes were associated with lower average monthly benefits for individuals ages 66 to 69 after the year 2000 relative to individuals of the same ages in 1994.
The quality of the causal evidence presented in this report is low because the authors did not demonstrate that the groups were similar before the intervention. This means we are not confident that the estimated effects are attributable to the intervention program; other factors are likely to have contributed.","Policy Changes to the Social Security Program","Federal retirement benefits Older workers' programs","Adult, Older worker",,"United States",2009,https://papers.ssrn.com/sol3/papers.cfm?abstract_id=1480653,"Employment and Training Review Protocol"
"How did the elimination of the US earnings test above the normal retirement age affect labour supply expectations?","Michaud, P., & Van Soest, A. (2008). How did the elimination of the US earnings test above the normal retirement age affect labour supply expectations? Fiscal Studies, 29(2), 197-231. doi:10.1111/j.1475-5890.2008.00073.x","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The authors used a nonexperimental approach and the data from Health and Retirement Study data from 1996 to 2002 and Social Security earnings history to estimate the impact.
The study examined the impact of repealing the earnings test from Social Security recipients between full retirement age and age 70 on older workers’ subjective probability of retirement.
The authors used a nonexperimental approach and the data from Health and Retirement Study data from 1996 to 2002 and Social Security earnings history to estimate the impact.
The study found that after the repeal of the earnings test, the subjective probability of working of full-time past age 65 for older male workers who were likely to have most of their projected Social Security benefits reduced under the earnings test has increased their expected probability of working relative to those who were not likely to be affected. •The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design.This means we are somewhat confident that the estimated effects are attributable to the repeal of the earnings test, but other factors might also have contributed.","Social Security Earnings Test","Federal retirement benefits Older workers' programs","Adult, Older worker, Male",,"United States",2008,,"Employment and Training Review Protocol"
"Evaluation of the Suffolk County juvenile treatment court: Process and impact findings","Kralstein, D. (2008). Evaluation of the Suffolk County juvenile treatment court: Process and impact findings. New York: Center for Court Innovation.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary:


The study’s objective was to examine the impact of Suffolk County’s juvenile drug court on recidivism.
The study used propensity scores based on state and county administrative records to match juveniles who participated in the drug court to similar juveniles in the year before the introduction of the drug court. The author used regression analysis to estimate the relationship between participation in the juvenile drug court and the number and rate of arrests 18 and 24 months following the initial petition.
The study found no statistically significant relationship between the juvenile drug court and recidivism.
The quality of causal evidence presented in this report is low because the study did not account for other changes that could have taken place at the same time as the introduction of the drug court and affected juvenile recidivism. This means we are not confident that any estimated effects would be attributable to the juvenile drug court, and not other factors. However, the study found no statistically significant effects.","Suffolk County’s Juvenile Drug Court","Reentry Substance abuse recovery Youth programs","Youth, Justice-involved, Disconnected youth",,"United States",2008,http://www.courtinnovation.org/sites/default/files/Suffolk_JTC.pdf,"Opportunities for Youth Review Protocol"
"The effect of the social security earnings test on male labor supply: New evidence from survey and administrative data.","Haider, S. J., & Loughran, D. S. (2008). The effect of the social security earnings test on male labor supply: New evidence from survey and administrative data. Journal of Human Resources, 43(1), 57-87.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Mixed impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employer benefits receipt-Low-Favorable impacts
      
    
  
              


      
            Employer benefits receipt","Summary:

The study’s objective is to examine the impact of 1983 and 2000 policy changes that removed the Social Security earnings test for certain age groups on the earnings and employment outcomes of affected men
The study is a nonexperimental analysis that examines the correlations between the 1983 and 2000 policy changes and earnings and employment status. The study compares the outcomes of men affected by the policy changes with the outcomes of men of similar ages not affected by the policy changes.
The study finds that the 1983 policy change is associated with few changes to the observed outcomes and that the 2000 policy change is associated with higher earnings and hours worked per week for affected men.
The quality of causal evidence presented in this report is low because the study does not demonstrate that men affected by the policy changes are similar to the men not affected by the policy change, nor does it control for possible differences. This means we are not confident that the estimated effects are attributable to the 1983 and 2000 policy changes; other factors are likely to have contributed.","Social Security Earnings Test","Federal retirement benefits Older workers' programs","Adult, Older worker, Male",,"United States",2008,http://jhr.uwpress.org/content/43/1/57.refs,"Employment and Training Review Protocol"
"The impact of reentry services on juvenile offenders’ recidivism","Bouffard, J., & Bergseth, K. (2008). The impact of reentry services on juvenile offenders’ recidivism. Youth Violence and Juvenile Justice, 6(3), 295-318.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary:


The study examined the impact of structured after-care and reentry services for justice-involved youth on their recidivism rates.
The study used a nonexperimental design to compare youth who received reentry services to a comparison group of youth who received traditional services in a neighboring county. Data came from the local juvenile court databases, probation and transitional coordinator files, and electronic records used by case managers to track client contacts.
The study found that there were no statistically significant differences between study groups in time to first reoffense or in number of criminal contacts with the justice system.
The quality of causal evidence presented in this report is low because all treated youth were in one county and all comparison youth were in another. This means we are not confident that the estimated effects are attributable to the after-care and reentry program; other factors are likely to have contributed.","After-care and Reentry Services","Mentoring Reentry Youth programs","Youth, Justice-involved, Disconnected youth",,"United States, Rural",2008,,"Opportunities for Youth Review Protocol"
"McNeil Education, Training and Evaluation (2008). Process evaluation of the Demand-Side Youth Offender Demonstration Project (Phase II).","McNeil Education, Training and Evaluation (2008). Process evaluation of the Demand-Side Youth Offender Demonstration Project (Phase II). Chapel Hill, NC: McNeil Education.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study’s objective was to examine the impact of being matched to employment through the Demand-Side Youth Offender Demonstration Project (DSYODP) Phase I on youths’ average weekly earnings.
The study compared the wages of employed youth who were matched to employment through DSYODP with the wages of employed youth who were eligible for the DSYODP but had secured employment through other means.
The study found that average weekly wages of youth matched to employment through DSYODP were significantly higher than wages of youth who secured employment through other means.
The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the DSYODP; however, other factors might also have contributed.","Demand-Side Youth Offender Demonstration Project (DSYODP)","Job search assistance and supportive services Youth programs","Youth, Justice-involved, Disconnected youth",,"United States",2008,https://wdr.doleta.gov/research/FullText_Documents/Process%20Evaluation%20of%20…,"Opportunities for Youth Review Protocol"
"Evaluation of the Boys & Girls Clubs of America Targeted Re-Entry Initiative","Barton, W., Jarjoura, G., & Rosay, A. (2008). Evaluation of the Boys & Girls Clubs of America Targeted Re-Entry Initiative. Indianapolis: Indiana University School of Social Work, and Anchorage: Justice Center, University of Alaska Anchorage.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary:


The study’s objective was to examine the impact of the Boys & Girls Clubs of America’s Targeted Re-Entry Initiative on youth’s recidivism.
The authors used administrative data to match Initiative participants to a comparison group of nonparticipants released from the same rehabilitation facilities. The authors compared recidivism rates among program participants and the comparison group.
The authors reported a statistically significant relationship between participation in the Targeted Re-Entry Initiative and higher rates of re-arrest at one of the three sites studied, and no statistically significant correlations at the other two sites.
The quality of causal evidence presented in this report is low because the authors did not include sufficient controls for pre-existing differences between the study groups in their analysis. This means we are not confident that the estimated effects are attributable to the Boys & Girls Clubs of America Targeted Re-Entry Initiative; other factors are likely to have contributed.","the Boys & Girls Clubs of America Targeted Re-Entry Initiative","Basic skills Health Job search assistance and supportive services Other training and education Reentry Substance abuse recovery Youth programs Behavioral Interventions","Youth, Justice-involved, Disconnected youth",,"United States",2008,http://justice.uaa.alaska.edu/research/2000/0411.targeted_reentry/0411.05.targe…,"Opportunities for Youth Review Protocol"
"State age protection laws and the Age Discrimination in Employment Act.","Lahey, J. State age protection laws and the Age Discrimination in Employment Act. (2008). The Journal of Law and Economics, 51(3), 433-460.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Low-No impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Low-Unfavorable impacts
      
    
  
              


      
            Employment","Summary:

The study examined the impact of enforcement of age discrimination laws on the employment and earnings of older male workers
The author used a nonexperimental regression model and data from the Current Population Survey to estimate the impact.
The study found that males older than 50 in states with age discrimination laws were 0.2 percentage points less likely to be hired compared with those in states without their own age discrimination laws.
The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the state laws on age discrimination, but other factors might also have contributed.","Age Discrimination Employment Act (ADEA)","Older workers' programs Other disparities or discrimination in employment and earnings","Adult, Older worker, Male",,"United States",2008,https://www.jstor.org/stable/10.1086/589670?seq=1#page_scan_tab_contents,"Employment and Training Review Protocol"
"Supported employment for middle-aged and older people with schizophrenia.","Twamley, E., Narvaez, J., Becker, D., Bartels, S., & Jeste, D. (2008). Supported employment for middle-aged and older people with schizophrenia. American Journal of Psychiatric Rehabilitation, 11(1), 76-89.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study examined the impact of Individual Placement and Support (IPS) on competitive employment for older people with schizophrenia
The study was a randomized controlled trial (RCT) and used weekly work logs cross-referenced with pay stubs to measure employment outcomes over a 12-month period.
The study found that IPS increased competitive employment and earnings compared with conventional services.
The quality of causal evidence presented in this report is low because the RCT has a confounding factor. This means we are not confident that the estimated effects are attributable to the IPS program; other factors are likely to have contributed.","Individual Placement and Support and Vocational Rehabilitation Program","Health Individuals facing barriers to employment Job search assistance and supportive services","Adult, Older worker, Disability",,"United States",2008,https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2638571/,"Employment and Training Review Protocol"
"An experimental evaluation of teen courts","Stickle, W., Connell, N., Wilson, D., & Gottfredson, D. (2008). An experimental evaluation of teen courts. Journal of Experimental Criminology, 4(2), 137-163.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence",,"Summary:


The study’s objective was to examine the impact of participation in a teen court on youth offenders’ rates of recidivism.
The study was a randomized controlled trial in which eligible youth were randomly assigned to either the treatment group, which participated in a teen court, or to the control group, which participated in the traditional juvenile justice system. The authors compared outcomes for the two groups using administrative data.
The study reported no differences in recidivism outcomes for teen court youth and those in the traditional juvenile justice system.
The quality of causal evidence presented in this report is moderate for some outcomes and low for other outcomes. This means we have little confidence that any estimated effects would be attributable to the teen court program. However, the study did not find statistically significant effects.","Teen Court","Youth programs","Youth, Justice-involved, Disconnected youth",,"United States",2008,,"Opportunities for Youth Review Protocol"
"Reentry services: An evaluation of a pilot project in Clay County, MN","Bergseth, K., & McDonald, T. (2007). Reentry services: An evaluation of a pilot project in Clay County, MN. Fargo, ND: North Dakota State University, Department of Criminal Justice and Political Science.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary:


The study’s objective was to examine the impact of the Reentry Services Project (RSP) on juvenile recidivism.
The authors estimated regression models comparing the number of criminal and official contacts with police or the courts, pulled from an electronic Court Services Tracking System, between RSP and comparison group members, controlling for differences in demographics and number of prior charges.
The study found that RSP group members had significantly fewer official and criminal contacts than the comparison group one year after release from out-of-home placement.
The quality of causal evidence presented in this report is low because the program was implemented in only one county and there was no variation in the implementation of the program over time. This means we are not confident that the estimated effects are attributable to the RSP; other factors are likely to have contributed.","the Reentry Services Project (RSP)","Health Job search assistance and supportive services Reentry Substance abuse recovery Youth programs Behavioral Interventions","Youth, Justice-involved, Disconnected youth",,"United States",2007,http://www.claycountycollaborative.org/projects/RSP%20Final%20Report%202007.pdf,"Opportunities for Youth Review Protocol"
"Labor market shocks and retirement: Do government programs matter?","Coile, C., & Levine, P. (2007). Labor market shocks and retirement: Do government programs matter? Journal of Public Economics, 91(10), 1902-1919.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-No impacts
      
    
  
              


      
            Employment
      


  
      
            Public benefits receipt-Low-No impacts
      
    
  
              


      
            Public benefit receipt","Summary:

The study examined the impact of the generosity of unemployment insurance (UI) benefits on retirement decisions.
The study used a statistical model and data from the March Current Population Survey for 1980–2004 to estimate impacts.
The study found no relationship between the generosity of UI benefits and the likelihood of retirement or receipt of UI.
The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before changes in the generosity of UI benefits were observed. This means we are not confident that the estimated effects are attributable to changes in the generosity of UI benefits; other factors are likely to have contributed.","Unemployment Insurance (UI)","Unemployment Insurance","Adult, Older worker, Unemployed",,"United States",2007,http://academics.wellesley.edu/Economics/Coile/PDF%20files/coile-levine%20JPubE…,"Employment and Training Review Protocol"
"The effects of an experimental intensive juvenile probation program on self-reported delinquency and drug use","Lane, J., Turner, S., Fain, T., & Sehgal, A. (2007). The effects of an experimental intensive juvenile probation program on self-reported delinquency and drug use. Journal of Experimental Criminology, 3(3), 201-219.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence",,"Summary:

The study’s objective was to examine the impact of the South Oxnard Challenge Project (SOCP), an alternative juvenile probation program, on delinquency and drug use.
The study was a randomized controlled trial. Eligible youth were randomly assigned to either a treatment group, which could participate in SOCP, or a control group, which had routine juvenile probation.
The study found that significantly more SOCP youth than youth in the control group reported committing a violent crime in the 12 months after starting probation (67.6 versus 55.6 percent). However, SOCP youth indicated they used ecstasy/MDMA less frequently than control youth in the past 30 days (1.8 versus 4.2 days).
The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the SOCP, and not to other factors.","South Oxnard Challenge Project (SOCP)","Substance abuse recovery Youth programs Behavioral Interventions","Youth, Justice-involved, Disconnected youth",,"United States",2007,,"Opportunities for Youth Review Protocol"
"A tax on work for the elderly: Medicare as a secondary payer.","Goda, G. S., Shoven, J. B., & Slavov, S. N. (2007). A tax on work for the elderly: Medicare as a secondary payer. (NBER Working Paper No. 13383). Cambridge, MA: National Bureau of Economic Research.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study’s objective was to examine the impact of Medicare as a Secondary Payer (MSP) on older workers’ labor force participation and full-time employment
The study used a nonexperimental regression design. The authors used data from the 1980 to 2006 March Supplement of the Current Population Survey.
The study found that labor force participation for older males increased following the enforcement of the MSP policy, and that older males and females in the labor force were more likely to be employed full time after the policy was enforced.
The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention, and confounding factors could have impacted older workers differentially during the time periods examined. This means we are not confident that the estimated effects are attributable to MSP; other factors are likely to have contributed.","Medicare as a Secondary Payer","Federal retirement benefits Older workers' programs","Adult, Older worker",,"United States",2007,https://www.nber.org/papers/w13383,"Employment and Training Review Protocol"
"New evidence on earnings and benefit claims following the changes in the retirement earnings test in 2000.","Song, J. G., & Manchester, J. (2006). New evidence on earnings and benefit claims following the changes in the retirement earnings test in 2000. (ORES Working Paper 107). Washington, DC: Social Security Administration, Office of Policy, Office of Research, Evaluation, and Statistics. Also available in Journal of Public Economics, 91(3–4), 669–700 (2007).","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-No impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Low-No impacts
      
    
  
              


      
            Employment
      


  
      
            Public benefits receipt-Mod/high-Unfavorable impacts
      
    
  
              


      
            Public benefit receipt","Summary:

The study examined the impact of the Senior Citizens Freedom to Work Act of 2000 on employment, earnings, and public benefit receipt outcomes of workers ages 65 to 69.
The study was a nonexperimental analysis and used Social Security Administrative data to estimate the impacts.
The study found that the Senior Citizens Freedom to Work Act of 2000 was associated with significant increases in the rate of Social Security claims for both sets of individuals affected by the law. The study found no statistically significant relationship between the Senior Citizens Freedom to Work Act of 2000 and earnings.
The quality of casual evidence presented in this report for Social Security claims and earnings outcomes is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the Senior Citizens Freedom to Work Act of 2000, but other factors might also have contributed. The quality of causal evidence presented in this report on employment is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Senior Citizens Freedom to Work Act of 2000; other factors are likely to have contributed.","Senior Citizens Freedom to Work Act of 2000","Older workers' programs Other disparities or discrimination in employment and earnings","Adult, Older worker",,"United States",2006,,"Employment and Training Review Protocol"
"Recidivism findings for the Juvenile Rehabilitation Administration’s mentoring program: Final report","Drake, E. (2006). Recidivism findings for the Juvenile Rehabilitation Administration’s mentoring program: Final report. Olympia, WA: Washington State Institute for Public Policy.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence",,"Summary:


The study’s objective was to examine the impact of the Washington State Juvenile Rehabilitation Administration’s mentoring program on recidivism.
The author estimated the effect of the mentoring program using administrative data to compare outcomes among youth released from a juvenile rehabilitation facility who applied to participate in the program with the outcomes of similar youth who did not apply.
The study did not find any statistically significant effects of the mentoring program on recidivism.
The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that any estimated effects would be attributable to the Washington State Juvenile Rehabilitation Administration’s mentoring program, but other factors might also have contributed. However, the study did not find statistically significant effects.","the Juvenile Rehabilitation Administration’s Mentoring Program","Mentoring Youth programs","Youth, Justice-involved, Disconnected youth",,"United States",2006,http://www.wsipp.wa.gov/ReportFile/947/Wsipp_Recidivism-Findings-for-the-Juveni…,"Opportunities for Youth Review Protocol"
"Harford County juvenile drug court performance evaluation: Final report","Crumpton, D., Carey, S., Mackin, J., Finigan, M., Pukstas, K., Weller, J., and Brekhus, J. (2006). Harford County juvenile drug court performance evaluation: Final report. Portland, Oregon. NPC Research, 1-104.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence",,"Summary:

The study’s objective was to examine the impact of the Harford County (Maryland) Juvenile Drug Court on recidivism.
The authors used administrative records to estimate the impact of the drug court by comparing the outcomes of youth who participated in the drug court with those of similar youth who did not.
The study found that drug court participants had significantly fewer rearrests (36 percent fewer) and fewer days (59 percent fewer) on probation than youth who were eligible for the program but did not participate. Participants spent fewer days in secure and community detention in the first year after program entry than youth in the comparison group. However, the study found no significant effects on the number of adjudication hearings, days in residential treatment, or days in a group home.
The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the Harford County Juvenile Drug Court, but other factors might also have contributed.","Harford County Juvenile Drug Court","Substance abuse recovery Youth programs Behavioral Interventions","Youth, Justice-involved, Disconnected youth",,"United States",2006,http://npcresearch.com/wp-content/uploads/HCJDC_Process_Outcome-Cost-FINAL-repo…,"Opportunities for Youth Review Protocol"
"Juvenile drug court: Enhancing outcomes by integrating evidence-based treatments.","Henggeler, S., Halliday-Boykins, C., Cunningham, P., Randall, J., Shapiro, S., & Chapman, J. (2006). Juvenile drug court: Enhancing outcomes by integrating evidence-based treatments. Journal of Consulting and Clinical Psychology, 74(1), 42-54.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Health and safety-Mod/high-Favorable impacts
      
    
  
              


      
            Health and safety","Summary:

The study’s objective was to examine the marginal impacts of three layered treatments—drug court hearings, substance abuse therapy, and contingency management counseling—on criminal justice outcomes and positive drug screens among youth in Charleston, South Carolina, diagnosed with substance abuse or dependence.
The authors randomly assigned eligible youth to one of three treatment groups—drug court, drug court with multisystemic therapy, or drug court with multisystemic therapy enhanced by contingency management—or to a control group that received typical family court services.
The study found no statistically significant differences between the groups on measures of recidivism after one year. However, the study found that participants in the treatment groups reported committing fewer delinquent acts than those in the control groups. Effects on drug screens were mixed.
The quality of causal evidence presented in this report is high for recidivism outcomes because they are based on a well-implemented randomized controlled trial but moderate for self-reported delinquency and drug screen outcomes because they had high attrition and the authors demonstrated that the groups being compared had similar baseline characteristics.","the Treatments","Substance abuse recovery Youth programs Behavioral Interventions","Youth, Justice-involved, Disconnected youth",,"United States",2006,,"Opportunities for Youth Review Protocol"
"The effect of the SSI program on labor supply: Improved evidence from Social Security administrative files","Neumark, D., & Powers, E. T. (2005). The effect of the SSI program on labor supply: Improved evidence from Social Security administrative files. Social Security Bulletin, 65(3), 45-60.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study examined the relationship between generous state Supplemental Security Income (SSI) benefits and the employment of older worker nearing SSI eligibility age.
The authors used a regression model and data from the Survey of Income and Program Participants (SIPP) and Social Security Administration (SSA) to estimate the effect.
The study found that older males who were likely SSI participants in generous states worked significantly fewer hours and had lower employment rates compared with those living in less generous states. The authors, using the SSA administrative records, also found that likely older participants (ages 60 to 64) worked significantly fewer hours than younger ones.
The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to generosity of state SSI benefits; other factors are likely to have contributed.","state Supplemental Security Income (SSI) benefits","Older workers' programs Other employment and reemployment","Adult, Older worker",,"United States",2005,https://www.ssa.gov/policy/docs/ssb/v65n3/v65n3p45.html,"Employment and Training Review Protocol"
"Evaluating an experimental intensive juvenile probation program: Supervision and official outcomes","Lane, J., Turner, S., Fain, T., & Sehgal, A. (2005). Evaluating an experimental intensive juvenile probation program: Supervision and official outcomes. Crime & Delinquency, 51(1), 26-52.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence",,"Summary:

The study’s objective was to examine the impact of the South Oxnard Challenge Project (SOCP), an alternative juvenile probation program, on recidivism outcomes.
The study was a randomized controlled trial. The authors used administrative data from the program and probation records to compare the outcomes of youth randomly assigned to the SOCP with those of youth randomly assigned to a control group that received standard probation services.
The study found no statistically significant effects of SOCP on arrests or referrals to probation, convictions, or incarceration.
The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects would be attributable to SOCP and not to other factors. However, the study did not find statistically significant effects.","South Oxnard Challenge Project (SOCP)","Substance abuse recovery Youth programs Behavioral Interventions","Youth, Justice-involved, Disconnected youth",,"United States",2005,,"Opportunities for Youth Review Protocol"
"Implementation and outcome evaluation of the Intensive Aftercare Program: Final report","Wiebush, R., Wagner, D., McNulty, B., Wang, Y., & Le, T. (2005). Implementation and outcome evaluation of the Intensive Aftercare Program: Final report. National Council on Crime and Delinquency. Washington, DC: U.S. Department of Justice, Office of Justice Programs.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence",,"Summary:


The study’s objective was to measure the impact of participation in an Intensive Aftercare Program (IAP) for high-risk youth from juvenile justice facility placements on recidivism.
The authors used a random assignment design and multivariate regression analysis to estimate impacts on aggregate recidivism scores, the sum of all subsequent offenses, weighted by severity. Data for the study were collected from standardized forms, surveys, risk assessment tests, and state agency and police records.
The study found no statistically significant effects of the program on participants’ aggregate recidivism scores.
The quality of causal evidence presented in this report is moderate for some outcomes and low for other outcomes. This means we have little confidence that any estimated effects would be attributable to the IAP. However, the study found few statistically significant effects.","the Intensive Aftercare Program (IAP)","Reentry Youth programs","Youth, Justice-involved, Disconnected youth, Male",,"United States",2005,http://files.eric.ed.gov/fulltext/ED484683.pdf,"Opportunities for Youth Review Protocol"
"Youth Corps: Promising strategies for young people and their communities","Jastrzab, J., Blomquist, J., Masker, J., & Orr, L. (1997). Youth Corps: Promising strategies for young people and their communities. Cambridge, MA: Abt Associates Inc.","Opportunities for Youth","Study Type: Descriptive Analysis",,,"Summary:

This report provides a high-level summary of a study on Youth Corps programs, which have engaged disadvantaged youth in community service projects since 1933. An in-depth impact analysis is contained in Jastrzab et al. 1996. The study’s objective was to gain insight into participants’ contributions and experiences; analyze program impacts on educational, employment, and behavioral outcomes; and assess the costs and benefits of the programs.
The authors analyzed data on initiatives sponsored by the Commission on National and Community Service in 1993 and 1994, and during that time also collected data directly from Youth Corps programs for the impact analysis and cost-benefit assessment. In addition, the authors talked with several program staff and participants.
The study found that although program completion rates were low, most participants felt the program was helpful and sponsors and beneficiaries were generally satisfied with youths’ performance.
The program had a significant impact on the employment and earnings of corps members. The analysis of program costs and benefits showed aggregate benefits to society.","Youth Corps Programs","Mentoring Youth programs","Youth, Disconnected youth, Low-skilled, Low income",,"United States",1997,http://www.abtassociates.com/reports/Youth-Corps.pdf,"Opportunities for Youth Review Protocol"