Title,Citation,Topic_area,Study_type,Study_evidence_rating,Outcome_effectiveness,Findings,Intervention_program,Topics,Target_population,Firm_characteristics,Geographic_setting,Original_publication_date,Original_publication_link,"Review Protocol"
"Synthesis Report: Behavioral Finance Synthesis: Findings",,"Behavioral Finance: Retirement",,,,"Findings:

  
  
  

  
  
  

  
  
  

          People have relatively limited knowledge about saving for retirement and can be induced to save more when provided with additional information.

          Making retirement more salient, by having people think of themselves in retirement or providing a target retirement date, can increase intentions to save and alter investment choices.

          People can become overwhelmed by the number of investment options they face; when this occurs, they tend to use simple rules to make decisions.",,"Employer provided retirement benefits","Adult, Older worker",,"United States",,,"Behavioral Finance: Retirement Review Protocol"
"The effect of participation in a Title V program on Latinx student success at a community college","Lacagnino, S. N. (2019). The effect of participation in a Title V program on Latinx student success at a community college. (Unpublished doctoral dissertation). Seton Hall University, South Orange, NJ.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts
      
    
  
              


      
            Education and skills gains","Summary:

The study’s objective was to determine the impact of participation in the Project Accel program on education outcomes for community college students.
The study used a nonexperimental design to compare the outcomes of students who participated in the Project Accel program with those who did not, based on administrative data from the community college. Using several demographic characteristics, the author created a matched comparison group of students who were not in the program to assess the effectiveness of the program on course completion, program persistence, and fall-to-fall retention.
For the accelerated English as a Second Language (ESL) program, the study found that program participation was significantly related to higher completion, persistence, and retention rates. For the accelerated developmental English program, the study found that program participation was significantly related to higher completion and persistence rates.
The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Project Accel program; other factors are likely to have contributed.","the Project Accel program","Community college education and other classroom training","Adult, Hispanic of any race",,"United States",2019,https://scholarship.shu.edu/dissertations/2642/,"Community College Review Protocol"
"Preparing Alaskans for mining careers through short, industry-informed training programs: University of Alaska round IV TAACCCT grant","Hanson, H., Stevens, D., Vazquez, M., & Roberts, B. (2018). Preparing Alaskans for mining careers through short, industry-informed training programs: University of Alaska round IV TAACCCT grant. Portland, OR: Education Northwest.","Community College",,,"Earnings and wages-Low-Favorable impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study’s objective was to examine the impact of the University of Alaska's Trade Adjustment Assistance Community College and Career Training (TAACCCT) grant program on the employment and earnings of community college students.
The study used a nonexperimental design to compare the outcomes of students in the TAACCCT-enhanced Surface Mining and Underground Mining programs to similar individuals who did not attend community college and instead entered the labor market in mining occupations.
The study found that the TAACCCT-enhanced program participation was significantly associated with a higher likelihood of employment retention and increased quarterly wages.
The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the University of Alaska's TAACCCT grant program; other factors are likely to have contributed.","the University of Alaska's TAACCCT Grant Program","Employer partnerships Capacity building programs Community college education and other classroom training","Adult, Dislocated or displaced worker, American Indian or Alaska Native, Veteran or military",,"United States",2018,http://www.skillscommons.org/bitstream/handle/taaccct/18578/AK_TAACCCT_Report_0…,"Community College Review Protocol"
"Developmental students' persistence towards graduation in paired coursework programs among African American and Latino males in community colleges","Davis, E. (2018). Developmental students' persistence towards graduation in paired coursework programs among African American and Latino males in community colleges. (Doctoral dissertation). Retrieved from ProQuest Dissertations and Theses database.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts
      
    
  
              


      
            Education and skills gains","Summary:

The study’s objective was to examine the impact of accelerated paired courses on male African American and Latino students’ academic persistence.
The study used a nonexperimental design to compare the outcomes of students who completed paired coursework to students who did not. The author examined enrollment and course completion using college administrative records.
The study found that students who completed paired coursework were significantly more likely to enroll in college the following semester than students in the comparison group.
The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the paired coursework; other factors are likely to have contributed.","Accelerated paired courses","Community college education and other classroom training","Adult, Male, Black or African American, Hispanic of any race",,"United States",2018,https://jscholarship.library.jhu.edu/handle/1774.2/59950,"Community College Review Protocol"
"Does protecting older workers from discrimination make it harder to get hired? Evidence from disability discrimination laws.","Neumark, D., Song, J., & Button, P. (2017). Does protecting older workers from discrimination make it harder to get hired? Evidence from disability discrimination laws. Research on Aging, 39(1), 29-63.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Mixed impacts
      
    
  
              


      
            Employment","Summary:

The study examined the impact of the strength of state disability discrimination laws on hiring rates of older men.
The study used statistical models and data from the Health and Retirement Study and the Survey of Income and Program Participation to estimate the impacts.
The study found no relationship between the strength of disability discrimination laws and the hiring rate for older unemployed disabled and nondisabled men.
The quality of casual evidence presented in this report is low because the study is a nonexperimental analysis that did not demonstrate that the groups being compared were similar and did not account for possible differences in the analysis. This means we are not confident that the estimated effects are attributable to state disability discrimination laws; other factors are likely to have contributed.","Disability discrimination laws","Health Older workers' programs","Adult, Older worker, Male",,"United States",2017,https://journals.sagepub.com/doi/full/10.1177/0164027516656142,"Employment and Training Review Protocol"
"The effect of the Affordable Care Act on labor transitions among older workers.","Camilleri, S. E. (2017). The effect of the Affordable Care Act on labor transitions among older workers. In Three papers on the Affordable Care Act (Doctoral dissertation). North Carolina State University, Raleigh, NC.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-No impacts
      
    
  
              


      
            Employment","Summary:

The study examined the impact of the Affordable Care Act (ACA) on the employment outcomes of older workers.
The author used data from the Current Population Survey for 2011–2016 and regression analyses to estimate impacts.
The study found that the ACA was not associated with employment outcomes among older workers.
The quality of causal evidence presented in this report is moderate because the study is based on a well-implemented nonexperimental design. This means we are somewhat confident that any estimated effects are attributable to the ACA, but other factors might also have contributed.","Affordable Care Act (ACA)","Older workers' programs Health insurance","Adult, Older worker",,"United States",2017,,"Employment and Training Review Protocol"
"The impact of Medicare Part D on self-employment.","Moulton, J. G., Diebold, J. C., & Scott, J. C. (2017). The impact of Medicare Part D on self-employment. Research on Aging, 39(1), 64-85.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study examined the effect of the introduction of Medicare Part D on self-employment. The authors used a nonexperimental approach and data from the American Community Survey to estimate the impact.
The authors found that self-employment significantly increased by 0.5 percentage points after the program began.
The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects on self-employment are attributable to the introduction of Medicare Part D, although other factors might also have contributed.","Medicare Part D","Federal retirement benefits Older workers' programs","Adult, Older worker",,"United States",2017,,"Employment and Training Review Protocol"
"Job insecurity, unemployment insurance and on-the-job search. Evidence from older American workers.","Gutierrez, I. A. (2016). Job insecurity, unemployment insurance and on-the-job search. Evidence from older American workers. Labour Economics, 41, 228-245. doi:10.1016/j.labeco.2016.05.011","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-No impacts
      
    
  
              


      
            Employment","Summary:

The study examined the impact of the potential wage replacement rate through Unemployment Insurance (UI) on the probability of transitioning to non-employment.
The study used a nonexperimental design and data from the Health and Retirement Study (HRS) from 1996–2006 and 2010–2012 to identify workers who expected job loss during the baseline survey and who experienced job transitions by the follow-up survey two years later.
The study found no statistically significant relationships between potential wage replacement rates and transitions to non-employment.
The quality of causal evidence presented in this report is low because the analyses do not sufficiently account for other factors that might contribute to the estimated effects. This means we are not confident that the estimated effects are attributable to the potential wage replacement rate through UI; other factors are likely to have contributed.","Unemployment Insurance (UI)","Older workers' programs Unemployment Insurance","Adult, Older worker, Employed",,"United States",2016,,"Employment and Training Review Protocol"
"Spousal labor market effects from government health insurance: Evidence from a veterans affairs expansion.","Boyle, M. A. & Lahey, J. N. (2016). Spousal labor market effects from government health insurance: Evidence from a veterans affairs expansion. Journal of Health Economics, Elsevier, 45(C), 63-76.","Older Workers, Veterans","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Low-Favorable impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Mod/high-No impacts
      
    
  
              


      
            Employment","Summary:

The study examined the impact of the expansion of health insurance for veterans through the U.S. Department of Veterans Affairs (VA) in the mid-1990s (as a result of the implementation of the Veteran’s Health Care Eligibility Reform Act) on the employment and earnings of non-covered spouses.
The authors used a statistical model and data from the Census Bureau’s March Current Population Survey and the Health and Retirement Study to compare the employment and earnings of wives of male veterans with wives of non-veterans of the same ages before and after the expansion of health insurance for veterans through the VA.
The study found no statistically significant associations between the expansion of health insurance for veterans and the employment of their wives and mixed evidence on associations between the expansion of health insurance for veterans and the earnings of their wives.
The quality of causal evidence presented in this report is moderate for the employment outcomes because it was based on a well-implemented nonexperimental design. This means we would be somewhat confident that any estimated effects would be attributable to the expansion of health insurance for veterans through the VA, but other factors might also have contributed. The quality of causal evidence presented in this report is low for earnings outcomes because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the expansion of health insurance for veterans through the VA; other factors are likely to have contributed.","Veteran Health Insurance Expansion","Health Older workers' programs Veterans' reemployment","Adult, Older worker, Veteran or military",,"United States",2016,,"Older Workers, Veterans Review Protocol"
"Men and women expecting to work longer: Do changing work conditions matter?","Moen, P., Kojola, E., Kelly, E.L., & Karakaya, Y. (2016). Men and women expecting to work longer: Do changing work conditions matter? Work, Aging and Retirement, 2(3), 321-344.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study’s objective was to examine the impact of a work flexibility intervention called STAR (Support. Transform. Achieve. Results) on workers’ expectations of retirement age and bridge jobs.
The study is a randomized controlled trial that uses surveys of workers before the intervention and five years post-intervention.
The study found that receiving STAR was associated with higher expectations of working at age 65 and retiring at age 67 or older.
The quality of causal evidence presented in this report is low because, although it was based on a randomized controlled trial, it had unknown attrition and the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to STAR; other factors are likely to have contributed.","STAR (Support. Transform. Achieve. Results.)","Work based and other occupational training Other employer services","Adult, Older worker",,"United States",2016,https://experts.umn.edu/en/publications/men-and-women-expecting-to-work-longer-…,"Employment and Training Review Protocol"
"Does “ban-the-box” help or hurt low-skilled workers? Statistical discrimination and employment outcomes when criminal histories are hidden","Doleac, J. L., & Hansen, B. (2016). Does “ban-the-box” help or hurt low-skilled workers? Statistical discrimination and employment outcomes when criminal histories are hidden. (NBER Working Paper No. 22469). Cambridge, MA: National Bureau of Economic Research.",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Unfavorable impacts
      
    
  
              


      
            Employment","Summary:

	The study’s objective was to examine how preventing employers from asking about an applicant’s criminal record in the early stage of the hiring process (ban-the-box) affected employment outcomes for low-skilled African American and Hispanic men ages 25 to 34.
	The authors use a nonexperimental difference-in-differences design to compare the employment probability of White non-Hispanic, African American non-Hispanic, and Hispanic men in areas that adopted ban-the-box policies with the employment probability of their counterparts in areas that did not adopt ban-the-box policies. The authors use a linear probability model to estimate employment outcomes. Information on study participant characteristics were from the Current Population Survey in 2004 to 2014.
	The study found that the probability of African American men obtaining employment was 3.4 percentage points lower among those who lived in areas with ban-the-box policies than among those who did not. In addition, the authors found that ban-the-box policies reduced the probability of African American men obtaining employment by 5.1 percentage points between one and two years after the policy went into effect, by 8.3 percentage points between three and four years afterward, and by 2.3 percentage points four or more years afterward. The study found no statistically significant relationships between ban-the-box policies and employment outcomes for Hispanic men.
	The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the ban-the-box policies, but other factors might also have contributed.",Ban-the-Box,Reentry,"Male, Black or African American, Hispanic of any race",,"United States",2016,https://www.nber.org/papers/w22469.pdf,"Employment and Training Review Protocol"
"The effect of Social Security information on the labor supply and savings of older Americans.","Armour, P., & Lovenheim, M. F. (2016). The effect of Social Security information on the labor supply and savings of older Americans. (Working paper no. 361). Ann Arbor, MI: University of Michigan, Michigan Retirement Research Center.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Mixed impacts
      
    
  
              


      
            Employment","Summary:

The study examined the impact of the Social Security statements issued by the Social Security Administration (SSA) on older men’s annual hours worked.
The authors used a nonexperimental design and data from Health and Retirement Study surveys and Social Security administrative records to estimate the impacts.
The study found that receiving the first Social Security Statement is associated with a decrease in self-reported annual hours worked and receiving the second Social Security Statement is associated with an increase in self-reported annual hours worked.
The quality of casual evidence presented in this report is moderate because that the study was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to Social Security statements, but other factors might also have contributed.","Social Security statements","Older workers' programs Other disparities or discrimination in employment and earnings","Adult, Older worker, Male",,"United States",2016,,"Employment and Training Review Protocol"
"The effect of health reform on retirement.","Levy, H., Buchmueller, T. C., & Nikpay, S. (2015). The effect of health reform on retirement (Research Paper 329). Ann Arbor, MI: Michigan Retirement Research Center.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-No impacts
      
    
  
              


      
            Employment","Summary:

The study’s objective was to examine the impact of the expansion of Medicaid to low-income adults in 2014 on retirement rates of workers ages 55 to 64.
The authors used a nonexperimental analysis to compare those who lived in an expansion state to those who lived in other states. The study used data from the monthly Current Population Survey from January 2005 through July 2015.
The study found no statistically significant relationships between Medicaid expansion and retirement.
The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the expansion of Medicaid; other factors are likely to have contributed.","Medicaid expansion","Health insurance Older workers' programs","Adult, Older worker, Low income",,"United States",2015,https://deepblue.lib.umich.edu/handle/2027.42/116062,"Employment and Training Review Protocol"
"The effect of a severe health shock on work behavior: Evidence from different health care regimes.","Datta Gupta, N., Kleinjans, K. J., & Larsen, M. (2015). The effect of a severe health shock on work behavior: Evidence from different health care regimes. Social Science and Medicine, 136-137, 44-51.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study’s objective was to examine the impact of the national health policies of the United States and Denmark on employment of older workers after a health shock, defined as a new cancer or cardiovascular disease diagnosis.
The authors used a nonexperimental approach to compare the impact of a health shock on the likelihood of nonemployment in the United States’ private multipayer system with Denmark’s nationalized universal health care model. The authors used the data from the RAND Health and Retirement Study survey from 1994 to 2002 and Danish population registers for 1993 to 2001.
The study found no differences between the United States and Denmark in the relationship between a health shock and employment for older workers.
The quality of causal evidence presented in this report is low because the authors did not account for unobserved differences between the countries. This means we are not confident that differences in the association between health shocks and employment in the United States and Denmark are attributable to the national health care policies; other factors are likely to have contributed.","National Healthcare Policy","Health Older workers' programs","Adult, Older worker",,"International, United States",2015,https://www.sciencedirect.com/science/article/pii/S0277953615002816,"Employment and Training Review Protocol"
"How much does access to health insurance influence the timing of retirement?","Coe, N. B., & Goda, G. S. (2015). How much does access to health insurance influence the timing of retirement? (SIEPR Discussion Paper No. 14-007). Stanford, CA: Stanford Institute for Economic Policy Research. City, ST: Publisher.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Unfavorable impacts
      
    
  
              


      
            Employment
      


  
      
            Public benefits receipt-Low-No impacts
      
    
  
              


      
            Public benefit receipt","Summary:

The study examined the impact of state-level reforms of health insurance on early retirement and Social Security retirement benefit claims.
The authors used 1996–2010 data from the Health and Retirement Study (HRS) and statistical models to compare the outcomes of individuals in states with state-level reforms of health insurance with those in non-reform states.
The study found that employed individuals in states with non-group health insurance reform were significantly more likely to retire at age 63.
The quality of causal evidence presented in this report is low because the authors did not demonstrate that individuals in states with state-level reforms of health insurance were similar to those in non-reform states. This means we are not confident that the estimated effects are attributable to the non-group health insurance reform; other factors are likely to have contributed.","Retiree Health Insurance","Health insurance Older workers' programs","Adult, Older worker",,"United States",2015,,"Employment and Training Review Protocol"
"The impact of a randomly assigned time and place management initiative on work and retirement expectations.","Cahill, K. E., James, J. B., & Pitt-Catsouphes, M. (2015). The impact of a randomly assigned time and place management initiative on work and retirement expectations. Work, Aging and Retirement, 1(4), 350-368.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Unfavorable impacts
      
    
  
              


      
            Employment","Summary:

	The study examined the impact of a time and place management (TPM) initiative at a medical provider on retirement expectations among workers ages 50 and older.
	The study was a randomized control trial and used a series of surveys and administrative data to estimate the impact.
	The study found that, when surveyed 12 months after randomization, employees in the treatment group were statistically significantly more likely to expect to directly exit their job as opposed to staying in their current job within the next five years.
	The quality of causal evidence presented in this report is moderate because the study was a randomized controlled trial with high attrition, but the authors did demonstrate that the treatment and control groups were similar before the intervention. This means we are somewhat confident that the estimated effects are attributable to TPM, but other factors might also have contributed.","Time and Placement Management (TPM)","Older workers' programs","Older worker","Health care and social assistance",,2015,https://hrs.isr.umich.edu/publications/biblio/8231,"Employment and Training Review Protocol"
"Employment outcomes among African American and white women with disabilities: Examining the inequalities.","Balcazar, F. E., & Suarez-Balcazar, Y. (2015). Employment outcomes among African American and white women with disabilities: Examining the inequalities. Women, Gender, and Families of Color, 3(2), 144-164.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-No impacts
      
    
  
              


      
            Employment","Summary:

The study examined the impact of adult vocational rehabilitation (VR) services on employment outcomes for African American and white women.
The authors used a statistical model and data from a Midwestern state VR system to compare the odds of employment after completing VR services for older versus younger women.
The study found no significant difference in employment outcomes between older and younger women who completed VR services.
The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before receiving VR services. This means we are not confident that the estimated effects are attributable to participation in VR services; other factors are likely to have contributed.","Vocational Rehabilitation (VR) Services","Vocational rehabilitation","Adult, Older worker, Female, Black or African American, White, Disability",,"United States",2015,,"Employment and Training Review Protocol"
"Sustained gains: Year Up’s continued impacts on young adults’ earnings","Roder, A., & Elliott, M. (2014). Sustained gains: Year Up’s continued impacts on young adults’ earnings. New York: Economic Mobility Corporation.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Education and skills gains-Mod/high-No impacts
      
    
  
              


      
            Education and skills gains
      


  
      
            Employment-Mod/high-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study’s objective was to examine the effect of the Year Up program on employment, earnings, and education outcomes. Year Up is an intensive, yearlong program that provides training and internships in financial operations and information technology for young adults from low-income urban communities.
About 200 students in three cities were randomly assigned to the treatment group, which was eligible to participate in Year Up beginning in September 2007, or the control group, which was not eligible to participate in Year Up in 2007. Members of the control group were eligible to reapply to the program after 10 months, and many did. The authors compared the outcomes of the treatment and control groups using data collected through telephone interviews with participants four years after random assignment.
The authors reported a positive, statistically significant impact of Year Up on earnings measured three years after random assignment, but these impacts did not extend to the fourth year after random assignment. Cumulatively, treatment group members earned $13,645 more than the control group over years 2 through 4 after random assignment, and they were more likely to have been employed in a field targeted by the program.
The quality of the causal evidence presented in this study is moderate because, although it was based on a randomized controlled trial with high attrition, the authors demonstrated that the treatment and control groups were similar before the intervention. This means we have confidence that the estimated effects are attributable at least in part to Year Up, although other factors could also have contributed.","Year Up","Basic skills Other training and education Work based and other occupational training Youth programs","Youth, Black or African American, Hispanic of any race, Low-skilled, Low income",,"United States, Urban",2014,http://economicmobilitycorp.org/uploads/sustained-gains-economic-mobility-corp…,"Opportunities for Youth Review Protocol"
"The role of secondary school and community college collaborations to increase Latinas in engineering in a rural community","Starobin, S., & Bivens, G. (2014). The role of secondary school and community college collaborations to increase Latinas in engineering in a rural community. New Directions for Community Colleges, 2014(165), 17-23.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary:

	The study described factors that might increase young Latinas’ enrollment in pre-engineering programs.
	The authors reviewed a case study of middle and high school Latina students in the rural Midwest who were participating in a national education pipeline program intended to facilitate a pathway to science, technology, engineering, and mathematics (STEM) degrees and careers.
	The authors recommended the following for recruiting and retaining rural Latina students in a pre-engineering program: (1) have a program leader with a similar background to students, including a knowledge of culture and language, to facilitate better connections with them; (2) familiarize students with the physical space of higher education institutions to reduce intimidation; and (3) interact with students’ families to facilitate family support.",,"Youth programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Youth, Hispanic of any race",,"United States",2014,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol"
"The economics of federal tax and employment laws: Empirical evidence from three studies.","Figinski, T. F. (2013). The economics of federal tax and employment laws: Empirical evidence from three studies. (Doctoral dissertation). Retrieved from ProQuest. Accession No. 1415455735.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Low-Favorable impacts
      
    
  
              


      
            Employment
      


  
      
            Public benefits receipt-Low-Unfavorable impacts
      
    
  
              


      
            Public benefit receipt","Summary:

The study examined the impact of removing the Social Security earnings test on Social Security claims, earnings, and labor force participation for female beneficiaries.
The study used a statistical model and the data from the Social Security Administration’s Benefit and Earnings Public Use File to estimate impacts.
The study found that removing the earnings test was associated with an increase in Social Security claims among women who were primary or spousal beneficiaries and with an increase in average earnings and in labor force participation among women who were primary beneficiaries.
The qaulity of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the change in Social Security earings test. This means we are not confident that the estimated effects are attributable to the removal of the Social Security earnings test; other factors are likely to have contributed.","Social Security 2000 Earnings Test Removal","Federal retirement benefits Older workers' programs","Adult, Older worker, Female",,"United States",2014,,"Employment and Training Review Protocol"
"Did age discrimination protections help older workers weather the Great Recession?","Neumark, D., & Button, P. (2014). Did age discrimination protections help older workers weather the Great Recession? Journal of Policy Analysis and Management, 33(4), 566-601. doi:10.1002/pam.21762","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Unfavorable impacts
      
    
  
              


      
            Employment","Summary:

The study examined whether the strong age discrimination laws moderated the impact of the Great Recession on employment outcomes of older workers.
The study used statistical models and the data from the 2003–2011 Current Population Survey (CPS) and 2004–2011 Quarterly Workforce Indicators to estimate impacts.
The study found that states with stronger age discrimination laws had experienced increases in unemployment rates, longer unemployment durations, and decreases in hiring rates for some types of older workers relative to younger workers in the months during and following the Great Recession.
The quality of causal evidence presented in this study is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the differential effect of the Great Recession on older workers in states with strong age discrimination laws, but other factors might also have contributed.","Age Discrimination Laws","Older workers' programs Other disparities or discrimination in employment and earnings","Adult, Older worker, Female, Male",,"United States",2014,https://www.nber.org/papers/w19216,"Employment and Training Review Protocol"
"Retiree health insurance for public school employees: Does it affect retirement?","Fitzpatrick, M. D. (2014). Retiree health insurance for public school employees: Does it affect retirement? Journal of Health Economics, 38, 88-98.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Mixed impacts
      
    
  
              


      
            Employment","Summary:

The study’s objective was to examine the impact of an Illinois Public Schools retiree health insurance program on the retirement rates of eligible staff ages 55 to 75.
The study used a nonexperimental approach to compare the retirement rates of eligible staff with those of staff who were not eligible and staff in years prior to the introduction of the health insurance program who would have been eligible. The author used data from the Illinois Public Schools' Teacher Service Record database from 1970 to 1992.
The study found that eligibility for the program was associated with an overall decrease in retirement age, with eligible staff more likely to retire at ages 55 or 56, but less likely to retire after age 65 compared with those who were not eligible for the program.
The quality of the causal evidence presented in this report is low because the study is a nonexperimental analysis that does not account for possible differences in the groups. This means we are not confident that the estimated effects are attributable to the Illinois Public Schools Teachers Retirement Health Insurance Plan; other factors are likely to have contributed.","Illinois Public Schools Teachers Retirement Health Insurance Plan","Employer provided retirement benefits Health insurance Older workers' programs","Adult, Older worker",,"United States",2014,https://www.nber.org/papers/w19524,"Employment and Training Review Protocol"
"Who pays the high health costs of older workers? Evidence from prostate cancer screening mandates.","Bailey, J. (2014). Who pays the high health costs of older workers? Evidence from prostate cancer screening mandates. Applied Economics, 46(32), 3931-3941. doi:10.1080/00036846.2014.948673","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Unfavorable impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Mod/high-Unfavorable impacts
      
    
  
              


      
            Employment","Summary:

The study examined the impact of state mandates that health insurance plans cover prostate cancer screenings on the earnings and employment of men older than age 50
The study used nonexperimental regression analyses to compare older men in states that had enacted a mandate with women, younger men, and older men living in states without a mandate. The author used data from the Current Population Survey(CPS) between 1990 and 2009.
The study found that older men in states with mandates had lower wages and were less likely than the comparison group to be employed.
The quality of causal evidence presented in this study is moderate, because it is a well-implemented nonexperimental study. This means we are somewhat confident that the estimated effects are attributable to the prostrate screening mandate, but other factors might also have contributed.","Prostate cancer screening mandates","Health insurance Older workers' programs","Adult, Older worker, Male",,"United States",2014,https://sites.temple.edu/jamesbailey/files/2013/08/Who-Pays-the-High-Health-Cos…,"Employment and Training Review Protocol"
"Mentoring practices proven to broaden participation in STEM disciplines","Crumpton-Young, L., Elde, A., & Ambrose, K. (2014, June). Mentoring practices proven to broaden participation in STEM disciplines. Paper presented at 2014 American Society for Engineering Education Annual Conference, Indianapolis, IN.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary:

	The study identified effective mentoring practices, mostly at postsecondary institutions, for women and minority students in science, technology, engineering, and mathematics (STEM) fields.
	The authors surveyed 25 randomly selected mentor programs or individuals who received a National Science Foundation award for being successful in mentoring students who are typically underrepresented (including women) in STEM. The survey asked award recipients to rate their performance on 22 mentoring practices using a scale ranging from not doing well to doing exceptionally well. The authors deemed those mentoring practices rated most highly as best practices.
	The study found that the highest-rated mentoring practices were being passionate about mentees and their development, creating opportunities for mentees, setting high expectations for mentees’ performance, providing needed support to mentees, and respecting mentees’ confidentiality. Conversely, the lowest-rated practices set the mentor in an authoritative light and included providing constant feedback to and having constant contact with mentees.",,"Mentoring Science, Technology, Engineering, and Math (STEM) programs","Youth, Female, Black or African American, Asian, Hispanic of any race, Multiracial, American Indian or Alaska Native, Native Hawaiian or other Pacific Islander",,"United States",2014,https://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=1&ved=0ahUKEwiM7t…,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol"
"The persistent effect of temporary affirmative action","Miller, C. (2014). The persistent effect of temporary affirmative action (Unpublished job market paper). Cambridge, MA: MIT Department of Economics.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Favorable impacts
      
    
  
              


      
            Employment","Summary:


The study’s objective was to determine the effect of affirmative action requirements for federal contractors through Executive Order 11246 on African American employment shares at the establishment level.
The study used establishment transitions between federal contractor and non-contractor status to pinpoint the effects of affirmative action regulation using multiple regression analysis. The author based his analysis on EEO-1 Employer Information Report files from 1978–2004.
The study found that federal contractors subject to the affirmative action Executive Order increased African American employment share by 0.13–0.15 percentage points each year relative to non-contractors not subject to the Order.
The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to affirmative action requirements under Executive Order 11246, but other factors might also have contributed.","Executive Order 11246","Executive Order 11246 (E.O. 11246)","Black or African American",,"United States",2014,http://economics.cornell.edu/sites/default/files/files/events/Conrad.Miller_jmp…,"Employer Compliance Review Protocol"
"The link between pensions and retirement timing: Lessons from California teachers.","Brown, K. M. (2013). The link between pensions and retirement timing: Lessons from California teachers. Journal of Public Economics, 98(C), 1-14.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study examined the impact of pension reform under the California State Teachers’ Retirement System (CalSTRS) on retirement timing.
The author used a statistical model and data from retirement-eligible employees in Los Angeles Unified School District from 1997 to 2000 to estimate the impact.
The study found public school employees were more likely to work an extra year in response to changes in pension plans that provided additional bonuses tied to age and tenure.
The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the changes in CalSTRS. This means we are not confident that the estimated effects are attributable to the changes in CalSTRS; other factors are likely to have contributed.","CalSTRS Defined Benefit Program","Older workers' programs Other wages and benefits","Adult, Older worker",,"United States",2013,https://eml.berkeley.edu//~saez/course/brown_jpube13.pdf,"Employment and Training Review Protocol"
"The impact of uncapping of mandatory retirement on postsecondary institutions.","Weinberg, S. L., & Scott, M. A. (2013). The impact of uncapping of mandatory retirement on postsecondary institutions. Educational Researcher, 42(6), 338-348.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study examined the impact of uncapping mandatory retirement on retirement ages at postsecondary institutions
The study used a statistical model to examine the age of retirement before and after the policy change in 1993. It used data on faculty’s employment and retirement from a research university with multiple schools.
The study found that uncapping was associated with a statistically significant increase in the retirement age among those who retired from the university.
The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar nor did they control for differences between the groups. This means we are not confident that the estimated effects are attributable to the federal Age Discrimination in Employment Act (ADEA); other factors are likely to have contributed.","Age Discrimination Employment Act (ADEA)","Federal retirement benefits Older workers' programs","Adult, Older worker",,"United States",2013,https://www.researchgate.net/publication/258134776_The_Impact_of_Uncapping_of_M…,"Employment and Training Review Protocol"
"Training and retirement patterns.","Montizaan, R., Cörvers, F., & de Grip, A. (2013). Training and retirement patterns. Applied Economics, 45(15), 1991-1999. doi:10.1080/00036846.2011.646066","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Unfavorable impacts
      
    
  
              


      
            Employment","Summary:

The study’s objective was to examine the impact of firm-specific training and general training on older men’s retirement decisions
The study used a nonexperimental design and data from the U.S. National Longitudinal Survey of Older Men for 1966 to 1983 to estimate impacts.
The study found that workers with firm-specific training were more likely to retire within the time period studied and to have jobs with a mandatory retirement age than workers without firm-specific training.
The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before receiving training and did not account for self-selection into training. This means we are not confident that the estimated effects are attributable to firm-specific or general training; other factors are likely to have contributed.","Firm-specific & General Training","Work based and other occupational training","Adult, Older worker, Male",,"United States",2013,https://www.researchgate.net/publication/236021967_Training_and_retirement_patt…,"Employment and Training Review Protocol"
"Does retiree health insurance encourage early retirement?","Nyce, S., Schieber, S. Shoven, J. B., Slavov, S., & Wise, D. A. (2013). Does retiree health insurance encourage early retirement? Journal of Public Economics, 104, 40-51.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Unfavorable impacts
      
    
  
              


      
            Employment","Summary:

The study’s objective was to examine the impact of employer-provided retiree health insurance on early retirement.
The authors used a nonexperimental design to compare early retirement outcomes of employees who are eligible for retiree health insurance with that of those who have no coverage.
The study found that people who were employed at age 57 and eligible for employer-subsidized retiree health coverage were significantly more likely to retire at ages 62 to 64 (before becoming eligible for Medicare at age 65) compared with those with no coverage.
The quality of causal evidence presented in this report is low because the authors did not account for other factors that could have affected the difference between the treatment and comparison groups. This means we are not confident that the estimated effects are attributable to retiree health insurance; other factors are likely to have contributed.","Retiree Health Insurance","Employer provided retirement benefits Older workers' programs","Adult, Older worker",,"United States",2013,https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3770310/,"Employment and Training Review Protocol"
"Do stronger age discrimination laws make Social Security reforms more effective?","Neumark, D., & Song, J. (2013). Do stronger age discrimination laws make Social Security reforms more effective? Journal of Public Economics, 108, 1-16.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Mixed impacts
      
    
  
              


      
            Employment
      


  
      
            Public benefits receipt-Mod/high-Favorable impacts
      
    
  
              


      
            Public benefit receipt","Summary:

The study examined whether the strength of state age discrimination protections affected rates of Social Security benefit claiming and employment outcomes of older workers.
The study used a nonexperimental design and the data on Social Security claiming and employment outcomes from the Health and Retirement Study (HRS) to estimate the impacts.
The study found that among older men affected by the 1983 Social Security reform, age discrimination protections were associated with increases in employment rates between age 62 and the full retirement age and delayed benefit claiming.
The quality of casual evidence presented in this report is moderate because the study was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to state age discrimination laws, but other factors might also have contributed.","The 1983 Social Security Reform","Older workers' programs Other disparities or discrimination in employment and earnings","Adult, Older worker, Male",,"United States",2013,https://ideas.repec.org/a/eee/pubeco/v108y2013icp1-16.html,"Employment and Training Review Protocol"
"Accelerating change for women faculty of color in STEM: Policy, action, and collaboration","Institute for Women’s Policy Research. (2013). Accelerating change for women faculty of color in STEM: Policy, action, and collaboration. Washington, DC: Institute for Women’s Policy Research.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary:

	
	
		This report highlighted a 2013 convening of stakeholders who discussed barriers to becoming successful STEM faculty for black, Hispanic, and Native American women, and strategies to overcome those barriers. The Institute for Women’s Policy Research organized the convening.
		The report was compiled from a series of conference sessions presented at the convening by about 50 experts from various academic, political, corporate, and community sectors. Session topics included the current status of women of color in STEM, areas of progress and nonprogress, and current initiatives to increase the representation of women of color in STEM faculty positions. Attendees provided recommendations for improvement.
		Conference representatives identified three main barriers to the advancement of minority female faculty: workplace climate policies that did not meet the needs of female faculty of color, a lack of multicultural perspectives, and a lack of embracement of diversity in academic departments. Health, financial, and family issues and obligations; high community service demands; and a lack of social support also created unique challenges for this population.
		Recommendations for improvement included raising awareness of underrepresentation of minority women in STEM faculty positions, monitoring and publicizing institutions’ progress on diversity in STEM faculty, and tailoring faculty mentoring programs or tools to effectively serve female faculty of color.",,"Science, Technology, Engineering, and Math (STEM) programs Other disparities or discrimination in employment and earnings","Female, STEM professional, Black or African American, Hispanic of any race, American Indian or Alaska Native","Professional, scientific, and technical services","United States",2013,http://www.iwpr.org/publications/pubs/accelerating-change-for-women-faculty-of-…,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol"
"The efficacy of supported employment for middle-aged and older people with schizophrenia.","Twamley, E. W., Vella, L., Burton, C. Z., Becker, D. R., Bell, M. D., & Jeste, D. V. (2012). The efficacy of supported employment for middle-aged and older people with schizophrenia. Schizophrenia Research, 135(1-3), 100-104.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study examined the impact of Individual Placement and Support (IPS) on competitive employment for older people with schizophrenia
The study was a randomized controlled trial (RCT) conducted at a community mental health clinic and used weekly work logs cross-referenced with pay stubs to measure employment outcomes over a 12-month period.
The study found that IPS was positively associated with employment and earnings.
The quality of causal evidence presented in this report is low because the RCT has a confounding factor. This means we are not confident that the estimated effects are attributable to the IPS program; other factors are likely to have contributed.","Individual Placement and Support and Vocational Rehabilitation Program","Health Individuals facing barriers to employment Job search assistance and supportive services","Adult, Older worker, Disability",,"United States",2012,https://psycnet.apa.org/record/2011-30184-001,"Employment and Training Review Protocol"
"Tax elasticity of labor earnings for older individuals","Alpert, A. & Powell, D. (2012). Tax elasticity of labor earnings for older individuals. (Report no. 2012-272). Ann Arbor, MI: University of Michigan Retirement Research Center, University of Michigan.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Mod/high-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study examined the impact of tax changes on people’s employment, retirement, and labor income outcomes.
The study uses a nonexperimental approach and the data from the Health and Retirement Study to estimate the effect.
The study found positive statistically significant relationships between increases in after-tax labor income and the employment of men and women as well as the delay in retirement for men. The study also found a positive statistically significant relationship between increases in the marginal net-of-tax rate and earnings for women.
The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to tax changes from the Economic Growth and Tax Relief Reconciliation Act (EGTRRA), the Jobs and Growth Tax Relief Reconciliation Act (JGTRRA), and their marriage tax penalty relief provision, but other factors might also have contributed.","Tax Changes","Older workers' programs Other employment and reemployment","Adult, Older worker",,"United States",2012,https://deepblue.lib.umich.edu/bitstream/handle/2027.42/94533/wp272.pdf?sequenc…,"Employment and Training Review Protocol"
"Income tax and older American workers’ job transition into self-employment.","Choi, S. (2012). Income tax and older American workers’ job transition into self-employment. Korea and the World Economy, 13(2), 189-214.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Unfavorable impacts
      
    
  
              


      
            Employment","Summary:

The study examined the effect of a progressive income tax on the likelihood of transitioning to self-employment among older workers.
The study used a nonexperimental approach (the exponential hazard model) that compared the likelihood of transitioning from a wage job to self-employment based on the marginal taxes a worker would expect to pay. The author used the data from the Health and Retirement Study in 1992 matched to the Social Security Administration Master Earnings File from 1980 to 1991, which contains W-2 records of earnings from both wage work and self-employment.
The study found that a more progressive tax (that is, a tax schedule that increases sharply toward the higher end) or higher marginal tax rates reduces the likelihood of entering self-employment.
The quality of causal evidence presented in this report is low because the author did not ensure that the groups with higher or lower marginal tax rates were similar before a change in the tax schedule. This means we are not confident that the estimated effects are attributable to changes in marginal taxes; other factors are likely to have contributed.","Progressive Income Tax","Other employment and reemployment","Adult, Older worker, Employed",,"United States",2012,,"Employment and Training Review Protocol"
"Questioning a white male advantage in STEM: Examining disparities in college major by gender and race/ethnicity","Riegle-Crumb, C., & King, B. (2011). Questioning a white male advantage in STEM: Examining disparities in college major by gender and race/ethnicity. Educational Researcher, 39(9), 656-664.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary:

	
	
		The study's objective was to examine differences in students’ likelihood of majoring in a science, technology, engineering, and mathematics (STEM) field, based on gender and ethnicity.
		The study used statistical methods to estimate the likelihood of majoring in the physical sciences or engineering, or in the biological sciences, versus non-STEM fields. The authors also examined this likelihood for traditionally underrepresented groups (white, black, and Hispanic women and black and Hispanic men) compared to white men. The analyses controlled for student socioeconomic factors, delayed college entry, academic preparation, and attitudes toward math. Data sources included students’ high school transcripts and surveys conducted through the Educational Longitudinal Study of 2002.
		The study found that white and Hispanic women were less likely to major in the physical sciences or engineering, versus a non-STEM major, than white men. Black women were also less likely to major in a physical science or engineering field than white men, but the gap was slightly smaller.
		In contrast to the large gender gaps evident in the choice of physical science and engineering majors, there were no differences between the gender/ethnicity groups in the likelihood of majoring in a biological sciences field compared to a non-STEM field. The study found that academic preparation and attitudes toward math rarely explained why men were more likely to choose a STEM major than women.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Female, Male, White, Black or African American, Hispanic of any race",,"United States",2011,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol"
"What predicts middle school girls’ interest in computing?","Denner, J. (2011). What predicts middle school girls’ interest in computing? International Journal of Gender, Science and Technology, 3(1), 54-69.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary:

	This paper analyzed white and Latina middle school girls’ interest in and knowledge of careers in computer science following their participation in a voluntary after-school and summer school program in central California.
	The author administered a survey to 140 program participants and conducted stepwise multiple regressions to identify factors that significantly affected the girls’ interest in computing classes and careers. The author also ran secondary analyses to address possible indirect or mediating influences on the girls’ interest in computing classes and careers.
	The study found that three factors significantly predicted girls’ interest in computing classes and careers: (1) a youth’s level of technological curiosity, (2) perceived support from school peers and teachers to pursue computing classes and degrees, and (3) feelings that computers were relevant to her life.
	The study also found that although perceived parental support and gender stereotypes did not directly predict the girls’ interest in computing classes and careers, these factors did indirectly predict girls’ interest in computing.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Female, White, Hispanic of any race",,"United States",2011,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol"
"Labor market rigidities and the employment behavior of older workers.","Blau, D., & Shvydko, T. (2011). Labor market rigidities and the employment behavior of older workers. Industrial and Labor Relations Review, 64(3), 464-484.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study’s objective was to examine the impact of flexibility in hours of work on the likelihood that older workers separate from an employer.
The study used a statistical model to compare the job exit behavior of older and younger workers in firms with different shares of women younger than age 30. The analysis used monthly data on workers ages 45 to 69 in the Survey of Income and Program Participation from 1990 to 2001 matched to employers in the Longitudinal Employment and Household Dynamics data.
The study found that workers in their sixties who work for employers with a higher share of women younger than age 30 are less likely to experience job separations compared with workers in their late 40s to mid-50s.
The quality of causal evidence presented in this report is low because the groups being compared might not be similar before leaving their employer. This means we are not confident that the estimated effects are attributable to employment flexibility, other factors are likely to have contributed.","Employment flexibility","Other employer services","Adult, Older worker",,"United States",2011,https://www.jstor.org/stable/41149475?seq=1#page_scan_tab_contents,"Employment and Training Review Protocol"
"Affirmative action bans and minority employment: Washington State’s Initiative 200","Colello, A. (2011). Affirmative action bans and minority employment: Washington State’s Initiative 200. Washington, DC: Georgetown University.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Unfavorable impacts
      
    
  
              


      
            Employment","Summary:

The study’s objective was to assess the effect of Washington State’s Initiative 200 (I-200), which repealed affirmative action statewide, on racial and ethnic minority employment and wages.
Using the Current Population Survey (CPS) outgoing rotation groups from 1993 to 1996 and 2000 to 2003, the author compared changes in racial and ethnic minority employment and wages relative to white employment and wages in Washington State to the corresponding changes in the rest of the United States.
After the state’s affirmative action repeal, Washington State residency was associated with a 4.1 percentage point increase in unemployment for African Americans relative to whites.
The quality of causal evidence provided in this study is low. This means that we are not confident that the estimated effects were attributable to I-200; other factors are likely to have contributed.","Washington State's I-200","Affirmative action","Black or African American",,"United States",2011,http://hdl.handle.net/10822/553693,"Employer Compliance Review Protocol"
"Framing Social Security Reform: Behavioral responses to changes in the full retirement age","Behaghel, L., & Blau, D. M. (2010) Framing Social Security Reform: Behavioral responses to changes in the full retirement age. (IZA Discussion Paper No. 5310). Bonn, Germany: IZA.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study examined the impact of changes to the Full Retirement Age (FRA) on labor force exit, Old Age and Survivor’s Insurance (OASI) claims, and retirement.
The study uses a statistical model and the data from the Health and Retirement Study (HRS) to compare outcomes of people in birth cohorts who were affected by the change in FRA with those of a comparison group of people who were not.
The study found that the change in the FRA was associated with significant increases in the likelihood of claiming OASI and exiting the labor force at the new, later full retirement age.
The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the change in FRA, but other factors might also have contributed.","changes to the Full Retirement Age (FRA)","Older workers' programs Other employment and reemployment","Older worker",,"United States",2010,https://www.aeaweb.org/articles?id=10.1257/pol.4.4.41,"Employment and Training Review Protocol"
"Can Social Security explain trends in labor force participation of older men in the United States?","Blau, D. M., & Goodstein, R. M. (2010). Can Social Security explain trends in labor force participation of older men in the United States? Journal of Human Resources, 45(2), 328-363.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study examined the impact of changes in Social Security Administration (SSA) retirement rules on men’s labor force participation rates in the 1960s–1980s and 1990s–2000s.
The study used regression analyses to predicted labor force participation rates using actual and counterfactual SSA retirement rules. These analyses use data from the Current Population Survey (CPS) and the Survey of Income and Program Participation (SIPP) for the period from 1962 to 2005 merged with data from SSA on taxable earnings.
The study found that changes in the delayed retirement credit and full retirement age in 1983 could explain one-quarter to one-half of the increase in labor force participation in the early 2000s.
The quality of causal evidence presented in this report is moderate, because it is a well-implemented nonexperimental study. This means we are somewhat confident that the estimated effects are attributable to SSA reforms, but other factors might also have contributed.","Social Security Administration Reforms","Federal retirement benefits Older workers' programs","Adult, Older worker, Male",,"United States",2010,http://jhr.uwpress.org/content/45/2/328.abstract,"Employment and Training Review Protocol"
"Effect of job skills training on employment and job seeking behaviors in an American Indian substance abuse treatment sample.","Foley, K., Pallas, D., Forcehimes, A., Houck, J., Bogenschutz, M., Keyser-Marcus, L., & Svikis, D. (2010). Effect of job skills training on employment and job seeking behaviors in an American Indian substance abuse treatment sample. Journal of Vocational Rehabilitation, 33(2010), 181-192.","Job Search Assistance","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Unfavorable impacts
      
    
  
              


      
            Education and skills gains
      


  
      
            Employment-Mod/high-No impacts
      
    
  
              


      
            Employment","Summary:

The study’s objective was to examine the impact of workshops for job seekers on employment and training outcomes.
The study used a randomized controlled trial (RCT) design, in which eligible participants were randomly assigned to the treatment group, which could participate in the job seeker workshops, or the control group, which could not participate. The authors used follow-up surveys three and six months after random assignment to measure self-reported employment and training outcomes.
The study found that three months after workshop participation, the treatment group spent fewer hours on training activities than the control group; the study did not find any significant impacts of the job seekers’ workshop on the number of hours spent on work or percentage of each group who were employed at the three-month follow-up.
The quality of causal evidence presented in this report is high for the percentage employed and hours spent on work and training outcomes collected at the three-month follow-up because those outcomes were based on a well-implemented RCT with low attrition. This means we are confident that the estimated effects are attributable to the job seekers’ workshop, and not to other factors. However, the quality of causal evidence presented in this report is low for the days to employment outcomes at the three-month follow-up and all outcomes at the six-month follow-up. This means we are not confident that the estimated effects are attributable to the job seekers’ workshop; other factors are likely to have contributed.","Job Seekers’ Workshop","Job search assistance and supportive services","Other barriers, Unemployed, American Indian or Alaska Native",,"United States",2010,,"Employment and Training Review Protocol"
"Elderly immigrants’ labor supply response to supplemental security income.","Kaushal, N. (2010). Elderly immigrants’ labor supply response to supplemental security income. Journal of Policy Analysis and Management, 29(1), 137-162.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study objective is to examine the impact of the Personal Responsibility and Work Opportunity Reconciliation Act (PRWORA) of 1996 on employment outcomes of foreign-born people and noncitizens ages 60 to 74
The study used a statistical model and the data from the Current Population Survey’s monthly outgoing rotation group and the March Current Population Survey from 1994 to 2005 to estimate the impact.
The study found that the PRWORA is associated with increased employment and decreased retirement for foreign-born men compared with U.S.-born men, but it found no statistically significant association with the employment for foreign-born women.
The quality of the causal evidence presented in this report is low because the study is a nonexperimental analysis that does not demonstrate that the groups were similar before the policy change. This means we are not confident that the estimated effects are attributable to PRWORA; other factors are likely to have contributed.","Personal Responsibility and Work Opportunity Reconciliation Act of 1996","Federal retirement benefits Foreign and temporary workers","Adult, Older worker, Immigrant",,"United States",2010,https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4222576/,"Employment and Training Review Protocol"
"The influences on bridge employment decisions.","Pengcharoen, C., & Shultz, K. S. (2010). The influences on bridge employment decisions. International Journal of Manpower, 31(3), 322-336. doi:10.1108/01437721011050602","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Unfavorable impacts
      
    
  
              


      
            Employment","Summary:

The study examined the impact of work schedule flexibility on retirement outcomes among older workers, where work schedule flexibility was measured as the ability to reduce hours from one’s regular work schedule.
The study used a statistical model (multinomial logit regression) and the longitudinal data from the Health and Retirement Study (HRS) from 1992 and 2002 to examine the relationship between reporting work schedule flexibility or inflexibility during the baseline survey and reporting complete retirement, partial retirement, or continued employment at the follow-up survey 10 years later among older workers.
The study found that individuals who reported work schedule inflexibility in the 1992 were more likely to report completely retired than partially retired in 2002, but when comparing the likelihood of reporting continued employment to complete or partial retirement, there was no difference between older workers reported work schedule flexibility and those who reported inflexibility in 1992.
The quality of causal evidence presented in this study is low because the authors did not demonstrate that the participants reporting work schedule flexibility were similar to the participants reporting work schedule inflexibility in 1992. This means we are not confident that the estimated effects are attributable to work schedule flexibility; other factors are likely to have contributed.",,"Other wages and benefits","Adult, Older worker",,"United States",2010,https://www.researchgate.net/publication/46545640_The_influences_on_bridge_empl…,"Employment and Training Review Protocol"
"The effects of changes in state SSI supplements on preretirement labor supply","Neumark, D., & Powers, E. T. (2005). The effects of changes in state SSI supplements on preretirement labor supply. Public Finance Review, 33(1), 3-35.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study examined the impact of a theoretical increase in Supplemental Security Income (SSI) benefits on the preretirement employment outcomes for likely SSI participants ages 60 to 64.
Using data from the annual Current Population Survey from 1979 to 2001 and state-level SSI receipt data, the authors used regression methods in a nonexperimental analysis of likely SSI participants to compare the outcomes of workers ages 62 to 64 with those of workers ages 60 to 61.
The study found that an increase in monthly SSI benefits was associated with a statistically significant decrease in the employment rate and number of hours worked for likely SSI recipients ages 62 to 64 compared with those ages 60 to 61.
The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to changes in SSI benefits; other factors are likely to have contributed.","Supplemental Security Income (SSI) benefits","Older workers' programs Other employment and reemployment","Adult, Older worker",,"United States",2010,https://journals.sagepub.com/doi/pdf/10.1177/1091142104270655,"Employment and Training Review Protocol"
"Retiree health insurance and disengagement from a career job.","Robinson, C., & Clark, R. (2010). Retiree health insurance and disengagement from a career job. Journal of Labor Research, 31(3), 247-262.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-No impacts
      
    
  
              


      
            Employment","Summary:

The study examined the effect of availability of retiree health insurance (RHI) on a person’s decision to leave a career job (a measure of retirement).
Using data from the Health and Retirement Study (HRS), the authors used a nonexperimental approach to estimate the likelihood of retirement for those who worked at firms with RHI compared with those who worked at firms without RHI.
The study found that workers at firms that offer RHI are more likely to retire than those at firms that do not offer RHI.
The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we would be somewhat confident that any estimated effects would be attributable to the availability at RHI, but other factors might also have contributed.","Retiree Health Insurance","Other health and safety Older workers' programs","Adult, Older worker",,"United States",2010,https://link.springer.com/article/10.1007/s12122-010-9091-4,"Employment and Training Review Protocol"
"An Evaluation of the Latino Coalition’s Reclamando Nuestro Futuro (Reclaiming our Future) Program","Monsma, S., & Smidt, C. (2009). An Evaluation of the Latino Coalition’s Reclamando Nuestro Futuro (Reclaiming our Future) Program. Paul Henry Institute for the Study of Christianity and Politics,","Opportunities for Youth","Study Type: Implementation Analysis",,,"Summary:

This report presents an implementation analysis of the Latino Coalition’s Reclamando Nuestro Futuro (RNF) program. The program provided skills training, case management, and follow-up services to at risk youth and those with previous criminal justice experience between the ages of 14 and 21.
The study examined RNF programs in 19 sites, focusing on program organization, sub-grantee characteristics, and participant characteristics and outcomes. The study utilized management information system (MIS) data, staff interviews, site visits, participant focus groups, and interviews with community partners.
The program was successful in reaching and retaining minority youth and those with previous criminal justice experience, largely because program subgrantees were located in and matched the neighborhoods they served, and had staff members who seemed similar to, and accessible to, their target population.
The Latino Coalition, the intermediary organization, played a critical role in the program’s success by establishing a robust organizational and oversight structure and providing capacity-building assistance to the relatively new and small faith-based and community organizations delivering program services.","Reclamando Nuestro Futuro (Reclaiming Our Future)","Basic skills Community college education and other classroom training Job search assistance and supportive services Mentoring Substance abuse recovery Work based and other occupational training Youth programs","Youth, Justice-involved, Hispanic of any race",,"United States",2009,http://wdr.doleta.gov/research/FullText_Documents/An%20Evaluation%20of%20the%20…,"Opportunities for Youth Review Protocol"
"New evidence on the labor supply effects of the Social Security earnings test.","Friedberg, L., & Webb, A. (2009). New evidence on the labor supply effects of the Social Security earnings test. Tax Policy and the Economy, 23(1), 1-36.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study examined the impact of changes to the Social Security earnings test in 1996 and 2000 on employment outcomes.
The authors used a nonexperimental design and the data from the Current Population Survey (CPS) and the Health and Retirement Study (HRS) to compare outcomes before and after the changes in earning test rules for those between the ages of 62 and 74 who faced different earnings test thresholds at different ages and years.
The study found that upcoming anticipated earnings test between ages 62 to 69 was associated with a significantly lower likelihood of having a job last week. A higher present value of upcoming anticipated earnings threshold between ages 62 to 69 was associated with a significantly higher likelihood of having a job last week.
The quality of causal evidence presented in this study is low because the study is a nonexperimental analysis that did not demonstrate that the groups being compared were similar and did not account for possible differences in the analysis. This means we are not confident that the estimated effects are attributable to the changes in the earnings test decision. Other factors are likely to have contributed.","Social Security Earnings Test","Older workers' programs Other employment and reemployment","Adult, Older worker",,"United States",2009,,"Employment and Training Review Protocol"
"The repeal of the retirement earnings test and the labor supply of older men.","Engelhardt, G. V., & Kumar, A. (2009). The repeal of the retirement earnings test and the labor supply of older men. Journal of Pension Economics & Finance, 8(4), 429-450.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study examined the impact of the repeal of the earnings test under the Senior Citizens Freedom to Work Act of 2000 on the labor supply and earnings of older men ages 62 to 72.
The authors used a nonexperimental approach and data from the Health and Retirement Study to compare labor force participation, annual hours of work, retirement behavior, and earnings of men who were and were not subject to the repeal of the earnings test.
The study found that the policy change was associated with a significant increase in older men’s average annual hours of work. The policy change was also associated with a change in the distribution of real earnings in that a smaller proportion of older men had earnings at or below the earnings test threshold.
The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Senior Citizens Freedom to Work Act of 2000; other factors are likely to have contributed.","Senior Citizens Freedom to Work Act of 2000","Older workers' programs Other disparities or discrimination in employment and earnings","Adult, Older worker, Male",,"United States",2009,,"Employment and Training Review Protocol"
"An empirical study of the effects of Social Security reforms on benefit claiming behavior and receipt using public-use administrative microdata.","Benítez-Silva, H., & Yin, N. (2009). An empirical study of the effects of Social Security reforms on benefit claiming behavior and receipt using public-use administrative microdata. Social Security Bulletin, 69(3), 77-95.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Public benefits receipt-Low-Favorable impacts
      
    
  
              


      
            Public benefit receipt","Summary:

The study examined the impact of three policy changes to the Social Security program that went into effect in 2000 on average monthly benefits and the proportion of new claimants by age.
The study was a nonexperimental analysis that examined outcomes for older workers by age and year using data from the 2004 Old Age, Survivors, and Disability Insurance program public-use microdata files.
The study found that the changes were associated with lower average monthly benefits for individuals ages 66 to 69 after the year 2000 relative to individuals of the same ages in 1994.
The quality of the causal evidence presented in this report is low because the authors did not demonstrate that the groups were similar before the intervention. This means we are not confident that the estimated effects are attributable to the intervention program; other factors are likely to have contributed.","Policy Changes to the Social Security Program","Federal retirement benefits Older workers' programs","Adult, Older worker",,"United States",2009,https://papers.ssrn.com/sol3/papers.cfm?abstract_id=1480653,"Employment and Training Review Protocol"
"The effect of the social security earnings test on male labor supply: New evidence from survey and administrative data.","Haider, S. J., & Loughran, D. S. (2008). The effect of the social security earnings test on male labor supply: New evidence from survey and administrative data. Journal of Human Resources, 43(1), 57-87.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Mixed impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employer benefits receipt-Low-Favorable impacts
      
    
  
              


      
            Employer benefits receipt","Summary:

The study’s objective is to examine the impact of 1983 and 2000 policy changes that removed the Social Security earnings test for certain age groups on the earnings and employment outcomes of affected men
The study is a nonexperimental analysis that examines the correlations between the 1983 and 2000 policy changes and earnings and employment status. The study compares the outcomes of men affected by the policy changes with the outcomes of men of similar ages not affected by the policy changes.
The study finds that the 1983 policy change is associated with few changes to the observed outcomes and that the 2000 policy change is associated with higher earnings and hours worked per week for affected men.
The quality of causal evidence presented in this report is low because the study does not demonstrate that men affected by the policy changes are similar to the men not affected by the policy change, nor does it control for possible differences. This means we are not confident that the estimated effects are attributable to the 1983 and 2000 policy changes; other factors are likely to have contributed.","Social Security Earnings Test","Federal retirement benefits Older workers' programs","Adult, Older worker, Male",,"United States",2008,http://jhr.uwpress.org/content/43/1/57.refs,"Employment and Training Review Protocol"
"State age protection laws and the Age Discrimination in Employment Act.","Lahey, J. State age protection laws and the Age Discrimination in Employment Act. (2008). The Journal of Law and Economics, 51(3), 433-460.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Low-No impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Low-Unfavorable impacts
      
    
  
              


      
            Employment","Summary:

The study examined the impact of enforcement of age discrimination laws on the employment and earnings of older male workers
The author used a nonexperimental regression model and data from the Current Population Survey to estimate the impact.
The study found that males older than 50 in states with age discrimination laws were 0.2 percentage points less likely to be hired compared with those in states without their own age discrimination laws.
The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the state laws on age discrimination, but other factors might also have contributed.","Age Discrimination Employment Act (ADEA)","Older workers' programs Other disparities or discrimination in employment and earnings","Adult, Older worker, Male",,"United States",2008,https://www.jstor.org/stable/10.1086/589670?seq=1#page_scan_tab_contents,"Employment and Training Review Protocol"
"Supported employment for middle-aged and older people with schizophrenia.","Twamley, E., Narvaez, J., Becker, D., Bartels, S., & Jeste, D. (2008). Supported employment for middle-aged and older people with schizophrenia. American Journal of Psychiatric Rehabilitation, 11(1), 76-89.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study examined the impact of Individual Placement and Support (IPS) on competitive employment for older people with schizophrenia
The study was a randomized controlled trial (RCT) and used weekly work logs cross-referenced with pay stubs to measure employment outcomes over a 12-month period.
The study found that IPS increased competitive employment and earnings compared with conventional services.
The quality of causal evidence presented in this report is low because the RCT has a confounding factor. This means we are not confident that the estimated effects are attributable to the IPS program; other factors are likely to have contributed.","Individual Placement and Support and Vocational Rehabilitation Program","Health Individuals facing barriers to employment Job search assistance and supportive services","Adult, Older worker, Disability",,"United States",2008,https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2638571/,"Employment and Training Review Protocol"
"How did the elimination of the US earnings test above the normal retirement age affect labour supply expectations?","Michaud, P., & Van Soest, A. (2008). How did the elimination of the US earnings test above the normal retirement age affect labour supply expectations? Fiscal Studies, 29(2), 197-231. doi:10.1111/j.1475-5890.2008.00073.x","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The authors used a nonexperimental approach and the data from Health and Retirement Study data from 1996 to 2002 and Social Security earnings history to estimate the impact.
The study examined the impact of repealing the earnings test from Social Security recipients between full retirement age and age 70 on older workers’ subjective probability of retirement.
The authors used a nonexperimental approach and the data from Health and Retirement Study data from 1996 to 2002 and Social Security earnings history to estimate the impact.
The study found that after the repeal of the earnings test, the subjective probability of working of full-time past age 65 for older male workers who were likely to have most of their projected Social Security benefits reduced under the earnings test has increased their expected probability of working relative to those who were not likely to be affected. •The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design.This means we are somewhat confident that the estimated effects are attributable to the repeal of the earnings test, but other factors might also have contributed.","Social Security Earnings Test","Federal retirement benefits Older workers' programs","Adult, Older worker, Male",,"United States",2008,,"Employment and Training Review Protocol"
"A tax on work for the elderly: Medicare as a secondary payer.","Goda, G. S., Shoven, J. B., & Slavov, S. N. (2007). A tax on work for the elderly: Medicare as a secondary payer. (NBER Working Paper No. 13383). Cambridge, MA: National Bureau of Economic Research.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study’s objective was to examine the impact of Medicare as a Secondary Payer (MSP) on older workers’ labor force participation and full-time employment
The study used a nonexperimental regression design. The authors used data from the 1980 to 2006 March Supplement of the Current Population Survey.
The study found that labor force participation for older males increased following the enforcement of the MSP policy, and that older males and females in the labor force were more likely to be employed full time after the policy was enforced.
The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention, and confounding factors could have impacted older workers differentially during the time periods examined. This means we are not confident that the estimated effects are attributable to MSP; other factors are likely to have contributed.","Medicare as a Secondary Payer","Federal retirement benefits Older workers' programs","Adult, Older worker",,"United States",2007,https://www.nber.org/papers/w13383,"Employment and Training Review Protocol"
"Labor market shocks and retirement: Do government programs matter?","Coile, C., & Levine, P. (2007). Labor market shocks and retirement: Do government programs matter? Journal of Public Economics, 91(10), 1902-1919.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-No impacts
      
    
  
              


      
            Employment
      


  
      
            Public benefits receipt-Low-No impacts
      
    
  
              


      
            Public benefit receipt","Summary:

The study examined the impact of the generosity of unemployment insurance (UI) benefits on retirement decisions.
The study used a statistical model and data from the March Current Population Survey for 1980–2004 to estimate impacts.
The study found no relationship between the generosity of UI benefits and the likelihood of retirement or receipt of UI.
The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before changes in the generosity of UI benefits were observed. This means we are not confident that the estimated effects are attributable to changes in the generosity of UI benefits; other factors are likely to have contributed.","Unemployment Insurance (UI)","Unemployment Insurance","Adult, Older worker, Unemployed",,"United States",2007,http://academics.wellesley.edu/Economics/Coile/PDF%20files/coile-levine%20JPubE…,"Employment and Training Review Protocol"
"A comparison of two Welfare-to-Work strategies among African American women in Atlanta, Georgia. (Unpublished doctoral dissertation).","Wilson-Brewster, V.L. (2006). A comparison of two Welfare-to-Work strategies among African American women in Atlanta, Georgia. (Unpublished doctoral dissertation). Capella University, Minneapolis, Minnesota.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study’s objective was to examine the effectiveness of two welfare-to-work programs—the Labor Force Attachment (LFA) program and the Human Capital Development (HCD) program—on the employment and earnings of African American women 25, 35, and 45 years old in Atlanta.
The author analyzed a subsample of participants in the National Evaluation of Welfare-to-Work Strategies (NEWWS) study. The study was a randomized controlled trial that assigned individuals within a geographic location to one of three groups: LFA, HCD, or a control group.
The study found that women in the 35-year-old group who participated in LFA or HCD had higher earnings and needed less time to find a job than those in the other age cohorts.
The quality of causal evidence presented in this report is low because the study was a randomized controlled trial with unknown attrition and the authors did not account for preexisting differences between the groups being compared in their analysis. This means we are not confident that the estimated effects are attributable to LFA or HCD programs; other factors are likely to have contributed.","Labor Force Attachment (LFA) and Human Capital Development (HCD)","Other employment and reemployment Other training and education","Female, Black or African American, Low income, Parent",,"United States, Urban",2006,,"Employment and Training Review Protocol"
"New evidence on earnings and benefit claims following the changes in the retirement earnings test in 2000.","Song, J. G., & Manchester, J. (2006). New evidence on earnings and benefit claims following the changes in the retirement earnings test in 2000. (ORES Working Paper 107). Washington, DC: Social Security Administration, Office of Policy, Office of Research, Evaluation, and Statistics. Also available in Journal of Public Economics, 91(3–4), 669–700 (2007).","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-No impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Low-No impacts
      
    
  
              


      
            Employment
      


  
      
            Public benefits receipt-Mod/high-Unfavorable impacts
      
    
  
              


      
            Public benefit receipt","Summary:

The study examined the impact of the Senior Citizens Freedom to Work Act of 2000 on employment, earnings, and public benefit receipt outcomes of workers ages 65 to 69.
The study was a nonexperimental analysis and used Social Security Administrative data to estimate the impacts.
The study found that the Senior Citizens Freedom to Work Act of 2000 was associated with significant increases in the rate of Social Security claims for both sets of individuals affected by the law. The study found no statistically significant relationship between the Senior Citizens Freedom to Work Act of 2000 and earnings.
The quality of casual evidence presented in this report for Social Security claims and earnings outcomes is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the Senior Citizens Freedom to Work Act of 2000, but other factors might also have contributed. The quality of causal evidence presented in this report on employment is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Senior Citizens Freedom to Work Act of 2000; other factors are likely to have contributed.","Senior Citizens Freedom to Work Act of 2000","Older workers' programs Other disparities or discrimination in employment and earnings","Adult, Older worker",,"United States",2006,,"Employment and Training Review Protocol"
"The effect of court-ordered hiring quotas on the composition and quality of police","McCrary, J. (2006). The effect of court-ordered hiring quotas on the composition and quality of police. National Bureau of Economic Research working paper no. 12368. Cambridge, MA: NBER.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:


The study’s objective was to examine the effect of litigation for claims of hiring discrimination on the representation gap of African Americans in U.S. police and fire departments.
The author examined Equal Employment Opportunity (EEO-4) State and Local Government Report data from 1973 to 1999 for 314 major U.S. cities. The author also examined additional data covering 1960 to 1973 for 120 cities, collected from a variety of historical sources. 
The study found that the difference in the African American representation gap between litigated and unlitigated cities diminished and almost completely disappeared by 1999.
The quality of causal evidence provided in this study is low because the author did not control for pre-existing differences between unlitigated and litigated cities. This means that we are not confident that the estimated effects are attributable to hiring discrimination litigation. Other factors are likely to have contributed.","litigation related to hiring discrimination","Civil Rights Act of 1964 Equal Employment Opportunity Act of 1972","Black or African American","Other services","United States",2006,http://www.nber.org/papers/w12368.pdf,"Employer Compliance Review Protocol"
"Enforcement of civil rights law in private workplaces: The effects of compliance reviews and lawsuits over time","Kalev, A., & Dobbin, F. (2006). Enforcement of civil rights law in private workplaces: The effects of compliance reviews and lawsuits over time. Law & Social Equity, 31(4), 855-903.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:


The study’s objective was to examine the effectiveness of compliance reviews by the Office of Federal Contract Compliance Programs (OFCCP) and lawsuits initiated by individuals or the Equal Employment Opportunity Commission (EEOC) in reducing discrimination against women and African Americans in management positions.
The authors applied a fixed-effects regression model to workforce data in the EEO-1 Employer Information Reports. These data were supplemented by a survey of compliance enforcement activities administered to a random sample of establishments drawn from the EEO-1 reports.
The study found that compliance reviews begun in the 1970s increased an establishment’s share of women and African Americans employed as managers, not only in the 1970s but also through the 1980s and 1990s.
The quality of causal evidence presented in this report is low because the study did not adequately control for existing differences between the study groups. This means we are not confident that the estimated effects are attributable to OFCCP compliance reviews or to lawsuits. Other factors are likely to have contributed.","the Civil Rights Act of 1964 and Affirmative Action Executive Orders","Civil Rights Act of 1964 Equal Employment Opportunity Act of 1972 Executive Order 11246 (E.O. 11246)","Female, Black or African American",,"United States",2006,,"Employer Compliance Review Protocol"
"The labor market effects of sex and race discrimination laws.","Neumark, D., & Stock, W. (2006). The labor market effects of sex and race discrimination laws. Economic Inquiry, 44(3), 385-419.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Low-Unfavorable impacts
      
    
  
              


      
            Employment","Summary:

The study’s objective was to examine the effect of state-level sex and race discrimination laws passed before 1960 on employment and earnings outcomes for women and African Americans.
The authors used a triple difference estimator including state, year, and subgroup variables. The primary data source was U.S. Census data from 1940 to 1960.
The study found that sex-related equal pay laws had negative, statistically significant effects on women’s employment relative to men and a growing positive effect on women’s earnings relative to men over time. Racial discrimination laws had no significant immediate effects on employment or earnings for African American men compared with white men in the short term, but there were positive effects after the laws were in effect for a number of years.
The quality of causal evidence presented in this report is low. This means we are not confident that the estimated effects were attributable to the state sex and race discrimination laws; other factors are likely to have contributed.","State Sex and Race Discrimination Laws","Affirmative action","Female, Male, Black or African American",,"United States",2006,,"Employer Compliance Review Protocol"
"The effect of the SSI program on labor supply: Improved evidence from Social Security administrative files","Neumark, D., & Powers, E. T. (2005). The effect of the SSI program on labor supply: Improved evidence from Social Security administrative files. Social Security Bulletin, 65(3), 45-60.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study examined the relationship between generous state Supplemental Security Income (SSI) benefits and the employment of older worker nearing SSI eligibility age.
The authors used a regression model and data from the Survey of Income and Program Participants (SIPP) and Social Security Administration (SSA) to estimate the effect.
The study found that older males who were likely SSI participants in generous states worked significantly fewer hours and had lower employment rates compared with those living in less generous states. The authors, using the SSA administrative records, also found that likely older participants (ages 60 to 64) worked significantly fewer hours than younger ones.
The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to generosity of state SSI benefits; other factors are likely to have contributed.","state Supplemental Security Income (SSI) benefits","Older workers' programs Other employment and reemployment","Adult, Older worker",,"United States",2005,https://www.ssa.gov/policy/docs/ssb/v65n3/v65n3p45.html,"Employment and Training Review Protocol"
"Study of Hispanics in Job Corps: 2004-2005","Garcia, Y. Study of Hispanics in Job Corps: 2004–2005. Washington, DC: HMA Associates, 2007.","Opportunities for Youth","Study Type: Descriptive Analysis",,,"Summary:

	This report aimed to explore in greater detail the findings of the National Job Corps Study, an impact study whose final report was published in 2001. Specifically, the authors sought to understand why Hispanic youth did not experience positive impacts on employment outcomes similar to the rest of the study population.
	Job Corps offers intensive academic classroom instruction and vocational skills training, along with support services, to economically disadvantaged youth.
	The authors reviewed data on Hispanic youth from the National Job Corps Study, program data, and data from a survey administered in 2004 to Hispanic youth in Job Corps centers. They also conducted site visits to four Job Corps centers, where they interviewed program staff and current and former participants.
	The study found that Hispanic youth performed well in the Job Corps program, but did not fully leverage the training they received. Many took the first job they were offered in order to start supporting their family immediately instead of expanding their employment search to include more lucrative long-term options. They also limited their search to places of employment where they felt poor English language skills would not constrain them.","Job Corps","Job search assistance and supportive services Youth programs Other training and education Work based and other occupational training","Youth, Hispanic of any race, Low-skilled, Low income",,"United States",2005,http://wdr.doleta.gov/research/FullText_Documents/Hispanic%20Job%20Corps%202004…,"Opportunities for Youth Review Protocol"
"The impact of Equal Employment Opportunity Commission enforcement on the wages of African American and white women, 1988–1996","Wilhelm, S. (2002). The impact of Equal Employment Opportunity Commission enforcement on the wages of African American and white women, 1988–1996. The Review of Black Political Economy, 30(2), 25-51.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts
      
    
  
              


      
            Earnings and wages","Summary:


The study’s objective was to examine the impact of employment discrimination charges filed with the Equal Employment Opportunity Commission (EEOC) on the wages of African American and white women.
The author used regression analyses to compare the effects of sex- and race-based discrimination charges within an industry in a given year on the wages of African American and white women from 1988 to 1996. Data came from the Current Population Survey and the EEOC National Database.
The study found that increases in employment discrimination charges based on sex were positively correlated with increases in wages for both African American and white women. 
The quality of causal evidence provided in this study is low because the study did not adequately control for existing differences between the study groups. This means that we are not confident that the estimated effects are attributable to EEOC enforcement. Other factors are likely to have contributed.","Equal Employment Opportunity Commission Enforcement","Equal Employment Opportunity Act of 1972","Female, Black or African American, White",,"United States",2002,,"Employer Compliance Review Protocol"
"The labor market impact of state-level anti-discrimination laws","Collins, W. (2001). The labor market impact of state-level anti-discrimination laws. National Bureau of Economic Research working paper no. 8310. Cambridge, MA: NBER.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Low-Mixed impacts
      
    
  
              


      
            Employment","Summary:


This study’s objective was to assess the impact of state-level fair employment legislation, enacted in the 1940s through the 1960s, on labor market outcomes including income, unemployment, and labor force participation, by gender and race.
The study used a nonexperimental design, drawing on data from the 1940, 1950, and 1960 decennial U.S. Censuses for 19 non-southern states.
The study found that state-level fair employment laws adopted in the 1940s had larger positive effects on the relative income of African American workers than those adopted in the 1950s. In contrast, laws adopted in the 1950s led to larger increases in African American male unemployment but larger increases in African American women’s labor force participation. Only states that implemented the laws in the 1940s experienced a narrowed income gap between white and African American workers.
The quality of causal evidence presented in this report is low because the author did not demonstrate that the states that adopted fair employment legislation when they did were comparable to those that did not adopt or adopted at a later time. This means we are not confident that the estimated effects are attributable to state-level fair employment legislation. Other factors are likely to have contributed.","State-level Fair Employment Legislation","Affirmative action","Black or African American, Female, Male",,"United States",2001,http://www.nber.org/papers/w8310.pdf,"Employer Compliance Review Protocol"
"Antidiscrimination measures of the 1960s and occupational mobility: Evidence for black American men","Fosu, A. (2000). Antidiscrimination measures of the 1960s and occupational mobility: Evidence for black American men. Journal of Labor Research, 21(1), 169-180.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:


The study’s objective was to assess the effect of the Civil Rights Act of 1964 on the occupational status of African American men in the United States.
Using labor force statistics derived from the Current Population Survey and other sources, the author used an interrupted time series design to estimate the occupational status of black men relative to white men from 1958 to 1981, specifically focusing on differences after the Civil Rights Act of 1964.
The study found a positive trend in the occupational status of African American men relative to white men over the entire 1958–1981 period and a larger positive trend for years after 1964. The author estimated that about half of the rise in relative earnings for African American men from 1964 to 1981 could be attributed to increased occupational status.
The quality of causal evidence provided in this study is low because the author examined only one demonstration of the intervention. This means that we are not confident that the estimated effects are attributable to the passage of the Civil Rights Act of 1964. Other factors are likely to have contributed.","the Civil Rights Act of 1964","Civil Rights Act of 1964","Black or African American",,"United States",2000,,"Employer Compliance Review Protocol"
"Using establishment size to measure the impact of Title VII and affirmative action","Carrington, W.J., McCue, K., & Pierce, B. (2000). Using establishment size to measure the impact of Title VII and affirmative action. Journal of Human Resources, 35(3): 503-523.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Low-No impacts
      
    
  
              


      
            Employment","Summary:

This study’s objective was to assess the impact of the Civil Rights Act of 1964 (the Civil Rights Act) and subsequent affirmative action executive orders on the employment share of African American employees at larger employers (which were subject to those laws) and the African American–white wage gap.
The authors examined trends in the annual employment shares of African American men, African American women, white men, and white women at employers in different size classes. They also assessed the contributions of individual- and firm-level factors to the gaps in wages earned by African American and white workers over time. Analyses used March Current Population Survey Annual Demographic Survey (1964–1988) linked with County Business Pattern data.
The authors estimated that the Civil Rights Act and affirmative action increased the share of African American men and women employed by large firms. In addition, the authors found that a substantial proportion of African American–white wage convergence during the study period was attributable to African American employees’ growing employment share at large firms.
The quality of causal evidence presented in this report is low. This means that we are not confident that the observed changes in employment are attributable to the Civil Rights Act and affirmative action; other factors are likely to have contributed.","the Civil Rights Act of 1964 and Affirmative Action Executive Orders","Affirmative action Civil Rights Act of 1964 Executive Order 11246 (E.O. 11246)","Black or African American",,"United States",2000,,"Employer Compliance Review Protocol"
"Matching the disadvantaged to job opportunities: Structural explanations for the past successes of the Center for Employment Training.","Melendez, E., & Harrison, B. (1998). Matching the disadvantaged to job opportunities: Structural explanations for the past successes of the Center for Employment Training. Economic Development Quarterly, 12(1), 3-11.","Opportunities for Youth","Study Type: Descriptive Analysis",,,"Summary:

The authors’ objective was to propose a plausible explanation for the Center for Employment Training-San Jose’s (CET) success in placing disadvantaged people into jobs.
CET is a national program that provides job training for disadvantaged people and matches them with entry-level jobs. The San Jose site, the focus of this article, served a mostly Hispanic population, consisting of dislocated farm workers, mothers on public assistance, out-of-school youth, and ex-offenders.
The authors reviewed findings from a recent case study on CET-San Jose and posited explanations for the program’s success. They attributed the success of the program to its ability to develop in its participants the skills necessary in the local labor market and become part of employers’ trusted recruiting networks. They also noted that CET-San Jose is embedded in a powerful social movement (West Coast Hispanic politics and culture).","the Center for Employment Training (CET) Replication","Basic skills Job search assistance and supportive services Other training and education Work based and other occupational training Youth programs","Youth, Hispanic of any race, Low-skilled, Low income",,"United States",1998,,"Opportunities for Youth Review Protocol"
"The impact of federal civil rights policy on black economic progress: Evidence from the Equal Employment Opportunity Act of 1972","Chay, K. (1998). The impact of federal civil rights policy on black economic progress: Evidence from the Equal Employment Opportunity Act of 1972. Industrial and Labor Relations Review, 51(4), 608-632.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Mod/high-Favorable impacts
      
    
  
              


      
            Employment","Summary:


The study’s objective was to examine the impact of the 1972 Equal Employment Opportunity Act (EEOA) on employment, earnings, and occupational outcomes of African American men.
The study used a non-experimental design that used regression analysis for impact evaluation. The author used data from the 1968–1980 Current Population Survey (CPS).
This study found that the 1972 EEOA had positive impacts on the employment, earnings, and occupational status of African American men in the South in industries with more than 50 percent of workers employed in small establishments covered by the law.
The quality of causal evidence presented in this study is moderate because it was based on a strong non-experimental design. This means we are somewhat confident that the estimated effects are attributable to the 1972 EEOA, but other factors might also have contributed.","the 1972 Equal Employment Opportunity Act","Civil Rights Act of 1964 Equal Employment Opportunity Act of 1972","Male, Black or African American","Small business","United States",1998,,"Employer Compliance Review Protocol"
"The effect of federal contractor status on racial differences in establishment-level employment shares: 1979–1992.","Rodgers, W., & Spriggs, W. (1996). The effect of federal contractor status on racial differences in establishment-level employment shares: 1979–1992. The American Economic Review 86(2), 290–293.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Mixed impacts
      
    
  
              


      
            Employment","Summary:

The study’s objective was to assess the effect of Executive Order 11246, a 1965 directive that subjected federal contractors to stringent antidiscrimination standards, by comparing the proportion of minority employees among federal contracting firms who were covered by such policies to the share among other private organizations that were not covered.
The authors analyzed the effect of federal contractor status on racial and ethnic groups’ shares of a firm’s employment while also accounting for other establishment-level differences using data from the 1979–1992 Employer Information Report EEO-1 files.
The study found that by 1992, the African American employment share was 1.36 percentage points higher among federal contractors than at an average EEO-1 reporting company. For Hispanics, however, federal contractor status had the opposite effect; it decreased the proportion of Hispanic employees by 0.45 percentage points in 1992.
The quality of causal evidence presented in this study is low. This means we are not confident that the estimated effects are attributable to Executive Order 11246; other factors are likely to have contributed.","Executive Order 11246","Executive Order 11246 (E.O. 11246) Civil Rights Act of 1964","Asian, Black or African American, Hispanic of any race",,"United States",1996,,"Employer Compliance Review Protocol"
"Some new historical evidence on the impact of affirmative action: Detroit, 1972","Hyclak, T., Taylor, L., & Stewart, J. (1992). Some new historical evidence on the impact of affirmative action: Detroit, 1972. The Review of Black Political Economy, 21(2), 81-98.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:


The study’s objective was to examine the effect of federal affirmative action reporting requirements on Detroit firms’ hiring of minorities into managerial positions in 1972.
The authors compared the probability that minority candidates applied to and were hired for managerial positions at firms that were and were not subject to affirmative action reporting requirements. The sample comprised 99 Detroit firms that fully responded to the 1972 Detroit Area Study survey.
The study found that firms subject to affirmative action reporting requirements were significantly more likely to hire African American males than firms not subject to the requirements.
The quality of causal evidence presented in this report is low because the authors did not adequately control for existing differences between firms that were and were not subject to affirmative action reporting requirements. This means we are not confident that the estimated effects are attributable to affirmative action reporting requirements. Other factors are likely to have contributed.","the Civil Rights Act of 1964 and Affirmative Action reporting requirements","Affirmative action Civil Rights Act of 1964 Equal Employment Opportunity Act of 1972","Adult, Black or African American",,"United States",1992,,"Employer Compliance Review Protocol"