Title,Citation,Topic_area,Study_type,Study_evidence_rating,Outcome_effectiveness,Findings,Intervention_program,Topics,Target_population,Firm_characteristics,Geographic_setting,Original_publication_date,Original_publication_link,"Review Protocol"
"Synthesis Report: Behavioral Finance Synthesis: Findings",,"Behavioral Finance: Retirement",,,,"Findings:

  
  
  

  
  
  

  
  
  

          People have relatively limited knowledge about saving for retirement and can be induced to save more when provided with additional information.

          Making retirement more salient, by having people think of themselves in retirement or providing a target retirement date, can increase intentions to save and alter investment choices.

          People can become overwhelmed by the number of investment options they face; when this occurs, they tend to use simple rules to make decisions.",,"Employer provided retirement benefits","Adult, Older worker",,"United States",,,"Behavioral Finance: Retirement Review Protocol"
"Supervisor support training effects on veteran health and work outcomes in the civilian workplace","Hammer, L. B., Wan, W. H., Brockwood, K. J., Bodner, T., & Mohr, C. D. (2019). Supervisor support training effects on veteran health and work outcomes in the civilian workplace. Journal of Applied Psychology, 104(1), 52–69.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence",,"Summary:

	
	The study’s objective was to examine the impact of Veteran-Supportive Supervisor Training (VSST) on perceived health, functional impairment, job performance, and turnover intentions of employed veterans. 
	
	
	The primary design of the study was a cluster randomized controlled trial. The authors collected survey data before and at three and nine months after random assignment. Using a statistical model, the study authors compared the outcomes of individuals in the control group organizations to the individuals in the treatment group organizations. 
	



	
	The study did not find any statistically significant impacts on perceived health, functional impairment, job performance, or turnover intentions.  
	
	
	The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects would be attributable to VSST and not to other factors. However, the study did not find statistically significant effects. ","Veteran-Supportive Supervisor Training","Other training and education","Veteran or military",,,2019,https://pubmed.ncbi.nlm.nih.gov/30265016/,"Employment and Training Review Protocol"
"Recruiting and retaining dental labor in federal facilities: Harder than pulling teeth?","Richards, M. R., & Wing, C. (2019). Recruiting and retaining dental labor in federal facilities: Harder than pulling teeth? Health Economics, 28(11), 1356–1369. https://doi.org/10.1002/hec.3949",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Mixed impacts
      
    
  
              


      
            Employment","Summary:

	
	The study’s objective was to examine the impact of the Health Care Personnel Enhancement Act’s (HCPEA) authorization of flexible, and potentially more generous, pay packages for U.S. Veterans Administration (VA) dentists on job separation, hiring rates, and part-time employment. 
	



	
	The authors compared changes in the outcomes of VA dentists to those of federal occupations that were not affected by HCPEA. The authors used administrative data on federal employees from 2002 to 2012 from the Office of Personnel Management’s Central Personnel Data File. In addition to analyzing the full sample, the authors examined findings for early- and later-career employees.  
	
	
	The authors found that, among the full sample, the announcement of HCPEA was associated with a higher job separation rate, while the enactment of HCPEA was associated with a lower new-hire rate and lower likelihood of transitions from full-time to part-time employment. 
	
	
	The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the HCPEA; other factors are likely to have contributed.  ","Health Care Personnel Enhancement Act","Other wages and benefits","Veteran or military",,,2019,https://onlinelibrary.wiley.com/doi/full/10.1002/hec.3949,"Review Protocol"
"Information technology career preparation for rural areas.","Hahs-Vaughn, D. L., Swan, B., & Clark, M. H. (2019). Information technology career preparation for rural areas. Community College Journal of Research and Practice, 1-13.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Education and skills gains-Low-Favorable impacts
      
    
  
              


      
            Education and skills gains
      


  
      
            Employment-Low-No impacts
      
    
  
              


      
            Employment","Summary:

The study’s objective was to examine the impact of the Florida Information Technology Careers for Rural Areas (XCEL-IT) program on education, employment, and earnings outcomes.
The authors used a nonexperimental design to compare the differences in outcomes between XCEL-IT program participants and a comparison group.
The study found that XCEL-IT program participation was significantly related to program completion.
The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the XCEL-IT program; other factors are likely to have contributed.","the Florida Information Technology Careers for Rural Areas (XCEL-IT)","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Unemployed, Veteran or military",,"Rural, United States",2019,,"Community College Review Protocol"
"Preparing Alaskans for mining careers through short, industry-informed training programs: University of Alaska round IV TAACCCT grant","Hanson, H., Stevens, D., Vazquez, M., & Roberts, B. (2018). Preparing Alaskans for mining careers through short, industry-informed training programs: University of Alaska round IV TAACCCT grant. Portland, OR: Education Northwest.","Community College",,,"Earnings and wages-Low-Favorable impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study’s objective was to examine the impact of the University of Alaska's Trade Adjustment Assistance Community College and Career Training (TAACCCT) grant program on the employment and earnings of community college students.
The study used a nonexperimental design to compare the outcomes of students in the TAACCCT-enhanced Surface Mining and Underground Mining programs to similar individuals who did not attend community college and instead entered the labor market in mining occupations.
The study found that the TAACCCT-enhanced program participation was significantly associated with a higher likelihood of employment retention and increased quarterly wages.
The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the University of Alaska's TAACCCT grant program; other factors are likely to have contributed.","the University of Alaska's TAACCCT Grant Program","Employer partnerships Capacity building programs Community college education and other classroom training","Adult, Dislocated or displaced worker, American Indian or Alaska Native, Veteran or military",,"United States",2018,http://www.skillscommons.org/bitstream/handle/taaccct/18578/AK_TAACCCT_Report_0…,"Community College Review Protocol"
"TAACCCT building Illinois' bio-economy (BIB) consortium final evaluation report","The New Growth Group. (2018). TAACCCT building Illinois' bio-economy (BIB) consortium final evaluation report. Cleveland, OH: New Growth Group.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts
      
    
  
              


      
            Education and skills gains","Summary:

The study’s objective was to examine the impact of the Building Illinois’ Bio-economy (BIB) consortium on education outcomes.
The authors used a nonexperimental design to compare the outcomes of students in BIB grant-affected programs to a matched comparison group of students in non-BIB grant-affected programs.
The study found a significant positive relationship between BIB program participation and program completion rates at two of the five colleges.
The quality of causal evidence presented in this report is low because the authors did not use sufficient controls in their analysis. This means we are not confident that the estimated effects are attributable to participation in BIB grant-affected programs; other factors are likely to have contributed.","the Building Illinois’ Bio-economy (BIB) Consortium","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Veteran or military",,"United States",2018,,"Community College Review Protocol"
"Johnson County Community College (JCCC) TAACCCT final evaluation report","York, V. (2018). Johnson County Community College (JCCC) TAACCCT final evaluation report. Office of Educational Innovation and Evaluation. Manhattan, KS: Kansas State University.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts
      
    
  
              


      
            Education and skills gains","Summary:

The study’s objective was to evaluate the effects of Johnson County Community College’s (JCCC) Accelerated, Collaborative Technology Training Services (ACTTS) project on education outcomes.
The author used a nonexperimental design to compare cohorts of students enrolled in ACTTS and comparison programs on five educational outcomes of interest.
The study found that ACTTS students were significantly more likely than comparison group participants to complete their program of study, be retained in their program of study, complete credit hours, and earn credentials.
The quality of causal evidence presented in this study is low because the authors did not ensure that the groups being compared were similar before the intervention or include sufficient controls. This means we are not confident that the estimated effects are attributable to ACTTS; other factors are likely to have contributed.","JCCC’s Accelerated, Collaborative Technology Training Services (ACTTS) project","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Dislocated or displaced worker, Veteran or military",,"United States",2018,https://www.skillscommons.org/bitstream/handle/taaccct/17872/JCCC%20TAACCCT%20F…,"Community College Review Protocol"
"Southern Regional Technical College TAACCCT: Healthcare Career Works! (HCW) program third-party evaluation final report","WorkED Consulting. (2018). Southern Regional Technical College TAACCCT: Healthcare Career Works! (HCW) program third-party evaluation final report. Burke, VA: WorkED Consulting.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts
      
    
  
              


      
            Education and skills gains","Summary:

The study’s objective was to examine the impact of the Healthcare Career Works! (HCW) program on education outcomes.
The authors used a nonexperimental design to compare differences in education outcomes between HCW participants and a matched comparison group.
The study found no statistically significant relationships between the HCW program and program completion.
The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the HCW program; other factors are likely to have contributed.","Healthcare Career Works! (HCW)","Capacity building programs Community college education and other classroom training","Adult, Dislocated or displaced worker, Unemployed, Veteran or military",,"United States",2018,,"Community College Review Protocol"
"Kansas Technical Re/training Among Industry-targeted Networks (KanTRAIN) TAACCCT IV evaluation final report","Foster, L. R., Staklis, S., Ott, N. R., & Moyer, R. (2018). Kansas Technical Re/training Among Industry-targeted Networks (KanTRAIN) TAACCCT IV evaluation final report. Raleigh, NC: RTI International.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Education and skills gains-Low-Favorable impacts
      
    
  
              


      
            Education and skills gains
      


  
      
            Employment-Low-No impacts
      
    
  
              


      
            Employment","Summary:

The study’s objective was to examine the impact of the Kansas Technical Re/training Among Industry-targeted Networks (KanTRAIN) program on education, earnings, and employment outcomes.
The authors used a nonexperimental design to compare education, earnings, and employment outcomes of KanTRAIN participants to a matched comparison group.
The study found KanTRAIN participants were significantly more likely to earn more credits per semester, pass a higher percentage of the credits attempted, attain more credentials, and earn a nondegree credential or a college degree, and receive a wage increase than the comparison group.
The quality of causal evidence presented in this study is low because the authors used a comparison group from previous enrollment years presenting a confounding factor. This means we are not confident that the estimated effects are attributable to the KanTRAIN program; other factors are likely to have contributed.","Kansas Technical Re/training Among Industry-targeted Networks (KanTRAIN)","Capacity building programs Community college education and other classroom training","Adult, Veteran or military",,"United States",2018,https://www.skillscommons.org/bitstream/handle/taaccct/18334/KanTRAIN_TAACCCT_I…,"Community College Review Protocol"
"Third-party evaluation of MoSTEMWINs: Implementation, outcomes, and impact","Cosgrove, J., & Cosgrove, M. (2018). Third-party evaluation of MoSTEMWINs: Implementation, outcomes, and impact. St. Louis, MO: Cosgrove & Associates, LLC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts
      
    
  
              


      
            Education and skills gains
      


  
      
            Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study’s objective was to examine the impact of the Missouri STEM Workforce Innovation Networks (MoSTEMWINs) program on education and employment outcomes.
The authors used a nonexperimental design to compare education and employment outcomes of MoSTEMWINs participants to a historical comparison group.
The study found that MoSTEMWINs participants were significantly more likely to complete the program and attain employment than the comparison group.
The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the MoSTEMWINs program; other factors are likely to have contributed.",MoSTEMWINs,"Basic skills Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Dislocated or displaced worker, Unemployed, Veteran or military",,"United States",2018,http://www.skillscommons.org/bitstream/handle/taaccct/10845/MoSTEMWINs%20Mid-Po…,"Community College Review Protocol"
"KCTCS Enhancing Programs for IT Certification (EPIC): Independent evaluation contracted by the Kentucky Community and Technical College System","Hughes, K., Belfield, C., Ran, F., & Jenkins, D. (2018). KCTCS Enhancing Programs for IT Certification (EPIC): Independent evaluation contracted by the Kentucky Community and Technical College System. New York, NY: Community College Research Center, Teacher's College, Columbia University.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Education and skills gains-Mod/high-Favorable impacts
      
    
  
              


      
            Education and skills gains","Summary:

The study’s objective was to assess the impact of the Enhancing Programs for IT Certification’s (EPIC) Learn on Demand (LoD) courses on community college students’ education outcomes. This summary focuses on the comparison between students who enrolled in EPIC LoD courses and students who enrolled in the traditional format courses. 
The authors used a nonexperimental design to compare the outcomes of students enrolled in EPIC LoD courses with those enrolled in traditional formats of courses where an EPIC LoD version was available.
The study found that EPIC LoD course participation was significantly associated with increased course completion and certificate completion.
The quality of causal evidence presented in this report is moderate for the course completion outcome because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the EPIC LoD courses, but other factors might also have contributed. For the certificate completion outcome, the quality of causal evidence presented in this report is low because the authors did not use sufficient controls in their analysis. This means we are not confident that the estimated effects are attributable to the EPIC LoD courses; other factors are likely to have contributed.","the Enhancing Programs for IT Certification (EPIC) Project","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Dislocated or displaced worker, Veteran or military",,"United States",2018,https://ccrc.tc.columbia.edu/media/k2/attachments/CCRC_KCTCS_EPIC_Report_09-26-…,"Community College Review Protocol"
"An analysis of the Veterans Employment Initiative","Moses-Stanton, S. (2018). An analysis of the Veterans Employment Initiative. (Doctoral dissertation). Retrieved from ProQuest. Accession No. 10745075.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-No impacts
      
    
  
              


      
            Employment","Summary:

	The study’s objective was to examine the impact Presidential Executive Order 13518 (EO13518) had on the employment of veterans who served in the military starting in September 2001 (Gulf War II-era veterans).
	The author used graphical analysis to examine employment outcomes for veterans and non-veterans after the implementation of EO13518. The study used Integrated Public Use Microdata Series (IPUMS USA) data for the years 2008, 2009, 2014, and 2015.
	The study did not show evidence of a relationship between the implementation of EO13518 and employment of Gulf War II-era veterans. The study did not statistically compare the employment of the veterans and non-veterans following implementation of the Executive Order.
	The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we would not be confident that any estimated effects would be attributable to the implementation of EO13518; other factors would be likely to have contributed to the findings. However, the study did not find statistically significant effects.","Executive Order 13518","Job search assistance and supportive services Veterans' reemployment","Veteran or military",,"United States",2018,https://search.proquest.com/openview/c2ddd5b8502115f80bf2a7352fe1e281/1?cbl=187…,"Employment and Training Review Protocol"
"KCTCS Enhancing Programs for IT Certification (EPIC): Independent evaluation contracted by the Kentucky Community and Technical College System","Hughes, K., Belfield, C., Ran, F., & Jenkins, D. (2018). KCTCS Enhancing Programs for IT Certification (EPIC): Independent evaluation contracted by the Kentucky Community and Technical College System. New York, NY: Community College Research Center, Teacher's College, Columbia University.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Education and skills gains-Mod/high-Favorable impacts
      
    
  
              


      
            Education and skills gains","Summary:

The study’s objective was to assess the impact of the Enhancing Programs for IT Certification’s (EPIC) Learn on Demand (LoD) courses on community college students’ education outcomes. This summary focuses on the comparison between students who enrolled in EPIC LoD courses and students who enrolled in non-EPIC LoD courses. 
The authors used a nonexperimental design to compare the outcomes of students enrolled in EPIC LoD courses with those enrolled in non-EPIC LoD courses.
The study found that EPIC LoD course participation was significantly associated with increased course completion and certificate completion.
The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the EPIC LoD courses, but other factors might also have contributed.","the Enhancing Programs for IT Certification (EPIC) Project","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Dislocated or displaced worker, Veteran or military",,"United States",2018,https://ccrc.tc.columbia.edu/media/k2/attachments/CCRC_KCTCS_EPIC_Report_09-26-…,"Community College Review Protocol"
"Evaluation of Richland College's Veterans-Focused Engineering Technology Project: Final Report","Haviland, S., Van Noy, M., Kuang, L., Vinton, J., & Pardalis, N. (2018). Evaluation of Richland College's Veterans-Focused Engineering Technology Project: Final Report. New Brunswick, NJ: Rutgers University Education and Employment Research Center.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Unfavorable impacts
      
    
  
              


      
            Education and skills gains","Summary:

The study’s objective was to examine the impact of Richland College’s Veterans-Focused Engineering Technology Project on education outcomes.
The authors used a nonexperimental design to compare education outcomes of program participants to a matched comparison group one and two years after enrollment.
The study found that program participation was significantly associated with fewer credit hours earned one year after enrollment.
The quality of causal evidence presented in this report is low because the authors did not use sufficient controls in their analysis. This means we are not confident that the estimated effects are attributable to the Veterans-Focused Engineering Technology Project; other factors are likely to have contributed program.","the Veterans-Focused Engineering Technology Project","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Veteran or military",,"United States",2018,https://smlr.rutgers.edu/sites/default/files/evaluation_of_richland_colleges_ve…,"Community College Review Protocol"
"Heroes for Hire (H4H) program evaluation final report","Horwood, T., Campbell, J., McKinney, M., & Bishop, M. (2018). Heroes for Hire (H4H) program evaluation final report. Fairfax, VA: ICF.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Education and skills gains-Low-Favorable impacts
      
    
  
              


      
            Education and skills gains","Summary:

	The study’s objective was to examine the impact of the Heroes for Hire (H4H) program on education and earnings outcomes.
	The authors used a nonexperimental design to compare the education outcomes of H4H program participants to a matched comparison group of students enrolled at the same college, at the same point of entry. and in similar programs of study. The authors also compared the earnings outcomes of students before and after participating in the H4H program.
	The study found that H4H participants were significantly more likely to complete the program and attain credit hours than the comparison group. In addition, participation in the H4H program was significantly associated with higher post-enrollment salaries compared to initial enrollment salaries.
	The quality of causal evidence presented in this study is low for the education outcomes because the authors did not ensure that the groups being compared were similar before the intervention nor include sufficient control variables. The quality of causal evidence is also low for the earnings outcomes because the authors did not account for trends in outcomes before the intervention. This means we are not confident that the estimated effects are attributable to the H4H program; other factors are likely to have contributed.","the Heroes for Hire (H4H) Program","Capacity building programs Community college education and other classroom training","Adult, Veteran or military",,"United States",2018,,"Community College Review Protocol"
"Minnesota advanced manufacturing project: Final external evaluation report","Bucci, P., Evans, W.D., Friesenborg, L., Fox, D.A., Bishop, K., Balraj, N., & Jang, B. (2018). Minnesota advanced manufacturing project: Final external evaluation report. Retrieved from https://www.skillscommons.org/bitstream/handle/taaccct/18521/MnAMP%20Final%20Evaluation%20Report.pdf?sequence=1&isAllowed=y","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Mixed impacts
      
    
  
              


      
            Education and skills gains","Summary:

The study’s objective was to examine the impact of the Minnesota Advanced Manufacturing Partnership (MnAMP) program on education outcomes.
The authors used a nonexperimental design to compare education outcomes of MnAMP participants to a matched comparison group using institutional data.
The study found that MnAMP program participation was significantly associated with earning fewer credits and fewer credentials relative to the comparison group. However, among students who attained credentials, participating in the MnAMP program was significantly associated with completing a one-year certificate in less time than comparison group students.
The quality of causal evidence presented in this study is low because the authors used a comparison group from previous enrollment years, presenting a confounding factor. This means we are not confident that the estimated effects are attributable to the MnAMP program; other factors are likely to have contributed.","Minnesota Advanced Manufacturing Partnership (MnAMP) Program","Capacity building programs Community college education and other classroom training","Adult, Unemployed, Veteran or military",,"United States",2018,https://www.skillscommons.org/bitstream/handle/taaccct/18521/MnAMP%20Final%20Ev…,"Community College Review Protocol"
"Improving the labor market outcomes of U.S. veterans: The long-run effect of the Transition Assistance Program","Li, X. (2018). Improving the labor market outcomes of U.S. veterans: The long-run effect of the Transition Assistance Program. New York: Syracuse University.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Education and skills gains-Low-Favorable impacts
      
    
  
              


      
            Education and skills gains
      


  
      
            Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:

	The study’s objective was to examine the impact the Transitional Assistance Program (TAP) had on outcomes related to employment, earnings, and education.
	The study used statistical models to compare veterans who had been offered and received TAP to veterans who were not offered TAP. Data came from the veterans supplement of the Current Population Survey for survey years 1995 to 2010.
	The study found positive associations between participation in TAP and employment, earnings, and education.
	The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to TAP; other factors are likely to have contributed to the findings.","the Transitional Assistance Program","Job search assistance and supportive services Veterans' reemployment Other training and education","Dislocated or displaced worker, Veteran or military",,"United States",2018,,"Employment and Training Review Protocol"
"SUN PATH comparison group study","Dauphinee, T., & Bishwakarma, R. (2018). SUN PATH comparison group study. Albuquerque, NM: University of New Mexico, Career to Cradle Policy Institute.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Education and skills gains-Mod/high-Favorable impacts
      
    
  
              


      
            Education and skills gains
      


  
      
            Employment-Mod/high-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study’s objective was to examine the impact of the Skill‐UP Network Pathways Acceleration in Technology and Healthcare (SUN PATH) program on education, earnings, and employment outcomes.
The authors used a nonexperimental design to compare the outcomes of students who were in the SUN PATH program to a matched comparison group of students.
The study found that SUN PATH students had higher rates of program completion, certificates/degree attainment, program retention, employment, and earnings than students in the comparison group.
The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the SUN PATH program, but other factors might also have contributed.","the Skill‐UP Network Pathways Acceleration in Technology and Healthcare (SUN PATH) Program","Capacity building programs Community college education and other classroom training","Adult, Dislocated or displaced worker, Other, Low-skilled, Veteran or military",,"United States",2018,https://www.skillscommons.org/bitstream/handle/taaccct/18108/SUN%20PATH%20Compa…,"Community College Review Protocol"
"Trade Adjustment Assistance Community College Career Training Grant (TAACCCT): Final evaluation report","The Greater Cincinnati Supply Chain Career Development Center (SCCDC). (2018). Trade Adjustment Assistance Community College Career Training Grant (TAACCCT): Final evaluation report. Cincinnati, OH: Author.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts
      
    
  
              


      
            Education and skills gains","Summary:

The study’s objective was to examine the impact of The Greater Cincinnati Supply Chain Career and Development Center’s (SCCDC) Supply Chain Management and Materials Handling & Logistics programs on education outcomes.
The study used a nonexperimental design to compare the program completion of students enrolled in SCCDC programs to students in a matched comparison group.
The study found that participation in the Supply Chain Management program, one of the SCCDC programs, was associated with a significant increase in the likelihood of program completion.
The quality of causal evidence presented in this report is low because the authors used a comparison group from different academic programs presenting a confounding factor. This means we are not confident that the estimated effects are attributable to the SCCDC programs; other factors are likely to have contributed.","the SCCDC’s Supply Chain Management and Materials Handling & Logistics Technologies Programs","Capacity building programs Community college education and other classroom training","Adult, Dislocated or displaced worker, Veteran or military",,"United States",2018,https://www.skillscommons.org/handle/taaccct/17943,"Community College Review Protocol"
"Southeastern Economic and Education Leadership Consortium (SEELC) final report","Takyi-Laryea, A., Gall, A., Chamberlin, M., Naughton, L., & Spychala, B. G. (2017). Southeastern Economic and Education Leadership Consortium (SEELC) final report. Fairfax, VA: ICF.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Education and skills gains-Low-No impacts
      
    
  
              


      
            Education and skills gains
      


  
      
            Employment-Low-No impacts
      
    
  
              


      
            Employment","Summary:

	The study’s objective was to examine the impact of the WorkKeys® assessment, a component of the TAACCCT-funded programming at Southeastern Economic and Education Leadership Consortium (SEELC) colleges, on education, earnings outcomes, and employment.
	The authors used a nonexperimental design to compare the education, earnings outcomes, and employment of SEELC program participants that took the WorkKeys® assessment to a matched comparison group of SEELC participants enrolled at the same colleges who did not take the assessment.
	The study found a significant relationship between taking the WorkKeys® assessment and earnings, with SEELC participants who took the assessment receiving higher post-program hourly wages than the comparison group of students who did not take the assessment.
	The quality of causal evidence presented in this study is low because the authors did not ensure that the groups being compared were similar before the intervention nor include sufficient control variables. This means we are not confident that the estimated effects are attributable to the SEELC consortium WorkKeys® assessment; other factors are likely to have contributed.","the Southeastern Economic and Education Leadership Consortium (SEELC)","Capacity building programs Community college education and other classroom training","Adult, Veteran or military",,"United States",2017,http://www.skillscommons.org/handle/taaccct/13986,"Community College Review Protocol"
"Orthotics, Prosthetics, and Pedorthics (HOPE) careers consortium: Final evaluation report","Good, K., & Yeh-Ho, H. (2017). Orthotics, Prosthetics, and Pedorthics (HOPE) careers consortium: Final evaluation report. Denver, CO: McREL International.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts
      
    
  
              


      
            Education and skills gains","Summary:

The study’s objective was to examine the impact of the Orthotics, Prosthetics & Pedorthics (HOPE) careers consortium program on education outcomes.
The authors used a nonexperimental design to compare education outcomes of HOPE participants to a matched comparison group with institutional research data.
The study found no significant associations between HOPE participation and program completion rates, completion of more than one certificate or degree, or furthering education status.
The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the HOPE program; other factors are likely to have contributed.","the Orthotics, Prosthetics & Pedorthics (HOPE) Careers Consortium Program","Capacity building programs Community college education and other classroom training","Adult, Other barriers, Dislocated or displaced worker, Unemployed, Veteran or military",,"United States",2017,https://www.skillscommons.org/bitstream/handle/taaccct/13872/hope-consortium-tc…,"Community College Review Protocol"
"The impact of Medicare Part D on self-employment.","Moulton, J. G., Diebold, J. C., & Scott, J. C. (2017). The impact of Medicare Part D on self-employment. Research on Aging, 39(1), 64-85.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study examined the effect of the introduction of Medicare Part D on self-employment. The authors used a nonexperimental approach and data from the American Community Survey to estimate the impact.
The authors found that self-employment significantly increased by 0.5 percentage points after the program began.
The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects on self-employment are attributable to the introduction of Medicare Part D, although other factors might also have contributed.","Medicare Part D","Federal retirement benefits Older workers' programs","Adult, Older worker",,"United States",2017,,"Employment and Training Review Protocol"
"Final evaluation report: Cincinnati State Technical and Community College: Greater Cincinnati Manufacturing Careers Accelerator (GCMCA)","Belville, J., Romano, G., Frisby, M., Chamberlin, M., & Strem, L. (2017). Final evaluation report: Cincinnati State Technical and Community College: Greater Cincinnati Manufacturing Careers Accelerator (GCMCA).","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Unfavorable impacts
      
    
  
              


      
            Education and skills gains","Summary:

The study’s objective was to examine the impact of the Greater Cincinnati Manufacturing Careers Accelerator (GCMCA) program on education outcomes.
The author used a nonexperimental design to compare the education persistence of students in the treatment group to students in a matched comparison group.
The study found that students in the comparison group were significantly more likely to complete the program than students in the treatment group for both the Welding or Mechanical Engineering Technology Manufacturing and Design programs.
The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention.This means we are not confident that the estimated effects are attributable to the Greater Cincinnati Manufacturing Careers Accelerator (GCMCA) program; other factors are likely to have contributed.

 
 ","Greater Cincinnati Manufacturing Careers Accelerator (GCMCA) Program","Basic skills Capacity building programs Community college education and other classroom training","Adult, Dislocated or displaced worker, Veteran or military",,"United States",2017,,"Community College Review Protocol"
"STEM-Connect at the University of Vermont, College of Engineering and Mathematical Sciences: Program evaluation final report","Farrell, R., Harris, D., Meyers, H., & Ratmeyer, S. (2017). STEM-Connect at the University of Vermont, College of Engineering and Mathematical Sciences: Program evaluation final report. Swanton, VT: Core Research and Evaluation.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Low-No impacts
      
    
  
              


      
            Employment","Summary:

The study’s objective was to examine the effects of the University of Vermont’s (UVM) Science, Technology, Engineering and Math (STEM) Connect program on earnings and employment outcomes.
The study used a nonexperimental design to compare the outcomes of students who were enrolled in the UVM STEM-Connect program to a matched comparison group of students who took a STEM-Connect course but were not enrolled in the STEM-Connect program.
The study found no statistically significant relationships between STEM-Connect program participation and average quarterly wages or employment rates.
The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the UVM STEM-Connect program; other factors are likely to have contributed.","the UVM STEM-Connect Program","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Dislocated or displaced worker, Unemployed, Veteran or military",,"United States",2017,http://www.skillscommons.org/bitstream/handle/taaccct/13127/STEM-Connect%20Fina…,"Community College Review Protocol"
"Does protecting older workers from discrimination make it harder to get hired? Evidence from disability discrimination laws.","Neumark, D., Song, J., & Button, P. (2017). Does protecting older workers from discrimination make it harder to get hired? Evidence from disability discrimination laws. Research on Aging, 39(1), 29-63.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Mixed impacts
      
    
  
              


      
            Employment","Summary:

The study examined the impact of the strength of state disability discrimination laws on hiring rates of older men.
The study used statistical models and data from the Health and Retirement Study and the Survey of Income and Program Participation to estimate the impacts.
The study found no relationship between the strength of disability discrimination laws and the hiring rate for older unemployed disabled and nondisabled men.
The quality of casual evidence presented in this report is low because the study is a nonexperimental analysis that did not demonstrate that the groups being compared were similar and did not account for possible differences in the analysis. This means we are not confident that the estimated effects are attributable to state disability discrimination laws; other factors are likely to have contributed.","Disability discrimination laws","Health Older workers' programs","Adult, Older worker, Male",,"United States",2017,https://journals.sagepub.com/doi/full/10.1177/0164027516656142,"Employment and Training Review Protocol"
"Butler Community College TAACCCT final evaluation report","Kansas State University Office of Educational Innovation and Evaluation. (2017). Butler Community College TAACCCT final evaluation report. Manhattan, KS: Kansas State University.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Education and skills gains-Low-Favorable impacts
      
    
  
              


      
            Education and skills gains
      


  
      
            Employment-Low-No impacts
      
    
  
              


      
            Employment","Summary:

The study’s objective was to examine the impact of the Butler Community College Trade Adjustment Assistance Community College and Career Training (TAACCCT) grant on education, earnings, and employment outcomes.
The study used a nonexperimental design to compare the outcomes of students who were in the Butler TAACCCT Information Technology (IT) program to a comparison group.
The study found that students in the Butler TAACCCT IT program were significantly more likely to complete their program, be retained in their program, and earn credentials than their counterparts in other selected Career and Technical Education (CTE) courses.
The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention or include sufficient controls. This means we are not confident that the estimated effects are attributable to the Butler TAACCCT IT program; other factors are likely to have contributed.","the Butler Community College TAACCCT Project","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Dislocated or displaced worker, Veteran or military",,"United States",2017,https://www.skillscommons.org/handle/taaccct/15664,"Community College Review Protocol"
"Final evaluation report: Linn-Benton Community College","Kelley-Smith, A., Schoeph, K., Hamai, T., & Bishop, M. (2017). Final evaluation report: Linn-Benton Community College. Albany, OR: LB iLearn Campus.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Education and skills gains-Low-Favorable impacts
      
    
  
              


      
            Education and skills gains
      


  
      
            Employment-Low-No impacts
      
    
  
              


      
            Employment","Summary:

The study’s objective was to assess the impact of degree and certificate programming offered at Linn-Benton Community College’s (LBCC) iLearn campus compared to traditional programming offered at the community college on various educational, employment, and earnings outcomes.
The study used a nonexperimental design to compare the outcomes of students enrolled in the Linn-Benton (LB) iLearn campus to students enrolled in traditional programming.
The study found that program participation was significantly associated with increased rates of program completion.
The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the LB iLearn campus program; other factors are likely to have contributed.","the LB iLearn Campus Program","Capacity building programs Community college education and other classroom training","Adult, Other barriers, Dislocated or displaced worker, Veteran or military",,"United States",2017,https://www.skillscommons.org/handle/taaccct/15675,"Community College Review Protocol"
"TAACCCT3 INTERFACE project: Final evaluation report","Smith, L., Gregg, A., Roth, L., Stoeklen, P., Krueger, B., Lawton, G., & Knaeble, B. (2017). TAACCCT3 INTERFACE project: Final evaluation report. Menomonie, WI: University of Wisconsin-Stout, Applied Research Center, Wisconsin’s Polytechnic University.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-No impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Education and skills gains-Mod/high-Favorable impacts
      
    
  
              


      
            Education and skills gains
      


  
      
            Employment-Mod/high-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study’s objective was to examine the impact of the Intentional Networks Transforming Effective and Rigorous Facilitation of Assessment, Collaboration, and Education (INTERFACE) project on education, earnings, and employment outcomes.
The authors used a nonexperimental design to compare education, earnings, and employment outcomes of students in the INTERFACE program to a matched comparison group.
The study found that INTERFACE students had significantly higher pass rates, graduation rates, and employment rates than students in the comparison group.
The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the INTERFACE program, but other factors might also have contributed.","the Intentional Networks Transforming Effective and Rigorous Facilitation of Assessment, Collaboration, and Education (INTERFACE) Program","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Veteran or military",,"United States",2017,https://www.skillscommons.org/bitstream/handle/taaccct/14262/INTERFACE%20Projec…,"Community College Review Protocol"
"Final evaluation Golden Triangle Modern Manufacturing Project","Harpole, S. (2017). Final evaluation Golden Triangle Modern Manufacturing Project. SHH Consulting, LLC","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Education and skills gains-Low-Favorable impacts
      
    
  
              


      
            Education and skills gains
      


  
      
            Employment-Low-No impacts
      
    
  
              


      
            Employment","Summary:

The study’s objective was to examine the impact of the Golden Triangle Modern Manufacturing Project on education, earnings, and employment outcomes.
The author used a nonexperimental design to compare outcomes of Golden Triangle Modern Manufacturing Project participants to a matched comparison group.
The study found that program participation was significantly associated with increases in program retention, credential attainment, and earnings.
The quality of causal evidence presented in this study is low because the author used a comparison group from previous enrollment years presenting a confounding factor. This means we are not confident that the estimated effects are attributable to Golden Triangle Modern Manufacturing Project; other factors are likely to have contributed.","the Golden Triangle Modern Manufacturing Project","Capacity building programs Community college education and other classroom training","Adult, Dislocated or displaced worker, Unemployed, Low-skilled, Veteran or military",,"United States",2017,https://www.skillscommons.org/handle/taaccct/15669,"Community College Review Protocol"
"The effect of the Affordable Care Act on labor transitions among older workers.","Camilleri, S. E. (2017). The effect of the Affordable Care Act on labor transitions among older workers. In Three papers on the Affordable Care Act (Doctoral dissertation). North Carolina State University, Raleigh, NC.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-No impacts
      
    
  
              


      
            Employment","Summary:

The study examined the impact of the Affordable Care Act (ACA) on the employment outcomes of older workers.
The author used data from the Current Population Survey for 2011–2016 and regression analyses to estimate impacts.
The study found that the ACA was not associated with employment outcomes among older workers.
The quality of causal evidence presented in this report is moderate because the study is based on a well-implemented nonexperimental design. This means we are somewhat confident that any estimated effects are attributable to the ACA, but other factors might also have contributed.","Affordable Care Act (ACA)","Older workers' programs Health insurance","Adult, Older worker",,"United States",2017,,"Employment and Training Review Protocol"
"Project IMPACT: Innovative multi-industry partnership and career training project final evaluation report. Gateway Community Technical College","Jensen, J., Horohov, J., & Waddington, J. (2017). Project IMPACT: Innovative multi-industry partnership and career training project final evaluation report. Gateway Community Technical College. Lexington, KY: University of Kentucky, College of Education, Educational Policy Studies & Evaluation.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Education and skills gains-Low-Favorable impacts
      
    
  
              


      
            Education and skills gains
      


  
      
            Employment-Low-No impacts
      
    
  
              


      
            Employment","Summary:

The study’s objective was to assess the impact of Project IMPACT on education, earnings, and employment outcomes.
Using academic records from the college as well as data obtained from the Kentucky Center for Workforce Statistics, the authors used a nonexperimental design to compare outcomes of Project IMPACT participants to outcomes of historical cohort students who were enrolled in the Project IMPACT programs of study prior to grant implementation.
The study found that participating in Project IMPACT was significantly associated with a higher likelihood to take courses, pass courses, earn credits, and receive credentials. The study also found that participating in Project IMPACT was significantly associated with higher earnings in the quarter following enrollment.
The quality of causal evidence presented in this study is low for the education and employment outcomes because the authors used a comparison group from previous enrollment years presenting a confounding factor and because the authors did not ensure the groups being compared were similar before the intervention, respectively. This means we are not confident that the estimated effects are attributable to Project IMPACT; other factors are likely to have contributed.","Project IMPACT","Employer partnerships Capacity building programs Community college education and other classroom training","Adult, Other barriers, Veteran or military",,"United States",2017,https://www.skillscommons.org/bitstream/handle/taaccct/15674/IMPACT%20Final%20E…,"Community College Review Protocol"
"Vincennes University Logistics Training and Education: Final evaluation report","Belville, J., Schoeph, K., Leger, R., Jenner, E., Maddox, D., Lass, K., & Beres, S. (2016). Vincennes University Logistics Training and Education Center: Final evaluation report. Retrieved from https://www.skillscommons.org/bitstream/handle/taaccct/9679/VU%20LTEC%20Final%20Evaluation%20Report%20TAACCCT%20R2_Sept%202016.pdf?sequence=1&isAllowed=y","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Low-No impacts
      
    
  
              


      
            Employment","Summary:

The study’s objective was to examine the impact of the Logistics Training and Education Center (LTEC) initiative on employment and earnings outcomes. This summary focuses on the estimated outcomes of the Tractor-Trailer Driver Training (TTDT) program. 
The authors used a nonexperimental design to compare the outcomes of TTDT program participants to a matched comparison group consisting of two student cohorts: a historical cohort of students from previous enrollment years and a concurrent cohort of students that attended a different college campus.
The study did not find significant relationships between completion of the TTDT program and employment status or quarterly earnings.
The quality of the causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Logistics Training and Education Center initiative; other factors are likely to have contributed.

 ","Logistics Training and Education Center (LTEC) Initiative","Capacity building programs Community college education and other classroom training","Adult, Veteran or military",,"United States",2016,https://www.skillscommons.org/bitstream/handle/taaccct/9679/VU%20LTEC%20Final%2…,"Community College Review Protocol"
"To work for yourself, for others, or not at all? How disability benefits affect the employment decisions of older veterans","Coile, C., Duggan, M., & Guo, A. (2016). To work for yourself, for others, or not at all? How disability benefits affect the employment decisions of older veterans. Unpublished manuscript.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-No impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Mod/high-No impacts
      
    
  
              


      
            Employment
      


  
      
            Public benefits receipt-Mod/high-Favorable impacts
      
    
  
              


      
            Public benefit receipt","Summary:

	The study examined the impact of a 2001 expansion in eligibility for Disability Compensation (DC) to cover type 2 diabetes for Vietnam-era veterans on their employment, earnings, and public benefit receipt.
	The authors estimated statistical models to compare outcomes among male Vietnam-era veterans who did and did not serve with on the ground using data from the Veterans Supplement to the Current Population Survey from 1995 to 2015.
	The study found that the expansion of eligibility for DC was associated with greater receipt of DC, a lower likelihood of working for others, and a greater likelihood of self-employment by on-the-ground veterans compared with those veterans who did not serve on the ground. The study did not find a relationship between the expansion and earnings.
	The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to changes in eligibility for DC and not to other factors.",DC,"Other wages and benefits Veterans' reemployment","Disability, Male, Veteran or military",,"United States",2016,https://www.nber.org/papers/w23006,"Employment and Training Review Protocol"
"Vincennes University Logistics Training and Education Center: Final evaluation report.","Belville, J. Schoeph, K., Leger, R., Jenner, E., Maddox, D., Lass, K., & Beres, S. (2016). Vincennes University Logistics Training and Education Center: Final evaluation report. Retrieved from https://www.skillscommons.org/bitstream/handle/taaccct/9769/VU%20LTEC%20Final%20Evaluation%20Report%20TAACCCT%20R2_Sept%202016.pdf?sequence=1&isAllowed=y","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Low-No impacts
      
    
  
              


      
            Employment","Summary:

The study’s objective was to examine the impact of the Vincennes University Logistics Training and Education Center (LTEC) initiative on employment and earnings outcomes. This summary focuses on the estimated outcomes of the Fork Lift Essentials (FLE) program.
The authors used an interrupted time series design to examine employment and earnings outcomes associated with the completion of LTEC's FLE program.
The study found FLE program completion was significantly associated with improved earnings in the first quarter immediately following program completion.
The quality of causal evidence presented in this report is low because the authors did not observe outcomes for multiple periods after the intervention. This means we are not confident that the estimated effects are attributable to the Logistics Training and Education Center initiative; other factors are likely to have contributed.","Logistics Training and Education Center (LTEC) Initiative","Capacity building programs Community college education and other classroom training","Adult, Veteran or military",,"United States",2016,https://www.skillscommons.org/bitstream/handle/taaccct/9679/VU%20LTEC%20Final%2…,"Community College Review Protocol"
"The impact of disability benefits on labor supply: Evidence from the VA’s disability compensation program","Autor, D. H., Duggan, M., Greenberg, K., & Lyle, D. S. (2016). The impact of disability benefits on labor supply: Evidence from the VA’s disability compensation program. American Economic Journal: Applied Economics, 8(3), 31-68. http://www.aeaweb.org/aej-applied/ [Impact of eligibility expansion]",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Unfavorable impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Low-Unfavorable impacts
      
    
  
              


      
            Employment
      


  
      
            Public benefits receipt-Low-Favorable impacts
      
    
  
              


      
            Public benefit receipt","Summary:

	The study examined the impact of a 2001 expansion in eligibility for Disability Compensation (DC) to type 2 diabetes for Vietnam-era veterans on labor force participation, earnings, and receipt of public benefits. The authors also examined the impact of receiving DC benefits and amount on labor force participation and earnings; see profile here .
	The authors estimated statistical models to compare outcomes for Vietnam-era Army veterans who served with “boots on the ground” (BOG) with those who served “not on the ground” (NOG) Veterans who did not fight directly in the conflict, from before and after the implementation of the type 2 diabetes policy change in 2001. The authors used administrative data from the U.S. Army Office of Economic and Manpower Analysis, the U.S. Department of Veterans Affairs (VA), and the Social Security Administration.
	The implementation of expanded DC coverage and benefits in 2001 resulted in reductions in labor force participation and earnings among impacted veterans as well as increases in the receipt of disability benefits.
	The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the expansion in eligibility for Disability Compensation (DC); other factors are likely to have contributed to the findings.",DC,"Disability insurance Veterans' reemployment","Disability, Male, Veteran or military",,"United States",2016,https://pubs.aeaweb.org/doi/pdf/10.1257/app.20150158,"Employment and Training Review Protocol"
"Men and women expecting to work longer: Do changing work conditions matter?","Moen, P., Kojola, E., Kelly, E.L., & Karakaya, Y. (2016). Men and women expecting to work longer: Do changing work conditions matter? Work, Aging and Retirement, 2(3), 321-344.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study’s objective was to examine the impact of a work flexibility intervention called STAR (Support. Transform. Achieve. Results) on workers’ expectations of retirement age and bridge jobs.
The study is a randomized controlled trial that uses surveys of workers before the intervention and five years post-intervention.
The study found that receiving STAR was associated with higher expectations of working at age 65 and retiring at age 67 or older.
The quality of causal evidence presented in this report is low because, although it was based on a randomized controlled trial, it had unknown attrition and the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to STAR; other factors are likely to have contributed.","STAR (Support. Transform. Achieve. Results.)","Work based and other occupational training Other employer services","Adult, Older worker",,"United States",2016,https://experts.umn.edu/en/publications/men-and-women-expecting-to-work-longer-…,"Employment and Training Review Protocol"
"The effect of Social Security information on the labor supply and savings of older Americans.","Armour, P., & Lovenheim, M. F. (2016). The effect of Social Security information on the labor supply and savings of older Americans. (Working paper no. 361). Ann Arbor, MI: University of Michigan, Michigan Retirement Research Center.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Mixed impacts
      
    
  
              


      
            Employment","Summary:

The study examined the impact of the Social Security statements issued by the Social Security Administration (SSA) on older men’s annual hours worked.
The authors used a nonexperimental design and data from Health and Retirement Study surveys and Social Security administrative records to estimate the impacts.
The study found that receiving the first Social Security Statement is associated with a decrease in self-reported annual hours worked and receiving the second Social Security Statement is associated with an increase in self-reported annual hours worked.
The quality of casual evidence presented in this report is moderate because that the study was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to Social Security statements, but other factors might also have contributed.","Social Security statements","Older workers' programs Other disparities or discrimination in employment and earnings","Adult, Older worker, Male",,"United States",2016,,"Employment and Training Review Protocol"
"Enhanced vocational rehabilitation for veterans with mild traumatic brain injury and mental illness: Pilot study","O’Connor, M. K., Mueller, L., Kwon, E., Drebing, C. E., O’Connor, A. A., Semiatin, A., & Daley, R. (2016). Enhanced vocational rehabilitation for veterans with mild traumatic brain injury and mental illness: Pilot study. Journal of Rehabilitation Research & Development, 53(3), 307-319.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Low-No impacts
      
    
  
              


      
            Employment","Summary:

The study’s objective was to examine the impact of an embedded cognitive rehabilitation intervention on employment and earnings.
The study was a randomized controlled trial with the authors using administrative data.
The study found no statistically significant relationships between an embedded cognitive rehabilitation intervention and employment and earnings after one year.
The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to an embedded cognitive rehabilitation intervention; other factors are likely to have contributed.","the cognitive rehabilitation intervention","Substance abuse recovery Vocational rehabilitation","Other barriers, Male, Veteran or military",,"United States",2016,http://search.proquest.com/openview/ee479834dd8beedff02771b00bc95e0a/1?pq-origs…,"Employment and Training Review Protocol"
"Evaluation of the Illinois Network for Advanced Manufacturing: Final Report","Westat. (2016). Evaluation of the Illinois Network for Advanced Manufacturing: Final Report. Rockville, MD: Westat & GEM Software Development, Inc.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Education and skills gains-Low-Favorable impacts
      
    
  
              


      
            Education and skills gains
      


  
      
            Employment-Low-No impacts
      
    
  
              


      
            Employment","Summary:

The study’s objective was to examine the impact of the Illinois Network for Advanced Manufacturing (INAM) program on education, earnings, and employment outcomes.
The study used a nonexperimental design to compare the outcomes of students who were in the INAM program to a comparison group of students who took similar courses before the creation of INAM. Using data from college databases and the Illinois Department of Employment Security, the authors conducted statistical models to examine differences in outcomes between the groups.
The study found that participation in the INAM program was significantly associated with improved rates of certificate or degree completion.
The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the INAM program; other factors are likely to have contributed.","the Illinois Network for Advanced Manufacturing (INAM)","Capacity building programs Community college education and other classroom training","Adult, Dislocated or displaced worker, Unemployed, Other, Veteran or military",,"United States",2016,https://www.researchgate.net/publication/315664265_Evaluation_of_the_Illinois_N…,"Community College Review Protocol"
"The impact of disability benefits on labor supply: Evidence from the VA’s disability compensation program","Autor, D. H., Duggan, M., Greenberg, K., & Lyle, D. S. (2016). The impact of disability benefits on labor supply: Evidence from the VA’s disability compensation program. American Economic Journal: Applied Economics, 8(3), 31-68. http://www.aeaweb.org/aej-applied/ [Impact of DC enrollment and benefit amount]",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Mod/high-Unfavorable impacts
      
    
  
              


      
            Employment","Summary:

	The study examined the impact of Disability Compensation (DC) enrollment and benefit amount on labor force participation and earnings. The authors also examined the impact of the expansion of eligibility for DC benefits on labor force participation and earnings; see profile here .
	The authors estimated statistical models to compare outcomes for Vietnam-era Army veterans who served with “boots on the ground” (BOG) with those who served “not on the ground” (NOG) who did not fight directly in the conflict, before and after the implementation of the Type 2 diabetes policy change in 2001. The authors used administrative data from the U.S. Army Office of Economic and Manpower Analysis, the U.S. Department of Veterans Affairs (VA), and the Social Security Administration (SSA).
	The increases in DC enrollment due to the expansion in eligibility for DC in 2001 were associated with reductions in labor force participation and earnings. Increases in DC benefit amounts due to the expansion in eligibility were also associated with reductions in labor force participation.
	The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to DC enrollment and benefit amounts, but other factors might also have contributed to the findings.",DC,"Disability insurance Veterans' reemployment","Disability, Male, Veteran or military",,"United States",2016,https://pubs.aeaweb.org/doi/pdf/10.1257/app.20150158,"Employment and Training Review Protocol"
"Third party evaluation of MoManufacturingWINS: Implementation, outcomes, and impact","Cosgrove, J. J., Cosgrove, M. S., & Bragg, D. D. (2016). Third party evaluation of MoManufacturingWINs: Implementation, outcomes, and impact. St. Louis, MO: Cosgrove & Associates and Bragg & Associates.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts
      
    
  
              


      
            Education and skills gains
      


  
      
            Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study’s objective was to examine the impact of Missouri’s Manufacturing Workforce Innovation Networks(MMW) program on student education and employment outcomes.
The study used a nonexperimental design to compare the outcomes of students who were in MMW to a comparison group of students in other manufacturing-technology related programs.
The study found that MMW participation was significantly associated with higher retention and employment rates.
The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention and they did not include sufficient controls. This means we are not confident that the estimated effects are attributable to MMW; other factors are likely to have contributed.","Missouri’s Manufacturing Workforce Innovation Networks (MMW)","Basic skills Capacity building programs Community college education and other classroom training","Adult, Unemployed, Other, Low-skilled, Veteran or military",,"United States",2016,https://www.skillscommons.org/bitstream/handle/taaccct/10116/ThirdPartyFinalEva…,"Community College Review Protocol"
"Life after service for post-9/11 veterans: Data, methods, and policy impacts","Gardner, J. S. (2016). Life after service for post-9/11 veterans: Data, methods, and policy impacts (Doctoral dissertation). Retrieved from https://digitalscholarship.unlv.edu/cgi/viewcontent.cgi?article=3867&context=thesesdissertations",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts
      
    
  
              


      
            Education and skills gains
      


  
      
            Employment-Low-Unfavorable impacts
      
    
  
              


      
            Employment","Summary:

	The study’s objective was to examine the effects of the 2008 GI Bill on post-9/11 veterans’ employment and educational attainment.
	The study used a statistical model to compare outcomes between veterans from before and after the passing of the 2008 GI Bill using data from the American Community Survey.
	The study found statistically significant relationships between the 2008 GI Bill and the education or employment of veterans.
	The quality of causal evidence presented in this report is low because the author did not observe outcomes for multiple demonstrations of the intervention. This means we are not confident that the estimated effects are attributable to the post-9/11 GI Bill; other factors are likely to have contributed.","the 2008 GI Bill","Veterans' reemployment Other training and education","Veteran or military",,"United States",2016,https://digitalscholarship.unlv.edu/cgi/viewcontent.cgi?article=3867&context=th…,"Employment and Training Review Protocol"
"Incorporating individualized placement and support principles into vocational rehabilitation for formerly incarcerated veterans","LePage, J. P., Lewis, A. A., Crawford, A. M., Parish, J. A., Ottomanelli, L., Washington, E. L., & Cipher, D. J. (2016). Incorporating individualized placement and support principles into vocational rehabilitation for formerly incarcerated veterans. Psychiatric Services, 67(7), 735-742.","Reentry, Veterans","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Mod/high-Favorable impacts
      
    
  
              


      
            Employment","Summary:

	The study examined the effect of the Individual Placement and Support (IPS) program on employment and earnings outcomes for justice-involved veterans with a prior felony conviction and a mental illness or substance abuse disorder.
	The study team used a randomized controlled trial and statistical tests to examine differences between justice-involved veterans who were offered the IPS program and veterans who were not offered this program. Justice-involved veterans self-reported their outcomes, which were verified based on a review of paystubs or contact with employers.
	The study showed that the IPS program increased employment, wages, number of days employed, and number of hours worked.
	The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the IPS program, not to other factors.","Individual Placement and Support (IPS)","Job search assistance and supportive services Supported employment or other employment supports Veterans' reemployment","Veteran or military",,"United States",2016,https://ps.psychiatryonline.org/doi/full/10.1176/appi.ps.201500058,"Reentry, Veterans Review Protocol"
"Retraining the Gulf Coast through Information Technology Pathways: Final impact evaluation report","Patnaik, A., & Prince, A. (2016). Retraining the Gulf Coast through Information Technology Pathways: Final Impact evaluation report. Austin, TX: The University of Texas at Austin, Lyndon B. Johnson School of Public Affairs.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts
      
    
  
              


      
            Education and skills gains","Summary:

The study’s objective was to examine the impact of the Retraining the Gulf Coast Workforce through Information Technology Pathways Consortium (Gulf Coast IT Pathways) grant program on education outcomes.
Using a nonexperimental design with institutional data from the college systems, the study authors compared students in the program to a matched historical cohort comparison group.
The study found that the Gulf Coast IT Pathways program was significantly related to higher credential, certificate, or a degree attainment and higher credit hour accumulation.
The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Gulf Coast IT Pathways TAACCCT; other factors are likely to have contributed.","the Gulf Coast IT Pathways Program","Basic skills Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Dislocated or displaced worker, Low-skilled, Veteran or military",,"United States",2016,https://raymarshallcenter.org/files/2016/11/Retraining-the-Gulf-Coast-through-I…,"Community College Review Protocol"
"Job insecurity, unemployment insurance and on-the-job search. Evidence from older American workers.","Gutierrez, I. A. (2016). Job insecurity, unemployment insurance and on-the-job search. Evidence from older American workers. Labour Economics, 41, 228-245. doi:10.1016/j.labeco.2016.05.011","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-No impacts
      
    
  
              


      
            Employment","Summary:

The study examined the impact of the potential wage replacement rate through Unemployment Insurance (UI) on the probability of transitioning to non-employment.
The study used a nonexperimental design and data from the Health and Retirement Study (HRS) from 1996–2006 and 2010–2012 to identify workers who expected job loss during the baseline survey and who experienced job transitions by the follow-up survey two years later.
The study found no statistically significant relationships between potential wage replacement rates and transitions to non-employment.
The quality of causal evidence presented in this report is low because the analyses do not sufficiently account for other factors that might contribute to the estimated effects. This means we are not confident that the estimated effects are attributable to the potential wage replacement rate through UI; other factors are likely to have contributed.","Unemployment Insurance (UI)","Older workers' programs Unemployment Insurance","Adult, Older worker, Employed",,"United States",2016,,"Employment and Training Review Protocol"
"Spousal labor market effects from government health insurance: Evidence from a veterans affairs expansion.","Boyle, M. A. & Lahey, J. N. (2016). Spousal labor market effects from government health insurance: Evidence from a veterans affairs expansion. Journal of Health Economics, Elsevier, 45(C), 63-76.","Older Workers, Veterans","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Low-Favorable impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Mod/high-No impacts
      
    
  
              


      
            Employment","Summary:

The study examined the impact of the expansion of health insurance for veterans through the U.S. Department of Veterans Affairs (VA) in the mid-1990s (as a result of the implementation of the Veteran’s Health Care Eligibility Reform Act) on the employment and earnings of non-covered spouses.
The authors used a statistical model and data from the Census Bureau’s March Current Population Survey and the Health and Retirement Study to compare the employment and earnings of wives of male veterans with wives of non-veterans of the same ages before and after the expansion of health insurance for veterans through the VA.
The study found no statistically significant associations between the expansion of health insurance for veterans and the employment of their wives and mixed evidence on associations between the expansion of health insurance for veterans and the earnings of their wives.
The quality of causal evidence presented in this report is moderate for the employment outcomes because it was based on a well-implemented nonexperimental design. This means we would be somewhat confident that any estimated effects would be attributable to the expansion of health insurance for veterans through the VA, but other factors might also have contributed. The quality of causal evidence presented in this report is low for earnings outcomes because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the expansion of health insurance for veterans through the VA; other factors are likely to have contributed.","Veteran Health Insurance Expansion","Health Older workers' programs Veterans' reemployment","Adult, Older worker, Veteran or military",,"United States",2016,,"Older Workers, Veterans Review Protocol"
"The effect of a severe health shock on work behavior: Evidence from different health care regimes.","Datta Gupta, N., Kleinjans, K. J., & Larsen, M. (2015). The effect of a severe health shock on work behavior: Evidence from different health care regimes. Social Science and Medicine, 136-137, 44-51.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study’s objective was to examine the impact of the national health policies of the United States and Denmark on employment of older workers after a health shock, defined as a new cancer or cardiovascular disease diagnosis.
The authors used a nonexperimental approach to compare the impact of a health shock on the likelihood of nonemployment in the United States’ private multipayer system with Denmark’s nationalized universal health care model. The authors used the data from the RAND Health and Retirement Study survey from 1994 to 2002 and Danish population registers for 1993 to 2001.
The study found no differences between the United States and Denmark in the relationship between a health shock and employment for older workers.
The quality of causal evidence presented in this report is low because the authors did not account for unobserved differences between the countries. This means we are not confident that differences in the association between health shocks and employment in the United States and Denmark are attributable to the national health care policies; other factors are likely to have contributed.","National Healthcare Policy","Health Older workers' programs","Adult, Older worker",,"International, United States",2015,https://www.sciencedirect.com/science/article/pii/S0277953615002816,"Employment and Training Review Protocol"
"How much does access to health insurance influence the timing of retirement?","Coe, N. B., & Goda, G. S. (2015). How much does access to health insurance influence the timing of retirement? (SIEPR Discussion Paper No. 14-007). Stanford, CA: Stanford Institute for Economic Policy Research. City, ST: Publisher.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Unfavorable impacts
      
    
  
              


      
            Employment
      


  
      
            Public benefits receipt-Low-No impacts
      
    
  
              


      
            Public benefit receipt","Summary:

The study examined the impact of state-level reforms of health insurance on early retirement and Social Security retirement benefit claims.
The authors used 1996–2010 data from the Health and Retirement Study (HRS) and statistical models to compare the outcomes of individuals in states with state-level reforms of health insurance with those in non-reform states.
The study found that employed individuals in states with non-group health insurance reform were significantly more likely to retire at age 63.
The quality of causal evidence presented in this report is low because the authors did not demonstrate that individuals in states with state-level reforms of health insurance were similar to those in non-reform states. This means we are not confident that the estimated effects are attributable to the non-group health insurance reform; other factors are likely to have contributed.","Retiree Health Insurance","Health insurance Older workers' programs","Adult, Older worker",,"United States",2015,,"Employment and Training Review Protocol"
"Fighting for Education: Financial Aid and Non-traditional Students","Barr, A. C. (2015). Fighting for Education: Financial Aid and Non-traditional Students. (Doctoral dissertation). Online Archive of University of Virginia Scholarship. https://doi.org/10.18130/V35Z6S.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts
      
    
  
              


      
            Education and skills gains","Summary:

The study’s objective was to examine the effects of Post-9/11 GI Bill on veterans’ college enrollment and degree attainment. The author investigated similar research questions in another study, the profile of which is available [here].
The study used regression methods in a nonexperimental analysis, drawing on data from Defense Manpower Data Center, the National Student Clearinghouse, and the Integrated Postsecondary Education Data System. The author used two statistical models to compare veterans eligible for the benefits with veterans who were not eligible.
The study found a statistically significant positive relationship between the Post-9/11 GI Bill benefits and education for veterans who were eligible for the benefits and likely to take them up compared with veterans who were not eligible for the benefits and with veterans who were eligible but unlikely to take up the benefits.
The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Post-9/11 GI Bill; other factors are likely to have contributed.","Post-9/11 GI Bill","Other training and education","Veteran or military",,"United States",2015,https://doi.org/10.18130/V35Z6S,"Employment and Training Review Protocol"
"Veterans Homelessness Prevention Demonstration evaluation: Final report","Cunningham, M. K., Biess, J., Emam, D., & Burt., M. R. (2015). Veterans Homelessness Prevention Demonstration evaluation: Final report. Washington, DC: Urban Institute.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Education and skills gains-Low-Favorable impacts
      
    
  
              


      
            Education and skills gains
      


  
      
            Employment-Low-Favorable impacts
      
    
  
              


      
            Employment
      


  
      
            Public benefits receipt-Low-Mixed impacts
      
    
  
              


      
            Public benefit receipt","Summary:

The study examined the effect of the Veterans Homelessness Prevention Demonstration (VHPD) program on the employment, earnings, public benefit receipt, and education and training outcomes of veterans at risk of homelessness.
The study uses a nonexperimental design to examine whether there were changes in veterans’ outcomes from before the program began to six months after the program ended using self-reported data directly from the veterans.
The study found statistically significant positive relationships between the VHPD program and veterans’ employment and earnings six months after the program ended compared with before the program. The study found mixed relationships between the VHPD program and public benefit receipt: significantly fewer veterans in the study received several types of public benefits, such as Temporary Assistance for Needy Families (TANF) or the Supplemental Nutrition Assistance Program (SNAP). Significantly more veterans in the study, however, received Veterans Pension benefits after the program compared with before it.
The quality of causal evidence presented in this report is low because the authors did not account for trends in outcomes before the intervention. This means we are not confident that the estimated effects are attributable to the VHPD program; other factors are likely to have contributed.","the Veterans Homelessness Prevention Demonstration (VHPD) program","Job search assistance and supportive services Other training and education","Low income, Veteran or military, Homeless",,"United States",2015,http://apps.urban.org/features/homeless-veterans/,"Employment and Training Review Protocol"
"The effect of health reform on retirement.","Levy, H., Buchmueller, T. C., & Nikpay, S. (2015). The effect of health reform on retirement (Research Paper 329). Ann Arbor, MI: Michigan Retirement Research Center.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-No impacts
      
    
  
              


      
            Employment","Summary:

The study’s objective was to examine the impact of the expansion of Medicaid to low-income adults in 2014 on retirement rates of workers ages 55 to 64.
The authors used a nonexperimental analysis to compare those who lived in an expansion state to those who lived in other states. The study used data from the monthly Current Population Survey from January 2005 through July 2015.
The study found no statistically significant relationships between Medicaid expansion and retirement.
The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the expansion of Medicaid; other factors are likely to have contributed.","Medicaid expansion","Health insurance Older workers' programs","Adult, Older worker, Low income",,"United States",2015,https://deepblue.lib.umich.edu/handle/2027.42/116062,"Employment and Training Review Protocol"
"The impact of a randomly assigned time and place management initiative on work and retirement expectations.","Cahill, K. E., James, J. B., & Pitt-Catsouphes, M. (2015). The impact of a randomly assigned time and place management initiative on work and retirement expectations. Work, Aging and Retirement, 1(4), 350-368.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Unfavorable impacts
      
    
  
              


      
            Employment","Summary:

	The study examined the impact of a time and place management (TPM) initiative at a medical provider on retirement expectations among workers ages 50 and older.
	The study was a randomized control trial and used a series of surveys and administrative data to estimate the impact.
	The study found that, when surveyed 12 months after randomization, employees in the treatment group were statistically significantly more likely to expect to directly exit their job as opposed to staying in their current job within the next five years.
	The quality of causal evidence presented in this report is moderate because the study was a randomized controlled trial with high attrition, but the authors did demonstrate that the treatment and control groups were similar before the intervention. This means we are somewhat confident that the estimated effects are attributable to TPM, but other factors might also have contributed.","Time and Placement Management (TPM)","Older workers' programs","Older worker","Health care and social assistance",,2015,https://hrs.isr.umich.edu/publications/biblio/8231,"Employment and Training Review Protocol"
"Employment outcomes among African American and white women with disabilities: Examining the inequalities.","Balcazar, F. E., & Suarez-Balcazar, Y. (2015). Employment outcomes among African American and white women with disabilities: Examining the inequalities. Women, Gender, and Families of Color, 3(2), 144-164.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-No impacts
      
    
  
              


      
            Employment","Summary:

The study examined the impact of adult vocational rehabilitation (VR) services on employment outcomes for African American and white women.
The authors used a statistical model and data from a Midwestern state VR system to compare the odds of employment after completing VR services for older versus younger women.
The study found no significant difference in employment outcomes between older and younger women who completed VR services.
The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before receiving VR services. This means we are not confident that the estimated effects are attributable to participation in VR services; other factors are likely to have contributed.","Vocational Rehabilitation (VR) Services","Vocational rehabilitation","Adult, Older worker, Female, Black or African American, White, Disability",,"United States",2015,,"Employment and Training Review Protocol"
"Evaluation of MoHealthWINS outcomes and impact","Cosgrove, J. J., Cosgrove, M. S., & Bragg, D. D. (2015). Evaluation of MoHealthWINS outcomes and impact. Retrieved from https://www.skillscommons.org/bitstream/handle/taaccct/5125/SEPTEMBER%202015%20FINAL%20VERSION%20OF%20MHW%20OUTCOME%20IMPACT%20EVALUATION%20REPORT.pdf?sequence=1&isAllowed=y","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts
      
    
  
              


      
            Education and skills gains
      


  
      
            Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study’s objective was to assess the relationship between the MoHealthWINS program and education and employment outcomes.
The study used a nonexperimental design, where the program participants were compared to a matched comparison group. Using college administrative data, state employment data, and employer data, the authors compared the program completion and employment rates between the treatment and comparison group.
The study found a significant relationship between program participation and the likelihood to complete the program and be employed post-program completion.
The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention or include sufficient control variables. This means we are not confident that the estimated effects are attributable to MoHealthWINS program; other factors are likely to have contributed.",MoHealthWINS,"Capacity building programs Community college education and other classroom training","Adult, Unemployed, Low-skilled, Veteran or military",,"United States",2015,https://www.skillscommons.org/bitstream/handle/taaccct/5125/SEPTEMBER%202015%20…,"Community College Review Protocol"
"What factors contributed to changes in employment during and after the great recession?","Farooq, A., & Kugler, A. D. (2015). What factors contributed to changes in employment during and after the great recession? IZA Journal of Labor Policy, 4(3), 1-28.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary:

	This study examined the impact of the Work Opportunity Tax Credit (WOTC) on employment for veterans with disabilities and unemployed veterans.
	The study used a nonexperimental design to examine the effects of the WOTC on employment, based on data from the Annual Social and Economic (ASEC) supplement of the Current Population Survey from 2003 to 2013.
	The study showed no statistically significant relationships between the WOTC and employment for veterans with disabilities or for unemployed veterans.
	The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that any estimated effects are attributable to the WOTC; other factors likely contributed to the outcomes. However, the study did not show any statistically significant effects.","the Work Opportunity Tax Credit","Veterans' reemployment Work Opportunity Tax Credit (WOTC)","Disability, Veteran or military",,"United States",2015,https://link.springer.com/article/10.1186/s40173-014-0029-y,"Employment and Training Review Protocol"
"Veterans’ labor force participation: What role does the VA’s disability compensation program play?","Coile, C., Duggan, M., & Guo, A. (2015). Veterans’ labor force participation: What role does the VA’s disability compensation program play? American Economic Review, 105(5), 131-136.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:

	The study examined the impact of expanding eligibility for veterans’ Disability Compensation (DC) in 2001 and 2010 on labor force participation.
	The authors conducted a nonexperimental analysis to compare veteran and non-veteran labor force participation over time using the March Current Population Survey data from 1980 to 2014.
	The study found that veteran labor force participation was generally lower than that of non-veterans in the same 10-year age range during the periods following eligibility expansions.
	The quality of causal evidence presented in this report is low because there could be differences in external conditions that affected the treatment group and not the comparison group. This means we are not confident that the estimated effects are attributable to veterans’ receipt of DC; other factors are likely to have contributed to the findings.",DC,"Other wages and benefits Veterans' reemployment","Disability, Male, Veteran or military",,"United States",2015,https://www.aeaweb.org/articles?id=10.1257/aer.p20151062,"Employment and Training Review Protocol"
"From the battlefield to the schoolyard: The short-term impact of the Post-9/11 GI Bill","Barr , A. (2015). From the battlefield to the schoolyard: The short-term impact of the Post-9/11 GI Bill. Journal of Human Resources, 50(3), 580-613.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts
      
    
  
              


      
            Education and skills gains","Summary:

The study’s objective was to examine the effects of Post-9/11 GI Bill on veterans’ college enrollment. The author investigated similar research questions in another study, the profile of which is available [here].
The study used regression methods in a nonexperimental analysis, drawing on data from the American Community Survey and Current Population Survey. The study compared college enrollment of veterans eligible for the GI Bill benefits with civilians, who were not eligible to receive the benefits.
The study found that veterans eligible for the Post-9/11 GI Bill benefits were significantly more likely to enroll in college after the introduction of the bill compared with civilians.
The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Post-9/11 GI Bill; other factors are likely to have contributed.","Post-9/11 GI Bill","Other training and education","Veteran or military",,"United States",2015,http://jhr.uwpress.org/content/50/3/580.full.pdf,"Employment and Training Review Protocol"
"Did age discrimination protections help older workers weather the Great Recession?","Neumark, D., & Button, P. (2014). Did age discrimination protections help older workers weather the Great Recession? Journal of Policy Analysis and Management, 33(4), 566-601. doi:10.1002/pam.21762","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Unfavorable impacts
      
    
  
              


      
            Employment","Summary:

The study examined whether the strong age discrimination laws moderated the impact of the Great Recession on employment outcomes of older workers.
The study used statistical models and the data from the 2003–2011 Current Population Survey (CPS) and 2004–2011 Quarterly Workforce Indicators to estimate impacts.
The study found that states with stronger age discrimination laws had experienced increases in unemployment rates, longer unemployment durations, and decreases in hiring rates for some types of older workers relative to younger workers in the months during and following the Great Recession.
The quality of causal evidence presented in this study is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the differential effect of the Great Recession on older workers in states with strong age discrimination laws, but other factors might also have contributed.","Age Discrimination Laws","Older workers' programs Other disparities or discrimination in employment and earnings","Adult, Older worker, Female, Male",,"United States",2014,https://www.nber.org/papers/w19216,"Employment and Training Review Protocol"
"Work outcomes after benefits counseling among veterans applying for service connection for a psychiatric condition","Rosen, M. I., Ablondi, K., Black, A. C., Mueller, L., Serowik, K. L., Martino, S., . . . Rosenheck, R. A. (2014). Work outcomes after benefits counseling among veterans applying for service connection for a psychiatric condition. Psychiatric Services, 65(12), 1426-1432.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Mod/high-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study examined the impact of benefits counseling on employment and earnings.
The study was a randomized controlled trial and collected self-reported data directly from veterans.
At one month, the study did not find a statistically significant relationship between benefits counseling and employment. Looking at data across all time periods, the study found a statistically significant relationship between benefits counseling and the number of days of paid work.
For the outcomes at one month, the quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects would be attributable to benefits counseling and not to other factors. However, the study did not find statistically significant effects at one month. For all other outcomes, the quality of causal evidence presented in this study is low because the study had high attrition and the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to benefits counseling; other factors are likely to have contributed.","Benefits Counseling","Health Veterans' reemployment","Veteran or military",,"United States",2014,https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4713007/,"Employment and Training Review Protocol"
"The economics of federal tax and employment laws: Empirical evidence from three studies.","Figinski, T. F. (2013). The economics of federal tax and employment laws: Empirical evidence from three studies. (Doctoral dissertation). Retrieved from ProQuest. Accession No. 1415455735.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Low-Favorable impacts
      
    
  
              


      
            Employment
      


  
      
            Public benefits receipt-Low-Unfavorable impacts
      
    
  
              


      
            Public benefit receipt","Summary:

The study examined the impact of removing the Social Security earnings test on Social Security claims, earnings, and labor force participation for female beneficiaries.
The study used a statistical model and the data from the Social Security Administration’s Benefit and Earnings Public Use File to estimate impacts.
The study found that removing the earnings test was associated with an increase in Social Security claims among women who were primary or spousal beneficiaries and with an increase in average earnings and in labor force participation among women who were primary beneficiaries.
The qaulity of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the change in Social Security earings test. This means we are not confident that the estimated effects are attributable to the removal of the Social Security earnings test; other factors are likely to have contributed.","Social Security 2000 Earnings Test Removal","Federal retirement benefits Older workers' programs","Adult, Older worker, Female",,"United States",2014,,"Employment and Training Review Protocol"
"Cognitive Symptom Management and Rehabilitation Therapy (CogSMART) for veterans with traumatic brain injury: Pilot randomized controlled trial","Twamley, E., Jak, A., Delis, D., Bondi, M., & Lohr, J. (2014). Cognitive Symptom Management and Rehabilitation Therapy (CogSMART) for veterans with traumatic brain injury: Pilot randomized controlled trial. Journal of Rehabilitation Research and Development, 51(1), 59-70.","Disability Employment Policy, Veterans","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study’s objective was to examine the impact of adding Cognitive Symptom Management and Rehabilitation Therapy (CogSMART) to standard supported employment programming for veterans with a history of traumatic brain injury (TBI) and persistent related postconcussive symptoms.
Veterans were referred to the program and completed a series of baseline neurocognitive and neuropsychological assessments to determine eligibility. Eligible veterans were randomly assigned to either the CogSMART treatment group, which received supported employment, enhanced by CogSMART sessions, or to a control group that did not participate in CogSMART sessions.
The study found that veterans in the CogSMART group demonstrated statistically significant reductions in postconcussive symptoms and improvements in prospective memory functioning. Although a higher proportion of the treatment group entered competitive employment within 14 weeks of starting the program—50 percent compared to 26 percent in the control group—the difference was not statistically significant.
The quality of causal evidence presented in this study is low because it is a randomized controlled trial with high or unknown attrition and no control variables included in the analysis. This means we are not confident that the estimated effects are attributable to CogSMART. Other factors are likely to have contributed.","Cognitive Symptom Management and Rehabilitation Therapy","Vocational rehabilitation Veterans' reemployment","Disability, Veteran or military",,"United States",2014,,"Disability Employment Policy, Veterans Review Protocol"
"Retiree health insurance for public school employees: Does it affect retirement?","Fitzpatrick, M. D. (2014). Retiree health insurance for public school employees: Does it affect retirement? Journal of Health Economics, 38, 88-98.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Mixed impacts
      
    
  
              


      
            Employment","Summary:

The study’s objective was to examine the impact of an Illinois Public Schools retiree health insurance program on the retirement rates of eligible staff ages 55 to 75.
The study used a nonexperimental approach to compare the retirement rates of eligible staff with those of staff who were not eligible and staff in years prior to the introduction of the health insurance program who would have been eligible. The author used data from the Illinois Public Schools' Teacher Service Record database from 1970 to 1992.
The study found that eligibility for the program was associated with an overall decrease in retirement age, with eligible staff more likely to retire at ages 55 or 56, but less likely to retire after age 65 compared with those who were not eligible for the program.
The quality of the causal evidence presented in this report is low because the study is a nonexperimental analysis that does not account for possible differences in the groups. This means we are not confident that the estimated effects are attributable to the Illinois Public Schools Teachers Retirement Health Insurance Plan; other factors are likely to have contributed.","Illinois Public Schools Teachers Retirement Health Insurance Plan","Employer provided retirement benefits Health insurance Older workers' programs","Adult, Older worker",,"United States",2014,https://www.nber.org/papers/w19524,"Employment and Training Review Protocol"
"Who pays the high health costs of older workers? Evidence from prostate cancer screening mandates.","Bailey, J. (2014). Who pays the high health costs of older workers? Evidence from prostate cancer screening mandates. Applied Economics, 46(32), 3931-3941. doi:10.1080/00036846.2014.948673","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Unfavorable impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Mod/high-Unfavorable impacts
      
    
  
              


      
            Employment","Summary:

The study examined the impact of state mandates that health insurance plans cover prostate cancer screenings on the earnings and employment of men older than age 50
The study used nonexperimental regression analyses to compare older men in states that had enacted a mandate with women, younger men, and older men living in states without a mandate. The author used data from the Current Population Survey(CPS) between 1990 and 2009.
The study found that older men in states with mandates had lower wages and were less likely than the comparison group to be employed.
The quality of causal evidence presented in this study is moderate, because it is a well-implemented nonexperimental study. This means we are somewhat confident that the estimated effects are attributable to the prostrate screening mandate, but other factors might also have contributed.","Prostate cancer screening mandates","Health insurance Older workers' programs","Adult, Older worker, Male",,"United States",2014,https://sites.temple.edu/jamesbailey/files/2013/08/Who-Pays-the-High-Health-Cos…,"Employment and Training Review Protocol"
"CogSMART compensatory cognitive training for traumatic brain injury: Effects over 1 year","Twamley, E. W., Thomas, K. R., Gregory, A. M., Jak, A. J., Bondi, M. W., Delias, D. C., & Lohr, J. B. (2014). CogSMART compensatory cognitive training for traumatic brain injury: Effects over 1 year. Journal of Head Trauma Rehabilitation, 30(6), 391-401.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Low-No impacts
      
    
  
              


      
            Employment","Summary:

	The study’s objective was to examine the impact of Cognitive Symptom Management and Rehabilitation Therapy (CogSMART) and enhanced supported employment (ESE) on employment, earnings, and health outcomes.
	The authors conducted a randomized controlled trial that randomly assigned participants to the intervention and comparison groups. Employment data came from weekly reports on job attainment, hours worked, and wages earned.
	The study did not find any statistically significant relationships between CogSMART plus ESE and employment, earnings, or health outcomes.
	The quality of causal evidence presented in this report is low because the study had a confounding factor. Specifically, one interventionist delivered CogSMART plus ESE and another interventionist implemented services to the comparison group, which makes it impossible to separate the effect of CogSMART plus ESE from the effect of the individual interventionists. This means we are not confident that the estimated effects are attributable to CogSMART plus ESE; other factors are likely to have contributed to the findings.","CogSMART Plus ESE","Health Job search assistance and supportive services Supported employment or other employment supports Veterans' reemployment","Disability, Veteran or military",,"United States",2014,https://doi.org/10.1097/HTR.0000000000000076,"Employment and Training Review Protocol"
"Military veterans marching towards entrepreneurship: An exploratory mixed methods study","Kerrick, S., Cumberland, D., Church-Nally, M., & Kemelgor, B. (2014). Military veterans marching towards entrepreneurship: An exploratory mixed methods study. International Journal of Management Education, 12(3), 469-478.","Entrepreneurship and Self-Employment","Study Type: Descriptive Analysis",,,"Summary:

	
	
		The study examined the relationship between an entrepreneurship education program for military veterans, VetStart, on entrepreneurship attitudes and behaviors. The VetStart program included 10 weeks of entrepreneurship courses followed by nine months of business mentorship and reimbursement of start-up business costs. Fourteen military veterans from a Midwestern community participated in the study over an 18-month period from spring 2012 to spring 2013.
		The authors used participants’ survey responses before and after participation in the program to measure participants’ level of entrepreneurial passion and frequency of consultations with informal networks (which included family, friends, business associates, and other entrepreneurs) about their new business ideas. The authors defined entrepreneurial passion along three dimensions: founding passion (interest in creating a new organization as an entrepreneur), inventing passion (interest in developing new products or ideas as an entrepreneur), and developing passion (interest in expanding an existing entrepreneurial idea or organization).
		The study found that the VetStart participants had higher levels of founding, inventing, and developing passion after the program than they did before it.
		The study also found that the VetStart participants consulted their informal networks regarding their business ideas more after the program than before it.",,"Mentoring Other training and education","Veteran or military",,"United States",2014,,"Employment and Training Review Protocol"
"Effects of structured vocational services in ex-offender veterans with mental illness: 6-month follow-up","LePage, J. P., Lewis, A. A., Washington, E. L., Davis, B., & Glasgow, A. (2013). Effects of structured vocational services in ex-offender veterans with mental illness: 6-month follow-up. Journal of Rehabilitation Research & Development, 50(2), 183-191. doi:10.1682/JRRD.2011.09.0163 [Full About Face vs. VERC]","Reentry, Veterans","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:

	The study examined the impact of About Face (AF) vocational classes on competitive employment.
	In this nonexperimental study, the authors used statistical analyses to compare the employment outcomes of two groups of veterans: (1) those who participated in the AF classes (full AF program) and (2) those who only had access to the Veterans Employment Resource Center (VERC). The authors collected monthly data from participants in person or over the phone.
	The study revealed significantly higher competitive employment in the full AF program (40.7 percent hired) than in the VERC-only condition (16.7 percent hired). The study also showed that veterans in the full AF program worked more months on average than veterans in the VERC-only condition (1.37 months vs. 0.35 months).
	The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the AF program; other factors likely contributed to the findings.","About Face","Job search assistance and supportive services Veterans' reemployment","Veteran or military",,"United States",2013,https://www.rehab.research.va.gov/JOUR/2013/502/pdf/lepage502.pdf,"Reentry, Veterans Review Protocol"
"Effects of structured vocational services in ex-offender veterans with mental illness: 6-month follow-up","LePage, J. P., Lewis, A. A., Washington, E. L., Davis, B., & Glasgow, A. (2013). Effects of structured vocational services in ex-offender veterans with mental illness: 6-month follow-up. Journal of Rehabilitation Research & Development, 50(2), 183-191. doi:10.1682/JRRD.2011.09.0163 [Full About Face vs. self-study]","Reentry, Veterans","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:

	This study examined the impact of About Face (AF) vocational classes on competitive employment.
	In this nonexperimental study, the authors used statistical analyses to compare the employment outcomes of two groups of justice-involved veterans: (1) those who participated in the AF classes (full AF program) and (2) those who did not take the classes but had access to the AF manual to study on their own (self-study program). The authors collected monthly data from participants in person or over the phone.
	The study revealed significantly higher competitive employment among justice-involved veterans in the full AF program (40.7 percent hired) than in the self-study condition (11.9 percent hired). The study also showed that justice-involved veterans in the full AF program worked more months on average than justice-involved veterans in the self-study condition (1.37 months vs. 0.16 months).
	The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the AF program; other factors likely contributed to the findings.","About Face","Job search assistance and supportive services Veterans' reemployment","Veteran or military",,"United States",2013,https://www.rehab.research.va.gov/JOUR/2013/502/pdf/lepage502.pdf,"Reentry, Veterans Review Protocol"
"Do stronger age discrimination laws make Social Security reforms more effective?","Neumark, D., & Song, J. (2013). Do stronger age discrimination laws make Social Security reforms more effective? Journal of Public Economics, 108, 1-16.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Mixed impacts
      
    
  
              


      
            Employment
      


  
      
            Public benefits receipt-Mod/high-Favorable impacts
      
    
  
              


      
            Public benefit receipt","Summary:

The study examined whether the strength of state age discrimination protections affected rates of Social Security benefit claiming and employment outcomes of older workers.
The study used a nonexperimental design and the data on Social Security claiming and employment outcomes from the Health and Retirement Study (HRS) to estimate the impacts.
The study found that among older men affected by the 1983 Social Security reform, age discrimination protections were associated with increases in employment rates between age 62 and the full retirement age and delayed benefit claiming.
The quality of casual evidence presented in this report is moderate because the study was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to state age discrimination laws, but other factors might also have contributed.","The 1983 Social Security Reform","Older workers' programs Other disparities or discrimination in employment and earnings","Adult, Older worker, Male",,"United States",2013,https://ideas.repec.org/a/eee/pubeco/v108y2013icp1-16.html,"Employment and Training Review Protocol"
"The impact of veterans’ preference on the composition and quality of the federal civil service","Lewis, G. B. (2013). The impact of veterans’ preference on the composition and quality of the federal civil service. Journal of Public Administration Research & Theory, 23(2), 247-265.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Mixed impacts
      
    
  
              


      
            Employment","Summary:

	The study’s objective was to examine the impact the federal practice of giving preference to veterans during the federal employment hiring process had on federal employment.
	The author used a nonexperimental design to compare federal employment outcomes of veterans and non-veterans, drawing on data from the 1990 and 2000 U.S. Census, the American Community Surveys from 2006–2009, and federal employee personnel records from the Central Personnel Data File from 2000–2009.
	The study found that the odds of federal employment compared to private-sector employment were 2.7 to 4.4 times greater for veterans than non-veterans. The study also found that veterans advanced slower than non-veterans after 5 and 10 years of employment.
	The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the veterans’ preference policy in federal hiring; other factors are likely to have contributed.","Veterans’ Preference Policy in Hiring for Federal Government Positions","Veterans' reemployment","Veteran or military",,"United States",2013,https://academic.oup.com/jpart/article-abstract/23/2/247/1000440,"Employment and Training Review Protocol"
"Veterans Health Administration vocational services for Operation Iraqi Freedom/Operation Enduring Freedom Veterans with mental health conditions","Twamley, E., Baker, D., Norman, S., Pittman, J., Lohr, J., & Resnick, S. (2013). Veterans Health Administration vocational services for Operation Iraqi Freedom/Operation Enduring Freedom Veterans with mental health conditions. Journal of Rehabilitation Research & Development, 50(5), 663-670.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:

	This study examined the impact of supported employment encounters on competitive employment for Operation Iraqi Freedom/Operation Enduring Freedom (OIF/OEF) veterans with mental health conditions.
	The study used statistical tests to examine differences between groups of OIF/OEF veterans with specified mental health conditions who had at least one supported employment encounter versus those who did not. The data for this study came from two nationwide Veterans Health Administration (VHA) databases for fiscal years 2008 and 2009.
	The study showed that having at least one supported employment encounter was associated with obtaining competitive employment.
	The quality of causal evidence presented in this report is low because the authors were not able to establish that the treatment and comparison groups were similar before the intervention. This means we are not confident that the estimated effects are attributable to VHA-supported employment encounters; other factors likely contributed to the effects.",,"Job search assistance and supportive services Veterans' reemployment","Veteran or military",,"United States",2013,https://doi.org/10.1682/jrrd.2012.08.0137,"Employment and Training Review Protocol"
"Evaluating the impact of dental care on housing intervention program outcomes among homeless veterans","Nunez, E., Gibson, G., Jones, J. A., & Schinka, J. A. (2013). Evaluating the impact of dental care on housing intervention program outcomes among homeless veterans. American Journal of Public Health, 103(S2), S368-S373.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study examined the impact of the Veterans Affairs (VA) Homeless Veteran Dental Program on employment outcomes of homeless veterans.
The authors used VA administrative data to compare the employment outcomes of veterans who received dental care through the VA Homeless Veteran Dental Program with those of veterans who did not.
The study found that participating in the VA Homeless Veteran Dental Program was associated with greater employment and financial stability.
The quality of causal evidence presented in this report is low because the authors did not ensure the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the VA Homeless Veteran Dental Program; other factors are likely to have contributed.","VA Homeless Veteran Dental Program","Health Veterans' reemployment","Veteran or military, Homeless",,"United States",2013,https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3969121/,"Employment and Training Review Protocol"
"The link between pensions and retirement timing: Lessons from California teachers.","Brown, K. M. (2013). The link between pensions and retirement timing: Lessons from California teachers. Journal of Public Economics, 98(C), 1-14.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study examined the impact of pension reform under the California State Teachers’ Retirement System (CalSTRS) on retirement timing.
The author used a statistical model and data from retirement-eligible employees in Los Angeles Unified School District from 1997 to 2000 to estimate the impact.
The study found public school employees were more likely to work an extra year in response to changes in pension plans that provided additional bonuses tied to age and tenure.
The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the changes in CalSTRS. This means we are not confident that the estimated effects are attributable to the changes in CalSTRS; other factors are likely to have contributed.","CalSTRS Defined Benefit Program","Older workers' programs Other wages and benefits","Adult, Older worker",,"United States",2013,https://eml.berkeley.edu//~saez/course/brown_jpube13.pdf,"Employment and Training Review Protocol"
"The impact of uncapping of mandatory retirement on postsecondary institutions.","Weinberg, S. L., & Scott, M. A. (2013). The impact of uncapping of mandatory retirement on postsecondary institutions. Educational Researcher, 42(6), 338-348.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study examined the impact of uncapping mandatory retirement on retirement ages at postsecondary institutions
The study used a statistical model to examine the age of retirement before and after the policy change in 1993. It used data on faculty’s employment and retirement from a research university with multiple schools.
The study found that uncapping was associated with a statistically significant increase in the retirement age among those who retired from the university.
The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar nor did they control for differences between the groups. This means we are not confident that the estimated effects are attributable to the federal Age Discrimination in Employment Act (ADEA); other factors are likely to have contributed.","Age Discrimination Employment Act (ADEA)","Federal retirement benefits Older workers' programs","Adult, Older worker",,"United States",2013,https://www.researchgate.net/publication/258134776_The_Impact_of_Uncapping_of_M…,"Employment and Training Review Protocol"
"Effects of structured vocational services in ex-offender veterans with mental illness: 6-month follow-up","LePage, J. P., Lewis, A. A., Washington, E. L., Davis, B., & Glasgow, A. (2013). Effects of structured vocational services in ex-offender veterans with mental illness: 6-month follow-up. Journal of Rehabilitation Research & Development, 50(2), 183-191. doi:10.1682/JRRD.2011.09.0163 [Self-study vs. VERC]","Reentry, Veterans","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-No impacts
      
    
  
              


      
            Employment","Summary:

	The study examined the impact of self-study of the About Face (AF) manual on competitive employment.
	In this nonexperimental study, the authors used statistical analyses to compare the employment outcomes of two groups of justice-involved veterans: (1) those who had access to the AF manual to study on their own (self-study program) and (2) those who only had access to the Veterans Employment Resource Center (VERC). The authors collected monthly data from participants in person or over the phone.
	The study showed no significant differences in competitive employment between the self-study condition (11.9 percent hired) and the VERC-only condition (16.7 percent hired). The study also showed no significant differences in average months employed (0.16 months for the self-study condition and 0.35 months for the VERC-only condition).
	The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the AF manual; other factors likely contributed to the findings.","About Face","Job search assistance and supportive services Veterans' reemployment","Veteran or military",,"United States",2013,https://www.rehab.research.va.gov/JOUR/2013/502/pdf/lepage502.pdf,"Reentry, Veterans Review Protocol"
"Does retiree health insurance encourage early retirement?","Nyce, S., Schieber, S. Shoven, J. B., Slavov, S., & Wise, D. A. (2013). Does retiree health insurance encourage early retirement? Journal of Public Economics, 104, 40-51.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Unfavorable impacts
      
    
  
              


      
            Employment","Summary:

The study’s objective was to examine the impact of employer-provided retiree health insurance on early retirement.
The authors used a nonexperimental design to compare early retirement outcomes of employees who are eligible for retiree health insurance with that of those who have no coverage.
The study found that people who were employed at age 57 and eligible for employer-subsidized retiree health coverage were significantly more likely to retire at ages 62 to 64 (before becoming eligible for Medicare at age 65) compared with those with no coverage.
The quality of causal evidence presented in this report is low because the authors did not account for other factors that could have affected the difference between the treatment and comparison groups. This means we are not confident that the estimated effects are attributable to retiree health insurance; other factors are likely to have contributed.","Retiree Health Insurance","Employer provided retirement benefits Older workers' programs","Adult, Older worker",,"United States",2013,https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3770310/,"Employment and Training Review Protocol"
"Training and retirement patterns.","Montizaan, R., Cörvers, F., & de Grip, A. (2013). Training and retirement patterns. Applied Economics, 45(15), 1991-1999. doi:10.1080/00036846.2011.646066","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Unfavorable impacts
      
    
  
              


      
            Employment","Summary:

The study’s objective was to examine the impact of firm-specific training and general training on older men’s retirement decisions
The study used a nonexperimental design and data from the U.S. National Longitudinal Survey of Older Men for 1966 to 1983 to estimate impacts.
The study found that workers with firm-specific training were more likely to retire within the time period studied and to have jobs with a mandatory retirement age than workers without firm-specific training.
The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before receiving training and did not account for self-selection into training. This means we are not confident that the estimated effects are attributable to firm-specific or general training; other factors are likely to have contributed.","Firm-specific & General Training","Work based and other occupational training","Adult, Older worker, Male",,"United States",2013,https://www.researchgate.net/publication/236021967_Training_and_retirement_patt…,"Employment and Training Review Protocol"
"A randomized controlled trial of supported employment among veterans with posttraumatic stress disorder","Davis, L., Leon, A., Toscano, R., Drebing, C., Ward, L., Parker, P., ..., & Drake, R. (2012). A randomized controlled trial of supported employment among veterans with posttraumatic stress disorder. Psychiatric Services, 63(5), 464-470.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Mod/high-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study’s objective was to examine the impact of individual placement and support (IPS) on competitive employment, earnings, and income for U.S. military veterans with posttraumatic stress disorder (PTSD).
The study was a randomized controlled trial conducted at the Tuscaloosa Veterans Affairs (VA) Medical Center. Treatment group members received IPS services, whereas the control group received standard Vocational Rehabilitation Program (VRP) services. Data sources included patients’ records from the clinical research coordinator and daily logs completed by participants.
The study found that IPS had positive impacts on competitive employment and gross income.
The quality of causal evidence presented in this report is high because it is based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to IPS, and not other factors.","Individual Placement and Support and Vocational Rehabilitation Program","Vocational rehabilitation Veterans' reemployment Supported employment or other employment supports","Disability, Veteran or military",,"United States",2012,,"Disability Employment Policy Review Protocol"
"Effectiveness of supported employment for veterans with spinal cord injuries: Results from a randomized multisite study","Ottomanelli, L., Goetz, L. L., Suris, A., McGeough, C., Sinnott, P. L., Toscano, R., … Thomas, F. P. (2012). Effectiveness of supported employment for veterans with spinal cord injuries: Results from a randomized multisite study. Archives of Physical Medicine and Rehabilitation, 93(5), 740-747. [CONTRAST 1: Non-experimental study]",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study examined the impact of supported employment on the employment outcomes for veterans with spinal cord injuries.
The authors used statistical comparisons in a non-experimental analysis to estimate the relationship between supported employment services and employment, drawing on self-reported data for employment information and chart review data from the spinal cord injury centers in six Veterans Affairs Medical Centers to obtain demographic information .
The study found statistically significant positive relationships between supported employment and veterans’ employment outcomes compared to treatment as usual.
The quality of causal evidence presented in the report is low because there are preexisting differences between the intervention and comparison groups. This means we are not confident that the estimated effects are attributable to supported employment; other factors are likely to have contributed.","Individual Placement and Support (IPS) model of supported employment","Veterans' reemployment","Disability, Veteran or military",,"United States",2012,https://doi.org/10.1016/j.apmr.2012.01.002,"Employment and Training Review Protocol"
"The effects of hiring tax credits on employment of disabled veterans","Heaton, P. (2012). The effects of hiring tax credits on employment of disabled veterans. Santa Monica, CA: Rand Corporation. Occasional Paper. Retrieved from https://www.rand.org/content/dam/rand/pubs/occassional papers/2012/RAND_OP 366.pdf.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Mod/high-Favorable impacts
      
    
  
              


      
            Employment","Summary:

	The study examined the impact of the 2007 Work Opportunity Tax Credit (WOTC) on the employment and earnings outcomes among veterans with disabilities.
	The authors used a nonexperimental approach and data from the American Community Survey Public Use Microdata Sample to compare the employment and earnings outcomes of veterans who were eligible for the WOTC with those of veterans who were not.
	The study found an approximately 2 percentage point increase in employment, a 0.58 hour increase in weekly hours, and a 40 percent increase in wage income among veterans with disabilities who were eligible for WOTC compared to veterans and nonveterans with other characteristics.
	The quality of causal evidence presented in this report is moderate because it relied on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the WOTC program, but other factors might also have contributed to the findings.","Work Opportunity Tax Credit","Veterans' reemployment Work Opportunity Tax Credit (WOTC)","Disability, Veteran or military",,"United States",2012,https://www.rand.org/pubs/occasional_papers/OP366.html,"Employment and Training Review Protocol"
"Tax elasticity of labor earnings for older individuals","Alpert, A. & Powell, D. (2012). Tax elasticity of labor earnings for older individuals. (Report no. 2012-272). Ann Arbor, MI: University of Michigan Retirement Research Center, University of Michigan.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Mod/high-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study examined the impact of tax changes on people’s employment, retirement, and labor income outcomes.
The study uses a nonexperimental approach and the data from the Health and Retirement Study to estimate the effect.
The study found positive statistically significant relationships between increases in after-tax labor income and the employment of men and women as well as the delay in retirement for men. The study also found a positive statistically significant relationship between increases in the marginal net-of-tax rate and earnings for women.
The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to tax changes from the Economic Growth and Tax Relief Reconciliation Act (EGTRRA), the Jobs and Growth Tax Relief Reconciliation Act (JGTRRA), and their marriage tax penalty relief provision, but other factors might also have contributed.","Tax Changes","Older workers' programs Other employment and reemployment","Adult, Older worker",,"United States",2012,https://deepblue.lib.umich.edu/bitstream/handle/2027.42/94533/wp272.pdf?sequenc…,"Employment and Training Review Protocol"
"Income tax and older American workers’ job transition into self-employment.","Choi, S. (2012). Income tax and older American workers’ job transition into self-employment. Korea and the World Economy, 13(2), 189-214.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Unfavorable impacts
      
    
  
              


      
            Employment","Summary:

The study examined the effect of a progressive income tax on the likelihood of transitioning to self-employment among older workers.
The study used a nonexperimental approach (the exponential hazard model) that compared the likelihood of transitioning from a wage job to self-employment based on the marginal taxes a worker would expect to pay. The author used the data from the Health and Retirement Study in 1992 matched to the Social Security Administration Master Earnings File from 1980 to 1991, which contains W-2 records of earnings from both wage work and self-employment.
The study found that a more progressive tax (that is, a tax schedule that increases sharply toward the higher end) or higher marginal tax rates reduces the likelihood of entering self-employment.
The quality of causal evidence presented in this report is low because the author did not ensure that the groups with higher or lower marginal tax rates were similar before a change in the tax schedule. This means we are not confident that the estimated effects are attributable to changes in marginal taxes; other factors are likely to have contributed.","Progressive Income Tax","Other employment and reemployment","Adult, Older worker, Employed",,"United States",2012,,"Employment and Training Review Protocol"
"The efficacy of supported employment for middle-aged and older people with schizophrenia.","Twamley, E. W., Vella, L., Burton, C. Z., Becker, D. R., Bell, M. D., & Jeste, D. V. (2012). The efficacy of supported employment for middle-aged and older people with schizophrenia. Schizophrenia Research, 135(1-3), 100-104.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study examined the impact of Individual Placement and Support (IPS) on competitive employment for older people with schizophrenia
The study was a randomized controlled trial (RCT) conducted at a community mental health clinic and used weekly work logs cross-referenced with pay stubs to measure employment outcomes over a 12-month period.
The study found that IPS was positively associated with employment and earnings.
The quality of causal evidence presented in this report is low because the RCT has a confounding factor. This means we are not confident that the estimated effects are attributable to the IPS program; other factors are likely to have contributed.","Individual Placement and Support and Vocational Rehabilitation Program","Health Individuals facing barriers to employment Job search assistance and supportive services","Adult, Older worker, Disability",,"United States",2012,https://psycnet.apa.org/record/2011-30184-001,"Employment and Training Review Protocol"
"Changes in social adjustment with cognitive processing effects of treatment and association with PTSD symptoms","Monson, C. M., Macdonald, A., Vorstenbosch, V., Schnaider, P., Goldstein, E. S. R., Ferrier-Auerbach, A. G., & Mocciola, K. E. (2012). Changes in social adjustment with cognitive processing effects of treatment and association with PTSD symptoms. Journal of Traumatic Stress, 25, 519-526.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts
      
    
  
              


      
            Earnings and wages","Summary:

The study’s objective was to examine the impact of cognitive processing therapy on earnings.
The study is a randomized controlled trial that collected self-reported data directly from veterans.
There were no statistically significant relationships between cognitive processing therapy and earnings.
The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to cognitive processing therapy; other factors are likely to have contributed.","Cognitive Processing Therapy",Health,"Veteran or military",,"United States",2012,https://cptforptsd.com/wp-content/uploads/2016/11/Monson-Macdonald_2012_JTS-soc…,"Employment and Training Review Protocol"
"Effectiveness of supported employment for veterans with spinal cord injuries: Results from a randomized multisite study","Ottomanelli, L., Goetz, L. L., Suris, A., McGeough, C., Sinnott, P. L., Toscano, R., … Thomas, F. P. (2012). Effectiveness of supported employment for veterans with spinal cord injuries: Results from a randomized multisite study. Archives of Physical Medicine and Rehabilitation, 93(5), 740-747.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study aimed to examine the impact of supported employment on the employment outcomes of veterans with spinal cord injuries.
The study included a randomized controlled trial and collected self-reported data directly from veterans and chart review data from the spinal cord injury centers in six Veterans Affairs Medical Centers (VAMCs) to obtain demographic information.
The study found statistically significant positive impacts on employment as a result of supported employment compared to treatment as usual.
The quality of causal evidence presented in the report is high because it used a well-implemented experimental design. This means that we are confident that the estimated effects are attributable to supported employment and not to other factors.","Individual Placement and Support (IPS) model of supported employment","Veterans' reemployment","Disability, Veteran or military",,"United States",2012,https://doi.org/10.1016/j.apmr.2012.01.002,"Employment and Training Review Protocol"
"Effects of structured vocational services on job-search success in ex-offender veterans with mental illness: 3-month follow-up","LePage, J. P., Washington, E. L., Lewis, A. A., Johnson, K. E., & Garcia-Rea, E. (2011). Effects of structured vocational services on job-search success in ex-offender veterans with mental illness: 3-month follow-up. Journal of Rehabilitation Research & Development, 48(3), 277-286. [Self-study vs. VERC]","Reentry, Veterans","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-No impacts
      
    
  
              


      
            Employment","Summary:

	The study examined the impact of self-studying the About Face (AF) manual on competitive employment.
	In this nonexperimental study, the authors used statistical analyses to compare the employment outcomes of two groups of justice-involved veterans: (1) those who had access to the AF manual to study on their own (self-study program) and (2) those who only had access to the Veterans Employment Resource Center (VERC). The authors collected biweekly data from participants in person or over the phone.
	The study showed no significant differences in competitive employment between the self-study condition (3 percent hired) and the VERC-only condition (0 percent hired).
	The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the AF manual; other factors likely contributed to the findings.","About Face","Job search assistance and supportive services Veterans' reemployment","Veteran or military",,"United States",2011,https://www.rehab.research.va.gov/jour/11/483/pdf/page277.pdf,"Reentry, Veterans Review Protocol"
"Residential treatment for homeless female veterans with psychiatric and substance use disorders: Effect on 1-year clinical outcomes","Harpaz-Rotem, I., Rosenheck, R. A., & Desai, R. (2011). Residential treatment for homeless female veterans with psychiatric and substance use disorders: Effect on 1-year clinical outcomes. Journal of Rehabilitation Research & Development, 48(8), 891-899.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Favorable impacts
      
    
  
              


      
            Employment","Summary:

	The study examined the impact of community residential treatment on female veterans’ employment and health outcomes.
	The study team used statistical tests to examine the differences between two groups: (1) people who were offered at least 30 or more days of residential treatment (RT) services at Veterans Affairs (VA) medical centers and (2) people who were not offered these services or were offered these services for less than 30 days. The data for this study came from case managers, discharge summaries, interviews, and standardized self-reported measures.
	The study showed that receiving RT services was associated with a greater number of days worked but with mixed results on health outcomes.
	The quality of causal evidence presented in this report is moderate because it is based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the RT program, but other factors might also have contributed to the effects.","Residential Treatment","Health Veterans' reemployment","Female, Veteran or military",,"United States",2011,https://www.researchgate.net/profile/Ilan_Harpaz-Rotem/publication/51784250_Res…,"Employment and Training Review Protocol"
"Effects of structured vocational services on job-search success in ex-offender veterans with mental illness: 3-month follow-up","LePage, J. P., Washington, E. L., Lewis, A. A., Johnson, K. E., & Garcia-Rea, E. (2011). Effects of structured vocational services on job-search success in ex-offender veterans with mental illness: 3-month follow-up. Journal of Rehabilitation Research & Development, 48(3), 277-286. [Full About Face vs. self-study]","Reentry, Veterans","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary:

	This study examined the impact of About Face (AF) vocational classes on competitive employment.
	In this nonexperimental study, the authors used statistical analyses to compare the employment outcomes of two groups of veterans: (1) those who took the AF classes (full AF program) and (2) those who did not take the classes but had access to the manual to study on their own (self-study program). The authors collected biweekly data from participants in person or over the phone.
	The study revealed significantly higher competitive employment among veterans in the full AF program (23.8 percent hired) than in the self-study condition (3 percent hired).
	The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the AF program; other factors likely contributed to the findings.","About Face","Job search assistance and supportive services Veterans' reemployment","Veteran or military",,"United States",2011,https://www.rehab.research.va.gov/jour/11/483/pdf/page277.pdf,"Reentry, Veterans Review Protocol"
"Effects of structured vocational services on job-search success in ex-offender veterans with mental illness: 3-month follow-up","LePage, J. P., Washington, E. L., Lewis, A. A., Johnson, K. E., & Garcia-Rea, E. (2011). Effects of structured vocational services on job-search success in ex-offender veterans with mental illness: 3-month follow-up. Journal of Rehabilitation Research & Development, 48(3), 277-286. [Full About Face vs VERC]","Reentry, Veterans","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:

	The study examined the impact of About Face (AF) vocational classes on competitive employment.
	In this nonexperimental study, the authors used statistical analyses to compare the employment outcomes of two groups of justice-involved veterans: (1) those who participated in the AF classes (full AF program) and (2) those who only had access to the Veterans Employment Resource Center (VERC). The authors collected biweekly data from participants in person or over the phone.
	The study revealed significantly higher competitive employment among justice-involved veterans in the full AF program (23.8 percent hired) than in the VERC condition (0 percent hired).
	The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the AF program; other factors likely contributed to the findings.","About Face","Job search assistance and supportive services Veterans' reemployment","Veteran or military",,"Urban, United States",2011,https://www.rehab.research.va.gov/jour/11/483/pdf/page277.pdf,"Reentry, Veterans Review Protocol"
"Schooling and the Vietnam-era GI bill: Evidence from the draft lottery","Angrist, J. D., & Chen, S. H. (2011). Schooling and the Vietnam-era GI bill: Evidence from the draft lottery. American Economic Journal: Applied Economics, 3(2), 96-118.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-No impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Education and skills gains-Mod/high-Favorable impacts
      
    
  
              


      
            Education and skills gains
      


  
      
            Employment-Mod/high-No impacts
      
    
  
              


      
            Employment","Summary:

	The study’s objective was to examine the impact of the G.I. Bill on education, employment, earnings.
	The authors used a nonexperimental comparison group analysis to estimate the impact of the Vietnam-era G.I. Bill on outcomes. The approach compared the outcomes of Vietnam-era veterans and non-veterans in 1999 using the 1-in-6 long form sample of the 2000 U.S. Census.
	The authors found that, compared with White male non-veterans, Vietnam-era White male veterans eligible for the draft and the G.I. Bill had significantly more years of schooling and were significantly more likely to have earned secondary and postsecondary degrees. The study found no statistically significant relationships between veteran status and employment or earnings.
	The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the G.I. Bill and not to other factors.","the WWII G.I. Bill","Veterans' reemployment Community college education and other classroom training","Veteran or military",,"United States",2011,https://www.aeaweb.org/articles?id=10.1257/app.3.2.96,"Employment and Training Review Protocol"
"Labor market rigidities and the employment behavior of older workers.","Blau, D., & Shvydko, T. (2011). Labor market rigidities and the employment behavior of older workers. Industrial and Labor Relations Review, 64(3), 464-484.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study’s objective was to examine the impact of flexibility in hours of work on the likelihood that older workers separate from an employer.
The study used a statistical model to compare the job exit behavior of older and younger workers in firms with different shares of women younger than age 30. The analysis used monthly data on workers ages 45 to 69 in the Survey of Income and Program Participation from 1990 to 2001 matched to employers in the Longitudinal Employment and Household Dynamics data.
The study found that workers in their sixties who work for employers with a higher share of women younger than age 30 are less likely to experience job separations compared with workers in their late 40s to mid-50s.
The quality of causal evidence presented in this report is low because the groups being compared might not be similar before leaving their employer. This means we are not confident that the estimated effects are attributable to employment flexibility, other factors are likely to have contributed.","Employment flexibility","Other employer services","Adult, Older worker",,"United States",2011,https://www.jstor.org/stable/41149475?seq=1#page_scan_tab_contents,"Employment and Training Review Protocol"
"Participation in the transition assistance program and job placement outcomes of U.S. veterans","Silva, E. (2011). Participation in the transition assistance program and job placement outcomes of U.S. veterans. (Publication No. AAI1491543) [Master’s dissertation, University of Rhode Island]. ProQuest.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-No impacts
      
    
  
              


      
            Employment","Summary:

	The study’s objective was to examine the impact of the Transition Assistance Program (TAP) on employment success—an outcome that reflects both employment and the desired number of work hours.
	The study involved a nonexperimental comparison group analysis that compared veterans who participated in TAP to those who did not, using data from the Current Population Survey and Veterans Supplement.
	The study showed no statistically significant relationship between TAP and veterans’ employment success.
	The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we could not be confident that any estimated effects would be attributable to TAP and not to other factors. However, the study did not show any statistically significant effects.","the Transition Assistance Program","Job search assistance and supportive services Veterans' reemployment","Veteran or military",,"United States",2011,https://digitalcommons.uri.edu/dissertations/AAI1491543/,"Employment and Training Review Protocol"
"The effects of changes in state SSI supplements on preretirement labor supply","Neumark, D., & Powers, E. T. (2005). The effects of changes in state SSI supplements on preretirement labor supply. Public Finance Review, 33(1), 3-35.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study examined the impact of a theoretical increase in Supplemental Security Income (SSI) benefits on the preretirement employment outcomes for likely SSI participants ages 60 to 64.
Using data from the annual Current Population Survey from 1979 to 2001 and state-level SSI receipt data, the authors used regression methods in a nonexperimental analysis of likely SSI participants to compare the outcomes of workers ages 62 to 64 with those of workers ages 60 to 61.
The study found that an increase in monthly SSI benefits was associated with a statistically significant decrease in the employment rate and number of hours worked for likely SSI recipients ages 62 to 64 compared with those ages 60 to 61.
The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to changes in SSI benefits; other factors are likely to have contributed.","Supplemental Security Income (SSI) benefits","Older workers' programs Other employment and reemployment","Adult, Older worker",,"United States",2010,https://journals.sagepub.com/doi/pdf/10.1177/1091142104270655,"Employment and Training Review Protocol"
"The influences on bridge employment decisions.","Pengcharoen, C., & Shultz, K. S. (2010). The influences on bridge employment decisions. International Journal of Manpower, 31(3), 322-336. doi:10.1108/01437721011050602","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Unfavorable impacts
      
    
  
              


      
            Employment","Summary:

The study examined the impact of work schedule flexibility on retirement outcomes among older workers, where work schedule flexibility was measured as the ability to reduce hours from one’s regular work schedule.
The study used a statistical model (multinomial logit regression) and the longitudinal data from the Health and Retirement Study (HRS) from 1992 and 2002 to examine the relationship between reporting work schedule flexibility or inflexibility during the baseline survey and reporting complete retirement, partial retirement, or continued employment at the follow-up survey 10 years later among older workers.
The study found that individuals who reported work schedule inflexibility in the 1992 were more likely to report completely retired than partially retired in 2002, but when comparing the likelihood of reporting continued employment to complete or partial retirement, there was no difference between older workers reported work schedule flexibility and those who reported inflexibility in 1992.
The quality of causal evidence presented in this study is low because the authors did not demonstrate that the participants reporting work schedule flexibility were similar to the participants reporting work schedule inflexibility in 1992. This means we are not confident that the estimated effects are attributable to work schedule flexibility; other factors are likely to have contributed.",,"Other wages and benefits","Adult, Older worker",,"United States",2010,https://www.researchgate.net/publication/46545640_The_influences_on_bridge_empl…,"Employment and Training Review Protocol"
"Veterans Health Administration transitional work experience vs. job placement in veterans with co-morbid substance use and non-psychotic psychiatric disorders","Penk, W., Drebing, C. E., Rosenheck, R, A., Krebs, C., Van Ormer, A., & Mueller, L. (2010). Veterans Health Administration transitional work experience vs. job placement in veterans with co-morbid substance use and non-psychotic psychiatric disorders. Psychiatric Rehabilitation Journal, 33(4), 297-307.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:


The study’s objective was to examine the impact of the Veterans Health Administration (VHA) Transitional Work Experience (TWE) program on employment and income for veterans with substance abuse and non-psychotic psychiatric disorders, compared with job placement (JP) services only.
The study was a randomized controlled trial carried out at one VHA medical center site over four years. Eligible veterans were randomly assigned to either the treatment group, which could participate in the TWE program, or to the control group, which could not participate in TWE but could receive JP services. The authors used data from participant surveys to measure impacts.
The study found that members of the treatment group worked significantly more hours in paid employment (including employment sponsored by the TWE program itself) and significantly more total weeks in paid employment, compared with the control group. The study also found that the treatment group earned significantly higher total income for the year (including noncompetitive TWE employment income) than the control group.
The quality of causal evidence presented in this report is low because the authors did not provide enough information to calculate attrition and did not include sufficient controls in their analysis to establish that treatment and control groups were similar on observable characteristics at baseline for the analytic sample. This means we are not confident that the estimated effects are attributable to TWE. Other factors are likely to have contributed.","the Transitional Work Experience (TWE) Program","Vocational rehabilitation Veterans' reemployment","Disability, Veteran or military",,"United States",2010,,"Disability Employment Policy Review Protocol"
"Retiree health insurance and disengagement from a career job.","Robinson, C., & Clark, R. (2010). Retiree health insurance and disengagement from a career job. Journal of Labor Research, 31(3), 247-262.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-No impacts
      
    
  
              


      
            Employment","Summary:

The study examined the effect of availability of retiree health insurance (RHI) on a person’s decision to leave a career job (a measure of retirement).
Using data from the Health and Retirement Study (HRS), the authors used a nonexperimental approach to estimate the likelihood of retirement for those who worked at firms with RHI compared with those who worked at firms without RHI.
The study found that workers at firms that offer RHI are more likely to retire than those at firms that do not offer RHI.
The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we would be somewhat confident that any estimated effects would be attributable to the availability at RHI, but other factors might also have contributed.","Retiree Health Insurance","Other health and safety Older workers' programs","Adult, Older worker",,"United States",2010,https://link.springer.com/article/10.1007/s12122-010-9091-4,"Employment and Training Review Protocol"
"Framing Social Security Reform: Behavioral responses to changes in the full retirement age","Behaghel, L., & Blau, D. M. (2010) Framing Social Security Reform: Behavioral responses to changes in the full retirement age. (IZA Discussion Paper No. 5310). Bonn, Germany: IZA.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study examined the impact of changes to the Full Retirement Age (FRA) on labor force exit, Old Age and Survivor’s Insurance (OASI) claims, and retirement.
The study uses a statistical model and the data from the Health and Retirement Study (HRS) to compare outcomes of people in birth cohorts who were affected by the change in FRA with those of a comparison group of people who were not.
The study found that the change in the FRA was associated with significant increases in the likelihood of claiming OASI and exiting the labor force at the new, later full retirement age.
The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the change in FRA, but other factors might also have contributed.","changes to the Full Retirement Age (FRA)","Older workers' programs Other employment and reemployment","Older worker",,"United States",2010,https://www.aeaweb.org/articles?id=10.1257/pol.4.4.41,"Employment and Training Review Protocol"
"Can Social Security explain trends in labor force participation of older men in the United States?","Blau, D. M., & Goodstein, R. M. (2010). Can Social Security explain trends in labor force participation of older men in the United States? Journal of Human Resources, 45(2), 328-363.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study examined the impact of changes in Social Security Administration (SSA) retirement rules on men’s labor force participation rates in the 1960s–1980s and 1990s–2000s.
The study used regression analyses to predicted labor force participation rates using actual and counterfactual SSA retirement rules. These analyses use data from the Current Population Survey (CPS) and the Survey of Income and Program Participation (SIPP) for the period from 1962 to 2005 merged with data from SSA on taxable earnings.
The study found that changes in the delayed retirement credit and full retirement age in 1983 could explain one-quarter to one-half of the increase in labor force participation in the early 2000s.
The quality of causal evidence presented in this report is moderate, because it is a well-implemented nonexperimental study. This means we are somewhat confident that the estimated effects are attributable to SSA reforms, but other factors might also have contributed.","Social Security Administration Reforms","Federal retirement benefits Older workers' programs","Adult, Older worker, Male",,"United States",2010,http://jhr.uwpress.org/content/45/2/328.abstract,"Employment and Training Review Protocol"
"Veterans Health Administration transitional work experience vs. job placement in veterans with co-morbid substance use and non-psychotic psychiatric disorders","Penk, W., Drebing, C.E., Rosenheck, R.A., Krebs, C., Van Ormer, A., & Mueller, L. (2010). Veterans Health Administration transitional work experience vs. job placement in veterans with co-morbid substance use and non-psychotic psychiatric disorders. Psychiatric Rehabilitation Journal, 33(4), 297-307.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study ’s objective was to examine the impact of a transitional work experience (TWE) program, within the Veterans Health Administration’s (VHA’s) Compensated Work Therapy (CWT) program, on outcomes related to employment and earnings for veterans with certain psychiatric diagnoses and substance use disorders.
The study used a randomized controlled trial design and compared treatment and control groups on self-reported employment and earnings outcomes, which were collected 6 and 12 months after enrollment in the study.
The study found that those who participated in TWE (the treatment group) worked more total hours and more weeks, and earned more income, over the 12-month period than the control group.
The quality of causal evidence presented in this report is low for employment and earnings outcomes because the randomized controlled trial design was compromised and authors did not account for existing differences between the treatment and control groups. This means we are not confident that the estimated effects are attributable to the transitional work experience program; other factors are likely to have contributed.","the Compensated Work Therapy transitional work experience program","Other health and safety Substance abuse recovery Veterans' reemployment","Other barriers, Veteran or military",,"United States",2010,https://psycnet.apa.org/record/2010-08280-008,"Employment and Training Review Protocol"
"Elderly immigrants’ labor supply response to supplemental security income.","Kaushal, N. (2010). Elderly immigrants’ labor supply response to supplemental security income. Journal of Policy Analysis and Management, 29(1), 137-162.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study objective is to examine the impact of the Personal Responsibility and Work Opportunity Reconciliation Act (PRWORA) of 1996 on employment outcomes of foreign-born people and noncitizens ages 60 to 74
The study used a statistical model and the data from the Current Population Survey’s monthly outgoing rotation group and the March Current Population Survey from 1994 to 2005 to estimate the impact.
The study found that the PRWORA is associated with increased employment and decreased retirement for foreign-born men compared with U.S.-born men, but it found no statistically significant association with the employment for foreign-born women.
The quality of the causal evidence presented in this report is low because the study is a nonexperimental analysis that does not demonstrate that the groups were similar before the policy change. This means we are not confident that the estimated effects are attributable to PRWORA; other factors are likely to have contributed.","Personal Responsibility and Work Opportunity Reconciliation Act of 1996","Federal retirement benefits Foreign and temporary workers","Adult, Older worker, Immigrant",,"United States",2010,https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4222576/,"Employment and Training Review Protocol"
"The repeal of the retirement earnings test and the labor supply of older men.","Engelhardt, G. V., & Kumar, A. (2009). The repeal of the retirement earnings test and the labor supply of older men. Journal of Pension Economics & Finance, 8(4), 429-450.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study examined the impact of the repeal of the earnings test under the Senior Citizens Freedom to Work Act of 2000 on the labor supply and earnings of older men ages 62 to 72.
The authors used a nonexperimental approach and data from the Health and Retirement Study to compare labor force participation, annual hours of work, retirement behavior, and earnings of men who were and were not subject to the repeal of the earnings test.
The study found that the policy change was associated with a significant increase in older men’s average annual hours of work. The policy change was also associated with a change in the distribution of real earnings in that a smaller proportion of older men had earnings at or below the earnings test threshold.
The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Senior Citizens Freedom to Work Act of 2000; other factors are likely to have contributed.","Senior Citizens Freedom to Work Act of 2000","Older workers' programs Other disparities or discrimination in employment and earnings","Adult, Older worker, Male",,"United States",2009,,"Employment and Training Review Protocol"
"An empirical study of the effects of Social Security reforms on benefit claiming behavior and receipt using public-use administrative microdata.","Benítez-Silva, H., & Yin, N. (2009). An empirical study of the effects of Social Security reforms on benefit claiming behavior and receipt using public-use administrative microdata. Social Security Bulletin, 69(3), 77-95.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Public benefits receipt-Low-Favorable impacts
      
    
  
              


      
            Public benefit receipt","Summary:

The study examined the impact of three policy changes to the Social Security program that went into effect in 2000 on average monthly benefits and the proportion of new claimants by age.
The study was a nonexperimental analysis that examined outcomes for older workers by age and year using data from the 2004 Old Age, Survivors, and Disability Insurance program public-use microdata files.
The study found that the changes were associated with lower average monthly benefits for individuals ages 66 to 69 after the year 2000 relative to individuals of the same ages in 1994.
The quality of the causal evidence presented in this report is low because the authors did not demonstrate that the groups were similar before the intervention. This means we are not confident that the estimated effects are attributable to the intervention program; other factors are likely to have contributed.","Policy Changes to the Social Security Program","Federal retirement benefits Older workers' programs","Adult, Older worker",,"United States",2009,https://papers.ssrn.com/sol3/papers.cfm?abstract_id=1480653,"Employment and Training Review Protocol"
"New evidence on the labor supply effects of the Social Security earnings test.","Friedberg, L., & Webb, A. (2009). New evidence on the labor supply effects of the Social Security earnings test. Tax Policy and the Economy, 23(1), 1-36.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study examined the impact of changes to the Social Security earnings test in 1996 and 2000 on employment outcomes.
The authors used a nonexperimental design and the data from the Current Population Survey (CPS) and the Health and Retirement Study (HRS) to compare outcomes before and after the changes in earning test rules for those between the ages of 62 and 74 who faced different earnings test thresholds at different ages and years.
The study found that upcoming anticipated earnings test between ages 62 to 69 was associated with a significantly lower likelihood of having a job last week. A higher present value of upcoming anticipated earnings threshold between ages 62 to 69 was associated with a significantly higher likelihood of having a job last week.
The quality of causal evidence presented in this study is low because the study is a nonexperimental analysis that did not demonstrate that the groups being compared were similar and did not account for possible differences in the analysis. This means we are not confident that the estimated effects are attributable to the changes in the earnings test decision. Other factors are likely to have contributed.","Social Security Earnings Test","Older workers' programs Other employment and reemployment","Adult, Older worker",,"United States",2009,,"Employment and Training Review Protocol"
"State age protection laws and the Age Discrimination in Employment Act.","Lahey, J. State age protection laws and the Age Discrimination in Employment Act. (2008). The Journal of Law and Economics, 51(3), 433-460.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Low-No impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Low-Unfavorable impacts
      
    
  
              


      
            Employment","Summary:

The study examined the impact of enforcement of age discrimination laws on the employment and earnings of older male workers
The author used a nonexperimental regression model and data from the Current Population Survey to estimate the impact.
The study found that males older than 50 in states with age discrimination laws were 0.2 percentage points less likely to be hired compared with those in states without their own age discrimination laws.
The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the state laws on age discrimination, but other factors might also have contributed.","Age Discrimination Employment Act (ADEA)","Older workers' programs Other disparities or discrimination in employment and earnings","Adult, Older worker, Male",,"United States",2008,https://www.jstor.org/stable/10.1086/589670?seq=1#page_scan_tab_contents,"Employment and Training Review Protocol"
"Supported employment for middle-aged and older people with schizophrenia.","Twamley, E., Narvaez, J., Becker, D., Bartels, S., & Jeste, D. (2008). Supported employment for middle-aged and older people with schizophrenia. American Journal of Psychiatric Rehabilitation, 11(1), 76-89.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study examined the impact of Individual Placement and Support (IPS) on competitive employment for older people with schizophrenia
The study was a randomized controlled trial (RCT) and used weekly work logs cross-referenced with pay stubs to measure employment outcomes over a 12-month period.
The study found that IPS increased competitive employment and earnings compared with conventional services.
The quality of causal evidence presented in this report is low because the RCT has a confounding factor. This means we are not confident that the estimated effects are attributable to the IPS program; other factors are likely to have contributed.","Individual Placement and Support and Vocational Rehabilitation Program","Health Individuals facing barriers to employment Job search assistance and supportive services","Adult, Older worker, Disability",,"United States",2008,https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2638571/,"Employment and Training Review Protocol"
"Rehabilitation of traumatic brain injury in active duty military personnel and veterans: Defense and Veterans Brain Injury Center randomized controlled trial of two rehabilitation approaches","Vanderploeg, R., Schwab, K., Walker, W., Fraser, J., Sigford, B., Date, E., . . . Warden, D. (2008). Rehabilitation of traumatic brain injury in active duty military personnel and veterans: Defense and Veterans Brain Injury Center randomized controlled trial of two rehabilitation approaches. Archives of Physical Medicine and Rehabilitation, 89(12), 2227-2237.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-No impacts
      
    
  
              


      
            Employment
      


  
      
            Education and skills gains-Mod/high-No impacts
      
    
  
              


      
            Education and skills gains","Summary:

The study’s objective was to examine the impact of two treatments—cognitive-didactic rehabilitation and functional-experiential rehabilitation—on return to work/school and functional independence among veterans and active military with traumatic brain injury (TBI).
The study used a randomized controlled trial design in which 366 active duty military service members or veterans with moderate-to-severe TBI were randomly assigned to receive either cognitive-didactic rehabilitation, which focuses on addressing cognitive deficits, or functional-experiential rehabilitation, which emphasizes performance of real-life tasks. Primary outcomes were measured using in-person evaluations or structured telephone interviews.
The study found no significant differences in return to work or school or functional independence between the two types of rehabilitation.
The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects would be attributable to the difference between the cognitive-didactic and functional-experiential treatments and not to other factors. However, the study did not find statistically significant effects between the two treatments.","Cognitive-Didactic and Functional-experiential rehabilitation","Vocational rehabilitation Veterans' reemployment","Disability, Veteran or military",,"United States",2008,,"Disability Employment Policy Review Protocol"
"How did the elimination of the US earnings test above the normal retirement age affect labour supply expectations?","Michaud, P., & Van Soest, A. (2008). How did the elimination of the US earnings test above the normal retirement age affect labour supply expectations? Fiscal Studies, 29(2), 197-231. doi:10.1111/j.1475-5890.2008.00073.x","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The authors used a nonexperimental approach and the data from Health and Retirement Study data from 1996 to 2002 and Social Security earnings history to estimate the impact.
The study examined the impact of repealing the earnings test from Social Security recipients between full retirement age and age 70 on older workers’ subjective probability of retirement.
The authors used a nonexperimental approach and the data from Health and Retirement Study data from 1996 to 2002 and Social Security earnings history to estimate the impact.
The study found that after the repeal of the earnings test, the subjective probability of working of full-time past age 65 for older male workers who were likely to have most of their projected Social Security benefits reduced under the earnings test has increased their expected probability of working relative to those who were not likely to be affected. •The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design.This means we are somewhat confident that the estimated effects are attributable to the repeal of the earnings test, but other factors might also have contributed.","Social Security Earnings Test","Federal retirement benefits Older workers' programs","Adult, Older worker, Male",,"United States",2008,,"Employment and Training Review Protocol"
"The effect of the social security earnings test on male labor supply: New evidence from survey and administrative data.","Haider, S. J., & Loughran, D. S. (2008). The effect of the social security earnings test on male labor supply: New evidence from survey and administrative data. Journal of Human Resources, 43(1), 57-87.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Mixed impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employer benefits receipt-Low-Favorable impacts
      
    
  
              


      
            Employer benefits receipt","Summary:

The study’s objective is to examine the impact of 1983 and 2000 policy changes that removed the Social Security earnings test for certain age groups on the earnings and employment outcomes of affected men
The study is a nonexperimental analysis that examines the correlations between the 1983 and 2000 policy changes and earnings and employment status. The study compares the outcomes of men affected by the policy changes with the outcomes of men of similar ages not affected by the policy changes.
The study finds that the 1983 policy change is associated with few changes to the observed outcomes and that the 2000 policy change is associated with higher earnings and hours worked per week for affected men.
The quality of causal evidence presented in this report is low because the study does not demonstrate that men affected by the policy changes are similar to the men not affected by the policy change, nor does it control for possible differences. This means we are not confident that the estimated effects are attributable to the 1983 and 2000 policy changes; other factors are likely to have contributed.","Social Security Earnings Test","Federal retirement benefits Older workers' programs","Adult, Older worker, Male",,"United States",2008,http://jhr.uwpress.org/content/43/1/57.refs,"Employment and Training Review Protocol"
"A tax on work for the elderly: Medicare as a secondary payer.","Goda, G. S., Shoven, J. B., & Slavov, S. N. (2007). A tax on work for the elderly: Medicare as a secondary payer. (NBER Working Paper No. 13383). Cambridge, MA: National Bureau of Economic Research.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study’s objective was to examine the impact of Medicare as a Secondary Payer (MSP) on older workers’ labor force participation and full-time employment
The study used a nonexperimental regression design. The authors used data from the 1980 to 2006 March Supplement of the Current Population Survey.
The study found that labor force participation for older males increased following the enforcement of the MSP policy, and that older males and females in the labor force were more likely to be employed full time after the policy was enforced.
The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention, and confounding factors could have impacted older workers differentially during the time periods examined. This means we are not confident that the estimated effects are attributable to MSP; other factors are likely to have contributed.","Medicare as a Secondary Payer","Federal retirement benefits Older workers' programs","Adult, Older worker",,"United States",2007,https://www.nber.org/papers/w13383,"Employment and Training Review Protocol"
"Adding contingency management intervention to vocational rehabilitation: Outcomes for dually diagnosed veterans","Drebing, C. E., Van Ormer, E. A., Mueller, L., Hebert, M., Penk, W. E., Petry, N. M., . . . Rounsaville, B. (2007). Adding contingency management intervention to vocational rehabilitation: Outcomes for dually diagnosed veterans. Journal of Rehabilitation Research & Development, 44(6), 851-865.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts
      
    
  
              


      
            Employment
      


  
      
            Health and safety-Mod/high-Favorable impacts
      
    
  
              


      
            Health and safety","Summary:

The study examined the impact of contingency management (CM) on employment and health outcomes.
The authors conducted a randomized controlled trial, using a work history form and drug and alcohol screenings to collect participant data.
At nine months, 50 percent of the individuals in the treatment group had obtained competitive employment compared with only 28 percent of those in the control group. Treatment group participants remained abstinent from drugs and alcohol longer than control group participants (11.8 weeks versus 9.4 weeks). Treatment group participants were also less likely to relapse by week 16 (50 percent versus 72 percent).
The quality of causal evidence presented in this report is high for employment outcomes because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the CM program, and not to other factors.","Contingency Management","Veterans' reemployment","Veteran or military",,"United States",2007,https://www.rehab.research.va.gov/jour/07/44/6/drebing.html,"Employment and Training Review Protocol"
"Implementation of supported employment for homeless veterans with psychiatric or addiction disorders: Two-year outcomes","Rosenheck, R. A., & Mares, A. S. (2007). Implementation of supported employment for homeless veterans with psychiatric or addiction disorders: Two-year outcomes. Psychiatric Services, 58(3), 325-333.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:

	The study examined the impact a newly implemented Individual Placement and Support (IPS) program had on employment and earnings outcomes of homeless veterans who were diagnosed with a psychiatric or substance abuse problem.
	The study team compared raw and adjusted outcome data for veterans who received IPS services and veterans who did not. The team used study participant interviews, activity logs, and employer contacts as data sources.
	The study found a statistically significant relationship between participation in the IPS program and competitive employment.
	The quality of causal evidence presented in this report is low because the data on the two groups were not collected at the same time. This means we are not confident that the estimated effects are attributable to the IPS program; other factors are likely to have contributed.","Individual Placement and Support (IPS)","Substance abuse recovery Job search assistance and supportive services Veterans' reemployment","Other barriers, Veteran or military, Homeless",,"United States",2007,https://ps.psychiatryonline.org/doi/full/10.1176/ps.2007.58.3.325,"Employment and Training Review Protocol"
"Labor market shocks and retirement: Do government programs matter?","Coile, C., & Levine, P. (2007). Labor market shocks and retirement: Do government programs matter? Journal of Public Economics, 91(10), 1902-1919.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-No impacts
      
    
  
              


      
            Employment
      


  
      
            Public benefits receipt-Low-No impacts
      
    
  
              


      
            Public benefit receipt","Summary:

The study examined the impact of the generosity of unemployment insurance (UI) benefits on retirement decisions.
The study used a statistical model and data from the March Current Population Survey for 1980–2004 to estimate impacts.
The study found no relationship between the generosity of UI benefits and the likelihood of retirement or receipt of UI.
The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before changes in the generosity of UI benefits were observed. This means we are not confident that the estimated effects are attributable to changes in the generosity of UI benefits; other factors are likely to have contributed.","Unemployment Insurance (UI)","Unemployment Insurance","Adult, Older worker, Unemployed",,"United States",2007,http://academics.wellesley.edu/Economics/Coile/PDF%20files/coile-levine%20JPubE…,"Employment and Training Review Protocol"
"Compensation of veterans with psychiatric or substance abuse disorders and employment and earnings","Greenberg, G. A., & Rosenheck, R. A. (2007). Compensation of veterans with psychiatric or substance abuse disorders and employment and earnings. Military Medicine, 172(2), 162-168.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Unfavorable impacts
      
    
  
              


      
            Employment","Summary:

	The study’s objective was to examine the impact of the Veterans Affairs (VA) Compensation Program on employment for veterans with service-connected disabilities.
	This study compared employment outcomes for two groups of veterans: (1) disabled veterans receiving VA compensation and (2) nondisabled veterans not receiving disability compensation. To do this, the study team combined data from two national surveys: the Survey of Disabled Veterans and the National Survey of Veterans.
	Veterans receiving benefits of more than $800 per month from the VA Compensation Program were significantly less likely to be employed than were nondisabled veterans.
	The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the VA Compensation Program; other factors likely contributed to the findings.","the VA Compensation Program","Disability insurance Veterans' reemployment","Disability, Veteran or military",,"United States",2007,https://academic.oup.com/milmed/article/172/2/162/4578021,"Employment and Training Review Protocol"
"New evidence on earnings and benefit claims following the changes in the retirement earnings test in 2000.","Song, J. G., & Manchester, J. (2006). New evidence on earnings and benefit claims following the changes in the retirement earnings test in 2000. (ORES Working Paper 107). Washington, DC: Social Security Administration, Office of Policy, Office of Research, Evaluation, and Statistics. Also available in Journal of Public Economics, 91(3–4), 669–700 (2007).","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-No impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Low-No impacts
      
    
  
              


      
            Employment
      


  
      
            Public benefits receipt-Mod/high-Unfavorable impacts
      
    
  
              


      
            Public benefit receipt","Summary:

The study examined the impact of the Senior Citizens Freedom to Work Act of 2000 on employment, earnings, and public benefit receipt outcomes of workers ages 65 to 69.
The study was a nonexperimental analysis and used Social Security Administrative data to estimate the impacts.
The study found that the Senior Citizens Freedom to Work Act of 2000 was associated with significant increases in the rate of Social Security claims for both sets of individuals affected by the law. The study found no statistically significant relationship between the Senior Citizens Freedom to Work Act of 2000 and earnings.
The quality of casual evidence presented in this report for Social Security claims and earnings outcomes is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the Senior Citizens Freedom to Work Act of 2000, but other factors might also have contributed. The quality of causal evidence presented in this report on employment is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Senior Citizens Freedom to Work Act of 2000; other factors are likely to have contributed.","Senior Citizens Freedom to Work Act of 2000","Older workers' programs Other disparities or discrimination in employment and earnings","Adult, Older worker",,"United States",2006,,"Employment and Training Review Protocol"
"Improving success in a veterans homeless domiciliary vocational program: Model development and evaluation","LePage, J. P., Bluitt, M., House-Hatfield, T., McAdams, H., Burdick, M., Dudley, D., …& Gaston, C. (2005). Improving success in a veterans homeless domiciliary vocational program: Model development and evaluation. Rehabilitation Psychology, 50(3), 297-304. doi: 10.1037/0090-5550.50.3.297",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:

	The study’s objective was to examine the relationship between the risk factor-based decision making (RFBDM) program and employment attainment.
	The study used a non-experimental comparison-group analysis. The study’s relied on data collected from the Risk Factor Scale and through data from the Veterans Affairs (VA) North Texas Health Care System. The authors used Pearson’s chi-squared test, a statistical model, to examine the relationship between the RFBDM program and employment.
	The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the RFBDM program; other factors are likely to have contributed to the study findings.","Risk factor-based decision making intervention.","Veterans' reemployment","Veteran or military",,"United States",2005,https://utsouthwestern.pure.elsevier.com/en/publications/improving-success-in-a…,"Employment and Training Review Protocol"
"The impact of enhanced incentives on vocational rehabilitation outcomes for dually diagnosed veterans.","Drebing, C. E., Van Ormer, E. A., Krebs, C., Rosenheck, R., & Rounsaville, B. (2005). The impact of enhanced incentives on vocational rehabilitation outcomes for dually diagnosed veterans. Journal of Applied Behavioral Analysis, 38(3), 359-372.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Low-No impacts
      
    
  
              


      
            Employment
      


  
      
            Health and safety-Low-Favorable impacts
      
    
  
              


      
            Health and safety","Summary:

The study examined the impact of enhanced incentives within an existing Veteran’s Administration (VA) Compensated Work Therapy (CWT) program on sustained abstinence from substances, transitioning to competitive employment, retention in competitive employment, and wages.
The study was a randomized controlled trial that compared outcomes for the intervention and control groups over 16 weeks. The CWT program’s clinical and financial records were used to assess employment and wage outcomes. Urine screens and participant reports were used to measure substance use outcomes.
The study found that total wages for the enhanced incentives group were significantly higher than for the control group. The study also found that the intervention group abstained from substance use for a significantly longer time than the control group.
The quality of causal evidence presented in this report is low for the employment and earnings outcomes because the authors did not establish that the intervention and control groups were equivalent one year before the intervention in terms of earnings or employment. This means we are not confident the estimated effects on these outcomes are attributable to the enhanced incentives in the CWT program; other factors are likely to have contributed.","Veterans’ Administration’s Compensated Work Therapy Program with Enhanced Incentives","Health Substance abuse recovery Veterans' reemployment","Veteran or military","Health care and social assistance","United States",2005,https://files.eric.ed.gov/fulltext/EJ725227.pdf,"Employment and Training Review Protocol"
"Work rehabilitation for middle-aged and older people with schizophrenia: A comparison of three approaches.","Twamley, E. W., Padin, D. S., Bayne, K. S., Narvaez, J. M., Williams, R. E., & Jeste, D. V. (2005). Work rehabilitation for middle-aged and older people with schizophrenia: A comparison of three approaches. Journal of Nervous and Mental Disease, 193(9), 596-601.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Unfavorable impacts
      
    
  
              


      
            Employment","Summary:

The study examined the impact of the Wellness and Vocational Enrichment Clinic (WAVE), a conventional vocational rehabilitation program with some elements of supported employment, on veterans’ employment outcomes.
The study used statistical tests to examine differences between veterans who were offered WAVE and individuals who were offered the Department of Rehabilitation’s Employment Services (DOR), a conventional vocational rehabilitation program. The data from this study come from program records.
The study found no statistically significant relationships between participation in WAVE and volunteer or paid work, or between participation in WAVE and competitive work or compensated work therapy.
The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the WAVE program; other factors are likely to have contributed.","Wellness and Vocational Enrichment Clinic (WAVE)","Veterans' reemployment","Veteran or military",,"United States",2005,,"Employment and Training Review Protocol"
"Employment outcomes and PTSD symptom severity","Smith, M., Schnurr, P., & Rosenheck, R. (2005). Employment outcomes and PTSD symptom severity. Mental Health Services Research, 7(2), 89-101.","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary:

	The authors assessed the relationship between male Vietnam-era veterans’ scores on the Clinician-Administered Post-Traumatic Stress Disorder (PTSD) Scale (CAPS), a clinically administered scale of PTSD severity, and their employment and earnings.
	The authors analyzed a data set containing demographic characteristics, PTSD symptom severity, employment status, and earnings for 325 male Vietnam-era veterans ages 18 to 54.
	The authors used a multinomial logistic regression framework to estimate the marginal effect of PTSD severity on three categories of employment—no employment, part-time employment, and full-time employment—and a Heckman selection model to estimate effects on earnings.
	The study found that a 10-point increase in the CAPS score was associated with a 5.9 percentage point increase in the probability of unemployment, a 2.1 percentage point decrease in the probability of part-time employment, and a 3.8 percentage point decrease in the probability of full-time work.",,,"Disability, Veteran or military",,"United States",2005,,"Disability Employment Policy Review Protocol"
"The effect of the SSI program on labor supply: Improved evidence from Social Security administrative files","Neumark, D., & Powers, E. T. (2005). The effect of the SSI program on labor supply: Improved evidence from Social Security administrative files. Social Security Bulletin, 65(3), 45-60.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study examined the relationship between generous state Supplemental Security Income (SSI) benefits and the employment of older worker nearing SSI eligibility age.
The authors used a regression model and data from the Survey of Income and Program Participants (SIPP) and Social Security Administration (SSA) to estimate the effect.
The study found that older males who were likely SSI participants in generous states worked significantly fewer hours and had lower employment rates compared with those living in less generous states. The authors, using the SSA administrative records, also found that likely older participants (ages 60 to 64) worked significantly fewer hours than younger ones.
The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to generosity of state SSI benefits; other factors are likely to have contributed.","state Supplemental Security Income (SSI) benefits","Older workers' programs Other employment and reemployment","Adult, Older worker",,"United States",2005,https://www.ssa.gov/policy/docs/ssb/v65n3/v65n3p45.html,"Employment and Training Review Protocol"
"Work rehabilitation for middle-aged and older people with schizophrenia: A comparison of three approaches","Twamley, E. W., Padin, D. S., Bayne, K. S., Narvaez, J. M., Williams, R. E., & Jeste, D. V. (2005). Work rehabilitation for middle-aged and older people with schizophrenia: A comparison of three approaches. Journal of Nervous and Mental Disease, 193(9), 596-601.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Unfavorable impacts
      
    
  
              


      
            Employment","Summary:

The study examined the impact of the Wellness and Vocational Enrichment Clinic (WAVE), a conventional vocational rehabilitation program with some elements of supported employment, on veterans’ employment outcomes.
The study used statistical tests to examine differences between veterans who were offered WAVE and individuals who were offered Individual Placement and Support (IPS), a supported employment program. The data from this study come from program records.
The study found that participation in the WAVE program is associated with lower rates of volunteer or paid work, and lower rates of competitive work or compensated work therapy participation compared with participation in the IPS program.
The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the WAVE program; other factors are likely to have contributed.","Wellness and Vocational Enrichment Clinic (WAVE)","Veterans' reemployment","Veteran or military",,"United States",2005,,"Employment and Training Review Protocol"
"Impact of public support payments, intensive psychiatric community care, and program fidelity on employment outcomes for people with severe mental illness","Resnick, S., Neale, M., & Rosenheck, R. (2003). Impact of public support payments, intensive psychiatric community care, and program fidelity on employment outcomes for people with severe mental illness. The Journal of Nervous and Mental Disease, 191(3), 139-144.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts
      
    
  
              


      
            Employment","Summary:

	The study’s objective was to evaluate the one-year impacts of a Department of Veterans Affairs (VA) model of assertive community treatment for veterans with serious mental illnesses known as Intensive Psychiatric Community Care (IPCC).
	The study was based on a randomized controlled trial. Roughly half of the 528 veterans participating in the study were randomly assigned to receive the IPCC treatment while the other half received standard VA services. The authors analyzed self-reported employment data collected from participants one year after random assignment.
	The study found that veterans in the IPCC group were three times more likely to be employed one year after random assignment than veterans in the control group.
	The quality of the causal evidence presented in this report is high because it is based on a well-conducted randomized controlled trial. This means we have confidence that the estimated effects are attributable to the IPCC program, and not other factors.","Intensive Psychiatric Community Care (IPCC)","Veterans' reemployment Vocational rehabilitation","Disability, Veteran or military",,"United States",2003,,"Disability Employment Policy Review Protocol"
"Impact of public support payments, intensive psychiatric community care, and program fidelity on employment outcomes for people with severe mental illness","Resnick, S., Neale, M., & Rosenheck, R. (2003). Impact of public support payments, intensive psychiatric community care, and program fidelity on employment outcomes for people with severe mental illness. The Journal of Nervous and Mental Disease, 191(3), 139-144.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Unfavorable impacts
      
    
  
              


      
            Employment","Summary:

	The study evaluated the one-year impacts of a U.S. Department of Veterans Affairs (VA) model of assertive community treatment for veterans with serious mental illnesses known as Intensive Psychiatric Community Care (IPCC) on employment.
	The study conducted a randomized controlled trial (RCT); those randomly assigned to the treatment group were eligible to receive the IPCC services, whereas those randomly assigned to the control group could not access IPCC services but could use other available health- and workforce-related services from the VA. The authors analyzed outcomes based on self-reported employment data collected from participants one year after random assignment.
	The study found that 7 percent of veterans in the IPCC group were employed one year after random assignment compared to 11 percent of veterans in the control group. The authors did not report the statistical significance of this difference.
	The quality of the causal evidence presented in this report is high because it was based on a well-conducted RCT. This means we have confidence that the estimated effects are attributable to the IPCC program and not other factors.","Intensive Psychiatric Community Care (IPCC)","Health Job search assistance and supportive services Veterans' reemployment Basic skills","Disability, Veteran or military",,"United States",2003,https://journals.lww.com/jonmd/Abstract/2003/03000/IMPACT_OF_PUBLIC_SUPPORT_PAY…,"Employment and Training Review Protocol"
"Going to war and going to college: Did World War II and the G.I. Bill increase educational attainment for returning veterans?","Bound, J., & Turner, S. (2002). Going to war and going to college: Did World War II and the G.I. Bill increase educational attainment for returning veterans? Journal of Labor Economics, 20(4), 784-815.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts
      
    
  
              


      
            Education and skills gains","Summary:

	The study’s objective was to examine the impact of the World War II (WWII) G.I. Bill on years of college completed and college completion.
	The authors used nonexperimental analyses to compare education outcomes for those eligible and not eligible for the WWII G.I. Bill benefits using data from the 1970 U.S. Census.
	The study found that being eligible for WWII G.I. Bill benefits was associated with completing more years of college and a greater likelihood of completing college.
	The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the WWII G.I. Bill; other factors are likely to have contributed to the findings.","the WWII G.I. Bill","Veterans' reemployment Community college education and other classroom training","Veteran or military",,"United States",2002,https://www.journals.uchicago.edu/doi/abs/10.1086/342012,"Employment and Training Review Protocol"
"Cognitive rehabilitation for traumatic brain injury: A randomized trial","Salazar, A., Warden, D., Schwab, K., Spector, J., Braverman, S., Walter, J., . . . Ellenbogen, R. (2000). Cognitive rehabilitation for traumatic brain injury: A randomized trial. Journal of American Medical Association, 283(23), 3075-3081.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-No impacts
      
    
  
              


      
            Employment","Summary:

The study’s objective was to examine the impact of in-hospital and home rehabilitation programs on the employment and health status of active duty military members with severe traumatic brain injuries (TBIs).
The study was a randomized controlled trial conducted at the Walter Reed Army Medical Center, where 120 active duty military members with TBI were randomly assigned to receive either in-hospital rehabilitation or home rehabilitation. Researchers collected outcome data 8 weeks and 6, 12, and 24 months after randomization.
Although the study authors originally hypothesized that in-hospital rehabilitation would increase the rates of patients who were able to return to work or able to return to active duty, the study found no statistically significant difference between the two groups on these outcomes.
The quality of the causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any differences in outcomes would be attributable to the more effective program; however, there were no statistically significant differences between the programs.","the In-hospital and Home Rehabilitation Programs Studied","Vocational rehabilitation","Disability, Veteran or military",,"United States",2000,,"Disability Employment Policy Review Protocol"
"Enhancing substance abuse treatment with case management: Its impact on employment","Siegal, H. A., Fisher, J. H., Rapp, R. C., & Kelliher, C. W. (1996). Enhancing substance abuse treatment with case management: Its impact on employment. Journal of Substance Abuse Treatment, 13(2), 93-98.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:

The study aimed to examine the impact of a strengths-based case management intervention on veterans’ employment and earnings.
Even though the treatment and control groups were randomly assigned, the study used a pre/post analysis design to compare all participants before the study to all participants six months after the study began. The study collected data using the Addiction Severity Index (ASI-5) and study-created measures including levels of drug use, substance abuse treatment history, health and psychiatric status, occupational and education functioning, living situation, relationship with family and peers, and HIV risk status.
The study found all study participants, including those in the intervention and control groups, increased earnings and days employed at the six-month follow-up.
The quality of causal evidence presented in this report is low because the authors did not account for trends in outcomes before the intervention. This means we are not confident that the estimated effects are attributable to strengths-based case management; other factors are likely to have contributed.","the strengths-based case management","Substance abuse recovery Job search assistance and supportive services Veterans' reemployment","Other barriers, Veteran or military",,"United States",1996,https://doi.org/10.1016/0740-5472(96)00029-3,"Employment and Training Review Protocol"
"Outcome evaluation of the Army Career and Alumni Program’s Job Assistance Centers (Study Report 96-04)","Sadacca, R., Laurence, J. H., DiFazio, A. S., Rauch, H. J., & Hintz, D. W. (1995) Outcome evaluation of the Army Career and Alumni Program’s Job Assistance Centers (Study Report 96-04). Alexandria, VA: Human Resources Research Organization.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Mixed impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Public benefits receipt-Low-Mixed impacts
      
    
  
              


      
            Public benefit receipt","Summary:

	The study’s objective was to examine the impact Job Assistance Centers (JACs) and the Transition Assistance Program (TAP) offered to ex-servicemembers had on their earnings and public benefits receipt.
	The study used a nonexperimental analysis to compare the outcomes of ex-servicemembers transitioning from military to civilian jobs who received various JAC or TAP services to the outcomes of those who did not receive JAC or TAP services. The authors used administrative records from the U.S. Department of Defense, the U.S. Army, and JACs, as well as data from a follow-up survey.
	The study showed mixed findings on the relationships between receipt of JAC and TAP services and earnings, as well as on the relationships between receipt of JAC and TAP services and receipt of unemployment compensation.
	The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to JACs and TAP; other factors are likely to have contributed.","Job Assistance Centers and the Transition Assistance Program","Job search assistance and supportive services Other employment and reemployment Veterans' reemployment","Dislocated or displaced worker, Veteran or military",,"United States",1995,,"Employment and Training Review Protocol"
"Pay and participation in work activity: Clinical benefits for clients with schizophrenia","Bell, M.D., & Milstein, R.M. (1993). Pay and participation in work activity: Clinical benefits for clients with schizophrenia. Psychosocial Rehabilitation Journal, 17(2), 173-176.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Employment-Low-Favorable impacts
      
    
  
              


      
            Employment","Summary:

	The study’s objective was to examine the impact of a paid supported work program for veterans diagnosed with schizophrenia or schizoaffective disorder on their employment, earnings, wages, and health outcomes.
	The authors used a randomized controlled trial to compare outcomes of veterans assigned to the paid supported work condition with those assigned to the unpaid work condition using data collected through interviews at baseline and five months later.
	The authors found that the paid group had higher employment and earnings and fewer depressive symptoms five months after random assignment compared with the unpaid group.
	The quality of causal evidence presented in this report is low because it was based on a randomized controlled trial in which the analytic sample sizes are unknown, and the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to paid supported work; other factors are likely to have contributed to the findings.","the Paid Supported Work Program","Health Veterans' reemployment","Disability, Veteran or military",,"United States",1993,https://psycnet.apa.org/doi/10.1037/h0095590,"Employment and Training Review Protocol"
"The effect of veterans benefits on education and earnings","Angrist, J. D. (1993). The effect of veterans benefits on education and earnings. Industrial and Labor Relations Review, 46(4), 637-652.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts
      
    
  
              


      
            Earnings and wages
      


  
      
            Education and skills gains-Low-Favorable impacts
      
    
  
              


      
            Education and skills gains","Summary:

The study’s objective was to examine the effects of veteran benefits on the post-service education and earnings of soldiers who served in the Vietnam era and in the first years of the All-Volunteer Forces (AVF).
The study used statistical tests in a nonexperimental analysis to evaluate the effects of veteran benefits. The data came from the U.S. Census Bureau’s 1987 Survey of Veterans.
The study found a statistically significant positive relationship between veteran benefits and education and earnings outcomes.
The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to veteran benefits; other factors are likely to have contributed.","the veteran benefits","Other wages and benefits Other training and education","Veteran or military",,"United States",1993,https://doi.org/10.1177%2F001979399304600404,"Employment and Training Review Protocol"
"Schizophrenic symptoms, work adjustment, and behavioral family therapy","Glynn, S. M., Randolph, E. T., Eth, S., Paz, G. G., Leong, G. B., Shaner, A. L., & Vort, W. V. (1992). Schizophrenic symptoms, work adjustment, and behavioral family therapy. Rehabilitation Psychology, 37(4), 323-338.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-No impacts
      
    
  
              


      
            Employment","Summary:

	This study examined the impact of behavioral family therapy on male veterans’ employment.
	The study conducted a randomized controlled trial using data from self-reported responses to the Social Adjustment Scale, Version I.
	The study showed that behavioral family therapy did not have statistically significant effects on employment.
	The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects are attributable to behavioral family therapy and not to other factors. However, the study did not show any statistically significant effects.","Behavioral Family Therapy","Health Veterans' reemployment","Disability, Veteran or military",,"United States",1992,,"Employment and Training Review Protocol"