Title,Citation,Topic_area,Study_type,Study_evidence_rating,Outcome_effectiveness,Findings,Intervention_program,Topics,Target_population,Firm_characteristics,Geographic_setting,Original_publication_date,Original_publication_link,"Review Protocol" "Supervisor support training effects on veteran health and work outcomes in the civilian workplace","Hammer, L. B., Wan, W. H., Brockwood, K. J., Bodner, T., & Mohr, C. D. (2019). Supervisor support training effects on veteran health and work outcomes in the civilian workplace. Journal of Applied Psychology, 104(1), 52–69.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence",,"Summary: The study’s objective was to examine the impact of Veteran-Supportive Supervisor Training (VSST) on perceived health, functional impairment, job performance, and turnover intentions of employed veterans.  The primary design of the study was a cluster randomized controlled trial. The authors collected survey data before and at three and nine months after random assignment. Using a statistical model, the study authors compared the outcomes of individuals in the control group organizations to the individuals in the treatment group organizations.  The study did not find any statistically significant impacts on perceived health, functional impairment, job performance, or turnover intentions.   The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects would be attributable to VSST and not to other factors. However, the study did not find statistically significant effects. ","Veteran-Supportive Supervisor Training","Other training and education","Veteran or military",,,2019,https://pubmed.ncbi.nlm.nih.gov/30265016/,"Employment and Training Review Protocol" "Recruiting and retaining dental labor in federal facilities: Harder than pulling teeth?","Richards, M. R., & Wing, C. (2019). Recruiting and retaining dental labor in federal facilities: Harder than pulling teeth? Health Economics, 28(11), 1356–1369. https://doi.org/10.1002/hec.3949",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Mixed impacts Employment","Summary: The study’s objective was to examine the impact of the Health Care Personnel Enhancement Act’s (HCPEA) authorization of flexible, and potentially more generous, pay packages for U.S. Veterans Administration (VA) dentists on job separation, hiring rates, and part-time employment.  The authors compared changes in the outcomes of VA dentists to those of federal occupations that were not affected by HCPEA. The authors used administrative data on federal employees from 2002 to 2012 from the Office of Personnel Management’s Central Personnel Data File. In addition to analyzing the full sample, the authors examined findings for early- and later-career employees.   The authors found that, among the full sample, the announcement of HCPEA was associated with a higher job separation rate, while the enactment of HCPEA was associated with a lower new-hire rate and lower likelihood of transitions from full-time to part-time employment.  The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the HCPEA; other factors are likely to have contributed.  ","Health Care Personnel Enhancement Act","Other wages and benefits","Veteran or military",,,2019,https://onlinelibrary.wiley.com/doi/full/10.1002/hec.3949,"Review Protocol" "Information technology career preparation for rural areas.","Hahs-Vaughn, D. L., Swan, B., & Clark, M. H. (2019). Information technology career preparation for rural areas. Community College Journal of Research and Practice, 1-13.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the Florida Information Technology Careers for Rural Areas (XCEL-IT) program on education, employment, and earnings outcomes. The authors used a nonexperimental design to compare the differences in outcomes between XCEL-IT program participants and a comparison group. The study found that XCEL-IT program participation was significantly related to program completion. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the XCEL-IT program; other factors are likely to have contributed.","the Florida Information Technology Careers for Rural Areas (XCEL-IT)","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Unemployed, Veteran or military",,"Rural, United States",2019,,"Community College Review Protocol" "Effects of a two-generation human capital program on low-income parents' education, employment, and psychological wellbeing.","Chase-Lansdale, P. L., Sabol, T. J., Eckrich Sommer, T., Chor, E., Cooperman, A. W., Brooks-Gunn, J., Yoshikawa, H., King, C., & Morris, A. (2019). Effects of a two-generation human capital program on low-income parents’ education, employment, and psychological wellbeing. Journal of Family Psychology, 33(4), 433-443.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-Mixed impacts Employment","Summary: The study’s objective was to examine the impact of CareerAdvance on education, employment, and earnings outcomes. The study used a nonexperimental design to compare the outcomes of parents who participated in CareerAdvance to outcomes of parents who did not participate. The study found that parents in the treatment group had significantly higher rates of certification, more years of education, and higher rates of enrollment in education and training programs than parents in the comparison group. The treatment group also had significantly higher rates of employment in the healthcare sector, higher rates of part-time employment, and worked more irregular hours than the comparison group. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the CareerAdvance program, but other factors might also have contributed.","CareerAdvance Program","Capacity building programs Community college education and other classroom training","Adult, Parent, Low income",,"United States",2019,https://www.semanticscholar.org/paper/Effects-of-a-two-generation-human-capital…,"Community College Review Protocol" "Kansas Technical Re/training Among Industry-targeted Networks (KanTRAIN) TAACCCT IV evaluation final report","Foster, L. R., Staklis, S., Ott, N. R., & Moyer, R. (2018). Kansas Technical Re/training Among Industry-targeted Networks (KanTRAIN) TAACCCT IV evaluation final report. Raleigh, NC: RTI International.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the Kansas Technical Re/training Among Industry-targeted Networks (KanTRAIN) program on education, earnings, and employment outcomes. The authors used a nonexperimental design to compare education, earnings, and employment outcomes of KanTRAIN participants to a matched comparison group. The study found KanTRAIN participants were significantly more likely to earn more credits per semester, pass a higher percentage of the credits attempted, attain more credentials, and earn a nondegree credential or a college degree, and receive a wage increase than the comparison group. The quality of causal evidence presented in this study is low because the authors used a comparison group from previous enrollment years presenting a confounding factor. This means we are not confident that the estimated effects are attributable to the KanTRAIN program; other factors are likely to have contributed.","Kansas Technical Re/training Among Industry-targeted Networks (KanTRAIN)","Capacity building programs Community college education and other classroom training","Adult, Veteran or military",,"United States",2018,https://www.skillscommons.org/bitstream/handle/taaccct/18334/KanTRAIN_TAACCCT_I…,"Community College Review Protocol" "KCTCS Enhancing Programs for IT Certification (EPIC): Independent evaluation contracted by the Kentucky Community and Technical College System","Hughes, K., Belfield, C., Ran, F., & Jenkins, D. (2018). KCTCS Enhancing Programs for IT Certification (EPIC): Independent evaluation contracted by the Kentucky Community and Technical College System. New York, NY: Community College Research Center, Teacher's College, Columbia University.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to assess the impact of the Enhancing Programs for IT Certification’s (EPIC) Learn on Demand (LoD) courses on community college students’ education outcomes. This summary focuses on the comparison between students who enrolled in EPIC LoD courses and students who enrolled in the traditional format courses. The authors used a nonexperimental design to compare the outcomes of students enrolled in EPIC LoD courses with those enrolled in traditional formats of courses where an EPIC LoD version was available. The study found that EPIC LoD course participation was significantly associated with increased course completion and certificate completion. The quality of causal evidence presented in this report is moderate for the course completion outcome because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the EPIC LoD courses, but other factors might also have contributed. For the certificate completion outcome, the quality of causal evidence presented in this report is low because the authors did not use sufficient controls in their analysis. This means we are not confident that the estimated effects are attributable to the EPIC LoD courses; other factors are likely to have contributed.","the Enhancing Programs for IT Certification (EPIC) Project","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Dislocated or displaced worker, Veteran or military",,"United States",2018,https://ccrc.tc.columbia.edu/media/k2/attachments/CCRC_KCTCS_EPIC_Report_09-26-…,"Community College Review Protocol" "Southern Regional Technical College TAACCCT: Healthcare Career Works! (HCW) program third-party evaluation final report","WorkED Consulting. (2018). Southern Regional Technical College TAACCCT: Healthcare Career Works! (HCW) program third-party evaluation final report. Burke, VA: WorkED Consulting.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Healthcare Career Works! (HCW) program on education outcomes. The authors used a nonexperimental design to compare differences in education outcomes between HCW participants and a matched comparison group. The study found no statistically significant relationships between the HCW program and program completion. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the HCW program; other factors are likely to have contributed.","Healthcare Career Works! (HCW)","Capacity building programs Community college education and other classroom training","Adult, Dislocated or displaced worker, Unemployed, Veteran or military",,"United States",2018,,"Community College Review Protocol" "Third-party evaluation of MoSTEMWINs: Implementation, outcomes, and impact","Cosgrove, J., & Cosgrove, M. (2018). Third-party evaluation of MoSTEMWINs: Implementation, outcomes, and impact. St. Louis, MO: Cosgrove & Associates, LLC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Missouri STEM Workforce Innovation Networks (MoSTEMWINs) program on education and employment outcomes. The authors used a nonexperimental design to compare education and employment outcomes of MoSTEMWINs participants to a historical comparison group. The study found that MoSTEMWINs participants were significantly more likely to complete the program and attain employment than the comparison group. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the MoSTEMWINs program; other factors are likely to have contributed.",MoSTEMWINs,"Basic skills Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Dislocated or displaced worker, Unemployed, Veteran or military",,"United States",2018,http://www.skillscommons.org/bitstream/handle/taaccct/10845/MoSTEMWINs%20Mid-Po…,"Community College Review Protocol" "An analysis of the Veterans Employment Initiative","Moses-Stanton, S. (2018). An analysis of the Veterans Employment Initiative. (Doctoral dissertation). Retrieved from ProQuest. Accession No. 10745075.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact Presidential Executive Order 13518 (EO13518) had on the employment of veterans who served in the military starting in September 2001 (Gulf War II-era veterans). The author used graphical analysis to examine employment outcomes for veterans and non-veterans after the implementation of EO13518. The study used Integrated Public Use Microdata Series (IPUMS USA) data for the years 2008, 2009, 2014, and 2015. The study did not show evidence of a relationship between the implementation of EO13518 and employment of Gulf War II-era veterans. The study did not statistically compare the employment of the veterans and non-veterans following implementation of the Executive Order. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we would not be confident that any estimated effects would be attributable to the implementation of EO13518; other factors would be likely to have contributed to the findings. However, the study did not find statistically significant effects.","Executive Order 13518","Job search assistance and supportive services Veterans' reemployment","Veteran or military",,"United States",2018,https://search.proquest.com/openview/c2ddd5b8502115f80bf2a7352fe1e281/1?cbl=187…,"Employment and Training Review Protocol" "KCTCS Enhancing Programs for IT Certification (EPIC): Independent evaluation contracted by the Kentucky Community and Technical College System","Hughes, K., Belfield, C., Ran, F., & Jenkins, D. (2018). KCTCS Enhancing Programs for IT Certification (EPIC): Independent evaluation contracted by the Kentucky Community and Technical College System. New York, NY: Community College Research Center, Teacher's College, Columbia University.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to assess the impact of the Enhancing Programs for IT Certification’s (EPIC) Learn on Demand (LoD) courses on community college students’ education outcomes. This summary focuses on the comparison between students who enrolled in EPIC LoD courses and students who enrolled in non-EPIC LoD courses. The authors used a nonexperimental design to compare the outcomes of students enrolled in EPIC LoD courses with those enrolled in non-EPIC LoD courses. The study found that EPIC LoD course participation was significantly associated with increased course completion and certificate completion. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the EPIC LoD courses, but other factors might also have contributed.","the Enhancing Programs for IT Certification (EPIC) Project","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Dislocated or displaced worker, Veteran or military",,"United States",2018,https://ccrc.tc.columbia.edu/media/k2/attachments/CCRC_KCTCS_EPIC_Report_09-26-…,"Community College Review Protocol" "Evaluation of Richland College's Veterans-Focused Engineering Technology Project: Final Report","Haviland, S., Van Noy, M., Kuang, L., Vinton, J., & Pardalis, N. (2018). Evaluation of Richland College's Veterans-Focused Engineering Technology Project: Final Report. New Brunswick, NJ: Rutgers University Education and Employment Research Center.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Unfavorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of Richland College’s Veterans-Focused Engineering Technology Project on education outcomes. The authors used a nonexperimental design to compare education outcomes of program participants to a matched comparison group one and two years after enrollment. The study found that program participation was significantly associated with fewer credit hours earned one year after enrollment. The quality of causal evidence presented in this report is low because the authors did not use sufficient controls in their analysis. This means we are not confident that the estimated effects are attributable to the Veterans-Focused Engineering Technology Project; other factors are likely to have contributed program.","the Veterans-Focused Engineering Technology Project","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Veteran or military",,"United States",2018,https://smlr.rutgers.edu/sites/default/files/evaluation_of_richland_colleges_ve…,"Community College Review Protocol" "Heroes for Hire (H4H) program evaluation final report","Horwood, T., Campbell, J., McKinney, M., & Bishop, M. (2018). Heroes for Hire (H4H) program evaluation final report. Fairfax, VA: ICF.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Heroes for Hire (H4H) program on education and earnings outcomes. The authors used a nonexperimental design to compare the education outcomes of H4H program participants to a matched comparison group of students enrolled at the same college, at the same point of entry. and in similar programs of study. The authors also compared the earnings outcomes of students before and after participating in the H4H program. The study found that H4H participants were significantly more likely to complete the program and attain credit hours than the comparison group. In addition, participation in the H4H program was significantly associated with higher post-enrollment salaries compared to initial enrollment salaries. The quality of causal evidence presented in this study is low for the education outcomes because the authors did not ensure that the groups being compared were similar before the intervention nor include sufficient control variables. The quality of causal evidence is also low for the earnings outcomes because the authors did not account for trends in outcomes before the intervention. This means we are not confident that the estimated effects are attributable to the H4H program; other factors are likely to have contributed.","the Heroes for Hire (H4H) Program","Capacity building programs Community college education and other classroom training","Adult, Veteran or military",,"United States",2018,,"Community College Review Protocol" "Improving the labor market outcomes of U.S. veterans: The long-run effect of the Transition Assistance Program","Li, X. (2018). Improving the labor market outcomes of U.S. veterans: The long-run effect of the Transition Assistance Program. New York: Syracuse University.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact the Transitional Assistance Program (TAP) had on outcomes related to employment, earnings, and education. The study used statistical models to compare veterans who had been offered and received TAP to veterans who were not offered TAP. Data came from the veterans supplement of the Current Population Survey for survey years 1995 to 2010. The study found positive associations between participation in TAP and employment, earnings, and education. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to TAP; other factors are likely to have contributed to the findings.","the Transitional Assistance Program","Job search assistance and supportive services Veterans' reemployment Other training and education","Dislocated or displaced worker, Veteran or military",,"United States",2018,,"Employment and Training Review Protocol" "Minnesota advanced manufacturing project: Final external evaluation report","Bucci, P., Evans, W.D., Friesenborg, L., Fox, D.A., Bishop, K., Balraj, N., & Jang, B. (2018). Minnesota advanced manufacturing project: Final external evaluation report. Retrieved from https://www.skillscommons.org/bitstream/handle/taaccct/18521/MnAMP%20Final%20Evaluation%20Report.pdf?sequence=1&isAllowed=y","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Mixed impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Minnesota Advanced Manufacturing Partnership (MnAMP) program on education outcomes. The authors used a nonexperimental design to compare education outcomes of MnAMP participants to a matched comparison group using institutional data. The study found that MnAMP program participation was significantly associated with earning fewer credits and fewer credentials relative to the comparison group. However, among students who attained credentials, participating in the MnAMP program was significantly associated with completing a one-year certificate in less time than comparison group students. The quality of causal evidence presented in this study is low because the authors used a comparison group from previous enrollment years, presenting a confounding factor. This means we are not confident that the estimated effects are attributable to the MnAMP program; other factors are likely to have contributed.","Minnesota Advanced Manufacturing Partnership (MnAMP) Program","Capacity building programs Community college education and other classroom training","Adult, Unemployed, Veteran or military",,"United States",2018,https://www.skillscommons.org/bitstream/handle/taaccct/18521/MnAMP%20Final%20Ev…,"Community College Review Protocol" "SUN PATH comparison group study","Dauphinee, T., & Bishwakarma, R. (2018). SUN PATH comparison group study. Albuquerque, NM: University of New Mexico, Career to Cradle Policy Institute.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Skill‐UP Network Pathways Acceleration in Technology and Healthcare (SUN PATH) program on education, earnings, and employment outcomes. The authors used a nonexperimental design to compare the outcomes of students who were in the SUN PATH program to a matched comparison group of students. The study found that SUN PATH students had higher rates of program completion, certificates/degree attainment, program retention, employment, and earnings than students in the comparison group. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the SUN PATH program, but other factors might also have contributed.","the Skill‐UP Network Pathways Acceleration in Technology and Healthcare (SUN PATH) Program","Capacity building programs Community college education and other classroom training","Adult, Dislocated or displaced worker, Other, Low-skilled, Veteran or military",,"United States",2018,https://www.skillscommons.org/bitstream/handle/taaccct/18108/SUN%20PATH%20Compa…,"Community College Review Protocol" "Preparing Alaskans for mining careers through short, industry-informed training programs: University of Alaska round IV TAACCCT grant","Hanson, H., Stevens, D., Vazquez, M., & Roberts, B. (2018). Preparing Alaskans for mining careers through short, industry-informed training programs: University of Alaska round IV TAACCCT grant. Portland, OR: Education Northwest.","Community College",,,"Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the University of Alaska's Trade Adjustment Assistance Community College and Career Training (TAACCCT) grant program on the employment and earnings of community college students. The study used a nonexperimental design to compare the outcomes of students in the TAACCCT-enhanced Surface Mining and Underground Mining programs to similar individuals who did not attend community college and instead entered the labor market in mining occupations. The study found that the TAACCCT-enhanced program participation was significantly associated with a higher likelihood of employment retention and increased quarterly wages. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the University of Alaska's TAACCCT grant program; other factors are likely to have contributed.","the University of Alaska's TAACCCT Grant Program","Employer partnerships Capacity building programs Community college education and other classroom training","Adult, Dislocated or displaced worker, American Indian or Alaska Native, Veteran or military",,"United States",2018,http://www.skillscommons.org/bitstream/handle/taaccct/18578/AK_TAACCCT_Report_0…,"Community College Review Protocol" "Trade Adjustment Assistance Community College Career Training Grant (TAACCCT): Final evaluation report","The Greater Cincinnati Supply Chain Career Development Center (SCCDC). (2018). Trade Adjustment Assistance Community College Career Training Grant (TAACCCT): Final evaluation report. Cincinnati, OH: Author.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of The Greater Cincinnati Supply Chain Career and Development Center’s (SCCDC) Supply Chain Management and Materials Handling & Logistics programs on education outcomes. The study used a nonexperimental design to compare the program completion of students enrolled in SCCDC programs to students in a matched comparison group. The study found that participation in the Supply Chain Management program, one of the SCCDC programs, was associated with a significant increase in the likelihood of program completion. The quality of causal evidence presented in this report is low because the authors used a comparison group from different academic programs presenting a confounding factor. This means we are not confident that the estimated effects are attributable to the SCCDC programs; other factors are likely to have contributed.","the SCCDC’s Supply Chain Management and Materials Handling & Logistics Technologies Programs","Capacity building programs Community college education and other classroom training","Adult, Dislocated or displaced worker, Veteran or military",,"United States",2018,https://www.skillscommons.org/handle/taaccct/17943,"Community College Review Protocol" "Johnson County Community College (JCCC) TAACCCT final evaluation report","York, V. (2018). Johnson County Community College (JCCC) TAACCCT final evaluation report. Office of Educational Innovation and Evaluation. Manhattan, KS: Kansas State University.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to evaluate the effects of Johnson County Community College’s (JCCC) Accelerated, Collaborative Technology Training Services (ACTTS) project on education outcomes. The author used a nonexperimental design to compare cohorts of students enrolled in ACTTS and comparison programs on five educational outcomes of interest. The study found that ACTTS students were significantly more likely than comparison group participants to complete their program of study, be retained in their program of study, complete credit hours, and earn credentials. The quality of causal evidence presented in this study is low because the authors did not ensure that the groups being compared were similar before the intervention or include sufficient controls. This means we are not confident that the estimated effects are attributable to ACTTS; other factors are likely to have contributed.","JCCC’s Accelerated, Collaborative Technology Training Services (ACTTS) project","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Dislocated or displaced worker, Veteran or military",,"United States",2018,https://www.skillscommons.org/bitstream/handle/taaccct/17872/JCCC%20TAACCCT%20F…,"Community College Review Protocol" "TAACCCT building Illinois' bio-economy (BIB) consortium final evaluation report","The New Growth Group. (2018). TAACCCT building Illinois' bio-economy (BIB) consortium final evaluation report. Cleveland, OH: New Growth Group.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Building Illinois’ Bio-economy (BIB) consortium on education outcomes. The authors used a nonexperimental design to compare the outcomes of students in BIB grant-affected programs to a matched comparison group of students in non-BIB grant-affected programs. The study found a significant positive relationship between BIB program participation and program completion rates at two of the five colleges. The quality of causal evidence presented in this report is low because the authors did not use sufficient controls in their analysis. This means we are not confident that the estimated effects are attributable to participation in BIB grant-affected programs; other factors are likely to have contributed.","the Building Illinois’ Bio-economy (BIB) Consortium","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Veteran or military",,"United States",2018,,"Community College Review Protocol" "Final evaluation report: Cincinnati State Technical and Community College: Greater Cincinnati Manufacturing Careers Accelerator (GCMCA)","Belville, J., Romano, G., Frisby, M., Chamberlin, M., & Strem, L. (2017). Final evaluation report: Cincinnati State Technical and Community College: Greater Cincinnati Manufacturing Careers Accelerator (GCMCA).","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Unfavorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Greater Cincinnati Manufacturing Careers Accelerator (GCMCA) program on education outcomes. The author used a nonexperimental design to compare the education persistence of students in the treatment group to students in a matched comparison group. The study found that students in the comparison group were significantly more likely to complete the program than students in the treatment group for both the Welding or Mechanical Engineering Technology Manufacturing and Design programs. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention.This means we are not confident that the estimated effects are attributable to the Greater Cincinnati Manufacturing Careers Accelerator (GCMCA) program; other factors are likely to have contributed.    ","Greater Cincinnati Manufacturing Careers Accelerator (GCMCA) Program","Basic skills Capacity building programs Community college education and other classroom training","Adult, Dislocated or displaced worker, Veteran or military",,"United States",2017,,"Community College Review Protocol" "STEM-Connect at the University of Vermont, College of Engineering and Mathematical Sciences: Program evaluation final report","Farrell, R., Harris, D., Meyers, H., & Ratmeyer, S. (2017). STEM-Connect at the University of Vermont, College of Engineering and Mathematical Sciences: Program evaluation final report. Swanton, VT: Core Research and Evaluation.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the effects of the University of Vermont’s (UVM) Science, Technology, Engineering and Math (STEM) Connect program on earnings and employment outcomes. The study used a nonexperimental design to compare the outcomes of students who were enrolled in the UVM STEM-Connect program to a matched comparison group of students who took a STEM-Connect course but were not enrolled in the STEM-Connect program. The study found no statistically significant relationships between STEM-Connect program participation and average quarterly wages or employment rates. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the UVM STEM-Connect program; other factors are likely to have contributed.","the UVM STEM-Connect Program","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Dislocated or displaced worker, Unemployed, Veteran or military",,"United States",2017,http://www.skillscommons.org/bitstream/handle/taaccct/13127/STEM-Connect%20Fina…,"Community College Review Protocol" "Butler Community College TAACCCT final evaluation report","Kansas State University Office of Educational Innovation and Evaluation. (2017). Butler Community College TAACCCT final evaluation report. Manhattan, KS: Kansas State University.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the Butler Community College Trade Adjustment Assistance Community College and Career Training (TAACCCT) grant on education, earnings, and employment outcomes. The study used a nonexperimental design to compare the outcomes of students who were in the Butler TAACCCT Information Technology (IT) program to a comparison group. The study found that students in the Butler TAACCCT IT program were significantly more likely to complete their program, be retained in their program, and earn credentials than their counterparts in other selected Career and Technical Education (CTE) courses. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention or include sufficient controls. This means we are not confident that the estimated effects are attributable to the Butler TAACCCT IT program; other factors are likely to have contributed.","the Butler Community College TAACCCT Project","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Dislocated or displaced worker, Veteran or military",,"United States",2017,https://www.skillscommons.org/handle/taaccct/15664,"Community College Review Protocol" "Final evaluation report: Linn-Benton Community College","Kelley-Smith, A., Schoeph, K., Hamai, T., & Bishop, M. (2017). Final evaluation report: Linn-Benton Community College. Albany, OR: LB iLearn Campus.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study’s objective was to assess the impact of degree and certificate programming offered at Linn-Benton Community College’s (LBCC) iLearn campus compared to traditional programming offered at the community college on various educational, employment, and earnings outcomes. The study used a nonexperimental design to compare the outcomes of students enrolled in the Linn-Benton (LB) iLearn campus to students enrolled in traditional programming. The study found that program participation was significantly associated with increased rates of program completion. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the LB iLearn campus program; other factors are likely to have contributed.","the LB iLearn Campus Program","Capacity building programs Community college education and other classroom training","Adult, Other barriers, Dislocated or displaced worker, Veteran or military",,"United States",2017,https://www.skillscommons.org/handle/taaccct/15675,"Community College Review Protocol" "Final evaluation Golden Triangle Modern Manufacturing Project","Harpole, S. (2017). Final evaluation Golden Triangle Modern Manufacturing Project. SHH Consulting, LLC","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the Golden Triangle Modern Manufacturing Project on education, earnings, and employment outcomes. The author used a nonexperimental design to compare outcomes of Golden Triangle Modern Manufacturing Project participants to a matched comparison group. The study found that program participation was significantly associated with increases in program retention, credential attainment, and earnings. The quality of causal evidence presented in this study is low because the author used a comparison group from previous enrollment years presenting a confounding factor. This means we are not confident that the estimated effects are attributable to Golden Triangle Modern Manufacturing Project; other factors are likely to have contributed.","the Golden Triangle Modern Manufacturing Project","Capacity building programs Community college education and other classroom training","Adult, Dislocated or displaced worker, Unemployed, Low-skilled, Veteran or military",,"United States",2017,https://www.skillscommons.org/handle/taaccct/15669,"Community College Review Protocol" "TAACCCT3 INTERFACE project: Final evaluation report","Smith, L., Gregg, A., Roth, L., Stoeklen, P., Krueger, B., Lawton, G., & Knaeble, B. (2017). TAACCCT3 INTERFACE project: Final evaluation report. Menomonie, WI: University of Wisconsin-Stout, Applied Research Center, Wisconsin’s Polytechnic University.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Intentional Networks Transforming Effective and Rigorous Facilitation of Assessment, Collaboration, and Education (INTERFACE) project on education, earnings, and employment outcomes. The authors used a nonexperimental design to compare education, earnings, and employment outcomes of students in the INTERFACE program to a matched comparison group. The study found that INTERFACE students had significantly higher pass rates, graduation rates, and employment rates than students in the comparison group. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the INTERFACE program, but other factors might also have contributed.","the Intentional Networks Transforming Effective and Rigorous Facilitation of Assessment, Collaboration, and Education (INTERFACE) Program","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Veteran or military",,"United States",2017,https://www.skillscommons.org/bitstream/handle/taaccct/14262/INTERFACE%20Projec…,"Community College Review Protocol" "Project IMPACT: Innovative multi-industry partnership and career training project final evaluation report. Gateway Community Technical College","Jensen, J., Horohov, J., & Waddington, J. (2017). Project IMPACT: Innovative multi-industry partnership and career training project final evaluation report. Gateway Community Technical College. Lexington, KY: University of Kentucky, College of Education, Educational Policy Studies & Evaluation.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study’s objective was to assess the impact of Project IMPACT on education, earnings, and employment outcomes. Using academic records from the college as well as data obtained from the Kentucky Center for Workforce Statistics, the authors used a nonexperimental design to compare outcomes of Project IMPACT participants to outcomes of historical cohort students who were enrolled in the Project IMPACT programs of study prior to grant implementation. The study found that participating in Project IMPACT was significantly associated with a higher likelihood to take courses, pass courses, earn credits, and receive credentials. The study also found that participating in Project IMPACT was significantly associated with higher earnings in the quarter following enrollment. The quality of causal evidence presented in this study is low for the education and employment outcomes because the authors used a comparison group from previous enrollment years presenting a confounding factor and because the authors did not ensure the groups being compared were similar before the intervention, respectively. This means we are not confident that the estimated effects are attributable to Project IMPACT; other factors are likely to have contributed.","Project IMPACT","Employer partnerships Capacity building programs Community college education and other classroom training","Adult, Other barriers, Veteran or military",,"United States",2017,https://www.skillscommons.org/bitstream/handle/taaccct/15674/IMPACT%20Final%20E…,"Community College Review Protocol" "Southeastern Economic and Education Leadership Consortium (SEELC) final report","Takyi-Laryea, A., Gall, A., Chamberlin, M., Naughton, L., & Spychala, B. G. (2017). Southeastern Economic and Education Leadership Consortium (SEELC) final report. Fairfax, VA: ICF.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Education and skills gains-Low-No impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the WorkKeys® assessment, a component of the TAACCCT-funded programming at Southeastern Economic and Education Leadership Consortium (SEELC) colleges, on education, earnings outcomes, and employment. The authors used a nonexperimental design to compare the education, earnings outcomes, and employment of SEELC program participants that took the WorkKeys® assessment to a matched comparison group of SEELC participants enrolled at the same colleges who did not take the assessment. The study found a significant relationship between taking the WorkKeys® assessment and earnings, with SEELC participants who took the assessment receiving higher post-program hourly wages than the comparison group of students who did not take the assessment. The quality of causal evidence presented in this study is low because the authors did not ensure that the groups being compared were similar before the intervention nor include sufficient control variables. This means we are not confident that the estimated effects are attributable to the SEELC consortium WorkKeys® assessment; other factors are likely to have contributed.","the Southeastern Economic and Education Leadership Consortium (SEELC)","Capacity building programs Community college education and other classroom training","Adult, Veteran or military",,"United States",2017,http://www.skillscommons.org/handle/taaccct/13986,"Community College Review Protocol" "Orthotics, Prosthetics, and Pedorthics (HOPE) careers consortium: Final evaluation report","Good, K., & Yeh-Ho, H. (2017). Orthotics, Prosthetics, and Pedorthics (HOPE) careers consortium: Final evaluation report. Denver, CO: McREL International.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Orthotics, Prosthetics & Pedorthics (HOPE) careers consortium program on education outcomes. The authors used a nonexperimental design to compare education outcomes of HOPE participants to a matched comparison group with institutional research data. The study found no significant associations between HOPE participation and program completion rates, completion of more than one certificate or degree, or furthering education status. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the HOPE program; other factors are likely to have contributed.","the Orthotics, Prosthetics & Pedorthics (HOPE) Careers Consortium Program","Capacity building programs Community college education and other classroom training","Adult, Other barriers, Dislocated or displaced worker, Unemployed, Veteran or military",,"United States",2017,https://www.skillscommons.org/bitstream/handle/taaccct/13872/hope-consortium-tc…,"Community College Review Protocol" "Eliminating child labour in El Salvador through economic empowerment and social inclusion: Impact report","de Hoop, J., Kovrova, I., & Rosati, F. C. (2016). Eliminating child labour in El Salvador through economic empowerment and social inclusion: Impact report. Retrieved from http://www.ucw-project.org/attachment/07032017224El_Salvador_IE_07042016_web.pdf","Child Labor","Study Type: Descriptive Analysis",,,"Summary: The study’s objective was to assess the effects of a women’s entrepreneurship training program on children’s participation in school and work. The study was a regression discontinuity design, using baseline and follow-up household surveys to measure program outcomes. Households were selected into the program if they had a wealth score below a cut-off point. The authors compared the outcomes of children in households above and below the cut-off score to understand the program’s effects. The study found that selection and participation in the program was significantly associated with a decrease in the percent of children working-only and not attending school, and the number of hours that children worked per week. Selection and participation in the program was also significantly related to an increase in school attendance. This study used a regression discontinuity design and therefore was reviewed using CLEAR’s descriptive study evidence review guidelines. As such, it does not receive a causal rating.","Eliminating Child Labour in El Salvador through Economic Empowerment and Social Inclusion","Child labor","Female, Parent, Low income",,International,2016,http://www.ucw-project.org/attachment/07032017224El_Salvador_IE_07042016_web.pdf,"Child Labor Review Protocol" "Enhanced vocational rehabilitation for veterans with mild traumatic brain injury and mental illness: Pilot study","O’Connor, M. K., Mueller, L., Kwon, E., Drebing, C. E., O’Connor, A. A., Semiatin, A., & Daley, R. (2016). Enhanced vocational rehabilitation for veterans with mild traumatic brain injury and mental illness: Pilot study. Journal of Rehabilitation Research & Development, 53(3), 307-319.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of an embedded cognitive rehabilitation intervention on employment and earnings. The study was a randomized controlled trial with the authors using administrative data. The study found no statistically significant relationships between an embedded cognitive rehabilitation intervention and employment and earnings after one year. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to an embedded cognitive rehabilitation intervention; other factors are likely to have contributed.","the cognitive rehabilitation intervention","Substance abuse recovery Vocational rehabilitation","Other barriers, Male, Veteran or military",,"United States",2016,http://search.proquest.com/openview/ee479834dd8beedff02771b00bc95e0a/1?pq-origs…,"Employment and Training Review Protocol" "The impact of disability benefits on labor supply: Evidence from the VA’s disability compensation program","Autor, D. H., Duggan, M., Greenberg, K., & Lyle, D. S. (2016). The impact of disability benefits on labor supply: Evidence from the VA’s disability compensation program. American Economic Journal: Applied Economics, 8(3), 31-68. http://www.aeaweb.org/aej-applied/ [Impact of DC enrollment and benefit amount]",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Unfavorable impacts Employment","Summary: The study examined the impact of Disability Compensation (DC) enrollment and benefit amount on labor force participation and earnings. The authors also examined the impact of the expansion of eligibility for DC benefits on labor force participation and earnings; see profile here . The authors estimated statistical models to compare outcomes for Vietnam-era Army veterans who served with “boots on the ground” (BOG) with those who served “not on the ground” (NOG) who did not fight directly in the conflict, before and after the implementation of the Type 2 diabetes policy change in 2001. The authors used administrative data from the U.S. Army Office of Economic and Manpower Analysis, the U.S. Department of Veterans Affairs (VA), and the Social Security Administration (SSA). The increases in DC enrollment due to the expansion in eligibility for DC in 2001 were associated with reductions in labor force participation and earnings. Increases in DC benefit amounts due to the expansion in eligibility were also associated with reductions in labor force participation. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to DC enrollment and benefit amounts, but other factors might also have contributed to the findings.",DC,"Disability insurance Veterans' reemployment","Disability, Male, Veteran or military",,"United States",2016,https://pubs.aeaweb.org/doi/pdf/10.1257/app.20150158,"Employment and Training Review Protocol" "Life after service for post-9/11 veterans: Data, methods, and policy impacts","Gardner, J. S. (2016). Life after service for post-9/11 veterans: Data, methods, and policy impacts (Doctoral dissertation). Retrieved from https://digitalscholarship.unlv.edu/cgi/viewcontent.cgi?article=3867&context=thesesdissertations",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Unfavorable impacts Employment","Summary: The study’s objective was to examine the effects of the 2008 GI Bill on post-9/11 veterans’ employment and educational attainment. The study used a statistical model to compare outcomes between veterans from before and after the passing of the 2008 GI Bill using data from the American Community Survey. The study found statistically significant relationships between the 2008 GI Bill and the education or employment of veterans. The quality of causal evidence presented in this report is low because the author did not observe outcomes for multiple demonstrations of the intervention. This means we are not confident that the estimated effects are attributable to the post-9/11 GI Bill; other factors are likely to have contributed.","the 2008 GI Bill","Veterans' reemployment Other training and education","Veteran or military",,"United States",2016,https://digitalscholarship.unlv.edu/cgi/viewcontent.cgi?article=3867&context=th…,"Employment and Training Review Protocol" "Nursing interventions to help prevent children from working on the streets","Mert, K., & Kadioglu, H. (2016). Nursing interventions to help prevent children from working on the streets. International Nursing Review 63, 429–436. doi:10.1111/inr.12301","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-No impacts Child labor","Summary: The study’s objective was to assess the impact of a program developed to prevent children under 18 years of age from working on the street. The study was an interrupted time series design conducted in one neighborhood in the city of Izmit, Turkey. The authors compared the outcomes for mothers and their children before, immediately after, and three months after participating in The Streets are Not the Solution program. The study found that participating in the program was associated with a 44 percentage point decrease from pretest to posttest in the percentage of children who worked on the streets. However, the study did not include tests of statistical significance. The quality of causal evidence presented in this report is low because the authors did not account for trends in outcomes before the intervention. This means we are not confident that the effects are attributable to the Streets are Not the Solution program; other factors are likely to have contributed.","The Streets are Not the Solution","Child labor","Female, Other, Parent",,International,2016,,"Child Labor Review Protocol" "Spousal labor market effects from government health insurance: Evidence from a veterans affairs expansion.","Boyle, M. A. & Lahey, J. N. (2016). Spousal labor market effects from government health insurance: Evidence from a veterans affairs expansion. Journal of Health Economics, Elsevier, 45(C), 63-76.","Older Workers, Veterans","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Mod/high-No impacts Employment","Summary: The study examined the impact of the expansion of health insurance for veterans through the U.S. Department of Veterans Affairs (VA) in the mid-1990s (as a result of the implementation of the Veteran’s Health Care Eligibility Reform Act) on the employment and earnings of non-covered spouses. The authors used a statistical model and data from the Census Bureau’s March Current Population Survey and the Health and Retirement Study to compare the employment and earnings of wives of male veterans with wives of non-veterans of the same ages before and after the expansion of health insurance for veterans through the VA. The study found no statistically significant associations between the expansion of health insurance for veterans and the employment of their wives and mixed evidence on associations between the expansion of health insurance for veterans and the earnings of their wives. The quality of causal evidence presented in this report is moderate for the employment outcomes because it was based on a well-implemented nonexperimental design. This means we would be somewhat confident that any estimated effects would be attributable to the expansion of health insurance for veterans through the VA, but other factors might also have contributed. The quality of causal evidence presented in this report is low for earnings outcomes because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the expansion of health insurance for veterans through the VA; other factors are likely to have contributed.","Veteran Health Insurance Expansion","Health Older workers' programs Veterans' reemployment","Adult, Older worker, Veteran or military",,"United States",2016,,"Older Workers, Veterans Review Protocol" "Evaluation of the Illinois Network for Advanced Manufacturing: Final Report","Westat. (2016). Evaluation of the Illinois Network for Advanced Manufacturing: Final Report. Rockville, MD: Westat & GEM Software Development, Inc.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the Illinois Network for Advanced Manufacturing (INAM) program on education, earnings, and employment outcomes. The study used a nonexperimental design to compare the outcomes of students who were in the INAM program to a comparison group of students who took similar courses before the creation of INAM. Using data from college databases and the Illinois Department of Employment Security, the authors conducted statistical models to examine differences in outcomes between the groups. The study found that participation in the INAM program was significantly associated with improved rates of certificate or degree completion. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the INAM program; other factors are likely to have contributed.","the Illinois Network for Advanced Manufacturing (INAM)","Capacity building programs Community college education and other classroom training","Adult, Dislocated or displaced worker, Unemployed, Other, Veteran or military",,"United States",2016,https://www.researchgate.net/publication/315664265_Evaluation_of_the_Illinois_N…,"Community College Review Protocol" "Third party evaluation of MoManufacturingWINS: Implementation, outcomes, and impact","Cosgrove, J. J., Cosgrove, M. S., & Bragg, D. D. (2016). Third party evaluation of MoManufacturingWINs: Implementation, outcomes, and impact. St. Louis, MO: Cosgrove & Associates and Bragg & Associates.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of Missouri’s Manufacturing Workforce Innovation Networks(MMW) program on student education and employment outcomes. The study used a nonexperimental design to compare the outcomes of students who were in MMW to a comparison group of students in other manufacturing-technology related programs. The study found that MMW participation was significantly associated with higher retention and employment rates. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention and they did not include sufficient controls. This means we are not confident that the estimated effects are attributable to MMW; other factors are likely to have contributed.","Missouri’s Manufacturing Workforce Innovation Networks (MMW)","Basic skills Capacity building programs Community college education and other classroom training","Adult, Unemployed, Other, Low-skilled, Veteran or military",,"United States",2016,https://www.skillscommons.org/bitstream/handle/taaccct/10116/ThirdPartyFinalEva…,"Community College Review Protocol" "Incorporating individualized placement and support principles into vocational rehabilitation for formerly incarcerated veterans","LePage, J. P., Lewis, A. A., Crawford, A. M., Parish, J. A., Ottomanelli, L., Washington, E. L., & Cipher, D. J. (2016). Incorporating individualized placement and support principles into vocational rehabilitation for formerly incarcerated veterans. Psychiatric Services, 67(7), 735-742.","Reentry, Veterans","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study examined the effect of the Individual Placement and Support (IPS) program on employment and earnings outcomes for justice-involved veterans with a prior felony conviction and a mental illness or substance abuse disorder. The study team used a randomized controlled trial and statistical tests to examine differences between justice-involved veterans who were offered the IPS program and veterans who were not offered this program. Justice-involved veterans self-reported their outcomes, which were verified based on a review of paystubs or contact with employers. The study showed that the IPS program increased employment, wages, number of days employed, and number of hours worked. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the IPS program, not to other factors.","Individual Placement and Support (IPS)","Job search assistance and supportive services Supported employment or other employment supports Veterans' reemployment","Veteran or military",,"United States",2016,https://ps.psychiatryonline.org/doi/full/10.1176/appi.ps.201500058,"Reentry, Veterans Review Protocol" "Retraining the Gulf Coast through Information Technology Pathways: Final impact evaluation report","Patnaik, A., & Prince, A. (2016). Retraining the Gulf Coast through Information Technology Pathways: Final Impact evaluation report. Austin, TX: The University of Texas at Austin, Lyndon B. Johnson School of Public Affairs.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Retraining the Gulf Coast Workforce through Information Technology Pathways Consortium (Gulf Coast IT Pathways) grant program on education outcomes. Using a nonexperimental design with institutional data from the college systems, the study authors compared students in the program to a matched historical cohort comparison group. The study found that the Gulf Coast IT Pathways program was significantly related to higher credential, certificate, or a degree attainment and higher credit hour accumulation. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Gulf Coast IT Pathways TAACCCT; other factors are likely to have contributed.","the Gulf Coast IT Pathways Program","Basic skills Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Dislocated or displaced worker, Low-skilled, Veteran or military",,"United States",2016,https://raymarshallcenter.org/files/2016/11/Retraining-the-Gulf-Coast-through-I…,"Community College Review Protocol" "To work for yourself, for others, or not at all? How disability benefits affect the employment decisions of older veterans","Coile, C., Duggan, M., & Guo, A. (2016). To work for yourself, for others, or not at all? How disability benefits affect the employment decisions of older veterans. Unpublished manuscript.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study examined the impact of a 2001 expansion in eligibility for Disability Compensation (DC) to cover type 2 diabetes for Vietnam-era veterans on their employment, earnings, and public benefit receipt. The authors estimated statistical models to compare outcomes among male Vietnam-era veterans who did and did not serve with on the ground using data from the Veterans Supplement to the Current Population Survey from 1995 to 2015. The study found that the expansion of eligibility for DC was associated with greater receipt of DC, a lower likelihood of working for others, and a greater likelihood of self-employment by on-the-ground veterans compared with those veterans who did not serve on the ground. The study did not find a relationship between the expansion and earnings. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to changes in eligibility for DC and not to other factors.",DC,"Other wages and benefits Veterans' reemployment","Disability, Male, Veteran or military",,"United States",2016,https://www.nber.org/papers/w23006,"Employment and Training Review Protocol" "Vincennes University Logistics Training and Education: Final evaluation report","Belville, J., Schoeph, K., Leger, R., Jenner, E., Maddox, D., Lass, K., & Beres, S. (2016). Vincennes University Logistics Training and Education Center: Final evaluation report. Retrieved from https://www.skillscommons.org/bitstream/handle/taaccct/9679/VU%20LTEC%20Final%20Evaluation%20Report%20TAACCCT%20R2_Sept%202016.pdf?sequence=1&isAllowed=y","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the Logistics Training and Education Center (LTEC) initiative on employment and earnings outcomes. This summary focuses on the estimated outcomes of the Tractor-Trailer Driver Training (TTDT) program.  The authors used a nonexperimental design to compare the outcomes of TTDT program participants to a matched comparison group consisting of two student cohorts: a historical cohort of students from previous enrollment years and a concurrent cohort of students that attended a different college campus. The study did not find significant relationships between completion of the TTDT program and employment status or quarterly earnings. The quality of the causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Logistics Training and Education Center initiative; other factors are likely to have contributed.  ","Logistics Training and Education Center (LTEC) Initiative","Capacity building programs Community college education and other classroom training","Adult, Veteran or military",,"United States",2016,https://www.skillscommons.org/bitstream/handle/taaccct/9679/VU%20LTEC%20Final%2…,"Community College Review Protocol" "Vincennes University Logistics Training and Education Center: Final evaluation report.","Belville, J. Schoeph, K., Leger, R., Jenner, E., Maddox, D., Lass, K., & Beres, S. (2016). Vincennes University Logistics Training and Education Center: Final evaluation report. Retrieved from https://www.skillscommons.org/bitstream/handle/taaccct/9769/VU%20LTEC%20Final%20Evaluation%20Report%20TAACCCT%20R2_Sept%202016.pdf?sequence=1&isAllowed=y","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the Vincennes University Logistics Training and Education Center (LTEC) initiative on employment and earnings outcomes. This summary focuses on the estimated outcomes of the Fork Lift Essentials (FLE) program. The authors used an interrupted time series design to examine employment and earnings outcomes associated with the completion of LTEC's FLE program. The study found FLE program completion was significantly associated with improved earnings in the first quarter immediately following program completion. The quality of causal evidence presented in this report is low because the authors did not observe outcomes for multiple periods after the intervention. This means we are not confident that the estimated effects are attributable to the Logistics Training and Education Center initiative; other factors are likely to have contributed.","Logistics Training and Education Center (LTEC) Initiative","Capacity building programs Community college education and other classroom training","Adult, Veteran or military",,"United States",2016,https://www.skillscommons.org/bitstream/handle/taaccct/9679/VU%20LTEC%20Final%2…,"Community College Review Protocol" "The impact of disability benefits on labor supply: Evidence from the VA’s disability compensation program","Autor, D. H., Duggan, M., Greenberg, K., & Lyle, D. S. (2016). The impact of disability benefits on labor supply: Evidence from the VA’s disability compensation program. American Economic Journal: Applied Economics, 8(3), 31-68. http://www.aeaweb.org/aej-applied/ [Impact of eligibility expansion]",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Unfavorable impacts Earnings and wages Employment-Low-Unfavorable impacts Employment Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study examined the impact of a 2001 expansion in eligibility for Disability Compensation (DC) to type 2 diabetes for Vietnam-era veterans on labor force participation, earnings, and receipt of public benefits. The authors also examined the impact of receiving DC benefits and amount on labor force participation and earnings; see profile here . The authors estimated statistical models to compare outcomes for Vietnam-era Army veterans who served with “boots on the ground” (BOG) with those who served “not on the ground” (NOG) Veterans who did not fight directly in the conflict, from before and after the implementation of the type 2 diabetes policy change in 2001. The authors used administrative data from the U.S. Army Office of Economic and Manpower Analysis, the U.S. Department of Veterans Affairs (VA), and the Social Security Administration. The implementation of expanded DC coverage and benefits in 2001 resulted in reductions in labor force participation and earnings among impacted veterans as well as increases in the receipt of disability benefits. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the expansion in eligibility for Disability Compensation (DC); other factors are likely to have contributed to the findings.",DC,"Disability insurance Veterans' reemployment","Disability, Male, Veteran or military",,"United States",2016,https://pubs.aeaweb.org/doi/pdf/10.1257/app.20150158,"Employment and Training Review Protocol" "Veterans Homelessness Prevention Demonstration evaluation: Final report","Cunningham, M. K., Biess, J., Emam, D., & Burt., M. R. (2015). Veterans Homelessness Prevention Demonstration evaluation: Final report. Washington, DC: Urban Institute.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Favorable impacts Employment Public benefits receipt-Low-Mixed impacts Public benefit receipt","Summary: The study examined the effect of the Veterans Homelessness Prevention Demonstration (VHPD) program on the employment, earnings, public benefit receipt, and education and training outcomes of veterans at risk of homelessness. The study uses a nonexperimental design to examine whether there were changes in veterans’ outcomes from before the program began to six months after the program ended using self-reported data directly from the veterans. The study found statistically significant positive relationships between the VHPD program and veterans’ employment and earnings six months after the program ended compared with before the program. The study found mixed relationships between the VHPD program and public benefit receipt: significantly fewer veterans in the study received several types of public benefits, such as Temporary Assistance for Needy Families (TANF) or the Supplemental Nutrition Assistance Program (SNAP). Significantly more veterans in the study, however, received Veterans Pension benefits after the program compared with before it. The quality of causal evidence presented in this report is low because the authors did not account for trends in outcomes before the intervention. This means we are not confident that the estimated effects are attributable to the VHPD program; other factors are likely to have contributed.","the Veterans Homelessness Prevention Demonstration (VHPD) program","Job search assistance and supportive services Other training and education","Low income, Veteran or military, Homeless",,"United States",2015,http://apps.urban.org/features/homeless-veterans/,"Employment and Training Review Protocol" "Evaluation of MoHealthWINS outcomes and impact","Cosgrove, J. J., Cosgrove, M. S., & Bragg, D. D. (2015). Evaluation of MoHealthWINS outcomes and impact. Retrieved from https://www.skillscommons.org/bitstream/handle/taaccct/5125/SEPTEMBER%202015%20FINAL%20VERSION%20OF%20MHW%20OUTCOME%20IMPACT%20EVALUATION%20REPORT.pdf?sequence=1&isAllowed=y","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to assess the relationship between the MoHealthWINS program and education and employment outcomes. The study used a nonexperimental design, where the program participants were compared to a matched comparison group. Using college administrative data, state employment data, and employer data, the authors compared the program completion and employment rates between the treatment and comparison group. The study found a significant relationship between program participation and the likelihood to complete the program and be employed post-program completion. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention or include sufficient control variables. This means we are not confident that the estimated effects are attributable to MoHealthWINS program; other factors are likely to have contributed.",MoHealthWINS,"Capacity building programs Community college education and other classroom training","Adult, Unemployed, Low-skilled, Veteran or military",,"United States",2015,https://www.skillscommons.org/bitstream/handle/taaccct/5125/SEPTEMBER%202015%20…,"Community College Review Protocol" "Veterans’ labor force participation: What role does the VA’s disability compensation program play?","Coile, C., Duggan, M., & Guo, A. (2015). Veterans’ labor force participation: What role does the VA’s disability compensation program play? American Economic Review, 105(5), 131-136.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study examined the impact of expanding eligibility for veterans’ Disability Compensation (DC) in 2001 and 2010 on labor force participation. The authors conducted a nonexperimental analysis to compare veteran and non-veteran labor force participation over time using the March Current Population Survey data from 1980 to 2014. The study found that veteran labor force participation was generally lower than that of non-veterans in the same 10-year age range during the periods following eligibility expansions. The quality of causal evidence presented in this report is low because there could be differences in external conditions that affected the treatment group and not the comparison group. This means we are not confident that the estimated effects are attributable to veterans’ receipt of DC; other factors are likely to have contributed to the findings.",DC,"Other wages and benefits Veterans' reemployment","Disability, Male, Veteran or military",,"United States",2015,https://www.aeaweb.org/articles?id=10.1257/aer.p20151062,"Employment and Training Review Protocol" "What factors contributed to changes in employment during and after the great recession?","Farooq, A., & Kugler, A. D. (2015). What factors contributed to changes in employment during and after the great recession? IZA Journal of Labor Policy, 4(3), 1-28.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: This study examined the impact of the Work Opportunity Tax Credit (WOTC) on employment for veterans with disabilities and unemployed veterans. The study used a nonexperimental design to examine the effects of the WOTC on employment, based on data from the Annual Social and Economic (ASEC) supplement of the Current Population Survey from 2003 to 2013. The study showed no statistically significant relationships between the WOTC and employment for veterans with disabilities or for unemployed veterans. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that any estimated effects are attributable to the WOTC; other factors likely contributed to the outcomes. However, the study did not show any statistically significant effects.","the Work Opportunity Tax Credit","Veterans' reemployment Work Opportunity Tax Credit (WOTC)","Disability, Veteran or military",,"United States",2015,https://link.springer.com/article/10.1186/s40173-014-0029-y,"Employment and Training Review Protocol" "From the battlefield to the schoolyard: The short-term impact of the Post-9/11 GI Bill","Barr , A. (2015). From the battlefield to the schoolyard: The short-term impact of the Post-9/11 GI Bill. Journal of Human Resources, 50(3), 580-613.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the effects of Post-9/11 GI Bill on veterans’ college enrollment. The author investigated similar research questions in another study, the profile of which is available [here]. The study used regression methods in a nonexperimental analysis, drawing on data from the American Community Survey and Current Population Survey. The study compared college enrollment of veterans eligible for the GI Bill benefits with civilians, who were not eligible to receive the benefits. The study found that veterans eligible for the Post-9/11 GI Bill benefits were significantly more likely to enroll in college after the introduction of the bill compared with civilians. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Post-9/11 GI Bill; other factors are likely to have contributed.","Post-9/11 GI Bill","Other training and education","Veteran or military",,"United States",2015,http://jhr.uwpress.org/content/50/3/580.full.pdf,"Employment and Training Review Protocol" "Fighting for Education: Financial Aid and Non-traditional Students","Barr, A. C. (2015). Fighting for Education: Financial Aid and Non-traditional Students. (Doctoral dissertation). Online Archive of University of Virginia Scholarship. https://doi.org/10.18130/V35Z6S.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the effects of Post-9/11 GI Bill on veterans’ college enrollment and degree attainment. The author investigated similar research questions in another study, the profile of which is available [here]. The study used regression methods in a nonexperimental analysis, drawing on data from Defense Manpower Data Center, the National Student Clearinghouse, and the Integrated Postsecondary Education Data System. The author used two statistical models to compare veterans eligible for the benefits with veterans who were not eligible. The study found a statistically significant positive relationship between the Post-9/11 GI Bill benefits and education for veterans who were eligible for the benefits and likely to take them up compared with veterans who were not eligible for the benefits and with veterans who were eligible but unlikely to take up the benefits. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Post-9/11 GI Bill; other factors are likely to have contributed.","Post-9/11 GI Bill","Other training and education","Veteran or military",,"United States",2015,https://doi.org/10.18130/V35Z6S,"Employment and Training Review Protocol" "Work outcomes after benefits counseling among veterans applying for service connection for a psychiatric condition","Rosen, M. I., Ablondi, K., Black, A. C., Mueller, L., Serowik, K. L., Martino, S., . . . Rosenheck, R. A. (2014). Work outcomes after benefits counseling among veterans applying for service connection for a psychiatric condition. Psychiatric Services, 65(12), 1426-1432.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study examined the impact of benefits counseling on employment and earnings. The study was a randomized controlled trial and collected self-reported data directly from veterans. At one month, the study did not find a statistically significant relationship between benefits counseling and employment. Looking at data across all time periods, the study found a statistically significant relationship between benefits counseling and the number of days of paid work. For the outcomes at one month, the quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects would be attributable to benefits counseling and not to other factors. However, the study did not find statistically significant effects at one month. For all other outcomes, the quality of causal evidence presented in this study is low because the study had high attrition and the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to benefits counseling; other factors are likely to have contributed.","Benefits Counseling","Health Veterans' reemployment","Veteran or military",,"United States",2014,https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4713007/,"Employment and Training Review Protocol" "CogSMART compensatory cognitive training for traumatic brain injury: Effects over 1 year","Twamley, E. W., Thomas, K. R., Gregory, A. M., Jak, A. J., Bondi, M. W., Delias, D. C., & Lohr, J. B. (2014). CogSMART compensatory cognitive training for traumatic brain injury: Effects over 1 year. Journal of Head Trauma Rehabilitation, 30(6), 391-401.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of Cognitive Symptom Management and Rehabilitation Therapy (CogSMART) and enhanced supported employment (ESE) on employment, earnings, and health outcomes. The authors conducted a randomized controlled trial that randomly assigned participants to the intervention and comparison groups. Employment data came from weekly reports on job attainment, hours worked, and wages earned. The study did not find any statistically significant relationships between CogSMART plus ESE and employment, earnings, or health outcomes. The quality of causal evidence presented in this report is low because the study had a confounding factor. Specifically, one interventionist delivered CogSMART plus ESE and another interventionist implemented services to the comparison group, which makes it impossible to separate the effect of CogSMART plus ESE from the effect of the individual interventionists. This means we are not confident that the estimated effects are attributable to CogSMART plus ESE; other factors are likely to have contributed to the findings.","CogSMART Plus ESE","Health Job search assistance and supportive services Supported employment or other employment supports Veterans' reemployment","Disability, Veteran or military",,"United States",2014,https://doi.org/10.1097/HTR.0000000000000076,"Employment and Training Review Protocol" "Military veterans marching towards entrepreneurship: An exploratory mixed methods study","Kerrick, S., Cumberland, D., Church-Nally, M., & Kemelgor, B. (2014). Military veterans marching towards entrepreneurship: An exploratory mixed methods study. International Journal of Management Education, 12(3), 469-478.","Entrepreneurship and Self-Employment","Study Type: Descriptive Analysis",,,"Summary: The study examined the relationship between an entrepreneurship education program for military veterans, VetStart, on entrepreneurship attitudes and behaviors. The VetStart program included 10 weeks of entrepreneurship courses followed by nine months of business mentorship and reimbursement of start-up business costs. Fourteen military veterans from a Midwestern community participated in the study over an 18-month period from spring 2012 to spring 2013. The authors used participants’ survey responses before and after participation in the program to measure participants’ level of entrepreneurial passion and frequency of consultations with informal networks (which included family, friends, business associates, and other entrepreneurs) about their new business ideas. The authors defined entrepreneurial passion along three dimensions: founding passion (interest in creating a new organization as an entrepreneur), inventing passion (interest in developing new products or ideas as an entrepreneur), and developing passion (interest in expanding an existing entrepreneurial idea or organization). The study found that the VetStart participants had higher levels of founding, inventing, and developing passion after the program than they did before it. The study also found that the VetStart participants consulted their informal networks regarding their business ideas more after the program than before it.",,"Mentoring Other training and education","Veteran or military",,"United States",2014,,"Employment and Training Review Protocol" "The impact of earnings disregards on the behavior of low‐income families.","Matsudaira, J. D., & Blank, R. M. (2014). The impact of earnings disregards on the behavior of low‐income families. Journal of Policy Analysis and Management, 33(1), 7-35.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-No impacts Employment Public benefits receipt-Low-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of earnings disregards—the amount of earned income that is not counted when calculating whether someone is eligible for public benefits—for welfare assistance on the employment, earnings, and public assistance receipt of low-skilled single mothers. The study used a difference-in-differences approach to compare the outcomes of women before and after changes in the disregard rate within their state relative to women in other states over the same time period. The study did not find any statistically significant effects of earnings disregards on the outcomes of interest. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design; this is the highest causal evidence rating possible for a nonexperimental design. This means we would be somewhat confident that any estimated effects would be attributable to earnings disregards, but other factors might also have contributed. However, the study did not find statistically significant effects.","Earnings Disregards for Welfare Assistance","Other employment and reemployment","Female, Parent, Low income",,"United States",2014,,"Employment and Training Review Protocol" "Cognitive Symptom Management and Rehabilitation Therapy (CogSMART) for veterans with traumatic brain injury: Pilot randomized controlled trial","Twamley, E., Jak, A., Delis, D., Bondi, M., & Lohr, J. (2014). Cognitive Symptom Management and Rehabilitation Therapy (CogSMART) for veterans with traumatic brain injury: Pilot randomized controlled trial. Journal of Rehabilitation Research and Development, 51(1), 59-70.","Disability Employment Policy, Veterans","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of adding Cognitive Symptom Management and Rehabilitation Therapy (CogSMART) to standard supported employment programming for veterans with a history of traumatic brain injury (TBI) and persistent related postconcussive symptoms. Veterans were referred to the program and completed a series of baseline neurocognitive and neuropsychological assessments to determine eligibility. Eligible veterans were randomly assigned to either the CogSMART treatment group, which received supported employment, enhanced by CogSMART sessions, or to a control group that did not participate in CogSMART sessions. The study found that veterans in the CogSMART group demonstrated statistically significant reductions in postconcussive symptoms and improvements in prospective memory functioning. Although a higher proportion of the treatment group entered competitive employment within 14 weeks of starting the program—50 percent compared to 26 percent in the control group—the difference was not statistically significant. The quality of causal evidence presented in this study is low because it is a randomized controlled trial with high or unknown attrition and no control variables included in the analysis. This means we are not confident that the estimated effects are attributable to CogSMART. Other factors are likely to have contributed.","Cognitive Symptom Management and Rehabilitation Therapy","Vocational rehabilitation Veterans' reemployment","Disability, Veteran or military",,"United States",2014,,"Disability Employment Policy, Veterans Review Protocol" "The impact of veterans’ preference on the composition and quality of the federal civil service","Lewis, G. B. (2013). The impact of veterans’ preference on the composition and quality of the federal civil service. Journal of Public Administration Research & Theory, 23(2), 247-265.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Mixed impacts Employment","Summary: The study’s objective was to examine the impact the federal practice of giving preference to veterans during the federal employment hiring process had on federal employment. The author used a nonexperimental design to compare federal employment outcomes of veterans and non-veterans, drawing on data from the 1990 and 2000 U.S. Census, the American Community Surveys from 2006–2009, and federal employee personnel records from the Central Personnel Data File from 2000–2009. The study found that the odds of federal employment compared to private-sector employment were 2.7 to 4.4 times greater for veterans than non-veterans. The study also found that veterans advanced slower than non-veterans after 5 and 10 years of employment. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the veterans’ preference policy in federal hiring; other factors are likely to have contributed.","Veterans’ Preference Policy in Hiring for Federal Government Positions","Veterans' reemployment","Veteran or military",,"United States",2013,https://academic.oup.com/jpart/article-abstract/23/2/247/1000440,"Employment and Training Review Protocol" "Veterans Health Administration vocational services for Operation Iraqi Freedom/Operation Enduring Freedom Veterans with mental health conditions","Twamley, E., Baker, D., Norman, S., Pittman, J., Lohr, J., & Resnick, S. (2013). Veterans Health Administration vocational services for Operation Iraqi Freedom/Operation Enduring Freedom Veterans with mental health conditions. Journal of Rehabilitation Research & Development, 50(5), 663-670.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: This study examined the impact of supported employment encounters on competitive employment for Operation Iraqi Freedom/Operation Enduring Freedom (OIF/OEF) veterans with mental health conditions. The study used statistical tests to examine differences between groups of OIF/OEF veterans with specified mental health conditions who had at least one supported employment encounter versus those who did not. The data for this study came from two nationwide Veterans Health Administration (VHA) databases for fiscal years 2008 and 2009. The study showed that having at least one supported employment encounter was associated with obtaining competitive employment. The quality of causal evidence presented in this report is low because the authors were not able to establish that the treatment and comparison groups were similar before the intervention. This means we are not confident that the estimated effects are attributable to VHA-supported employment encounters; other factors likely contributed to the effects.",,"Job search assistance and supportive services Veterans' reemployment","Veteran or military",,"United States",2013,https://doi.org/10.1682/jrrd.2012.08.0137,"Employment and Training Review Protocol" "STEM faculty and parental leave: Understanding an institution’s policy within a national policy context through structuration theory","Schimpf, C., Santiago, M., Hoegh, J., Banerjee, D., & Pawley, A. (2013). STEM faculty and parental leave: Understanding an institution’s policy within a national policy context through structuration theory. International Journal of Gender, Science and Technology, 5(2), 103-125.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: This study summarized the role of various factors, both within and outside a university, in shaping use of the university’s parental leave policy. The authors conducted semistructured interviews in 2009–2010 with 10 science, technology, engineering and math (STEM) faculty members (7 women and 3 men) at a Midwestern university. The interviews aimed to study the barriers STEM faculty face in using the university’s parental leave policy. The authors analyzed these data using a variety of qualitative coding techniques. The study found that faculty under-used the university’s parental leave policy for several reasons. First, the opinions of their department chairs and their peers often shaped faculty’s willingness to take parental leave. If faculty felt that their department heads, fellow faculty members, laboratory personnel, and students were supportive of parental leave policies, they were more willing to participate, because they felt less pressure to maintain their typical teaching and research workload after having a child. Additionally, the authors suggested that both knowledge of the parental leave policy and understanding of what was covered, among both the faculty themselves and their supervisors and administrators, was important to ensure that the policy was applied correctly in each specific case. The study also noted that faculty saw limitations in the university’s policy because it did not cover professional obligations outside the school, including writing and revising journal articles or managing externally funded laboratory experiments.",,"Other employer services Science, Technology, Engineering, and Math (STEM) programs","STEM professional, Parent",,"United States",2013,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Conditional cash transfers in New York City: The continuing story of the Opportunity NYC—Family Rewards demonstration","Riccio, J., Dechausay, N., Miller, C., Nunez, S., Verma, N., & Yang E. (2013). Conditional cash transfers in New York City: The continuing story of the Opportunity NYC—Family Rewards demonstration. New York, NY: MDRC.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employer benefits receipt-Mod/high-Favorable impacts Employer benefits receipt Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of Family Rewards, an experimental privately funded conditional cash transfer program in New York City, on earnings, employment, public benefits receipt, and education. The study was based on a randomized controlled trial and estimated the effect of the Family Rewards program on low-income families. The authors used New York City and New York State administrative data to compare average outcomes between families offered access to the program and families excluded from the program, after adjusting for chance initial differences between the groups. The authors found that, on average, the Family Rewards program decreased the likelihood of ever being employed at an Unemployment Insurance (UI)-covered job in the first year by 2 percentage points, but increased monthly earnings by $353 and decreased the share of families receiving income from Supplemental Security Income (SSI) or disability benefits by 3.9 percentage points. The authors also found that parents in the Family Rewards program group were 4.2 percentage points more likely to have achieved any trade license training certification. The quality of causal evidence presented in this report is high for most outcomes because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Family Rewards program, and not to other factors. However, some outcomes in the study receive a moderate or low causal evidence rating, meaning that we are less confident that the estimated effects are attributable to the Family Rewards program; other factors may have contributed.","the Family Rewards Program","Other employment and reemployment Other training and education","Low income, Parent",,"United States, Urban",2013,http://files.eric.ed.gov/fulltext/ED545453.pdf,"Employment and Training Review Protocol" "Evaluating the impact of dental care on housing intervention program outcomes among homeless veterans","Nunez, E., Gibson, G., Jones, J. A., & Schinka, J. A. (2013). Evaluating the impact of dental care on housing intervention program outcomes among homeless veterans. American Journal of Public Health, 103(S2), S368-S373.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study examined the impact of the Veterans Affairs (VA) Homeless Veteran Dental Program on employment outcomes of homeless veterans. The authors used VA administrative data to compare the employment outcomes of veterans who received dental care through the VA Homeless Veteran Dental Program with those of veterans who did not. The study found that participating in the VA Homeless Veteran Dental Program was associated with greater employment and financial stability. The quality of causal evidence presented in this report is low because the authors did not ensure the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the VA Homeless Veteran Dental Program; other factors are likely to have contributed.","VA Homeless Veteran Dental Program","Health Veterans' reemployment","Veteran or military, Homeless",,"United States",2013,https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3969121/,"Employment and Training Review Protocol" "Effects of structured vocational services in ex-offender veterans with mental illness: 6-month follow-up","LePage, J. P., Lewis, A. A., Washington, E. L., Davis, B., & Glasgow, A. (2013). Effects of structured vocational services in ex-offender veterans with mental illness: 6-month follow-up. Journal of Rehabilitation Research & Development, 50(2), 183-191. doi:10.1682/JRRD.2011.09.0163 [Self-study vs. VERC]","Reentry, Veterans","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-No impacts Employment","Summary: The study examined the impact of self-study of the About Face (AF) manual on competitive employment. In this nonexperimental study, the authors used statistical analyses to compare the employment outcomes of two groups of justice-involved veterans: (1) those who had access to the AF manual to study on their own (self-study program) and (2) those who only had access to the Veterans Employment Resource Center (VERC). The authors collected monthly data from participants in person or over the phone. The study showed no significant differences in competitive employment between the self-study condition (11.9 percent hired) and the VERC-only condition (16.7 percent hired). The study also showed no significant differences in average months employed (0.16 months for the self-study condition and 0.35 months for the VERC-only condition). The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the AF manual; other factors likely contributed to the findings.","About Face","Job search assistance and supportive services Veterans' reemployment","Veteran or military",,"United States",2013,https://www.rehab.research.va.gov/JOUR/2013/502/pdf/lepage502.pdf,"Reentry, Veterans Review Protocol" "Why academic STEM mothers feel they have to work harder than others on the job","Kmec, J. (2013a). Why academic STEM mothers feel they have to work harder than others on the job. International Journal of Gender, Science, & Technology, 5(2), 80-101.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: This report analyzed faculty members’ perceptions of how hard they have to work at their job based on their sex and parental status, specifically in the context of science, technology, engineering, and mathematics (STEM) disciplines that are typically characterized by a masculine work culture. The objective was to contribute to the knowledge base on gender issues in academic professions and the specific challenges that working mothers in STEM fields face. The study used data from the 2011 Faculty Caregiving and Workplace and Culture survey administered online to about 300 tenure-line faculty members in all disciplines at a large public U.S. university. The author conducted regression analyses to estimate the link between faculty members’ sex, parental status, academic discipline, and their level of agreement with the statement, “My job requires me to work very hard.” The regression controlled for several factors that might affect faculty members’ perceptions of how hard they have to work at their job, such as length of time at current institution, academic rank, perceived job demand levels, feelings of being valued, marital status, age of children, household/family responsibilities, and degree to which household responsibilities are perceived to affect job performance. The study found that mothers in STEM fields were more likely to strongly agree that they have to work very hard at their job, compared to fathers in both STEM and non-STEM fields and mothers in non-STEM fields, after controlling for a number of factors related to perceptions of effort required. Specifically, fathers in STEM and non-STEM fields were 84 percent and 92 percent less likely, respectively, to strongly agree that they have to work very hard at their job than mothers in STEM fields. Similarly, mothers in non-STEM fields were about 81 percent less likely than mothers in STEM fields to agree that they have to work very hard at their job.",,"Science, Technology, Engineering, and Math (STEM) programs Other disparities or discrimination in employment and earnings","Female, Male, STEM professional, Parent",,"United States",2013,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Effects of structured vocational services in ex-offender veterans with mental illness: 6-month follow-up","LePage, J. P., Lewis, A. A., Washington, E. L., Davis, B., & Glasgow, A. (2013). Effects of structured vocational services in ex-offender veterans with mental illness: 6-month follow-up. Journal of Rehabilitation Research & Development, 50(2), 183-191. doi:10.1682/JRRD.2011.09.0163 [Full About Face vs. VERC]","Reentry, Veterans","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study examined the impact of About Face (AF) vocational classes on competitive employment. In this nonexperimental study, the authors used statistical analyses to compare the employment outcomes of two groups of veterans: (1) those who participated in the AF classes (full AF program) and (2) those who only had access to the Veterans Employment Resource Center (VERC). The authors collected monthly data from participants in person or over the phone. The study revealed significantly higher competitive employment in the full AF program (40.7 percent hired) than in the VERC-only condition (16.7 percent hired). The study also showed that veterans in the full AF program worked more months on average than veterans in the VERC-only condition (1.37 months vs. 0.35 months). The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the AF program; other factors likely contributed to the findings.","About Face","Job search assistance and supportive services Veterans' reemployment","Veteran or military",,"United States",2013,https://www.rehab.research.va.gov/JOUR/2013/502/pdf/lepage502.pdf,"Reentry, Veterans Review Protocol" "Effects of structured vocational services in ex-offender veterans with mental illness: 6-month follow-up","LePage, J. P., Lewis, A. A., Washington, E. L., Davis, B., & Glasgow, A. (2013). Effects of structured vocational services in ex-offender veterans with mental illness: 6-month follow-up. Journal of Rehabilitation Research & Development, 50(2), 183-191. doi:10.1682/JRRD.2011.09.0163 [Full About Face vs. self-study]","Reentry, Veterans","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: This study examined the impact of About Face (AF) vocational classes on competitive employment. In this nonexperimental study, the authors used statistical analyses to compare the employment outcomes of two groups of justice-involved veterans: (1) those who participated in the AF classes (full AF program) and (2) those who did not take the classes but had access to the AF manual to study on their own (self-study program). The authors collected monthly data from participants in person or over the phone. The study revealed significantly higher competitive employment among justice-involved veterans in the full AF program (40.7 percent hired) than in the self-study condition (11.9 percent hired). The study also showed that justice-involved veterans in the full AF program worked more months on average than justice-involved veterans in the self-study condition (1.37 months vs. 0.16 months). The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the AF program; other factors likely contributed to the findings.","About Face","Job search assistance and supportive services Veterans' reemployment","Veteran or military",,"United States",2013,https://www.rehab.research.va.gov/JOUR/2013/502/pdf/lepage502.pdf,"Reentry, Veterans Review Protocol" "From the shop floor to the kitchen floor: Maternal occupational complexity and children’s reading and math skills","Yetis-Bayraktar, A., Budig, M., & Tomaskovic-Devey, D. (2013). From the shop floor to the kitchen floor: Maternal occupational complexity and children’s reading and math skills. Work and Occupations, 40(1), 37-64.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The authors sought to determine whether the complexity of a mother’s occupation (or the quality of employment as defined by its task complexity, autonomy, and authority) affected her 6- to 13-year-old children’s math and reading test scores. The study considered both the complexity of the mother’s occupation when her children were ages 6 to 13 as well as the complexity of her occupation in her children’s earliest years (birth to age 3). The authors analyzed data from the 1984–1996 Panel Study of Income Dynamics and its 1997 Child Development Supplement to determine the relationship between maternal occupational complexity and children’s scores on the Revised Woodcock-Johnson Test of Achievement. The analysis first accounted for traits associated with mothers’ employment status, that is, whether the mother was employed. Assuming the mother was employed, the authors then assessed the association between the complexity of the mother’s occupation and her children’s performance on the reading and math sections of the test. The study found that a one-point increase on the maternal white collar occupational complexity scale was associated with a 2.49-point increase in children’s test scores, whereas a one-point increase on the blue collar occupational complexity scale corresponded to a 1.01-point gain in test scores. Maternal occupational complexity during the child’s first three years also was associated with increased test scores later in life; a one-point gain in white collar occupational complexity in the first three years of the child’s life was associated with a 3.7-point increase in test scores when the child was ages 6 to 13.",,"Other employment and reemployment","Employed, Female, Parent",,"United States",2013,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Helping parents to motivate adolescents in mathematics and science: An experimental test of a utility-value intervention","Harackiewicz, J., Rozek, C., Hulleman, C., & Hyde, J. (2012). Helping parents to motivate adolescents in mathematics and science: An experimental test of a utility-value intervention. Psychological Science, 23(8), 899-906.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of providing information to parents about the importance of STEM on their children’s decisions to enroll in advanced high school math and science courses. The study was based on a subsample of 188 students and their parents included in the Wisconsin Study of Families and Work (WSFW) 1990–1991 birth cohort. Students were randomly assigned at the end of 9th grade to either a treatment group that was given brochures and access to a website that promoted STEM at the beginning of 10th grade, or to the control group, to which no materials were provided. The authors measured STEM course enrollment using students’ self-reported responses to the WSFW surveys and the students’ high school transcripts. The study found that students in the treatment group took significantly more math and science classes than students in the control group (predicted means of 8.31 versus 7.50 semesters), but outcomes did not vary by gender. The quality of causal evidence provided in this study is high. This means we are confident that the estimated effects are attributable to the information provided to parents about the importance of STEM, and not to other factors.",,"Science, Technology, Engineering, and Math (STEM) programs Youth programs","Adult, Parent",,"United States",2012,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "What strategies work for the hard-to-employ? Final results of the Hard-to-Employ demonstration and evaluation project and selected sites from the Employment Retention and Advancement project. [Minnesota Tier 2]","Butler, D., Alson, J., Bloom, D., Deitch, V., Hill, A., Hsueh, J., Jacobs, E., Kim, S., McRoberts, R., & Redcross, C. (2012). What strategies work for the hard-to-employ? Final results of the Hard-to-Employ demonstration and evaluation project and selected sites from the Employment Retention and Advancement project. (OPRE report 2012-08). Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. [Minnesota Tier 2]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study examined the impact of the Minnesota Tier 2 program on employment, earnings, and receipt of public assistance for unemployed single parents. The study was a randomized controlled trial. The authors estimated the impact of the Tier 2 program by comparing the outcomes of the treatment and control groups four years after random assignment using data from Minnesota public assistance records and Unemployment Insurance wage records. The study found no statistically significant relationships between the Minnesota Tier 2 program and employment, earnings, or receipt of public assistance. The quality of causal evidence presented in this report is high for the employment and earnings outcomes because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects on earnings and employment would be attributable to the Minnesota Tier 2 program, and not to other factors. The public assistance outcomes receive a low rating, which means we would not be confident that any estimated effects on public assistance would be attributable to the Minnesota Tier 2 program; other factors are likely to have contributed. However, the study did not find any statistically significant effects on employment, earnings, or benefit receipt.","the Minnesota Tier 2 Program","Other employment and reemployment Substance abuse recovery","Low income, Parent",,"United States",2012,http://www.acf.hhs.gov/sites/default/files/opre/strategies_work.pdf,"Employment and Training Review Protocol" "Changes in social adjustment with cognitive processing effects of treatment and association with PTSD symptoms","Monson, C. M., Macdonald, A., Vorstenbosch, V., Schnaider, P., Goldstein, E. S. R., Ferrier-Auerbach, A. G., & Mocciola, K. E. (2012). Changes in social adjustment with cognitive processing effects of treatment and association with PTSD symptoms. Journal of Traumatic Stress, 25, 519-526.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages","Summary: The study’s objective was to examine the impact of cognitive processing therapy on earnings. The study is a randomized controlled trial that collected self-reported data directly from veterans. There were no statistically significant relationships between cognitive processing therapy and earnings. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to cognitive processing therapy; other factors are likely to have contributed.","Cognitive Processing Therapy",Health,"Veteran or military",,"United States",2012,https://cptforptsd.com/wp-content/uploads/2016/11/Monson-Macdonald_2012_JTS-soc…,"Employment and Training Review Protocol" "Increasing opportunities for low-income women and student parents in science, technology, engineering, and math at community colleges","Costello, C. (2012). Increasing opportunities for low-income women and student parents in science, technology, engineering, and math at community colleges. Washington, DC: Institute for Women’s Policy Research.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: This study examined the enrollment patterns for low-income women and students with children (including mostly mothers and some fathers, collectively referred to as student parents) in STEM fields at community colleges in the United States, comparing outcomes for 2000–2001 to 2008–2009. In addition, the study presented examples of promising strategies to encourage low-income women and student parents to participate in STEM education at community colleges. To assess the involvement of low-income women and student parents in STEM fields at community colleges, the author analyzed publicly available data, including data from the U.S. Department of Labor and the National Center for Education Statistics at the U.S. Department of Education. The author also completed a review of existing programs at community colleges that encourage low-income women and student parents to participate in STEM fields, and consulted with 16 experts to formulate suggestions for additional programs to support these students in STEM fields. The study found that in the 2008–2009 school year, women earned 22 percent of associate’s degrees awarded in STEM fields—a 7 percentage point reduction in the proportion of STEM associate degrees earned by women eight years earlier. The study also found that, in 2008, roughly one-third of community college students were parents and student parents with children younger than 12 who ultimately earned a baccalaureate or master’s degree in a STEM field were more likely to have attended a community college at some point than students without young children. Given the decline in women’s share of STEM associate degrees earned over the study observation period, as well as the high proportion of student parents in STEM fields who attend community colleges (compared with students without young children), the author highlighted potential strategies to increase and improve the involvement of low-income women and student parents in STEM fields at community colleges, including targeted recruitment, financial support, child care services, strong developmental education options, and specific counseling and academic support for women. These recommendations were informed by information gathered from existing programs and consultation with experts.",,"Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Female, Male, Parent, Low income",,"United States",2012,http://www.iwpr.org/initiatives/student-parent-success-initiative/increasing-op…,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Enhanced Early Head Start with employment services: 42-month impacts from the Kansas and Missouri sites of the Enhanced Services for the Hard-to-Employ Demonstration and Research Project","Hsueh, J., and Farrell, M. (2012). Enhanced Early Head Start with employment services: 42-month impacts from the Kansas and Missouri sites of the Enhanced Services for the Hard-to-Employ Demonstration and Research Project. OPRE Report 2012-05. Washington DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of Enhanced Early Head Start (EHS) participation on employment, earnings, and public assistance receipt for low-income families with young children. The study used a randomized controlled trial design, assigning eligible families to either the Enhanced EHS program or existing services. To estimate the program’s impacts, the authors used administrative employment and earnings data, as well as a 42-month follow-up survey emphasizing respondents’ employment, income, and public assistance receipt. Outcomes were adjusted for characteristics before random assignment. The study found that the longest period of continuous employment during the 3.5-year follow-up period was, on average, 2.5 months shorter for mothers in the Enhanced EHS group than mothers in the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to Enhanced EHS services, and not to other factors.","Enhanced Early Head Start","Other employment and reemployment","Low income, Parent",,"United States, Rural",2012,http://www.acf.hhs.gov/sites/default/files/opre/kansas_missouri.pdf,"Employment and Training Review Protocol" "Effectiveness of supported employment for veterans with spinal cord injuries: Results from a randomized multisite study","Ottomanelli, L., Goetz, L. L., Suris, A., McGeough, C., Sinnott, P. L., Toscano, R., … Thomas, F. P. (2012). Effectiveness of supported employment for veterans with spinal cord injuries: Results from a randomized multisite study. Archives of Physical Medicine and Rehabilitation, 93(5), 740-747.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The study aimed to examine the impact of supported employment on the employment outcomes of veterans with spinal cord injuries. The study included a randomized controlled trial and collected self-reported data directly from veterans and chart review data from the spinal cord injury centers in six Veterans Affairs Medical Centers (VAMCs) to obtain demographic information. The study found statistically significant positive impacts on employment as a result of supported employment compared to treatment as usual. The quality of causal evidence presented in the report is high because it used a well-implemented experimental design. This means that we are confident that the estimated effects are attributable to supported employment and not to other factors.","Individual Placement and Support (IPS) model of supported employment","Veterans' reemployment","Disability, Veteran or military",,"United States",2012,https://doi.org/10.1016/j.apmr.2012.01.002,"Employment and Training Review Protocol" "A randomized controlled trial of supported employment among veterans with posttraumatic stress disorder","Davis, L., Leon, A., Toscano, R., Drebing, C., Ward, L., Parker, P., ..., & Drake, R. (2012). A randomized controlled trial of supported employment among veterans with posttraumatic stress disorder. Psychiatric Services, 63(5), 464-470.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of individual placement and support (IPS) on competitive employment, earnings, and income for U.S. military veterans with posttraumatic stress disorder (PTSD). The study was a randomized controlled trial conducted at the Tuscaloosa Veterans Affairs (VA) Medical Center. Treatment group members received IPS services, whereas the control group received standard Vocational Rehabilitation Program (VRP) services. Data sources included patients’ records from the clinical research coordinator and daily logs completed by participants. The study found that IPS had positive impacts on competitive employment and gross income. The quality of causal evidence presented in this report is high because it is based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to IPS, and not other factors.","Individual Placement and Support and Vocational Rehabilitation Program","Vocational rehabilitation Veterans' reemployment Supported employment or other employment supports","Disability, Veteran or military",,"United States",2012,,"Disability Employment Policy Review Protocol" "Effectiveness of supported employment for veterans with spinal cord injuries: Results from a randomized multisite study","Ottomanelli, L., Goetz, L. L., Suris, A., McGeough, C., Sinnott, P. L., Toscano, R., … Thomas, F. P. (2012). Effectiveness of supported employment for veterans with spinal cord injuries: Results from a randomized multisite study. Archives of Physical Medicine and Rehabilitation, 93(5), 740-747. [CONTRAST 1: Non-experimental study]",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study examined the impact of supported employment on the employment outcomes for veterans with spinal cord injuries. The authors used statistical comparisons in a non-experimental analysis to estimate the relationship between supported employment services and employment, drawing on self-reported data for employment information and chart review data from the spinal cord injury centers in six Veterans Affairs Medical Centers to obtain demographic information . The study found statistically significant positive relationships between supported employment and veterans’ employment outcomes compared to treatment as usual. The quality of causal evidence presented in the report is low because there are preexisting differences between the intervention and comparison groups. This means we are not confident that the estimated effects are attributable to supported employment; other factors are likely to have contributed.","Individual Placement and Support (IPS) model of supported employment","Veterans' reemployment","Disability, Veteran or military",,"United States",2012,https://doi.org/10.1016/j.apmr.2012.01.002,"Employment and Training Review Protocol" "The effects of hiring tax credits on employment of disabled veterans","Heaton, P. (2012). The effects of hiring tax credits on employment of disabled veterans. Santa Monica, CA: Rand Corporation. Occasional Paper. Retrieved from https://www.rand.org/content/dam/rand/pubs/occassional papers/2012/RAND_OP 366.pdf.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study examined the impact of the 2007 Work Opportunity Tax Credit (WOTC) on the employment and earnings outcomes among veterans with disabilities. The authors used a nonexperimental approach and data from the American Community Survey Public Use Microdata Sample to compare the employment and earnings outcomes of veterans who were eligible for the WOTC with those of veterans who were not. The study found an approximately 2 percentage point increase in employment, a 0.58 hour increase in weekly hours, and a 40 percent increase in wage income among veterans with disabilities who were eligible for WOTC compared to veterans and nonveterans with other characteristics. The quality of causal evidence presented in this report is moderate because it relied on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the WOTC program, but other factors might also have contributed to the findings.","Work Opportunity Tax Credit","Veterans' reemployment Work Opportunity Tax Credit (WOTC)","Disability, Veteran or military",,"United States",2012,https://www.rand.org/pubs/occasional_papers/OP366.html,"Employment and Training Review Protocol" "Effects of structured vocational services on job-search success in ex-offender veterans with mental illness: 3-month follow-up","LePage, J. P., Washington, E. L., Lewis, A. A., Johnson, K. E., & Garcia-Rea, E. (2011). Effects of structured vocational services on job-search success in ex-offender veterans with mental illness: 3-month follow-up. Journal of Rehabilitation Research & Development, 48(3), 277-286. [Self-study vs. VERC]","Reentry, Veterans","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-No impacts Employment","Summary: The study examined the impact of self-studying the About Face (AF) manual on competitive employment. In this nonexperimental study, the authors used statistical analyses to compare the employment outcomes of two groups of justice-involved veterans: (1) those who had access to the AF manual to study on their own (self-study program) and (2) those who only had access to the Veterans Employment Resource Center (VERC). The authors collected biweekly data from participants in person or over the phone. The study showed no significant differences in competitive employment between the self-study condition (3 percent hired) and the VERC-only condition (0 percent hired). The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the AF manual; other factors likely contributed to the findings.","About Face","Job search assistance and supportive services Veterans' reemployment","Veteran or military",,"United States",2011,https://www.rehab.research.va.gov/jour/11/483/pdf/page277.pdf,"Reentry, Veterans Review Protocol" "Residential treatment for homeless female veterans with psychiatric and substance use disorders: Effect on 1-year clinical outcomes","Harpaz-Rotem, I., Rosenheck, R. A., & Desai, R. (2011). Residential treatment for homeless female veterans with psychiatric and substance use disorders: Effect on 1-year clinical outcomes. Journal of Rehabilitation Research & Development, 48(8), 891-899.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The study examined the impact of community residential treatment on female veterans’ employment and health outcomes. The study team used statistical tests to examine the differences between two groups: (1) people who were offered at least 30 or more days of residential treatment (RT) services at Veterans Affairs (VA) medical centers and (2) people who were not offered these services or were offered these services for less than 30 days. The data for this study came from case managers, discharge summaries, interviews, and standardized self-reported measures. The study showed that receiving RT services was associated with a greater number of days worked but with mixed results on health outcomes. The quality of causal evidence presented in this report is moderate because it is based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the RT program, but other factors might also have contributed to the effects.","Residential Treatment","Health Veterans' reemployment","Female, Veteran or military",,"United States",2011,https://www.researchgate.net/profile/Ilan_Harpaz-Rotem/publication/51784250_Res…,"Employment and Training Review Protocol" "Effects of structured vocational services on job-search success in ex-offender veterans with mental illness: 3-month follow-up","LePage, J. P., Washington, E. L., Lewis, A. A., Johnson, K. E., & Garcia-Rea, E. (2011). Effects of structured vocational services on job-search success in ex-offender veterans with mental illness: 3-month follow-up. Journal of Rehabilitation Research & Development, 48(3), 277-286. [Full About Face vs. self-study]","Reentry, Veterans","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: This study examined the impact of About Face (AF) vocational classes on competitive employment. In this nonexperimental study, the authors used statistical analyses to compare the employment outcomes of two groups of veterans: (1) those who took the AF classes (full AF program) and (2) those who did not take the classes but had access to the manual to study on their own (self-study program). The authors collected biweekly data from participants in person or over the phone. The study revealed significantly higher competitive employment among veterans in the full AF program (23.8 percent hired) than in the self-study condition (3 percent hired). The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the AF program; other factors likely contributed to the findings.","About Face","Job search assistance and supportive services Veterans' reemployment","Veteran or military",,"United States",2011,https://www.rehab.research.va.gov/jour/11/483/pdf/page277.pdf,"Reentry, Veterans Review Protocol" "Mothers of invention: Gender, motherhood, and new dimensions of productivity in the science profession","Whittington, K. (2011). Mothers of invention: Gender, motherhood, and new dimensions of productivity in the science profession. Work and Occupations, 38(3), 417-456.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study's objective was to determine whether women, specifically mothers, in STEM academic or industry jobs were less likely to participate in the patenting process than fathers and childless men in the same field. In addition, the study sought to examine whether previous experience with patenting reduced gender or motherhood inequalities in patenting participation. The study analyzed survey data from the April 1995 and April 2001 waves of the Survey of Doctorate Recipients, a longitudinal study of research doctorates conducted by the National Science Foundation. The author restricted the sample to scientists in four-year colleges and in business or industry who worked in computer and mathematical sciences, life sciences, physical sciences, and engineering; were active in applied and basic research, development, or design; and worked full time. Respondents were asked if they had been named as an inventor on a U.S. patent application in the past five or six years. The author estimated logistic regression models to determine whether females, and specifically mothers, were less likely to have received a patent in the past five or six years. The author also conducted additional analyses to determine if previous experience with patenting affected patenting participation. The study found that in academia, among those surveyed at both rounds, mothers were no less likely to patent than males, including fathers, or childless females after controlling for prior patenting experience. In industry, among those surveyed in both rounds, married, childless women were less likely to patent than childless women, even after controlling for prior patenting experience. The authors estimated numerous other models that found mixed effects of gender, marital status, and parenthood on the likelihood of scientists participating in patenting activities.",,"Science, Technology, Engineering, and Math (STEM) programs Other disparities or discrimination in employment and earnings","Female, STEM professional, Parent",,"United States",2011,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Schooling and the Vietnam-era GI bill: Evidence from the draft lottery","Angrist, J. D., & Chen, S. H. (2011). Schooling and the Vietnam-era GI bill: Evidence from the draft lottery. American Economic Journal: Applied Economics, 3(2), 96-118.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine the impact of the G.I. Bill on education, employment, earnings. The authors used a nonexperimental comparison group analysis to estimate the impact of the Vietnam-era G.I. Bill on outcomes. The approach compared the outcomes of Vietnam-era veterans and non-veterans in 1999 using the 1-in-6 long form sample of the 2000 U.S. Census. The authors found that, compared with White male non-veterans, Vietnam-era White male veterans eligible for the draft and the G.I. Bill had significantly more years of schooling and were significantly more likely to have earned secondary and postsecondary degrees. The study found no statistically significant relationships between veteran status and employment or earnings. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the G.I. Bill and not to other factors.","the WWII G.I. Bill","Veterans' reemployment Community college education and other classroom training","Veteran or military",,"United States",2011,https://www.aeaweb.org/articles?id=10.1257/app.3.2.96,"Employment and Training Review Protocol" "Effects of structured vocational services on job-search success in ex-offender veterans with mental illness: 3-month follow-up","LePage, J. P., Washington, E. L., Lewis, A. A., Johnson, K. E., & Garcia-Rea, E. (2011). Effects of structured vocational services on job-search success in ex-offender veterans with mental illness: 3-month follow-up. Journal of Rehabilitation Research & Development, 48(3), 277-286. [Full About Face vs VERC]","Reentry, Veterans","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study examined the impact of About Face (AF) vocational classes on competitive employment. In this nonexperimental study, the authors used statistical analyses to compare the employment outcomes of two groups of justice-involved veterans: (1) those who participated in the AF classes (full AF program) and (2) those who only had access to the Veterans Employment Resource Center (VERC). The authors collected biweekly data from participants in person or over the phone. The study revealed significantly higher competitive employment among justice-involved veterans in the full AF program (23.8 percent hired) than in the VERC condition (0 percent hired). The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the AF program; other factors likely contributed to the findings.","About Face","Job search assistance and supportive services Veterans' reemployment","Veteran or military",,"Urban, United States",2011,https://www.rehab.research.va.gov/jour/11/483/pdf/page277.pdf,"Reentry, Veterans Review Protocol" "A two-generational child-focused program enhanced with employment services: Eighteen-month impacts from the Kansas and Missouri sites of the enhanced services for the Hard-to-Employ Demonstration and Evaluation project","Hsueh, J., Jacobs, E., & Farrell, M. (2011). A two-generational child-focused program enhanced with employment services: Eighteen-month impacts from the Kansas and Missouri sites of the enhanced services for the Hard-to-Employ Demonstration and Evaluation project. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Low-No impacts Education and skills gains Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of Enhanced Early Head Start (EHS) participation on employment, earnings, public assistance receipt, and education for low-income families with young children. The study used a randomized controlled trial design, assigning eligible families to either the Enhanced EHS program or existing services. To estimate the program’s impacts, the authors used administrative employment and earnings data, as well as an 18-month follow-up survey emphasizing respondents’ employment, income, and other outcomes. Outcomes were adjusted for characteristics before random assignment. The study did not find any statistically significant effects on employment, earnings, public assistance receipt, or education. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects would be attributable to Enhanced EHS services and not to other factors. However, the study did not find statistically significant effects.","Enhanced Early Head Start (EHS)","Other employment and reemployment Other training and education","Low income, Parent",,"United States",2011,http://www.acf.hhs.gov/sites/default/files/opre/two_generational.pdf,"Employment and Training Review Protocol" "Participation in the transition assistance program and job placement outcomes of U.S. veterans","Silva, E. (2011). Participation in the transition assistance program and job placement outcomes of U.S. veterans. (Publication No. AAI1491543) [Master’s dissertation, University of Rhode Island]. ProQuest.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the Transition Assistance Program (TAP) on employment success—an outcome that reflects both employment and the desired number of work hours. The study involved a nonexperimental comparison group analysis that compared veterans who participated in TAP to those who did not, using data from the Current Population Survey and Veterans Supplement. The study showed no statistically significant relationship between TAP and veterans’ employment success. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we could not be confident that any estimated effects would be attributable to TAP and not to other factors. However, the study did not show any statistically significant effects.","the Transition Assistance Program","Job search assistance and supportive services Veterans' reemployment","Veteran or military",,"United States",2011,https://digitalcommons.uri.edu/dissertations/AAI1491543/,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. [Texas ERA—Forth Worth]","Hendra, R., Dillman, K.-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [Texas ERA—Forth Worth]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on welfare recipients’ employment and benefits receipt outcomes after four years. The Fort Worth site was one of three in Texas that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,572 unemployed single-parent participants in Fort Worth’s Temporary Assistance for Needy Families (TANF) program to either a treatment group that received ERA services or a control group that received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records and a survey administered 12 months after random assignment. The study found that, compared with the control group, those in the Fort Worth ERA group received on average $162 more per year in Food Stamps across the first four years after random assignment. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to the ERA program and not to other factors.","the Employment Retention and Advancement project, Fort Worth","Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States, Urban",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models [TAAG—Medford]","Hendra, R., Dillman, K-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [TAAG—Medford]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of post-employment job supports on former and current public assistance recipients’ employment and benefits receipt outcomes after three years. The Medford site was one of four in Oregon that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,164 employed single parents who were former or current public assistance recipients to either a treatment group that received services from Medford’s ERA project (Transition, Advancement, and Growth, or TAAG), or a control group that could participate in other programs in the community. The authors analyzed data from Unemployment Insurance (UI), Temporary Assistance for Needy Families (TANF), and Food Stamps administrative records and a survey administered 12 months after random assignment. The study found that those assigned to the Medford ERA project earned, on average, $41 more per week when surveyed one year after random assignment than those in the control group. However, treatment group members were also 6.7 percentage points more likely to have ever received Food Stamps at the three-year follow-up than those in the control group. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to the Medford ERA project and not to other factors.","the Employment Retention and Advancement Project, Medford","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent, Employed",,"United States",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models [RFS-Los Angeles]","Hendra, R., Dillman, K.-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [RFS-Los Angeles]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of individualized and flexible post-employment job supports on employed welfare recipients’ employment and benefits receipt outcomes after three years. The Los Angeles Reach for Success (RFS) site was one of two in Los Angeles that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 5,700 employed single-parent participants in Los Angeles’s Temporary Assistance for Needy Families (TANF) program who were working full-time to either a treatment group that received RFS services or to a control group that received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records and surveys administered 12 and 42 months after random assignment. The study found that, 12 to 42 months after random assignment, RFS group members’ employment, earnings, and benefits receipt did not differ significantly from those of control group members. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we are confident that any estimated effects would be attributable to Los Angeles’ RFS and not to other factors. However, the study did not find statistically significant effects.","Reach for Success (RFS)","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States, Urban",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. [Texas ERA—Corpus Christi]","Hendra, R., Dillman, K-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [Texas ERA—Corpus Christi]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on welfare recipients’ employment and benefits receipt outcomes after four years. The Corpus Christi site was one of three in Texas that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,727 unemployed single-parent participants in Corpus Christi’s Temporary Assistance for Needy Families (TANF) program to either a treatment group that received ERA services or a control group that received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records and a survey administered 12 months after random assignment. The study found that, compared with the control group, those in the Corpus Christi ERA group were more likely to be employed at all or for four consecutive quarters in the fourth year after random assignment. Corpus Christi ERA group members also had higher earnings and received lower Food Stamps benefits. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to the ERA program and not to other factors.","the Employment Retention and Advancement project, Corpus Christi","Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States, Urban",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models [PROGRESS—Eugene]","Hendra, R., Dillman, K-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [PROGRESS—Eugene]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of post-employment job supports on former welfare recipients’ employment and benefits receipt outcomes after three years. The Eugene site was one of four in Oregon that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,179 employed single parents who were former Temporary Assistance for Needy Families (TANF) program participants to either a treatment group that received employment retention services from Eugene’s Progress Towards Retention, Opportunities, Growth, Enhancement and Self-Sufficiency (PROGRESS) program or a control group that could participate in other employment-related programs in the community. The authors analyzed data from Unemployment Insurance (UI), Temporary Assistance for Needy Families (TANF), and Food Stamps administrative records and a survey administered 12 months after random assignment. The study found that those in the PROGRESS group were 7 percentage points less likely than control group members to be employed in the third year after random assignment and 6.6 percentage points less likely to have been employed in every quarter of that year. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to the Eugene ERA program and not to other factors.","the Employment Retention and Advancement Project, Eugene","Other employment and reemployment Unemployment Insurance","Employed, Low income, Parent",,"United States",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf,"Employment and Training Review Protocol" "Toward reduced poverty across generations: Early findings from New York City’s conditional cash transfer program","Riccio, J., Dechausay, N., Greenberg, D., Miller, C., Rucks, Z., and Verma, N. (2010). Toward reduced poverty across generations: Early findings from New York City’s conditional cash transfer program. New York: MDRC.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of Family Rewards, an experimental privately funded conditional cash transfer program in New York City, on earnings, employment, public benefits receipt, and education. The study was based on a randomized controlled trial and estimated the effect of the Family Rewards program on low-income families. The authors used New York City and New York State administrative data to compare average outcomes among those offered access to the program against the average outcomes of those excluded, after adjusting for chance initial differences between the groups. The study found that, on average, the Family Rewards program decreased the likelihood of ever being employed at a job covered by unemployment insurance (UI) in the first year. However, the Family Rewards program increased the likelihood of being employed at a job not covered by UI after 18 months, total monthly income after 18 months, and the likelihood that adult recipients had received an associate’s degree after 18 months. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Family Rewards program, and not to other factors.","the Family Rewards Program","Other employment and reemployment Other training and education Unemployment Insurance","Unemployed, Low income, Parent",,"United States",2010,http://www.mdrc.org/sites/default/files/FamRewards2010ONYC%20FULL%20Report%20RE…,"Employment and Training Review Protocol" "Veterans Health Administration transitional work experience vs. job placement in veterans with co-morbid substance use and non-psychotic psychiatric disorders","Penk, W., Drebing, C.E., Rosenheck, R.A., Krebs, C., Van Ormer, A., & Mueller, L. (2010). Veterans Health Administration transitional work experience vs. job placement in veterans with co-morbid substance use and non-psychotic psychiatric disorders. Psychiatric Rehabilitation Journal, 33(4), 297-307.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study ’s objective was to examine the impact of a transitional work experience (TWE) program, within the Veterans Health Administration’s (VHA’s) Compensated Work Therapy (CWT) program, on outcomes related to employment and earnings for veterans with certain psychiatric diagnoses and substance use disorders. The study used a randomized controlled trial design and compared treatment and control groups on self-reported employment and earnings outcomes, which were collected 6 and 12 months after enrollment in the study. The study found that those who participated in TWE (the treatment group) worked more total hours and more weeks, and earned more income, over the 12-month period than the control group. The quality of causal evidence presented in this report is low for employment and earnings outcomes because the randomized controlled trial design was compromised and authors did not account for existing differences between the treatment and control groups. This means we are not confident that the estimated effects are attributable to the transitional work experience program; other factors are likely to have contributed.","the Compensated Work Therapy transitional work experience program","Other health and safety Substance abuse recovery Veterans' reemployment","Other barriers, Veteran or military",,"United States",2010,https://psycnet.apa.org/record/2010-08280-008,"Employment and Training Review Protocol" "Working toward Wellness: Telephone care management for Medicaid recipients with depression, eighteen months after random assignment.","Kim, S., LeBlanc, A., Morris, P., Simon, G., & Walter, J. (2010). Working toward Wellness: Telephone care management for Medicaid recipients with depression, eighteen months after random assignment. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine the impacts of a telephone care management program, Working toward Wellness (WtW), on low-income depressed parents’ employment and earnings. The study used a randomized controlled trial design, assigning eligible parents to either the WtW program or existing services. Authors used data from an 18-month follow-up survey to estimate program impacts, adjusting for sample members’ characteristics before random assignment. The study did not find any statistically significant effects of the WtW program on employment or earnings. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects would be attributable to WtW and not to other factors. However, the study did not find statistically significant effects.","Working toward Wellness (WtW)","Other employment and reemployment","Low income, Parent",,"United States",2010,http://www.acf.hhs.gov/sites/default/files/opre/telephone_care.pdf,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models [VISION—Salem, OR]","Hendra, R., Dillman, K.-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [VISION—Salem, OR]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on Temporary Assistance for Needy Families (TANF) recipients’ employment and benefits receipt outcomes after three years. The Salem site was one of several across the United States that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,504 single parents eligible for welfare-to-work programs to either a treatment group that received Valuing Individual Success and Increasing Opportunities Now (VISION) services or to a control group that received the state’s typical welfare-to-work program. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records and a survey administered 12 months after random assignment. The study found that those in the VISION group were 6.7 percentage points more likely than those in the control group to have received TANF benefits at any point during the first follow-up year. The VISION group also received, on average, $298 more in annual TANF benefits during the first three follow-up years, compared with the control group. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to the Salem ERA program and not to other factors.","the Salem Valuing Individual Success and Increasing Opportunities Now (VISION) Program","Other employment and reemployment Unemployment Insurance Job search assistance and supportive services","Low income, Parent",,"United States",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf,"Employment and Training Review Protocol" "Veterans Health Administration transitional work experience vs. job placement in veterans with co-morbid substance use and non-psychotic psychiatric disorders","Penk, W., Drebing, C. E., Rosenheck, R, A., Krebs, C., Van Ormer, A., & Mueller, L. (2010). Veterans Health Administration transitional work experience vs. job placement in veterans with co-morbid substance use and non-psychotic psychiatric disorders. Psychiatric Rehabilitation Journal, 33(4), 297-307.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Veterans Health Administration (VHA) Transitional Work Experience (TWE) program on employment and income for veterans with substance abuse and non-psychotic psychiatric disorders, compared with job placement (JP) services only. The study was a randomized controlled trial carried out at one VHA medical center site over four years. Eligible veterans were randomly assigned to either the treatment group, which could participate in the TWE program, or to the control group, which could not participate in TWE but could receive JP services. The authors used data from participant surveys to measure impacts. The study found that members of the treatment group worked significantly more hours in paid employment (including employment sponsored by the TWE program itself) and significantly more total weeks in paid employment, compared with the control group. The study also found that the treatment group earned significantly higher total income for the year (including noncompetitive TWE employment income) than the control group. The quality of causal evidence presented in this report is low because the authors did not provide enough information to calculate attrition and did not include sufficient controls in their analysis to establish that treatment and control groups were similar on observable characteristics at baseline for the analytic sample. This means we are not confident that the estimated effects are attributable to TWE. Other factors are likely to have contributed.","the Transitional Work Experience (TWE) Program","Vocational rehabilitation Veterans' reemployment","Disability, Veteran or military",,"United States",2010,,"Disability Employment Policy Review Protocol" "The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. [PASS - Riverside]","Hendra, R., Dillman, K.-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [PASS - Riverside]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of post-employment job supports and supportive services on recent welfare recipients’ employment and benefits receipt outcomes after four years. The Riverside Post-Assistance Self-Sufficiency (PASS) site was one of two in Riverside, California, that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 2,770 employed single parents who had recently left the Temporary Assistance for Needy Families (TANF) program to either a treatment group that received ERA services or a control group that could participate in other employment-related programs in the community. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records and surveys administered 12 and 42 months after random assignment. The study found that individuals assigned to the Riverside PASS ERA program had significantly higher earnings in the first and fourth years after random assignment and were more likely to be employed in every quarter of the fourth year, compared with those in the control group. The quality of causal evidence provided in this study is high for most outcomes because it was based on a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to the Riverside PASS ERA program and not to other factors. However, the study receives a moderate causal evidence rating for outcomes from the 12-month survey because that data source had high attrition, yet the analysis included adequate statistical controls to correct for resulting imbalance.","the Employment Retention and Advancement Project, Riverside Post-Assistance Self-Sufficiency (PASS) Program","Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States",2010,http://www.acf.hhs.gov/sites/default/files/opre/era_core.pdf,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. [Texas ERA—Houston]","Hendra, R., Dillman, K.-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [Texas ERA—Houston]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-Unfavorable impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on welfare recipients’ employment and benefits receipt outcomes after four years. The Houston site was one of three in Texas that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 2,032 unemployed single-parent participants in Houston’s Temporary Assistance for Needy Families (TANF) program to either a treatment group that received ERA services or a control group that received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records and a survey administered 12 months after random assignment. The study found that those in the Houston ERA group received on average $56 more per year in TANF benefits across the first four years after random assignment, compared with the control group. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to the ERA program and not to other factors.","the Employment Retention and Advancement project, Houston","Other employment and reemployment Unemployment Insurance","Parent, Low income",,"Urban, United States",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models [Moving Up—South Carolina]","Hendra, R., Dillman, K-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [Moving Up—South Carolina]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on former welfare recipients’ employment and benefits receipt outcomes after four years. The South Carolina site was one of 16 sites nationwide that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 2,776 single parents who had left the Temporary Assistance for Needy Families (TANF) program in the past three years to either a treatment group that received ERA services or a control group that could participate in other employment-related programs in the community. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records and a survey administered 12 months after random assignment. The study did not find any statistically significant effects on earnings, employment, or benefits receipt one to four years after random assignment. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we are confident that any estimated effects would be attributable to the South Carolina ERA project and not to other factors. However, the study did not find statistically significant effects.","the Employment Retention and Advancement Project, South Carolina","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models [Los Angeles EJC]","Hendra, R., Dillman, K.-N., Hamilton, G., Lundquist, E., Martinson, K., Wavelet, M., Hill, A., & Williams, S. (2010). The Employment Retention and Advancement project: How effective are different approaches aiming to increase employment retention and advancement? Final impacts for twelve models. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families. [Los Angeles EJC]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to gauge how a Los Angeles job club focused on participants’ career interests affected employment, earnings, and benefits receipt outcomes after about 36 months. The Los Angeles site was one of 16 nationwide to participate in the Employment Retention and Advancement (ERA) project. (See the CLEAR review of the interim report here.) The authors randomly assigned nearly 1,200 single-parent recipients of Temporary Assistance for Needy Families (TANF) to either a treatment group, which received Enhanced Job Club (EJC) services, or a control group, which received traditional job club (TJC) services. The authors collected employment and earnings data from Unemployment Insurance (UI) records and used automated TANF and food stamp databases to obtain benefits receipt information. Thirty-six months after random assignment, the study found no statistically significant differences between treatment and control group members’ employment, earnings, or benefits receipt. The quality of causal evidence provided in this study is high because it is based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects would be attributable to the EJC and not to other factors. However, the study found no statistically significant impacts.","the Employment Retention and Advancement project, Los Angeles’s Enhanced Job Club","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States, Urban",2010,http://files.eric.ed.gov/fulltext/ED514699.pdf,"Employment and Training Review Protocol" "Rewarding Persistence: Effects of a performance-based scholarship program for low-income parents","Richburg-Hayes, L., Brock, T., LeBlanc, A., Paxson, C., Rouse, C.E., & Barrow, L. (2009). Rewarding persistence: Effects of a performance-based scholarship program for low-income parents. New York: MDRC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Opening Doors program at Delgado Community College and Louisiana Technical College-West Jefferson in New Orleans, Louisiana, on progress toward completing a college degree. The Opening Doors program offered students with dependent children a performance-based $1,000 scholarship in each of two semesters. The study examined both the shorter- and longer-term impacts of the Opening Doors program using different cohorts of students. The study was a randomized controlled trial. Eligible students were randomly assigned to either the treatment group, which was offered the opportunity to receive the scholarship, or the control group, which was not eligible for the scholarship. The primary data sources were a baseline survey on the background characteristics of students, student transcripts, and degree attainment information from the National Student Clearinghouse. The study found that for all four cohorts of students, the treatment group was significantly more likely to have registered for any course and have enrolled full-time in college, and to have attempted and earned significantly more credits in both the first and second program semesters, compared with the control group. The study found that for the first two cohorts of students, the treatment group registered for classes at a higher rate, enrolled in more semesters of college, and earned more credits than the control group cumulatively through the fourth semester after random assignment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Opening Doors program, and not to other factors.","the Opening Doors Program at Delgado Community College and Louisiana Technical College-West Jefferson","Tuition assistance Community college education and other classroom training","Adult, Low income, Parent",,"United States",2009,http://www.mdrc.org/sites/default/files/rewarding_persistence_fr.pdf,"Community College Review Protocol" "The Employment Retention and Advancement project: Results from the Los Angeles Reach For Success program","Anderson, J., Freedman, S., and Hamilton, G. (2009). The Employment Retention and Advancement project: Results from the Los Angeles Reach For Success program. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-Mixed impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of an individualized case management program called Reach for Success (RFS) on employment, earnings, and public assistance receipt for recipients of Temporary Assistance for Needy Families (TANF) cash assistance benefits. The study used a randomized controlled trial design, assigning eligible people over a two-year period to either the RFS program or existing services. To estimate the program’s impacts, the authors used administrative employment, earnings, and public benefits data, as well as a 12-month follow-up survey emphasizing respondents’ employment, income, and other outcomes. Outcomes were adjusted for prerandom assignment characteristics. The study found that RFS participants were significantly more likely to receive TANF and Food Stamps benefits at the end of the two-year follow-up period. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the RFS program and not to other factors.","Reach for Success (RFS)","Other employment and reemployment","Parent, Low income",,"United States",2009,http://www.acf.hhs.gov/sites/default/files/opre/era_la_rfs_embed.pdf,"Employment and Training Review Protocol" "Essays on welfare, children, and families","Zhu, Yi. (2009.) Essays on welfare, children, and families. (Unpublished dissertation, Michigan State University.)","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the effect of child care subsidies through the Child Care and Development Fund (CCDF) program on the employment of low-income single mothers. The author used data from the 2001–2007 Current Population Survey (CPS). The treatment condition was defined as the amount of the state child care subsidy for single mothers with children younger than 13. The study found a statistically significant relationship between the amount of child care subsidies and single mothers’ full-time employment. The study did not find relationships between child care subsidies and other employment outcomes examined. The quality of causal evidence presented in this report is low because the author did not account for existing differences between the mothers who did and did not receive the child care assistance. This means we are not confident that the estimated effects are attributable to the child care subsidies; other factors are likely to have contributed.","Child Care Subsidies","Other employment and reemployment","Low income, Parent",,"United States",2009,,"Employment and Training Review Protocol" "The links between parent behaviors and boys’ and girls’ science achievement beliefs","Bhanot, R.T., & Jovanovic, J. (2009). The links between parent behaviors and boys’ and girls’ science achievement beliefs. Applied Developmental Science, 13(1), 42-59.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study's objective was to examine the relationship between parents’ and middle school students’ perceptions of science education and whether that relationship varied based on the gender of the parent or child. Specifically, the study looked at links between parents’ attitudes toward science and participation in their children’s science education and the child’s opinion of the utility of science (called science task-value) and perception of his or her own science ability. The study, conducted in four school districts in Illinois, used student survey data collected at the start and end of the school year and parent survey data collected in the middle of the school year. The authors analyzed changes in students’ perceptions from the beginning to end of the year, by gender, as well as differences in parents’ perceptions and behavior by the gender of the child and parent. The authors also conducted a series of regression analyses by gender to determine the relationship between parents’ involvement in their children’s science education and their children’s end-of-year perceptions. The study found that boys had higher perceptions of their own science ability at the end of the school year than girls, though there was no difference in actual performance. Compared with parents of girls, parents of boys also had higher perceptions of the child’s science ability and of the value of science and were more likely to encourage an interest in science. There were some positive correlations between parents’ beliefs and actions and girls’ perceptions of science; however, some actions taken by mothers were found to be negatively correlated with boys’ perceptions of their science ability and their task-value beliefs about science. Even after controlling for mothers’ behaviors, mothers’ perceptions of their children’s science ability was a significant predictor of the children’s perceptions of their own ability. The study found that the links between fathers’ actions and children’s perceptions did not vary by the child’s gender.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Parent",,"United States",2009,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Working toward Wellness: Early results from a telephone care management program for Medicaid recipients with depression.","Kim, S., LeBlanc, A. and Michalopoulos, C. (2009). Working toward Wellness: Early results from a telephone care management program for Medicaid recipients with depression. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impacts of a telephone care management program, Working toward Wellness (WtW), on low-income depressed parents’ employment and earnings. The study used a randomized controlled trial design, assigning eligible parents to either the WtW program or existing services. Authors used data from a six-month follow-up survey to estimate program impacts, accounting for parents’ characteristics before random assignment. The study did not find any statistically significant effects of the WtW program on employment or earnings. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects would be attributable to WtW and not to other factors. However, the study did not find statistically significant effects.","Working toward Wellness (WtW)","Other employment and reemployment","Low income, Parent",,"United States",2009,http://www.acf.hhs.gov/sites/default/files/opre/working_wellness.pdf,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: A comparison of two job club strategies: The effects of enhanced versus traditional job clubs in Los Angeles","Navarro, D., Azurdia, G., & Hamilton, G. (2008). The Employment Retention and Advancement project: A comparison of two job club strategies: The effects of enhanced versus traditional job clubs in Los Angeles. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to gauge the effect of a Los Angeles job club focused on participants’ career interests on employment, earnings, and benefits receipt outcomes after about 18 months. The Los Angeles site was one of 16 nationwide to participate in the Employment Retention and Advancement (ERA) project. (See the CLEAR review of the final report here.) The authors randomly assigned almost 1,200 single-parent Temporary Assistance for Needy Families (TANF) recipients to either a treatment group, which received Enhanced Job Club (EJC) services, or a control group, which received Traditional Job Club (TJC) services. The authors collected employment and earnings data from Unemployment Insurance (UI) records and used automated TANF and Food Stamps databases to obtain benefits receipt information. The study found that, 18 months after random assignment, there were no statistically significant differences between EJC and control group members’ employment, earnings, or public benefits receipt. The quality of causal evidence provided in this study is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects would be attributable to the EJC and not to other factors. However, the study found no statistically significant impacts.","the Employment Retention and Advancement project, Los Angeles’s Enhanced Job Club","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States, Urban",2008,http://www.acf.hhs.gov/sites/default/files/opre/era_la.pdf,"Employment and Training Review Protocol" "Rehabilitation of traumatic brain injury in active duty military personnel and veterans: Defense and Veterans Brain Injury Center randomized controlled trial of two rehabilitation approaches","Vanderploeg, R., Schwab, K., Walker, W., Fraser, J., Sigford, B., Date, E., . . . Warden, D. (2008). Rehabilitation of traumatic brain injury in active duty military personnel and veterans: Defense and Veterans Brain Injury Center randomized controlled trial of two rehabilitation approaches. Archives of Physical Medicine and Rehabilitation, 89(12), 2227-2237.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-No impacts Employment Education and skills gains-Mod/high-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of two treatments—cognitive-didactic rehabilitation and functional-experiential rehabilitation—on return to work/school and functional independence among veterans and active military with traumatic brain injury (TBI). The study used a randomized controlled trial design in which 366 active duty military service members or veterans with moderate-to-severe TBI were randomly assigned to receive either cognitive-didactic rehabilitation, which focuses on addressing cognitive deficits, or functional-experiential rehabilitation, which emphasizes performance of real-life tasks. Primary outcomes were measured using in-person evaluations or structured telephone interviews. The study found no significant differences in return to work or school or functional independence between the two types of rehabilitation. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects would be attributable to the difference between the cognitive-didactic and functional-experiential treatments and not to other factors. However, the study did not find statistically significant effects between the two treatments.","Cognitive-Didactic and Functional-experiential rehabilitation","Vocational rehabilitation Veterans' reemployment","Disability, Veteran or military",,"United States",2008,,"Disability Employment Policy Review Protocol" "The Employment Retention and Advancement project: Results from the Valuing Individual Success and Increasing Opportunities Now (VISION) program in Salem, Oregon","Molina, F., Cheng, W., and Hendra, R. (2008). The Employment Retention and Advancement project: Results from the Valuing Individual Success and Increasing Opportunities Now (VISION) program in Salem, Oregon. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Salem, Oregon, Valuing Individual Success and Increasing Opportunities Now (VISION) program on employment, earnings, and public benefits receipt among eligible single parents. VISION provided job search assistance and post-employment services to unemployed Temporary Assistance for Needy Families (TANF) applicants. The study used a randomized controlled trial to assign TANF applicants eligible for welfare-to-work programs to either VISION or the state’s typical welfare-to-work program, Job Opportunities and Basic Skills Training (JOBS), from May 2002 to May 2004. To estimate differences in outcomes between the two study groups, the authors retrieved data from unemployment insurance wage records, TANF and Food Stamps administrative records, and a 12-month follow-up survey. The study found that people in the VISION group received, on average, $365 more in TANF benefits and $160 more in Food Stamps than those in the JOBS group during the first year after random assignment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to VISION, and not to other factors.","the Salem Valuing Individual Success and Increasing Opportunities Now (VISION) Program","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States",2008,http://files.eric.ed.gov/fulltext/ED501587.pdf,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: Results from two education and training models for employed welfare recipients in Riverside, California.","Navarro, D., Freedman, S., & Hamilton, G. (2007). The Employment Retention and Advancement project: Results from two education and training models for employed welfare recipients in Riverside, California. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-Unfavorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of post-employment job supports and intensive case management on welfare recipients’ employment, earnings, and benefit receipt outcomes after two years. The Riverside Phase 2 site was one of two in Riverside, California, that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 2,907 employed single-parent participants in Riverside’s Temporary Assistance for Needy Families (TANF) program to one of two treatment groups that received differing ERA services or to a control group that received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records and a survey administered 12 months after random assignment. The study found that the households of participants in the Work Plus program were 10.5 percentage points less likely to receive TANF benefits relative to those in the control group 12 months after random assignment. The study found no statistically significant effects associated with the Training Focused program. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to the Riverside Work Plus program and not to other factors. It also means that we would be confident that any estimated effects would be attributable to Riverside Training Focused program and not to other factors. However, the study did not find statistically significant effects of the Training Focused program.","the Employment Retention and Advancement Project—Work Plus and Training Focused (Phase 2), Riverside","Other employment and reemployment","Parent, Low income",,"United States",2007,http://www.acf.hhs.gov/sites/default/files/opre/riverside_phase2.pdf,"Employment and Training Review Protocol" "Adding contingency management intervention to vocational rehabilitation: Outcomes for dually diagnosed veterans","Drebing, C. E., Van Ormer, E. A., Mueller, L., Hebert, M., Penk, W. E., Petry, N. M., . . . Rounsaville, B. (2007). Adding contingency management intervention to vocational rehabilitation: Outcomes for dually diagnosed veterans. Journal of Rehabilitation Research & Development, 44(6), 851-865.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts Employment Health and safety-Mod/high-Favorable impacts Health and safety","Summary: The study examined the impact of contingency management (CM) on employment and health outcomes. The authors conducted a randomized controlled trial, using a work history form and drug and alcohol screenings to collect participant data. At nine months, 50 percent of the individuals in the treatment group had obtained competitive employment compared with only 28 percent of those in the control group. Treatment group participants remained abstinent from drugs and alcohol longer than control group participants (11.8 weeks versus 9.4 weeks). Treatment group participants were also less likely to relapse by week 16 (50 percent versus 72 percent). The quality of causal evidence presented in this report is high for employment outcomes because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the CM program, and not to other factors.","Contingency Management","Veterans' reemployment","Veteran or military",,"United States",2007,https://www.rehab.research.va.gov/jour/07/44/6/drebing.html,"Employment and Training Review Protocol" "Implementation of supported employment for homeless veterans with psychiatric or addiction disorders: Two-year outcomes","Rosenheck, R. A., & Mares, A. S. (2007). Implementation of supported employment for homeless veterans with psychiatric or addiction disorders: Two-year outcomes. Psychiatric Services, 58(3), 325-333.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study examined the impact a newly implemented Individual Placement and Support (IPS) program had on employment and earnings outcomes of homeless veterans who were diagnosed with a psychiatric or substance abuse problem. The study team compared raw and adjusted outcome data for veterans who received IPS services and veterans who did not. The team used study participant interviews, activity logs, and employer contacts as data sources. The study found a statistically significant relationship between participation in the IPS program and competitive employment. The quality of causal evidence presented in this report is low because the data on the two groups were not collected at the same time. This means we are not confident that the estimated effects are attributable to the IPS program; other factors are likely to have contributed.","Individual Placement and Support (IPS)","Substance abuse recovery Job search assistance and supportive services Veterans' reemployment","Other barriers, Veteran or military, Homeless",,"United States",2007,https://ps.psychiatryonline.org/doi/full/10.1176/ps.2007.58.3.325,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: Results from the Personal Roads to Individual Development and Employment (PRIDE) program in New York City","Bloom, D., Miller, C., and Azurdia, G. (2007). The Employment Retention and Advancement project: Results from the Personal Roads to Individual Development and Employment (PRIDE) program in New York City. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Unfavorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Personal Roads to Individual Development and Employment (PRIDE) welfare-to-work program in New York City on the employment, earnings, and public benefits receipt of low-income single parents with physical or mental health problems that limited their ability to work. The study was a randomized controlled trial that used data from administrative records for the two years following assignment and a survey conducted with a random subset of the sample to assess outcomes one year after assignment. The study found that treatment group participants were significantly more likely than control group participants to have had a job and had higher average earnings. The treatment group was significantly less likely to receive cash assistance and received lower amounts of cash assistance benefits than the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to PRIDE and not to other factors.","Personal Roads to Individual Development and Employment (PRIDE)","Other employment and reemployment","Disability, Low income, Parent",,"United States, Urban",2007,http://www.acf.hhs.gov/sites/default/files/opre/era_pride.pdf,"Employment and Training Review Protocol" "Compensation of veterans with psychiatric or substance abuse disorders and employment and earnings","Greenberg, G. A., & Rosenheck, R. A. (2007). Compensation of veterans with psychiatric or substance abuse disorders and employment and earnings. Military Medicine, 172(2), 162-168.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Unfavorable impacts Employment","Summary: The study’s objective was to examine the impact of the Veterans Affairs (VA) Compensation Program on employment for veterans with service-connected disabilities. This study compared employment outcomes for two groups of veterans: (1) disabled veterans receiving VA compensation and (2) nondisabled veterans not receiving disability compensation. To do this, the study team combined data from two national surveys: the Survey of Disabled Veterans and the National Survey of Veterans. Veterans receiving benefits of more than $800 per month from the VA Compensation Program were significantly less likely to be employed than were nondisabled veterans. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the VA Compensation Program; other factors likely contributed to the findings.","the VA Compensation Program","Disability insurance Veterans' reemployment","Disability, Veteran or military",,"United States",2007,https://academic.oup.com/milmed/article/172/2/162/4578021,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: Results from the Post-Assistance Self-Sufficiency (PASS) program in Riverside, California","Navarro, D., van Dok, M., & Hendra, R. (2007). The Employment Retention and Advancement project: Results from the Post-Assistance Self-Sufficiency (PASS) program in Riverside, California. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt Public benefits receipt-Low-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Riverside Post-Assistance Self-Sufficiency (PASS) program on employment, earnings, and public benefits receipt after two years. The Riverside PASS site was one of two in Riverside, California, that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 2,770 employed single-parent participants who had recently left the Temporary Assistance for Needy Families (TANF) program to a treatment group that received ERA services or to a control group that received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records and a survey administered 12 months after random assignment. The study found that Riverside PASS had positive impacts on earnings and employment in the first and second years after random assignment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to Riverside PASS, and not to other factors.","the Riverside Post-Assistance Self-Sufficiency (PASS) Program","Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States",2007,http://www.acf.hhs.gov/sites/default/files/opre/riverside_pass.pdf,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: Results from Minnesota’s Tier 2 program","LeBlanc, A., Miller, C., Martinson, K., & Azurdia, G. (2007). The Employment Retention and Advancement project: Results from Minnesota’s Tier 2 program. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to determine the 18-month impact of Minnesota’s Tier 2 welfare-to-work program compared with existing Tier 1 services. Minnesota’s Tier 2 program was part of the nationwide Employment Retention and Advancement (ERA) project. The authors randomly assigned approximately 1,700 long-term Temporary Assistance for Needy Families (TANF) recipients to either a treatment group, which received Tier 2 services including intensive assessments and case management, or a control group, which received Minnesota’s existing Tier 1 TANF services. The authors analyzed data from Minnesota Unemployment Insurance (UI), TANF, and Food Stamps administrative records. The study found that, 12 months after random assignment, more people in the Tier 2 group (79.2 percent) reported that they received Food Stamps than in the control group (70.0 percent). After 18 months however, there were no statistically significant differences between treatment and control group members’ employment, earnings, or benefits receipt. The quality of causal evidence provided in this study is high because it is based on a well-conducted randomized controlled trial. This means we are confident that any estimated effects are attributable to Minnesota’s Tier 2 program and not to other factors.","the Employment Retention and Advancement project, Minnesota’s Tier 2 Program","Job search assistance and supportive services Other employment and reemployment","Unemployed, Low income, Parent",,"United States",2007,http://www.acf.hhs.gov/sites/default/files/opre/minnesota_tier2.pdf,"Employment and Training Review Protocol" "Paying for persistence: Early results of a Louisiana scholarship program for low-income parents attending community college","Brock, T., & Richburg-Hayes, L. (2006). Paying for persistence: Early results of a Louisiana scholarship program for low-income parents attending community college. New York: MDRC.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of Louisiana Opening Doors, a scholarship program, on semester-to-semester retention and course completion at two community colleges in Louisiana. The study was a randomized controlled trial that compared the outcomes of treatment and control groups over three semesters. The primary data sources were students’ transcripts from the colleges and a baseline survey on students’ background characteristics. The study found that students who participated in the Opening Doors program attempted and passed a greater number of courses, registered for and earned more credits, and were enrolled for more semesters than students in the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Louisiana Opening Doors program, and not to other factors.","Opening Doors in Louisiana","Community college education and other classroom training Tuition assistance","Adult, Low income, Parent",,"United States",2006,http://www.mdrc.org/sites/default/files/full_472.pdf,"Community College Review Protocol" "College as a job advancement strategy: Final report on the New Visions Self-Sufficiency and Lifelong Learning Project","Fein, D., & Beecroft, E. (2006). College as a job advancement strategy: Final report on the New Visions Self-Sufficiency and Lifelong Learning Project. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Riverside Community College’s New Visions Self-Sufficiency and Lifelong Learning Project on welfare recipients’ employment, earnings, welfare receipt, and educational achievement. The study was based on a randomized controlled trial and estimated the effect of offering welfare recipients the New Visions Project services compared with encouraging recipients to participate in other employment services. The authors used California public benefits and community college administrative data to compare average outcomes among those offered access to New Visions with the average outcomes of those excluded, after adjusting for differences in demographic and pre-intervention characteristics between the groups. The study found that participants in the New Visions program received $456 more in Temporary Assistance for Needy Families (TANF) payments than control group participants in the third year after random assignment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the New Visions Project, and not to other factors.","the New Visions Self-Sufficiency and Lifelong Learning Project","Community college education and other classroom training Other employment and reemployment","Low income, Parent",,"United States",2006,http://www.acf.hhs.gov/sites/default/files/opre/nv_final_pdf.pdf,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: Results from the Texas ERA site [Texas ERA—Houston]","Martinson, K., & Hendra, R. (2006). The Employment Retention and Advancement project: Results from the Texas ERA site. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. [Texas ERA—Houston]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on welfare recipients’ employment and benefits receipt outcomes after 18 to 24 months. The Houston site was one of three in Texas that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned about 1,800 single-parent participants in Houston’s Temporary Assistance for Needy Families (TANF) program to either a treatment group, which received ERA services, or a control group, which received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Supplemental Nutrition Assistance Program (SNAP) administrative records. The study did not find any statistically significant effects on employment or earnings. However, the study found that treatment group members received, on average, $33 more in TANF benefits in the ninth quarter after random assignment than those in the control group. The quality of causal evidence provided in this study is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the ERA program, and not to other factors.","the Employment Retention and Advancement project, Houston","Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States, Urban",2006,http://www.acf.hhs.gov/sites/default/files/opre/results_texas.pdf,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: Results from the Texas ERA site [Texas ERA—Forth Worth]","Martinson, K., & Hendra, R. (2006). The Employment Retention and Advancement project: Results from the Texas ERA site. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. [Texas ERA—Forth Worth]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on welfare recipients’ employment and benefits receipt outcomes after 18 to 24 months. The Fort Worth site was one of three in Texas that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned about 1,200 single-parent participants in Fort Worth’s Temporary Assistance for Needy Families (TANF) program to either a treatment group, which received ERA services, or a control group, which received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Supplemental Nutrition Assistance Program (SNAP) administrative records. The study found that treatment group members were 6.1 percentage points more likely to have been employed at any time in the second year after random assignment than those in the control group. Treatment group members were also 4.2 percentage points more likely to be employed during the last quarter of that second year. The quality of causal evidence provided in this study is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the ERA program, and not to other factors.","the Employment Retention and Advancement project, Fort Worth","Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States, Urban",2006,http://www.acf.hhs.gov/sites/default/files/opre/results_texas.pdf,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: Results from the Texas ERA site [Texas ERA—Corpus Christi]","Martinson, K., & Hendra, R. (2006). The Employment Retention and Advancement project: Results from the Texas ERA site. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. [Texas ERA—Corpus Christi]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on welfare recipients’ employment and benefits receipt outcomes after 18 to 24 months. The Corpus Christi site was one of three in Texas that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned about 1,300 single-parent participants in Corpus Christi’s Temporary Assistance for Needy Families (TANF) program to either a treatment group, which received ERA services, or a control group, which received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Supplemental Nutrition Assistance Program (SNAP) administrative records. The study did not find statistically significant effects 18 to 24 months after random assignment on employment, earnings, and public benefit receipt. The quality of causal evidence provided in this study is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects would be attributable to the ERA program and not to other factors. However, the study found no statistically significant impacts.","the Employment Retention and Advancement project, Corpus Christi","Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States",2006,http://www.acf.hhs.gov/sites/default/files/opre/results_texas.pdf,"Employment and Training Review Protocol" "A comparison of two Welfare-to-Work strategies among African American women in Atlanta, Georgia. (Unpublished doctoral dissertation).","Wilson-Brewster, V.L. (2006). A comparison of two Welfare-to-Work strategies among African American women in Atlanta, Georgia. (Unpublished doctoral dissertation). Capella University, Minneapolis, Minnesota.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the effectiveness of two welfare-to-work programs—the Labor Force Attachment (LFA) program and the Human Capital Development (HCD) program—on the employment and earnings of African American women 25, 35, and 45 years old in Atlanta. The author analyzed a subsample of participants in the National Evaluation of Welfare-to-Work Strategies (NEWWS) study. The study was a randomized controlled trial that assigned individuals within a geographic location to one of three groups: LFA, HCD, or a control group. The study found that women in the 35-year-old group who participated in LFA or HCD had higher earnings and needed less time to find a job than those in the other age cohorts. The quality of causal evidence presented in this report is low because the study was a randomized controlled trial with unknown attrition and the authors did not account for preexisting differences between the groups being compared in their analysis. This means we are not confident that the estimated effects are attributable to LFA or HCD programs; other factors are likely to have contributed.","Labor Force Attachment (LFA) and Human Capital Development (HCD)","Other employment and reemployment Other training and education","Female, Black or African American, Low income, Parent",,"United States, Urban",2006,,"Employment and Training Review Protocol" "Improving success in a veterans homeless domiciliary vocational program: Model development and evaluation","LePage, J. P., Bluitt, M., House-Hatfield, T., McAdams, H., Burdick, M., Dudley, D., …& Gaston, C. (2005). Improving success in a veterans homeless domiciliary vocational program: Model development and evaluation. Rehabilitation Psychology, 50(3), 297-304. doi: 10.1037/0090-5550.50.3.297",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the relationship between the risk factor-based decision making (RFBDM) program and employment attainment. The study used a non-experimental comparison-group analysis. The study’s relied on data collected from the Risk Factor Scale and through data from the Veterans Affairs (VA) North Texas Health Care System. The authors used Pearson’s chi-squared test, a statistical model, to examine the relationship between the RFBDM program and employment. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the RFBDM program; other factors are likely to have contributed to the study findings.","Risk factor-based decision making intervention.","Veterans' reemployment","Veteran or military",,"United States",2005,https://utsouthwestern.pure.elsevier.com/en/publications/improving-success-in-a…,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: Early results from four sites [Texas ERA—Houston]","Bloom, D., Hendra, R., Martinson, K., & Scrivener, S. (2005). The Employment Retention and Advancement project: Early results from four sites. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. [Texas ERA—Houston]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on welfare recipients’ employment and benefits receipt outcomes after one year. The Houston site was one of three in Texas that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,816 unemployed single-parent participants in Houston’s Temporary Assistance for Needy Families (TANF) program to either a treatment group that received ERA services or a control group that received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records. The study did not find any statistically significant effects of the Houston ERA program on employment, earnings, and benefits receipt one year after random assignment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects are attributable to the Houston ERA program and not to other factors. However, the study did not find any statistically significant effects.","the Employment Retention and Advancement project, Houston","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States, Urban",2005,http://www.acf.hhs.gov/sites/default/files/opre/early_results.pdf,"Employment and Training Review Protocol" "Turning welfare into a work support: Six-year impacts on parents and children from the Minnesota Family Investment Program.","Gennetian, L., Miller, C., & Smith, J. (2005). Turning welfare into a work support: Six-year impacts on parents and children from the Minnesota Family Investment Program. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Unfavorable impacts Earnings and wages Employment-Mod/high-Mixed impacts Employment Public benefits receipt-Mod/high-Unfavorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Minnesota Family Investment Program (MFIP), a precursor to the national Temporary Assistance for Needy Families program, on employment, earnings, and public benefit receipt. The study was a randomized controlled trial: Families newly applying to Aid to Families with Dependent Children (AFDC) or families that were recertifying their eligibility were randomly assigned to MFIP or AFDC. Evaluators analyzed outcomes using a 36-month follow-up survey and administrative data from the six years after the intervention. The study found that, among single parents in the year after MFIP began, the MFIP group experienced higher rates of short-term employment and higher rates and levels of cash assistance than the AFDC group. For two-parent households, the study found that, in the first year after the study began, the MFIP group had lower rates of employment, lower levels of earnings, and higher rates and levels of benefits receipt than the AFDC group. In both family types, higher receipt of cash assistance for the MFIP group persisted through six years after the study began. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to MFIP, and not to other factors.","the Minnesota Family Investment Program (MFIP)","Other employment and reemployment Other training and education","Parent, Low income",,"United States",2005,http://www.mdrc.org/sites/default/files/full_594.pdf,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: Early results from four sites [Riverside, CA – Work Plus]","Bloom, D., Hendra, R., Martinson, K. & Scrivener, S. (2005). The Employment Retention and Advancement project: Early results from four sites. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. [Riverside, CA – Work Plus]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the effectiveness of a Riverside, California, program to increase the earnings of welfare recipients after one year. The Riverside Phase 2 site was one of two in Riverside that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,912 employed single-parent participants in Riverside’s Temporary Assistance for Needy Families (TANF) program to one of two treatment groups (Work Plus or Training Focused) that received different ERA services, or to a control group (Work Focused) that received standard public benefits and some limited case management. This review compared the Work Plus program and the control group. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records. The study found that those in the Work Plus group were 5 percentage points more likely to receive Food Stamps in the year after random assignment than those in the control group. The quality of causal evidence provided in this study is high because it was based on a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to the Riverside Work Plus program and not to other factors.","the Employment Retention and Advancement (ERA) Project—Work Plus (Phase 2), Riverside","Other employment and reemployment","Low income, Parent",,"United States",2005,http://www.acf.hhs.gov/sites/default/files/opre/early_results.pdf,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: Early results from four sites [Texas ERA—Fort Worth]","Bloom, D., Hendra, R., Martinson, K., & Scrivener, S. (2005). The Employment Retention and Advancement project: Early results from four sites. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children & Families, U.S. Department of Health and Human Services. [Texas ERA—Fort Worth]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on welfare recipients’ employment and benefits receipt outcomes after one year. The Fort Worth site was one of three in Texas that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,163 unemployed single-parent participants in Fort Worth’s Temporary Assistance for Needy Families (TANF) program to either a treatment group that received ERA services or a control group that received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records. The study did not find any statistically significant effects of the Texas ERA program in Fort Worth on employment, earnings, and benefits receipt one year after random assignment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects are attributable to Texas ERA and not to other factors. However, the study did not find any statistically significant effects.","the Employment Retention and Advancement project, Fort Worth","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States",2005,http://www.acf.hhs.gov/sites/default/files/opre/early_results.pdf,"Employment and Training Review Protocol" "The effects of welfare-to-work program activities on labor market outcomes","Dyke, A., Heinrich, C., Mueser, P., & Troske, K. (2005). The effects of welfare-to-work program activities on labor market outcomes. Institute for Research on Poverty, 1295(5). [North Carolina]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages","Summary: The study’s objective was to examine the impact of North Carolina’s welfare-to-work program training activities on the quarterly earnings of women ages 18 to 65 years in single-parent households who were cash recipients of Temporary Assistance for Needy Families (TANF). Using data from the state’s administrative records and unemployment insurance program, the authors compared the quarterly earnings of women who took part in the training activities with those who enrolled in the welfare-to-work program but never took part in any of the training. The study found that those taking part in any of the training activities experienced an initial (quarter 1) reduction in their quarterly earnings, compared with those who did not take part in the training activities. However, those who took part in the assessment or intensive training activities experienced an increase in both their cumulative (based on 16 quarters of follow-up) and average (based on quarters 11 to 15 of follow-up) quarterly earnings, compared with those who did not take part in any training activities. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the welfare-to-work program, but other factors might also have contributed.","the Welfare-to-Work Program","Job search assistance and supportive services","Female, Low income, Parent",,"United States",2005,http://repec.iza.org/dp1520.pdf,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: Early results from four sites [Texas ERA—Corpus Christi]","Bloom, D., Hendra, R., Martinson, K., & Scrivener, S. (2005). The Employment Retention and Advancement project: Early results from four sites. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children & Families, U.S. Department of Health and Human Services. [Texas ERA—Corpus Christi]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on welfare recipients’ employment and benefits receipt outcomes after one year. The Corpus Christi site was one of three in Texas that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned about 1,300 single-parent participants in Corpus Christi’s Temporary Assistance for Needy Families (TANF) program to either a treatment group, which received ERA services, or a control group, which received standard TANF services. The authors analyzed data from Unemployment Insurance (UI), TANF, and Supplemental Nutrition Assistance Program administrative records. The study did not find any statistically significant effects one year after random assignment on employment, earnings, and public benefits receipt. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects would be attributable to the Corpus Christi ERA program and not to other factors. However, the study found no statistically significant impacts.","the Employment Retention and Advancement project, Corpus Christi","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States",2005,http://www.acf.hhs.gov/sites/default/files/opre/early_results.pdf,"Employment and Training Review Protocol" "The effects of welfare-to-work program activities on labor marker outcomes","Dyke, A., Heinrich, C., Mueser, P., & Troske, K. (2005). The effects of welfare-to-work program activities on labor marker outcomes. Institute for Research on Poverty, 1295(5). [Missouri]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages","Summary: The study’s objective was to examine the impact of Missouri’s welfare-to-work program training activities on the quarterly earnings of women ages 18 to 65 years in single-parent households who were cash recipients of Temporary Assistance for Needy Families (TANF). Using data from the state’s administrative records and unemployment insurance program, the authors compared the quarterly earnings of women who took part in the training activities with those who enrolled in the welfare-to-work program but never took part in any of the training. The study found that those taking part in the training activities experienced an initial (quarter 1) reduction in their quarterly earnings, compared with those who did not take part in the training activities. However, both cumulative (based on all 16 quarters of follow-up) and average (based on quarters 11 to 15) quarterly earnings increased for those who took part in the training activities compared with those who did not. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the welfare-to-work program training activities, but other factors might also have contributed.","the Welfare-to-Work Program","Job search assistance and supportive services","Female, Low income, Parent",,"United States",2005,http://repec.iza.org/dp1520.pdf,"Employment and Training Review Protocol" "The impact of enhanced incentives on vocational rehabilitation outcomes for dually diagnosed veterans.","Drebing, C. E., Van Ormer, E. A., Krebs, C., Rosenheck, R., & Rounsaville, B. (2005). The impact of enhanced incentives on vocational rehabilitation outcomes for dually diagnosed veterans. Journal of Applied Behavioral Analysis, 38(3), 359-372.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-No impacts Employment Health and safety-Low-Favorable impacts Health and safety","Summary: The study examined the impact of enhanced incentives within an existing Veteran’s Administration (VA) Compensated Work Therapy (CWT) program on sustained abstinence from substances, transitioning to competitive employment, retention in competitive employment, and wages. The study was a randomized controlled trial that compared outcomes for the intervention and control groups over 16 weeks. The CWT program’s clinical and financial records were used to assess employment and wage outcomes. Urine screens and participant reports were used to measure substance use outcomes. The study found that total wages for the enhanced incentives group were significantly higher than for the control group. The study also found that the intervention group abstained from substance use for a significantly longer time than the control group. The quality of causal evidence presented in this report is low for the employment and earnings outcomes because the authors did not establish that the intervention and control groups were equivalent one year before the intervention in terms of earnings or employment. This means we are not confident the estimated effects on these outcomes are attributable to the enhanced incentives in the CWT program; other factors are likely to have contributed.","Veterans’ Administration’s Compensated Work Therapy Program with Enhanced Incentives","Health Substance abuse recovery Veterans' reemployment","Veteran or military","Health care and social assistance","United States",2005,https://files.eric.ed.gov/fulltext/EJ725227.pdf,"Employment and Training Review Protocol" "Employment outcomes and PTSD symptom severity","Smith, M., Schnurr, P., & Rosenheck, R. (2005). Employment outcomes and PTSD symptom severity. Mental Health Services Research, 7(2), 89-101.","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: The authors assessed the relationship between male Vietnam-era veterans’ scores on the Clinician-Administered Post-Traumatic Stress Disorder (PTSD) Scale (CAPS), a clinically administered scale of PTSD severity, and their employment and earnings. The authors analyzed a data set containing demographic characteristics, PTSD symptom severity, employment status, and earnings for 325 male Vietnam-era veterans ages 18 to 54. The authors used a multinomial logistic regression framework to estimate the marginal effect of PTSD severity on three categories of employment—no employment, part-time employment, and full-time employment—and a Heckman selection model to estimate effects on earnings. The study found that a 10-point increase in the CAPS score was associated with a 5.9 percentage point increase in the probability of unemployment, a 2.1 percentage point decrease in the probability of part-time employment, and a 3.8 percentage point decrease in the probability of full-time work.",,,"Disability, Veteran or military",,"United States",2005,,"Disability Employment Policy Review Protocol" "The Employment Retention and Advancement project: Early results from four sites. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children & Families, U.S. Department of Health and Human Services. [South Carolina] (Bloom et al. 2005)","Bloom, D., Hendra, R., Martinson, K., & Scrivener, S. (2005). The Employment Retention and Advancement project: Early results from four sites. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children & Families, U.S. Department of Health and Human Services. [South Carolina]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to estimate the impact of pre- and post-employment job supports and intensive case management on former welfare recipients’ employment and benefits receipt outcomes after one year. The South Carolina site was one of 16 sites nationwide that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 1,839 people who had recently left the Temporary Assistance for Needy Families (TANF) to either a treatment group (Moving Up) that received ERA services or a control group that could participate in other employment-related programs in the community. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records. The study did not find any statistically significant effects of Moving Up on employment, earnings, or benefits receipt one year after random assignment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects are attributable to Moving Up and not to other factors. However, the study did not find any statistically significant effects.","the Employment Retention and Advancement Project, South Carolina","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States",2005,http://www.acf.hhs.gov/sites/default/files/opre/early_results.pdf,"Employment and Training Review Protocol" "Work rehabilitation for middle-aged and older people with schizophrenia: A comparison of three approaches.","Twamley, E. W., Padin, D. S., Bayne, K. S., Narvaez, J. M., Williams, R. E., & Jeste, D. V. (2005). Work rehabilitation for middle-aged and older people with schizophrenia: A comparison of three approaches. Journal of Nervous and Mental Disease, 193(9), 596-601.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Unfavorable impacts Employment","Summary: The study examined the impact of the Wellness and Vocational Enrichment Clinic (WAVE), a conventional vocational rehabilitation program with some elements of supported employment, on veterans’ employment outcomes. The study used statistical tests to examine differences between veterans who were offered WAVE and individuals who were offered the Department of Rehabilitation’s Employment Services (DOR), a conventional vocational rehabilitation program. The data from this study come from program records. The study found no statistically significant relationships between participation in WAVE and volunteer or paid work, or between participation in WAVE and competitive work or compensated work therapy. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the WAVE program; other factors are likely to have contributed.","Wellness and Vocational Enrichment Clinic (WAVE)","Veterans' reemployment","Veteran or military",,"United States",2005,,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: Early results from four sites [Riverside, CA – Work Plus versus Training Focused]","Bloom, D., Hendra, R., Martinson, K., & Scrivener, S. (2005). The Employment Retention and Advancement project: Early results from four sites. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children & Families, U.S. Department of Health and Human Services. [Riverside, CA – Work Plus versus Training Focused]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to examine the effectiveness of a Riverside, California, program to increase the earnings of welfare recipients after one year. The Riverside Phase 2 site was one of two in Riverside that participated in the Employment Retention and Advancement (ERA) project. The authors randomly assigned eligible single-parent participants in Riverside’s Temporary Assistance for Needy Families (TANF) program to one of two treatment groups (Work Plus and Training Focused) that received differing ERA services or to a control group that received standard TANF services. This review focuses on the comparison between the Work Plus program and the Training Focused program. The authors analyzed data from Unemployment Insurance (UI), TANF, and Food Stamps administrative records. The study did not find any statistically significant effects of the Work Plus program on employment, earnings, and benefits receipt compared with the Training Focused program. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects are attributable to the Riverside Work Plus program and not to other factors. However, the study did not find any statistically significant effects.","the Employment Retention and Advancement Project—Work Plus and Training Focused (Phase 2), Riverside","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States",2005,http://www.acf.hhs.gov/sites/default/files/opre/early_results.pdf,"Employment and Training Review Protocol" "Work rehabilitation for middle-aged and older people with schizophrenia: A comparison of three approaches","Twamley, E. W., Padin, D. S., Bayne, K. S., Narvaez, J. M., Williams, R. E., & Jeste, D. V. (2005). Work rehabilitation for middle-aged and older people with schizophrenia: A comparison of three approaches. Journal of Nervous and Mental Disease, 193(9), 596-601.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Unfavorable impacts Employment","Summary: The study examined the impact of the Wellness and Vocational Enrichment Clinic (WAVE), a conventional vocational rehabilitation program with some elements of supported employment, on veterans’ employment outcomes. The study used statistical tests to examine differences between veterans who were offered WAVE and individuals who were offered Individual Placement and Support (IPS), a supported employment program. The data from this study come from program records. The study found that participation in the WAVE program is associated with lower rates of volunteer or paid work, and lower rates of competitive work or compensated work therapy participation compared with participation in the IPS program. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the WAVE program; other factors are likely to have contributed.","Wellness and Vocational Enrichment Clinic (WAVE)","Veterans' reemployment","Veteran or military",,"United States",2005,,"Employment and Training Review Protocol" "The Employment Retention and Advancement project: Early results from four sites [Chicago]","Bloom, D, Hendra, R., Martinson, K., & Scrivener, S. (2005). The Employment Retention and Advancement project: Early results from four sites. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. [Chicago]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Public benefits receipt-Mod/high-Unfavorable impacts Public benefit receipt","Summary: The study’s objective was to determine the effectiveness of a Chicago program to increase the earnings of Temporary Assistance for Needy Families (TANF) recipients after one year. The Chicago site was one of 16 nationwide to participate in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 990 TANF recipients to either a treatment group, which received enhanced employment services, or a control group, which received benefits as usual. The authors collected employment and earnings data from Illinois Unemployment Insurance (UI) records and Food Stamps and TANF receipt data from Illinois administrative records. The study found that those in the Chicago ERA program received, on average, $193 less in TANF benefits in the first year after random assignment than those in the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Chicago ERA project, and not to other factors.","the Employment Retention and Advancement project, Chicago","Job search assistance and supportive services Other employment and reemployment Unemployment Insurance","Low income, Parent",,"United States, Urban",2005,http://www.acf.hhs.gov/sites/default/files/opre/early_results.pdf,"Employment and Training Review Protocol" "College as a job advancement strategy: An interim report on the New Visions Self-Sufficiency and Lifelong Learning Project","Fein, D., Beecroft, E., Long, D., & Robertson A. (2003). College as a job advancement strategy: An interim report on the New Visions Self-Sufficiency and Lifelong Learning Project. Cambridge, MA: Abt Associates Inc.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of Riverside Community College’s New Visions Self-Sufficiency and Lifelong Learning Project on welfare recipients’ employment, earnings, and welfare receipt. The study is based on a randomized controlled trial and estimated the effect of offering welfare recipients the New Visions program by using California and community college administrative data to compare average outcomes among those offered access to the program to the average outcomes of those excluded, after adjusting for differences between the groups. The authors found that access to the New Visions program increased the average number of quarters during which participants received Temporary Assistance for Needy Families (TANF) benefits and increased the average amount of TANF benefits received in the first two years. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the New Visions program, and not to other factors.","the New Visions Self-Sufficiency and Lifelong Learning Project","Community college education and other classroom training Other employment and reemployment","Low income, Parent",,"United States",2003,,"Employment and Training Review Protocol" "Impact of public support payments, intensive psychiatric community care, and program fidelity on employment outcomes for people with severe mental illness","Resnick, S., Neale, M., & Rosenheck, R. (2003). Impact of public support payments, intensive psychiatric community care, and program fidelity on employment outcomes for people with severe mental illness. The Journal of Nervous and Mental Disease, 191(3), 139-144.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Unfavorable impacts Employment","Summary: The study evaluated the one-year impacts of a U.S. Department of Veterans Affairs (VA) model of assertive community treatment for veterans with serious mental illnesses known as Intensive Psychiatric Community Care (IPCC) on employment. The study conducted a randomized controlled trial (RCT); those randomly assigned to the treatment group were eligible to receive the IPCC services, whereas those randomly assigned to the control group could not access IPCC services but could use other available health- and workforce-related services from the VA. The authors analyzed outcomes based on self-reported employment data collected from participants one year after random assignment. The study found that 7 percent of veterans in the IPCC group were employed one year after random assignment compared to 11 percent of veterans in the control group. The authors did not report the statistical significance of this difference. The quality of the causal evidence presented in this report is high because it was based on a well-conducted RCT. This means we have confidence that the estimated effects are attributable to the IPCC program and not other factors.","Intensive Psychiatric Community Care (IPCC)","Health Job search assistance and supportive services Veterans' reemployment Basic skills","Disability, Veteran or military",,"United States",2003,https://journals.lww.com/jonmd/Abstract/2003/03000/IMPACT_OF_PUBLIC_SUPPORT_PAY…,"Employment and Training Review Protocol" "Impact of public support payments, intensive psychiatric community care, and program fidelity on employment outcomes for people with severe mental illness","Resnick, S., Neale, M., & Rosenheck, R. (2003). Impact of public support payments, intensive psychiatric community care, and program fidelity on employment outcomes for people with severe mental illness. The Journal of Nervous and Mental Disease, 191(3), 139-144.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to evaluate the one-year impacts of a Department of Veterans Affairs (VA) model of assertive community treatment for veterans with serious mental illnesses known as Intensive Psychiatric Community Care (IPCC). The study was based on a randomized controlled trial. Roughly half of the 528 veterans participating in the study were randomly assigned to receive the IPCC treatment while the other half received standard VA services. The authors analyzed self-reported employment data collected from participants one year after random assignment. The study found that veterans in the IPCC group were three times more likely to be employed one year after random assignment than veterans in the control group. The quality of the causal evidence presented in this report is high because it is based on a well-conducted randomized controlled trial. This means we have confidence that the estimated effects are attributable to the IPCC program, and not other factors.","Intensive Psychiatric Community Care (IPCC)","Veterans' reemployment Vocational rehabilitation","Disability, Veteran or military",,"United States",2003,,"Disability Employment Policy Review Protocol" "Going to war and going to college: Did World War II and the G.I. Bill increase educational attainment for returning veterans?","Bound, J., & Turner, S. (2002). Going to war and going to college: Did World War II and the G.I. Bill increase educational attainment for returning veterans? Journal of Labor Economics, 20(4), 784-815.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the World War II (WWII) G.I. Bill on years of college completed and college completion. The authors used nonexperimental analyses to compare education outcomes for those eligible and not eligible for the WWII G.I. Bill benefits using data from the 1970 U.S. Census. The study found that being eligible for WWII G.I. Bill benefits was associated with completing more years of college and a greater likelihood of completing college. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the WWII G.I. Bill; other factors are likely to have contributed to the findings.","the WWII G.I. Bill","Veterans' reemployment Community college education and other classroom training","Veteran or military",,"United States",2002,https://www.journals.uchicago.edu/doi/abs/10.1086/342012,"Employment and Training Review Protocol" "Cognitive rehabilitation for traumatic brain injury: A randomized trial","Salazar, A., Warden, D., Schwab, K., Spector, J., Braverman, S., Walter, J., . . . Ellenbogen, R. (2000). Cognitive rehabilitation for traumatic brain injury: A randomized trial. Journal of American Medical Association, 283(23), 3075-3081.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine the impact of in-hospital and home rehabilitation programs on the employment and health status of active duty military members with severe traumatic brain injuries (TBIs). The study was a randomized controlled trial conducted at the Walter Reed Army Medical Center, where 120 active duty military members with TBI were randomly assigned to receive either in-hospital rehabilitation or home rehabilitation. Researchers collected outcome data 8 weeks and 6, 12, and 24 months after randomization. Although the study authors originally hypothesized that in-hospital rehabilitation would increase the rates of patients who were able to return to work or able to return to active duty, the study found no statistically significant difference between the two groups on these outcomes. The quality of the causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any differences in outcomes would be attributable to the more effective program; however, there were no statistically significant differences between the programs.","the In-hospital and Home Rehabilitation Programs Studied","Vocational rehabilitation","Disability, Veteran or military",,"United States",2000,,"Disability Employment Policy Review Protocol" "College as a job advancement strategy: An early report of the New Visions Self-Sufficiency and Lifelong Learning Project","Fein, D., Beecroft, E., Long, D., & Catalfamo, A. (2000). College as a job advancement strategy: An early report of the New Visions Self-Sufficiency and Lifelong Learning Project. Bethesda, MD: Abt Associates Inc.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of a pilot for Riverside Community College’s New Visions Self-Sufficiency and Lifelong Learning Project on welfare recipients’ welfare receipt. The study was based on a randomized controlled trial and estimated the effect of offering welfare recipients the New Visions program compared with encouraging recipients to participate in other employment services. The authors used California Temporary Assistance for Needy Families (TANF) records to compare average outcomes among those offered access to the program against the average outcomes of those excluded, after adjusting for differences in demographic and pre-intervention characteristics between the groups. The authors did not find any statistically significant effect of the New Visions program on the likelihood of receiving TANF or the amount of TANF benefits received. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the New Visions Project, and not to other factors.","the New Visions Self-Sufficiency and Lifelong Learning Project","Community college education and other classroom training Other employment and reemployment","Low income, Parent",,"United States",2000,http://files.eric.ed.gov/fulltext/ED466834.pdf,"Employment and Training Review Protocol" "Final report on the implementation and impacts of the Minnesota Family Investment Program in Ramsey County. [MFIP-R versus AFDC, single parents in the early cohort]","Auspos, P., Miller, C., & Hunter, J. A. (2000). Final report on the implementation and impacts of the Minnesota Family Investment Program in Ramsey County. Washington, DC: U.S. Department of Health and Human Services, Administration for Children and Families, Office of Planning, Research and Evaluation. [MFIP-R versus AFDC, single parents in the early cohort]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: The study’s objective was to examine the impact of the Minnesota Family Investment Program of Ramsey County (MFIP-R), a precursor to the national Temporary Assistance for Needy Families program, on participants’ employment, earnings, and benefit receipt. The authors used a randomized controlled trial design, assigning eligible families to either MFIP-R or existing services. Employment, earnings, and benefit receipt data were collected quarterly from Minnesota’s Unemployment Insurance earnings and public assistance benefit records. This review was conducted in collaboration with the Employment Strategies for Low-Income Adults Evidence Review (ESER). Because ESER did not report findings for studies that received a low causal evidence rating, this CLEAR profile does not report the findings either. The quality of causal evidence presented in this report is low because assignment to condition was not fully random, and the authors did not account for potential pre-existing differences in group characteristics in their analysis. This means we are not confident that the estimated effects are attributable to MFIP-R; other factors are likely to have contributed.","the Minnesota Family Investment Program of Ramsey County (MFIP-R)","Job search assistance and supportive services Other employment and reemployment","Low income, Parent",,"United States",2000,http://www.mdrc.org/sites/default/files/full_364.pdf,"Employment and Training Review Protocol" "New Hope for people with low incomes: Two-year results of a program to reduce poverty and reform welfare","Bos, J., Huston, A., Granger, R., Duncan, G., Brock, T., & McLoyd, V. (1999). New Hope for people with low incomes: Two-year results of a program to reduce poverty and reform welfare. New York: MDRC.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the New Hope program on employment, earnings, public benefits receipt, and educational attainment. The authors estimated the impact of the New Hope program by comparing average outcomes among a treatment group randomly selected to have access to the program with those of a randomly selected control group that did not have access to the program. The study found that receiving access to New Hope services increased average earnings in the first year of the program by $583 and the average likelihood of ever being employed in the first and second year of the program by 7.8 percentage points and 5.5 percentage points, respectively. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the New Hope program, and not to other factors.","The New Hope Program","Other employment and reemployment Other training and education","Low income, Parent",,"United States",1999,http://files.eric.ed.gov/fulltext/ED433455.pdf,"Employment and Training Review Protocol" "An evaluation of an urban community college Single Parent and Displaced Homemaker Program (Doctoral dissertation)","Rice, L. M. (1999). An evaluation of an urban community college Single Parent and Displaced Homemaker Program (Doctoral dissertation). Old Dominion University. DOI: 10.25777/tqh7-3c76","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study's objective was to examine the impact of the Single Parent and Displaced Homemaker Program on education outcomes by students at an urban community college. The study used a nonexperimental design to compare the outcomes of program participants to those on the waiting list. Using data from the community college’s Students Information System, the author conducted statistical tests to examine the differences between groups. The study found that participation in the Single Parent and Displaced Homemaker Program was significantly related to increased retention rates and number of credits taken. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Single Parent and Displaced Homemaker Program; other factors are likely to have contributed.","the Single Parent and Displaced Homemaker Program","Employment and Training Services Training and Education Capacity building programs Community college education and other classroom training Other training and education","Adult, Other barriers, Female, Parent",,"Urban, United States",1999,https://digitalcommons.odu.edu/urbanservices_education_etds/50/,"Community College Review Protocol" "Enhancing substance abuse treatment with case management: Its impact on employment","Siegal, H. A., Fisher, J. H., Rapp, R. C., & Kelliher, C. W. (1996). Enhancing substance abuse treatment with case management: Its impact on employment. Journal of Substance Abuse Treatment, 13(2), 93-98.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study aimed to examine the impact of a strengths-based case management intervention on veterans’ employment and earnings. Even though the treatment and control groups were randomly assigned, the study used a pre/post analysis design to compare all participants before the study to all participants six months after the study began. The study collected data using the Addiction Severity Index (ASI-5) and study-created measures including levels of drug use, substance abuse treatment history, health and psychiatric status, occupational and education functioning, living situation, relationship with family and peers, and HIV risk status. The study found all study participants, including those in the intervention and control groups, increased earnings and days employed at the six-month follow-up. The quality of causal evidence presented in this report is low because the authors did not account for trends in outcomes before the intervention. This means we are not confident that the estimated effects are attributable to strengths-based case management; other factors are likely to have contributed.","the strengths-based case management","Substance abuse recovery Job search assistance and supportive services Veterans' reemployment","Other barriers, Veteran or military",,"United States",1996,https://doi.org/10.1016/0740-5472(96)00029-3,"Employment and Training Review Protocol" "Outcome evaluation of the Army Career and Alumni Program’s Job Assistance Centers (Study Report 96-04)","Sadacca, R., Laurence, J. H., DiFazio, A. S., Rauch, H. J., & Hintz, D. W. (1995) Outcome evaluation of the Army Career and Alumni Program’s Job Assistance Centers (Study Report 96-04). Alexandria, VA: Human Resources Research Organization.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Mixed impacts Earnings and wages Public benefits receipt-Low-Mixed impacts Public benefit receipt","Summary: The study’s objective was to examine the impact Job Assistance Centers (JACs) and the Transition Assistance Program (TAP) offered to ex-servicemembers had on their earnings and public benefits receipt. The study used a nonexperimental analysis to compare the outcomes of ex-servicemembers transitioning from military to civilian jobs who received various JAC or TAP services to the outcomes of those who did not receive JAC or TAP services. The authors used administrative records from the U.S. Department of Defense, the U.S. Army, and JACs, as well as data from a follow-up survey. The study showed mixed findings on the relationships between receipt of JAC and TAP services and earnings, as well as on the relationships between receipt of JAC and TAP services and receipt of unemployment compensation. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to JACs and TAP; other factors are likely to have contributed.","Job Assistance Centers and the Transition Assistance Program","Job search assistance and supportive services Other employment and reemployment Veterans' reemployment","Dislocated or displaced worker, Veteran or military",,"United States",1995,,"Employment and Training Review Protocol" "The effect of veterans benefits on education and earnings","Angrist, J. D. (1993). The effect of veterans benefits on education and earnings. Industrial and Labor Relations Review, 46(4), 637-652.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the effects of veteran benefits on the post-service education and earnings of soldiers who served in the Vietnam era and in the first years of the All-Volunteer Forces (AVF). The study used statistical tests in a nonexperimental analysis to evaluate the effects of veteran benefits. The data came from the U.S. Census Bureau’s 1987 Survey of Veterans. The study found a statistically significant positive relationship between veteran benefits and education and earnings outcomes. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to veteran benefits; other factors are likely to have contributed.","the veteran benefits","Other wages and benefits Other training and education","Veteran or military",,"United States",1993,https://doi.org/10.1177%2F001979399304600404,"Employment and Training Review Protocol" "Pay and participation in work activity: Clinical benefits for clients with schizophrenia","Bell, M.D., & Milstein, R.M. (1993). Pay and participation in work activity: Clinical benefits for clients with schizophrenia. Psychosocial Rehabilitation Journal, 17(2), 173-176.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of a paid supported work program for veterans diagnosed with schizophrenia or schizoaffective disorder on their employment, earnings, wages, and health outcomes. The authors used a randomized controlled trial to compare outcomes of veterans assigned to the paid supported work condition with those assigned to the unpaid work condition using data collected through interviews at baseline and five months later. The authors found that the paid group had higher employment and earnings and fewer depressive symptoms five months after random assignment compared with the unpaid group. The quality of causal evidence presented in this report is low because it was based on a randomized controlled trial in which the analytic sample sizes are unknown, and the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to paid supported work; other factors are likely to have contributed to the findings.","the Paid Supported Work Program","Health Veterans' reemployment","Disability, Veteran or military",,"United States",1993,https://psycnet.apa.org/doi/10.1037/h0095590,"Employment and Training Review Protocol" "Schizophrenic symptoms, work adjustment, and behavioral family therapy","Glynn, S. M., Randolph, E. T., Eth, S., Paz, G. G., Leong, G. B., Shaner, A. L., & Vort, W. V. (1992). Schizophrenic symptoms, work adjustment, and behavioral family therapy. Rehabilitation Psychology, 37(4), 323-338.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-No impacts Employment","Summary: This study examined the impact of behavioral family therapy on male veterans’ employment. The study conducted a randomized controlled trial using data from self-reported responses to the Social Adjustment Scale, Version I. The study showed that behavioral family therapy did not have statistically significant effects on employment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects are attributable to behavioral family therapy and not to other factors. However, the study did not show any statistically significant effects.","Behavioral Family Therapy","Health Veterans' reemployment","Disability, Veteran or military",,"United States",1992,,"Employment and Training Review Protocol"