Title,Citation,Topic_area,Study_type,Study_evidence_rating,Outcome_effectiveness,Findings,Intervention_program,Topics,Target_population,Firm_characteristics,Geographic_setting,Original_publication_date,Original_publication_link "Pima Community College Pathways to Healthcare Program: Implementation and early impact report (Report No. 2017-10)","Gardiner, K., Rolston, H., Fein, D., & Cho, S-W. (2017). Pima Community College Pathways to Healthcare Program: Implementation and early impact report (Report No. 2017-10). Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to assess the impact of the Pathways to Healthcare program on students’ education and employment outcomes. The study used a randomized controlled trial to compare outcomes of students enrolled in the Pathways to Healthcare program with non-participants. The study found that Pathways to Healthcare program participants had significantly higher average total hours of college occupational training, higher rates of certification receipt, and higher rates of credential receipt from a college than the control group. The quality of causal evidence presented in this study is high because it is based on a well-implemented randomized controlled trial with low attrition. This means we are confident that the estimated effects are attributable to the Pathways to Healthcare program and not to other factors.","the Pathways to Healthcare Program","Basic skills Capacity building programs Community college education and other classroom training","Adult, Low-skilled, Low income","Health care and social assistance","United States",2017,https://www.acf.hhs.gov/sites/default/files/opre/pathways_to_healthcare_impleme… "The real effects of mandated information on social responsibility in financial reports: Evidence from mine-safety records","Christensen, H. B., Floyd, E., Liu, L. Y., & Maffett, M. (2017). The real effects of mandated information on social responsibility in financial reports: Evidence from mine-safety records. Journal of Accounting and Economics, 64(2-3), 284-304. https://doi.org/10.1016/j.jacceco.2017.08.001","Mine Workers and Mine Health and Safety","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Health and safety-Mod/high-Favorable impacts Health and safety","Summary: The study’s objective was to examine the impact of mine safety disclosures (MSD) on health and safety outcomes. The authors used a difference-in-differences model to compare the changes in safety citations and injury rates for mines that are required to include MSD records in financial reports with mines that are not. The study found that including safety records in financial reports is associated with a significant reduction in mining-related citations and worker injuries. The quality of causal evidence presented in this report is moderate because it is based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the mandatory inclusion of mine safety disclosures (MSD), but other factors might also have contributed.",,"Mine safety and health Workplace injury",,"Mining, quarrying, and oil and gas extraction","United States",2017,https://doi.org/10.1016/j.jacceco.2017.08.001 "Implementation of risk management programs: Identification of best practices to reduce injuries and maximize economic benefits","Burgess, J. L. (2016). Implementation of risk management programs: Identification of best practices to reduce injuries and maximize economic benefits. (Report No. AFC113-07). Tucson, Arizona: University of Arizona.","Mine Workers and Mine Health and Safety","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Health and safety-Low-Favorable impacts Health and safety","Summary: The study’s objective was to examine the impact of risk management practices on mine worker health and safety outcomes. The study used a nonexperimental design to compare the differences in 25-year injury rates and lost time injury rates between four mines that implemented risk management practices and a matched comparison group of mines that did not. The study found that implementation of risk management practices in one mine was significantly associated with a lower lost time injury rate than the comparison group of mines. The quality of causal evidence presented in this report is low because the author did not account for preexisting differences between the groups before the intervention or include sufficient control variables. This means we are not confident that the estimated effects are attributable to the risk management practices; other factors are likely to have contributed.","Risk Management","Mine safety and health Workplace injury",,"Mining, quarrying, and oil and gas extraction","United States",2016, "The Mining Healthy Worksite Program","Cherniack, M. (2016). The Mining Healthy Worksite Program. (Grant No. AFC113-9). Philadelphia, PA: Alpha Foundation for the Improvement of Mine Safety and Health, Inc.","Mine Workers and Mine Health and Safety","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Health and safety-Low-Favorable impacts Health and safety","Summary: The study’s objective was to examine the impact of the Mining Healthy Worksite Program (MHWP) on mine worker health and safety outcomes. The study used a nonexperimental design to assess self-reported health and safety knowledge after mining apprentices completed underground mining or surface mining MHWP courses. Using survey data, the author conducted statistical models to examine differences in outcomes between the groups. The study found a significant positive relationship between knowledge and transfer of training in the Hearing Loss and Prevention module for both surface and underground mining apprentices. The study also found that participation in the surface mining course was significantly associated with higher knowledge scores than the underground mining course. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Mining Healthy Worksite Program (MHWP); other factors are likely to have contributed.","Mining Healthy Worksite Program (MHWP)","Mine safety and health Workplace injury",,"Mining, quarrying, and oil and gas extraction","United States",2016,https://www.alpha-foundation.org/wp-content/uploads/2016/11/AFC113-9_Connecticu… "Evaluating the effectiveness of mine safety enforcement actions in forecasting the lost-days rate at specific worksites","Gernand, J. M. (2016). Evaluating the effectiveness of mine safety enforcement actions in forecasting the lost-days rate at specific worksites. Journal of Risk and Uncertainty in Engineering Systems, 2(4). https://doi.org/10.1115/1.4032929","Mine Workers and Mine Health and Safety","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Health and safety-Mod/high-Favorable impacts Health and safety","Summary: The study’s objective was to examine the impact of Mine Safety and Health Administration (MSHA) inspection violations on future accidents and injuries in underground coal mines. The author used statistical models and publicly available MSHA data to predict whether a non-fatal or severe disabling injury would occur in the 12 months following an infraction. The study found that the rate of lost-time injuries could be significantly predicted by total worker time at the mine and the average penalty assessed by MSHA, with a lower likelihood of injury with increased number of worker days at the mine and higher penalties per violation. The quality of causal evidence presented in this report is moderate because it is based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to MSHA inspection violations, but other factors might also have contributed.",,"Mine safety and health Workplace injury",,"Mining, quarrying, and oil and gas extraction","United States",2016,https://doi.org/10.1115/1.4032929 "The impact of a randomly assigned time and place management initiative on work and retirement expectations.","Cahill, K. E., James, J. B., & Pitt-Catsouphes, M. (2015). The impact of a randomly assigned time and place management initiative on work and retirement expectations. Work, Aging and Retirement, 1(4), 350-368.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Unfavorable impacts Employment","Summary: The study examined the impact of a time and place management (TPM) initiative at a medical provider on retirement expectations among workers ages 50 and older. The study was a randomized control trial and used a series of surveys and administrative data to estimate the impact. The study found that, when surveyed 12 months after randomization, employees in the treatment group were statistically significantly more likely to expect to directly exit their job as opposed to staying in their current job within the next five years. The quality of causal evidence presented in this report is moderate because the study was a randomized controlled trial with high attrition, but the authors did demonstrate that the treatment and control groups were similar before the intervention. This means we are somewhat confident that the estimated effects are attributable to TPM, but other factors might also have contributed.","Time and Placement Management (TPM)","Older workers' programs","Older worker","Health care and social assistance",,2015,https://hrs.isr.umich.edu/publications/biblio/8231 "Evaluation of automated vs. manual bagger exposures related to ergonomics, dust, and noise at a sand mine processing plant","Wilson, L. A. (2015). Evaluation of automated vs. manual bagger exposures related to ergonomics, dust, and noise at a sand mine processing plant (Unpublished master’s thesis). Montana Tech of the University of Montana, Butte, MT.","Mine Workers and Mine Health and Safety","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Health and safety-Low-Favorable impacts Health and safety","Summary: The study’s objective was to examine the impact of an automated bagging system on mine worker health and safety outcomes. Using data from a sand mining plant, the author used an interrupted time series design to compare the rates of mine worker injuries and health issues before and after implementing an automated bagging system. The study found that implementation of an automated bagging system is significantly associated with a reduction in noise exposure. The quality of causal evidence presented in this report is low because the authors did not observe outcomes for multiple periods before and after the intervention. This means we are not confident that the estimated effects are attributable to the automated bagging system; other factors are likely to have contributed.",,"Mine safety and health Workplace injury",,"Mining, quarrying, and oil and gas extraction","United States",2015,https://digitalcommons.mtech.edu/cgi/viewcontent.cgi?referer=https%3A//scholar… "Net impact and benefit-cost estimates of the workforce development system in Washington state. (Upjohn Institute Technical Report No. 13-029). [Private career school programs]","Hollenbeck, K., & Huang, W.-J. (2014). Net impact and benefit-cost estimates of the workforce development system in Washington state. (Upjohn Institute Technical Report No. 13-029). Retrieved from W.E. Upjohn Institute for Employment Research website: http://dx.doi.org/10.17848/tr13-029 [Private career school programs]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Unfavorable impacts Employment Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of private career schools’ programs on the employment rate, earnings, and benefit receipt of adults who completed high school in Washington State. The authors used a nonexperimental method to compare short-term (3 quarters after program exit) and long-term (9 to 12 quarters after program exit) employment, earnings, and Unemployment Insurance benefits between those who took part in private career school programs with those who registered for services at the Labor Exchange Employment Services. The study found that, compared with those who registered for services at the Labor Exchange, participants in private career school programs had lower initial employment but higher long-term employment and earnings. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before program participation. This means we are not confident that the estimated effects are attributable to private career school programs; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Private Career School Programs","Other training and education",Adult,"Other services, Transportation and warehousing","United States",2014,http://research.upjohn.org/cgi/viewcontent.cgi?article=1032&context=up_technica… "Gasper, J., & Henderson, K. (2014). Sector-focused career centers evaluation: Effects on employment and earnings after one year.","Gasper, J., & Henderson, K. (2014). Sector-focused career centers evaluation: Effects on employment and earnings after one year. New York: New York City Center for Economic Opportunity. Retrieved from http://www.nyc.gov/html/ceo/downloads/pdf/CEO-Sector_Based_Approaches_Evaluation_Report-2014_final.pdf.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: The study’s objective was to examine the impact of sector-focused career centers in New York City on employment and earnings. The authors estimated the effect of sector-focused career centers by comparing employment and earnings outcomes captured in New York State unemployment insurance data among participants in New York City sector-focused career centers against the outcomes for individuals served by New York City career centers without a specific sector focus who were deemed similar in terms of initial characteristics to the sector-focused group. This review was conducted in collaboration with the Employment Strategies for Low-Income Adults Evidence Review (ESER). Because ESER did not report findings for studies that received a low causal evidence rating, the CLEAR profile does not report the findings either. The quality of causal evidence presented in this report is low because the authors did not demonstrate that the groups were similar at baseline or make statistical adjustments for differences between the two groups in the analyses. This means we are not confident that the estimated effects are attributable to sector-focused career centers; other factors are likely to have contributed.","New York City Sector-focused Career Centers","Job search assistance and supportive services Other employment and reemployment","Low income","Manufacturing, Health care and social assistance, Transportation and warehousing","Urban, United States",2014,http://www.nyc.gov/html/ceo/downloads/pdf/CEO-Sector_Based_Approaches_Evaluatio… "The impact of career mentoring and psychosocial mentoring on affective organizational commitment, job involvement, and turnover intention","Craig, C. A., Allen, M. W., Reid, M. F., Riemenschneider, C. K., & Armstrong, D. J. (2013). The impact of career mentoring and psychosocial mentoring on affective organizational commitment, job involvement, and turnover intention. Administration & Society, 45(8), 949–973. doi:10.1177/0095399712451885","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Mixed impacts Employment","Summary: This study examines the relationship between mentoring and employees’ employment outcomes. Specifically, the study examines the relationship between psychosocial mentoring and turnover intention. The authors used a statistical model in a nonexperimental analysis to determine the relationship between mentoring and employment outcomes using data from a convenience sample of information technology (IT) staff in one state agency of a state located in the south-central region of the United States. The study found a statistically significant favorable relationship between one type of mentoring, psychosocial mentoring, and turnover intention. In other words, if a respondent reported participating in psychosocial mentoring, they tended to be less likely to intend to leave the job. There was no statistically significant relationship between the other type of mentoring in the study, career mentoring, and turnover intention. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups compared were similar before the intervention. This means we are not confident that the estimated relationships are attributable to psychosocial mentoring; other factors are likely to have contributed.",,Mentoring,"STEM professional","Professional, scientific, and technical services","United States",2013,https://journals.sagepub.com/doi/10.1177/0095399712451885 "Effect of control order on steering a simulated underground coal shuttle car","Burgess-Limerick, R., Zupanc, C., & Wallis, G. (2013). Effect of control order on steering a simulated underground coal shuttle car. Applied Ergonomics, 44(2), 225-229. https://doi.org/10.1016/j.apergo.2012.07.007","Mine Workers and Mine Health and Safety","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Health and safety-Mod/high-Favorable impacts Health and safety","Summary: The study’s objective was to examine the impact of first-order and second-order joystick controls on mining shuttle car steering accuracy over multiple trials. The study was a randomized controlled trial conducted in a laboratory setting. The authors compared the steering accuracy of mining shuttle car operators when the operators were using a first-order versus second-order joystick steering mechanism and how the accuracy varied with repeated trials. The study found that the operators using the first-order joystick control had significantly better steering accuracy than those using the second-order joystick control. Both groups significantly improved over the three trials and the difference in the performance of the two groups lessened over the three trials. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the joystick mechanism, and not to other factors.",,"Mine safety and health Workplace injury",,"Mining, quarrying, and oil and gas extraction","United States",2013,https://doi.org/10.1016/j.apergo.2012.07.007 "A comparison of student outcomes and overall retention between a 10-week accelerated and a 15-week traditional curriculum in a postsecondary apprenticeship training program","Adams, G. (2013). A comparison of student outcomes and overall retention between a 10-week accelerated and a 15-week traditional curriculum in a postsecondary apprenticeship training program (Doctoral dissertation). Available from ProQuest Dissertations & Theses A&I. (Accession No. 3575536).","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Training-Low-Favorable impacts Training","Summary: The study’s objective was to examine the impact of compressed delivery of a World Class Shipbuilding apprenticeship program on program retention. The Apprentice School of Newport News Shipbuilding compressed its delivery of program instructional hours from 75 weeks (five 15-week terms) to 40 weeks (four 10-week terms) in January 2009. The author compared administrative data on program completion for all apprentices who enrolled at the school from January 2004 to December 2008 (the comparison group) with those who enrolled from January 2009 to June 2012 (the treatment group). The study found that students who enrolled in the 40-week program were 17 percentage points more likely to be retained in the program than students who enrolled in the 75-week program, a statistically significant finding. The quality of causal evidence presented in this report is low because the treatment and comparison groups were not equivalent before the intervention, and the author did not adjust for these differences during analysis. This means we are not confident that the estimated effects are attributable to the compression of the apprenticeship program; other factors are likely to have contributed.","the Apprentice School of Newport News Shipbuilding","Registered apprenticeship Work based and other occupational training",Adult,Manufacturing,"United States",2013, "Accelerating change for women faculty of color in STEM: Policy, action, and collaboration","Institute for Women’s Policy Research. (2013). Accelerating change for women faculty of color in STEM: Policy, action, and collaboration. Washington, DC: Institute for Women’s Policy Research.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: This report highlighted a 2013 convening of stakeholders who discussed barriers to becoming successful STEM faculty for black, Hispanic, and Native American women, and strategies to overcome those barriers. The Institute for Women’s Policy Research organized the convening. The report was compiled from a series of conference sessions presented at the convening by about 50 experts from various academic, political, corporate, and community sectors. Session topics included the current status of women of color in STEM, areas of progress and nonprogress, and current initiatives to increase the representation of women of color in STEM faculty positions. Attendees provided recommendations for improvement. Conference representatives identified three main barriers to the advancement of minority female faculty: workplace climate policies that did not meet the needs of female faculty of color, a lack of multicultural perspectives, and a lack of embracement of diversity in academic departments. Health, financial, and family issues and obligations; high community service demands; and a lack of social support also created unique challenges for this population. Recommendations for improvement included raising awareness of underrepresentation of minority women in STEM faculty positions, monitoring and publicizing institutions’ progress on diversity in STEM faculty, and tailoring faculty mentoring programs or tools to effectively serve female faculty of color.",,"Science, Technology, Engineering, and Math (STEM) programs Other disparities or discrimination in employment and earnings","Female, STEM professional, Black or African American, Hispanic of any race, American Indian or Alaska Native","Professional, scientific, and technical services","United States",2013,http://www.iwpr.org/publications/pubs/accelerating-change-for-women-faculty-of-… "The effects of hands-on activities on middle school females’ spatial skills and interest in engineering and technology-based careers","Phelps, M. (2012). The effects of hands-on activities on middle school females’ spatial skills and interest in engineering and technology-based careers. Proceedings of the 2012 American Society for Engineering Education Annual Conference & Exposition. Washington, DC: American Society for Engineering Education.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Attitudes-Low-Favorable impacts Attitudes","Summary: The study’s objective was to examine the impact of participating in technology-based three-dimensional hands-on activities on middle school girls’ interest in becoming an engineer or technologist. The activities took place at a 2006 Society of Women Engineers-sponsored event and included designing and constructing a vehicle and assembling an electrical circuit. The author conducted statistical analyses to compare self-reported career interests of girls who participated in the hands-on activities and those who did not, as measured by a program-administered survey. The study found that participation in the hands-on activities was positively related to increased interest in becoming an engineer or technologist. The quality of causal evidence presented in this report is low. This means we are not confident that the estimated effects are attributable to the hands-on activities; other factors are likely to have contributed.","the Intervention","Science, Technology, Engineering, and Math (STEM) programs Youth programs","Youth, Female","Professional, scientific, and technical services","United States",2012,https://peer.asee.org/the-effects-of-hands-on-activities-on-middle-school-femal… "A new estimate of the impact of OSHA inspections on manufacturing injury rates, 1998-2005","Haviland, A., Burns, R., Gray, W., Ruder, T., & Mendeloff, J. (2012). A new estimate of the impact of OSHA inspections on manufacturing injury rates, 1998-2005. American Journal of Industrial Medicine, 55(11), 964-975.","OSHA Enforcement","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Health and safety-Low-Favorable impacts Health and safety","Summary: The study’s objective was to determine the effect of OSHA inspections on injuries in single-facility manufacturing firms in Pennsylvania between 1998 and 2005. The study used a regression model to compare the changes in workplace injuries of firms that had received particular types of inspections to those that had not received those types of inspections. The study found that inspections with penalties were associated with a statistically significantly decrease in injuries by an average of 19 to 24 percent annually in the two years after the inspection. The quality of the causal evidence presented in this study is low. This means we are not confident that the differences in workplace injuries between firms that received particular types of OSHA inspections and firms that did not receive those types of inspections are attributable to the inspections.","OSHA Enforcement Activities","Inspections Workplace injury",Employed,Manufacturing,"United States",2012, "A promising start: Initial impacts of Year Up on low-income young adults’ careers.","Roder, A., & Elliott, M. (2011). A promising start: Initial impacts of Year Up on low-income young adults' careers. Economic Mobility Corporation.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Mixed impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-No impacts Employment","Summary: This report presents preliminary findings for the impacts of the Year Up program, which provides technical skills training and internships to low-income adults ages 18 to 24. The authors randomly assigned eligible applicants to either be invited to participate in the program immediately (treatment group) or gain entry after 10 months (control group). They compared the outcomes of treatment and control group members for approximately two years after random assignment. The authors reported many statistically significant and positive impacts of the program in the second year after random assignment. These included impacts on annual earnings and hourly wages. The quality of causal evidence is low because the randomized controlled trial had high attrition and the study did not show that the groups being compared were equivalent prior to the program. This means we are not confident that the estimated effects are attributable to Year Up. Other factors are likely to have contributed.","Year Up","Mentoring Work based and other occupational training Youth programs","Youth, Low income","Finance and insurance","United States, Urban",2011, "Stemming inequality? Employment and pay of female and minority scientists and engineers in the federal and private sectors","Oh, S., & Lewis, G. (2011). Stemming inequality? Employment and pay of female and minority scientists and engineers in the federal and private sectors. Social Science Journal, 48(2), 397-403.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study investigated the relationships among sector (federal or private); science, technology, engineering, and mathematics (STEM) occupation; gender or racial minority status; and earnings to determine whether federal- or private-sector STEM positions offer the greatest financial opportunities for female and racial minority STEM professionals. The authors compared the earnings of male and female STEM and non-STEM public sector employees in 1983 and 2003 using a 1 percent sample of the Office of Personnel Management’s Central Personnel Data File. To compare public- and private-sector outcomes, the authors also analyzed a 5 percent sample of the 2000 U.S. Census, examining differences in STEM and non-STEM public and private employees’ salaries by gender and race. The study found that women in public sector STEM positions earned 7.2 percent less than men in comparable public sector positions in 1983 even after controlling for education, STEM field, tenure, age, and race. This gender pay gap disappeared in the 2003 sample. Race and gender pay disparities, measured as the average difference in pay between racial minorities or women and white men, are smaller in the federal than the private sector and for STEM relative to non-STEM occupations. For example, in 1999, black male federal STEM employees earned 8.3 percent less than white men, compared to a pay gap of 10.9 percent for black male private sector STEM employees. For black men in non-STEM occupations, the pay gap relative to white men was 11.1 percent in the public sector and 20.6 percent in the private sector.",,"Science, Technology, Engineering, and Math (STEM) programs Other disparities or discrimination in employment and earnings","Other barriers, Female, STEM professional","Professional, scientific, and technical services","United States",2011, "What kinds of injuries do OSHA inspections prevent? ","Haviland, A., Burns, R., Gray, W., Ruder, T., & Mendeloff, J. (2010). What kinds of injuries do OSHA inspections prevent? Journal of Safety Research, 41(4), 339-345.","OSHA Enforcement","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Health and safety-Low-Favorable impacts Health and safety","Summary: The study’s objective was to determine whether OSHA inspections that resulted in penalties or citations prevented specific types of workplace injuries. The study used a regression model to compare the changes in the workplace injuries in single-facility manufacturing firms that had received an inspection that resulted in a penalty or citation to changes in firms that had not received a penalty or citation. The group of firms that had not received a penalty or citation combined two types of firms: firms that had not been inspected and firms that received inspections that did not result in a penalty or citation. The study found that inspections that imposed penalties were associated with statistically significant reductions in the rates of all types of injuries examined. Among the specific citations studied, only citations for violating the general standard for personal protective equipment were associated with reduced injury rates. The quality of the causal evidence presented in this study is low. This means we are not confident that OSHA inspections that resulted in penalties or citations caused the reductions in workplace injuries.","OSHA Enforcement Activities","Inspections Other health and safety Workplace injury",Employed,Manufacturing,"United States",2010, "Tuning in to local labor markets: Findings from the Sectoral Employment Impact Study. [Per Scholas]","Maguire, S., Freely, J., Clymer, C., Conway, M., & Schwartz, D. (2010). Tuning in to local labor markets: Findings from the Sectoral Employment Impact Study. Philadelphia, PA: Public/Private Ventures. [Per Scholas]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: The study’s objective was to examine the impact of the Per Scholas sectoral employment program on participants’ earnings and employment. The study was a randomized controlled trial and used survey data to estimate the effect of Per Scholas by comparing average outcomes among applicants offered access to the program with average outcomes of those excluded from the program, after adjusting for differences between the groups. This review was conducted in collaboration with the Employment Strategies for Low-Income Adults Evidence Review (ESER). Because ESER did not report findings for studies that received a low causal evidence rating, this CLEAR profile does not report the findings either. The quality of causal evidence presented in this report is low because the study was a randomized controlled trial with high attrition, and the authors did not demonstrate that the groups that remained in the study were similar before the intervention began. This means we would not be confident that the estimated effects would be attributable to Per Scholas; other factors are likely to have contributed. However, the study did not find statistically significant effects.","Per Scholas","Work based and other occupational training","Low income","Professional, scientific, and technical services","United States",2010,http://ppv.issuelab.org/resources/5101/5101.pdf "Tuning in to local labor markets: Findings from the Sectoral Employment impact study","Maguire, S., Freely, J., Clymer, C., Conway, M. & Schwartz, D. (2010). Tuning in to local labor markets: Findings from the Sectoral Employment impact study. Philadelphia: Public/Private Ventures. [Wisconsin Regional Training Partnership]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence",,"Summary: The study’s objective was to examine the impact of the Wisconsin Regional Training Partnership’s (WRTP) sectoral employment program on earnings and employment. The study was based on a randomized controlled trial and it estimated the effect of offering eligible WRTP applicants the program by using survey data to compare average outcomes among those offered access to the program against the average outcomes of those excluded, after adjusting for differences between the groups. The study found that being offered access to the WRTP’s sectoral employment program increased earnings by $6,255, on average, over the two years after acceptance to the program. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the WRTP’s sectoral employment program, and not to other factors.","Wisconsin Regional Training Partnership’s (WRTP) Sectoral Employment Program","Job search assistance and supportive services Other employment and reemployment","Low income","Professional, scientific, and technical services","United States",2010,http://ppv.issuelab.org/resources/5101/5101.pdf "The impact of culinary student extracurricular work experience on graduate persistence in the foodservice industry","Mesch, B. D. (2010). The impact of culinary student extracurricular work experience on graduate persistence in the foodservice industry. (Doctoral dissertation). Retrieved from ProQuest. Accession No. 872556263. [Graduate sample]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains Employment-Low-Favorable impacts Employment","Summary: The study examined the relationship between participation in extracurricular food service employment during culinary arts training and two eligible outcomes: students’ post-graduation employment in food service and the proportion of culinary arts courses students successfully completed. The author investigated similar research questions in another study of current culinary arts students, the profile of which is available [here]. The study used a nonexperimental design to compare the employment and educational outcomes of culinary arts graduates of one school who took part in extracurricular foodservice employment during their degree program with culinary arts graduates from the school who did not. Data for the study came from a survey of program graduates administered by the author and student records maintained by the school. The study found a statistically significant relationship between students’ participation in extracurricular food service employment during culinary school and postgraduation employment in the foodservice industry. The quality of causal evidence presented in this study is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to food service work experience; other factors are likely to have contributed.","the voluntary extracurricular employment in food service","Other training and education",Youth,"Accommodation and food services","United States",2010,https://search.proquest.com/openview/2bcb106f1d3cc1b9ccb7ffbe42547a1a/1?pq-orig… "Tuning in to local labor markets: Findings from the Sectoral Employment impact study","Maguire, S., Freely, J., Clymer, C., Conway, M. & Schwartz, D. (2010). Tuning in to local labor markets: Findings from the Sectoral Employment impact study. Philadelphia: Public/Private Ventures. [Wisconsin Regional Training Partnership]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine the impact of the Wisconsin Regional Training Partnership’s (WRTP) sectoral employment program on earnings and employment. The authors investigated similar research questions with two other programs, the profiles of which are available through the study search. The study was based on a randomized controlled trial, with the authors estimating the effect of offering eligible WRTP applicants the program by using survey data to compare average outcomes among those offered access to the program against the average outcomes of those not offered access, after adjusting for differences between the groups. The study found that being offered access to the WRTP’s sectoral employment program increased earnings by $6,255, on average, over the two years after acceptance to the program. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the WRTP’s sectoral employment program, and not to other factors.","the WRTP Sectoral Employment Program","Job search assistance and supportive services Other training and education","Low income","Construction, Manufacturing, Health care and social assistance","United States",2010,https://www.explorevr.org/sites/explorevr.org/files/files/Tuning%20In%20to%20Lo… "The impact of culinary student extracurricular work experience on graduate persistence in the foodservice industry","Mesch, B. D. (2010). The impact of culinary student extracurricular work experience on graduate persistence in the foodservice industry. (Doctoral dissertation). Retrieved from ProQuest. Accession No. 872556263. [Current student sample]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains","Summary: The study examined the relationship between participation in extracurricular food service employment during culinary arts training and the proportion of culinary arts courses students successfully completed. The author investigated similar research questions in another study of culinary arts graduates, the profile of which is available [here]. The study used a nonexperimental design to compare culinary arts students at one school who took part in extracurricular food service employment during their program with culinary arts students at the school who did not. Data for the study came from a survey of current students administered by the author and student records maintained by the school. The study did not find a statistically significant relationship between a students’ participation in extracurricular food service employment during culinary school and the percentage of culinary arts courses successfully completed. The quality of causal evidence presented in this study is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to food service work experience; other factors are likely to have contributed.","the voluntary extracurricular employment in food service","Other training and education",Youth,"Accommodation and food services","United States",2010,https://search.proquest.com/openview/2bcb106f1d3cc1b9ccb7ffbe42547a1a/1?pq-orig… "Do disability laws impair firm performance?","Bird, R., & Knopf, J. (2010). Do disability laws impair firm performance? American Business Law Journal, 47(1), 145-190.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Unfavorable impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the effect of state disability laws—those related to antidiscrimination and reasonable accommodation for employees with disabilities—on commercial banks’ number of full-time equivalent employees and their average salary. The authors estimated the impact of antidiscrimination and reasonable accommodation laws using a differences-in-differences regression model with state- and year-fixed effects. Data were obtained from the Federal Reserve Bank of Chicago’s Commercial Bank Database and from Global Insight. The study found that neither antidiscrimination nor reasonable accommodation laws had a statistically significant effect on bank employment levels during the year the law went into effect or during the subsequent three years. Antidiscrimination laws led to a statistically significant 1.3 percent decline in bank employees’ average salary in the third year after enactment, but not in any other time period. The quality of causal evidence presented in this report is low. This means we are not confident that the estimated effects are attributable to state disability laws. Other factors are likely to have contributed.","State Disability Laws","Americans with Disabilities Act (ADA)",Disability,"Finance and insurance","United States",2010, "Tuning in to local labor markets: Findings from the Sectoral Employment Impact Study","Maguire, S., Freely, J., Clymer, C., Conway, M., & Schwartz, D. (2010). Tuning in to local labor markets: Findings from the Sectoral Employment Impact Study. Philadelphia, PA: Public/Private Ventures. [Per Scholas]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: The study’s objective was to examine the impact of the Per Scholas sectoral employment program on participants’ earnings and employment. The authors investigated similar research questions with two other programs, the profiles of which are available through the study search. The study was a randomized controlled trial, with the authors using survey data to estimate the effect of Per Scholas by comparing average outcomes among applicants offered access to the program with average outcomes of those not offered access to the program, after adjusting for differences between the groups. This review was conducted in collaboration with the Employment Strategies for Low-Income Adults Evidence Review (ESER). Because ESER did not report findings for studies that received a low causal evidence rating, this CLEAR profile does not report the findings either. The quality of causal evidence presented in this report is low because the study was a randomized controlled trial with high attrition, and the authors did not demonstrate that the groups that remained in the study were similar before the intervention began. This means we would not be confident that the estimated effects would be attributable to the Per Scholas sectoral employment program; other factors are likely to have contributed. The study did not, however, find statistically significant effects.","Per Scholas","Job search assistance and supportive services Other training and education",Adult,"Professional, scientific, and technical services","United States",2010,https://www.explorevr.org/sites/explorevr.org/files/files/Tuning%20In%20to%20Lo… "Simplification and saving","Beshears, J., Choi, J., Laibson, D., & Madrian, B. (2010). Simplification and saving. Cambridge, MA: National Bureau of Economic Research.","Behavioral Finance: Retirement","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employer benefits receipt-Low-Favorable impacts Employer benefits receipt","Summary: The study’s key objective was to examine the impact of Quick Enrollment, an option enabling individuals to more quickly and easily enroll in a retirement savings plan, on plan enrollment rates and contribution levels at two firms in the United States (companies A and B). The study also examined the impact of Easy Escalation, an option enabling individuals to quickly increase their retirement-plan contribution levels to a predetermined percentage of pay, on contribution rates. The analysis was based on data on enrollment in and contributions to retirement plans from Hewitt Associates, a benefits administration and consulting firm. The study used an interrupted time series (ITS) design, analyzing changes in outcomes before and after the implementation of Quick Enrollment or Easy Escalation. The study found that Quick Enrollment increased enrollment rates by 10 to 20 percentage points and that Easy Escalation increased the percentage of employees contributing to their savings plans at the higher, predetermined rate specified by Easy Escalation.  The quality of causal evidence presented in this report is low. This means we are not confident that the estimated effects are attributable to Quick Enrollment or Easy Escalation. Other factors are likely to have contributed to the changes in enrollment and contribution rates.","the Quick Enrollment and Easy Escalation","Employer provided retirement benefits",Employed,"Health care and social assistance, Manufacturing","United States",2010, "Tuning in to local labor markets: Findings from the Sectoral Employment impact study","Maguire, S., Freely, J., Clymer, C., Conway, M., & Schwartz, D. (2010). Tuning in to local labor markets: Findings from the Sectoral Employment impact study. Philadelphia, PA: Public/Private Ventures. [JVS-Boston]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: The study’s objective was to examine the impact of the Jewish Vocational Service (JVS)-Boston sectoral employment program on earnings and employment. The authors investigated similar research questions with two other programs, the profiles of which are available through the study search. The study was based on a randomized controlled trial, with the authors using survey data to estimate the effect of offering eligible JVS-Boston applicants the program by comparing average outcomes among those offered access to the program with the average outcomes of those not offered access to the program, after adjusting for differences between the groups. This review was conducted in collaboration with the Employment Strategies for Low-Income Adults Evidence Review (ESER). Because ESER did not report findings for studies that received a low causal evidence rating, the CLEAR profile does not report the findings either. The quality of causal evidence presented in this report is low because it was based on a randomized controlled trial with high attrition, and the authors did not demonstrate that the groups were similar at or account for differences between the two groups in the analyses. This means we are not confident that the estimated effects are attributable to the JVS-Boston sectoral employment program; other factors are likely to have contributed.","JVS-Boston Sectoral Employment","Job search assistance and supportive services Other training and education",Adult,"Finance and insurance","Urban, United States",2010,https://www.explorevr.org/sites/explorevr.org/files/files/Tuning%20In%20to%20Lo… "Tuning in to local labor markets: Findings from the Sectoral Employment impact study.","Maguire, S., J. Freely, C. Clymer, M. Conway, & D. Schwartz. (2010). Tuning in to local labor markets: Findings from the Sectoral Employment impact study. Philadelphia: Public/Private Ventures. [JVS-Boston]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: The study’s objective was to examine the impact of the Jewish Vocational Service (JVS)-Boston sectoral employment program on earnings and employment. The study was based on a randomized controlled trial and used survey data to estimate the effect of offering eligible JVS-Boston applicants the program by comparing average outcomes among those offered access to the program with the average outcomes of those excluded from the program, after adjusting for differences between the groups. This review was conducted in collaboration with the Employment Strategies for Low-Income Adults Evidence Review (ESER). Because ESER did not report findings for studies that received a low causal evidence rating, the CLEAR profile does not report the findings either. The quality of causal evidence presented in this report is low because it was based on a randomized controlled trial with high attrition and the authors did not demonstrate that the groups were similar at or account for differences between the two groups in the analyses. This means we are not confident that the estimated effects are attributable to the JVS-Boston program; other factors are likely to have contributed.","the Jewish Vocational Service (JVS)-Boston Sectoral Employment Program","Other employment and reemployment Other training and education","Low income","Health care and social assistance","United States",2010,http://www.aspenwsi.org/wordpress/wp-content/uploads/TuningIntoLocalLaborMarket… "The Employment Retention and Advancement project: Findings for the Cleveland Achieve model: Implementation and early impacts of an employer-based approach to encourage employment retention among low-wage workers","Miller, C., Martin, V., Hamilton, G., Cates, L., and Deitch, V. (2008). The Employment Retention and Advancement project: Findings for the Cleveland Achieve model: Implementation and early impacts of an employer-based approach to encourage employment retention among low-wage workers. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to determine the impact of a program designed to increase employment retention among low-wage workers in the long-term nursing care industry in Cleveland, Ohio. Cleveland was one of 16 sites nationwide to participate in the Employment Retention and Advancement (ERA) project. The authors randomly assigned 44 firms to either a treatment group, whose employees could receive employment retention services through Cleveland Achieve, or a control group. The authors collected data on employee turnover directly from firms and employment and earnings data from state Unemployment Insurance (UI) records. Two years after random assignment, the study did not find statistically significant differences in the turnover rates, employment rates, or earnings of employees in Achieve firms compared with employees in firms that did not have access to Achieve services. The quality of causal evidence provided in this study is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects would be attributable to the Achieve program, and not to other factors. However, the study found no statistically significant impacts.","the Employment Retention and Advancement project, Cleveland","Other employment and reemployment Unemployment Insurance","Low income","Health care and social assistance","United States, Urban",2008,http://www.acf.hhs.gov/sites/default/files/opre/cleveland.pdf "Employee development, commitment, and intention to turnover: A test of “employability” policies in action","Benson, G.S. (2006). Employee development, commitment, and intention to turnover: A test of “employability” policies in action. Human Resource Management Journal, 16(2), 173–192.","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the relationship between employees’ intent to leave (that is, employees’ stated intentions to leave the firm in the next year) and their participation in on-the-job training and company-sponsored training classes. The author used a statistical model to examine the association between employees’ participation in on-the-job and company-sponsored training classes and their intention to leave the firm in the next year, using data from an employee survey. The study found that participation in on-the-job training was associated with a reduction in employees’ intent to leave, but there was no significant relationship between participation in company sponsored training and intent to turnover. The quality of causal evidence presented in this report is low because the author did not ensure that groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the work-based training; other factors are likely to have contributed.","the on-the-job training","Work based and other occupational training","Employed, STEM professional","Professional, scientific, and technical services","United States",2006,https://doi.org/10.1111/j.1748-8583.2006.00011.x "The effect of court-ordered hiring quotas on the composition and quality of police","McCrary, J. (2006). The effect of court-ordered hiring quotas on the composition and quality of police. National Bureau of Economic Research working paper no. 12368. Cambridge, MA: NBER.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the effect of litigation for claims of hiring discrimination on the representation gap of African Americans in U.S. police and fire departments. The author examined Equal Employment Opportunity (EEO-4) State and Local Government Report data from 1973 to 1999 for 314 major U.S. cities. The author also examined additional data covering 1960 to 1973 for 120 cities, collected from a variety of historical sources.  The study found that the difference in the African American representation gap between litigated and unlitigated cities diminished and almost completely disappeared by 1999. The quality of causal evidence provided in this study is low because the author did not control for pre-existing differences between unlitigated and litigated cities. This means that we are not confident that the estimated effects are attributable to hiring discrimination litigation. Other factors are likely to have contributed.","litigation related to hiring discrimination","Civil Rights Act of 1964 Equal Employment Opportunity Act of 1972","Black or African American","Other services","United States",2006,http://www.nber.org/papers/w12368.pdf "Net impact and benefit-cost estimates of the workforce development system in Washington State. Upjohn Institute technical report no. TR06-020). [Private career school programs]","Hollenbeck, K., & Huang, W-J. (2006). Net impact and benefit-cost estimates of the workforce development system in Washington State. Upjohn Institute technical report no. TR06-020). Kalamazoo, MI: W.E. Upjohn Institute for Employment Research. [Private career school programs]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Private Career School program on the employment rate, earnings, and public benefit receipt of adults with a high school education. The authors used a nonexperimental method to compare the short-term (3 quarters after program exit) and long-term (9 to 12 quarters after program exit) employment, earnings, and public benefits of those who took part in the Private Career School program relative to those who registered for services at the Labor Exchange. The study found that, compared with those who registered for Labor Exchange services, Private Career School program participants had higher employment and earnings, and lower receipt of several types of public benefits. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups compared were similar before program participation. This means we are not confident that the estimated effects are attributable to the Private Career School program; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Private Career School Programs","Other training and education","Adult, Unemployed","Other services, Transportation and warehousing","United States",2006,http://research.upjohn.org/cgi/viewcontent.cgi?article=1023&context=up_technica… "An analysis of the impact of affirmative action programs on self-employment in the construction industry.","Blanchflower, D.G., & Wainwright, J. (2005). An analysis of the impact of affirmative action programs on self-employment in the construction industry. Working paper no. 11793. Cambridge, MA: National Bureau of Economic Research.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of City of Richmond v. J.A. Croson Co. (referred to as the Croson decision) in 1989, which weakened affirmative action policies, on self-employment, with a focus on the construction industry, by race, ethnicity, and gender. The study used a nonexperimental analyses to compare self-employment before and after the Croson decision. The authors used national data from the Current Population Survey (CPS) and the 2000 decennial U.S. Census. The study found that gender disparities in self-employment rates have declined since the Croson decision in all industries, but have declined most in construction. In contrast, racial and ethnic disparities in self-employment have declined since the Croson decision in all industries except construction. The quality of causal evidence presented in this study is low because the authors did not control for trends in self-employment or earnings before the Croson decision. This means we are not confident that the estimated effects are attributable to the Croson decision. Other factors are likely to have contributed.","City of Richmond v. J.A. Croson Co.","Affirmative action",Other,Construction,"United States",2005,http://www.nber.org/papers/w11793.pdf "The impact of enhanced incentives on vocational rehabilitation outcomes for dually diagnosed veterans.","Drebing, C. E., Van Ormer, E. A., Krebs, C., Rosenheck, R., & Rounsaville, B. (2005). The impact of enhanced incentives on vocational rehabilitation outcomes for dually diagnosed veterans. Journal of Applied Behavioral Analysis, 38(3), 359-372.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-No impacts Employment Health and safety-Low-Favorable impacts Health and safety","Summary: The study examined the impact of enhanced incentives within an existing Veteran’s Administration (VA) Compensated Work Therapy (CWT) program on sustained abstinence from substances, transitioning to competitive employment, retention in competitive employment, and wages. The study was a randomized controlled trial that compared outcomes for the intervention and control groups over 16 weeks. The CWT program’s clinical and financial records were used to assess employment and wage outcomes. Urine screens and participant reports were used to measure substance use outcomes. The study found that total wages for the enhanced incentives group were significantly higher than for the control group. The study also found that the intervention group abstained from substance use for a significantly longer time than the control group. The quality of causal evidence presented in this report is low for the employment and earnings outcomes because the authors did not establish that the intervention and control groups were equivalent one year before the intervention in terms of earnings or employment. This means we are not confident the estimated effects on these outcomes are attributable to the enhanced incentives in the CWT program; other factors are likely to have contributed.","Veterans’ Administration’s Compensated Work Therapy Program with Enhanced Incentives","Health Substance abuse recovery Veterans' reemployment","Veteran or military","Health care and social assistance","United States",2005,https://files.eric.ed.gov/fulltext/EJ725227.pdf "The declining effects of OSHA inspections on manufacturing injuries, 1979-1998","Gray, W., & Mendeloff, J. (2005). The declining effects of OSHA inspections on manufacturing injuries, 1979-1998. Industrial and Labor Relations Review, 58(4), 571-587.","OSHA Enforcement","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Health and safety-Low-Favorable impacts Health and safety","Summary: The study’s objective was to examine the effect of federal OSHA inspections in manufacturing establishments on workplace injuries during three separate time periods: 1979–1985, 1987–1991, and 1992–1998. The study used a regression model to compare the changes in workplace injuries in manufacturing establishments that had received an inspection within the past four years to those in establishments that had not received inspections. The study found that OSHA inspections were associated with statistically significant reductions in lost-workday injuries of 10 percent in 1979–1985 and 4 percent in 1987–1991, but had no statistically significant effect on these injuries in 1992–1998. The quality of causal evidence presented in this study is low. This means we are not confident that the differences in workplace injuries between firms that did and did not receive OSHA inspections are attributable to the inspections.","OSHA Enforcement Activities","Inspections Other health and safety Workplace injury",Employed,Manufacturing,"United States",2005,http://digitalcommons.ilr.cornell.edu/cgi/viewcontent.cgi?article=1140&context=… "Registered apprenticeship training in the U.S. construction industry","Glover, R. W., & Bilginsoy, C. (2005). Registered apprenticeship training in the U.S. construction industry. Education + Training, 47(4-5), 337-349.","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Training-Low-No impacts Training","Summary: The study’s objective was to examine the impact of participation in building trades apprenticeship programs sponsored jointly by employers and unions on apprentices’ program completion rates. The authors compared the program completion rates of apprentices who participated in registered apprenticeship programs sponsored jointly by employers and labor unions with those who participated in programs sponsored unilaterally by employers. Data on apprentices’ characteristics, program participation, and completion came from the U.S. Department of Labor’s Registered Apprentices Information System and California State Apprenticeship Council databases. The authors’ analysis included apprentices in 31 states from 1996 to 2003. The study found that the completion rate for joint apprenticeships was higher than for nonjoint apprenticeships, but did not conduct any statistical tests of differences in completion rates. The quality of causal evidence presented in this report is low because the authors did not account for relevant pre-intervention characteristics in their analysis. This means we are not confident that the estimated effects are attributable to joint apprenticeship programs; other factors are likely to have contributed.",,"Registered apprenticeship Work based and other occupational training",Adult,Construction,"United States",2005, "Inside the black box: How do OSHA inspections lead to reductions in workplace injuries?","Mendeloff, J., & Gray, W. (2005). Inside the black box: How do OSHA inspections lead to reductions in workplace injuries? Law and Policy, 27(2), 219-237.","OSHA Enforcement","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Health and safety-Low-Favorable impacts Health and safety","Summary: The study’s objective was to examine the effects of OSHA inspections that resulted in penalties or citations on the types of injuries workers suffered. The study used a regression model to compare the changes in workplace injuries of manufacturing firms that had received an inspection that resulted in a penalty or citation to those that had not received a penalty or citation. The group of firms that had not received a penalty or citation combined two types of firms: firms that had not been inspected and firms that received inspections that did not result in a penalty or citation. The study found that OSHA inspections that resulted in a penalty were associated with statistically significant decreases in lost-workday injuries. Among the specific citations studied, citations for the standards for general requirements for personal protective equipment and general machine guarding were associated with statistically significant reductions in some types of lost-workday injuries. The quality of the causal evidence presented in this study is low. This means we are not confident that OSHA inspections that resulted in penalties or citations caused the reductions in workplace injuries.","OSHA Enforcement Activities","Inspections Other health and safety Workplace injury",Employed,Manufacturing,"United States",2005, "Life after YouthBuild: 900 YouthBuild graduates reflect on their lives, dreams, and experiences","Hahn, A., Leavitt, T., Horvat, E., & Davis, J. (2004). Life after YouthBuild: 900 YouthBuild graduates reflect on their lives, dreams, and experiences. Somerville, MA: Brandeis University Heller School for Social Policy and Management and Temple University College of Education.","Opportunities for Youth","Study Type: Descriptive Analysis",,,"Summary: This report summarizes YouthBuild participants’ experiences after program completion. YouthBuild was founded in 1991 and offers academic instruction and construction training to economically disadvantaged youth who use those skills to build affordable housing for low-income households. The authors collected information on what students go on to do after YouthBuild by conducting in-depth interviews with 57 graduates and a detailed survey of 882 graduates. YouthBuild graduates who were interviewed had a very positive view of the program; they appreciated that staff set high expectations for them while acting as their substitute families and providing a caring environment. They also enjoyed the construction work, which enabled them to see tangible results of their efforts. Many expressed the need for additional career- or education-related programming after the period of full-time participation in YouthBuild. Seventy-five percent of the graduates who were surveyed were either working or engaged in postsecondary studies at the time of the survey, and similar percentages were free of government support and participating in at least one community activity. Like the interview findings, many survey respondents expressed a need for further career- or education-related programming.",Youthbuild,"Youth programs Other training and education Work based and other occupational training","Youth, Low income",Construction,"United States",2004, "An examination of the utility of training: Relationships with turnover and promotion","Wagner, S. (2004). An examination of the utility of training: Relationships with turnover and promotion. A thesis presented to the Department of Psychology and Special Education, Emporia State University, [1-69].","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-No impacts Employment","Summary: The study’s objective was to explore the relationship between employee training investment, promotion strategies, and employee turnover in credit unions in the United States. Using data from a 13-item survey, the author compared employee turnover rates and promotions across organizations with differing human resource management practices, such as employee training programs and promotion strategies. The study found no statistically significant relationships between employee training investment or turnover and the human resource management practices examined. The quality of causal evidence presented in this study is low. This means that we would not be confident that any estimated effects would be attributable to the human resource management practices examined. However, the study found no statistically significant effects.","the Human Resource Management Strategies Examined","Other employer services Other training and education",,"Finance and insurance","United States",2004,https://esirc.emporia.edu/bitstream/handle/123456789/995/Wagner%202004.pdf?sequ… "Long-term ethylene oxide exposure trends in U.S. hospitals: relationship with OSHA regulatory and enforcement actions","LaMontagne, A., Oakes, J., & Turley, R. (2004). Long-term ethylene oxide exposure trends in U.S. hospitals: Relationship with OSHA regulatory and enforcement actions. American Journal of Public Health, 94(9), 1614-1619.","OSHA Enforcement","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Health and safety-Low-Mixed impacts Health and safety","Summary: The study’s objective was to examine differences in hospital worker exposures to ethylene oxide (EtO) after the implementation of the 1984 and 1988 OSHA EtO standards. The authors used a random effects model to examine changes over time in hospital worker exposures to EtO. The study reported a steady, statistically significant decline in EtO exposures for the first several years after each OSHA standard was set. The quality of evidence presented in this study is low. This means we are not confident that changes in worker EtO exposures over time are attributable to OSHA’s implementation of EtO standards.","OSHA Enforcement Activities","Other health and safety Safety",Employed,"Health care and social assistance","United States",2004,http://www.ncbi.nlm.nih.gov/pmc/articles/PMC1448503/pdf/0941614.pdf "Effect of state workplace safety laws on occupational injury rates","Smitha, M., Kirk, K., Oestenstad, K., Brown, K., & Lee, S. (2001). Effect of state workplace safety laws on occupational injury rates. Journal of Occupational Environmental Medicine, 43(12), 1001-1010.","OSHA Enforcement","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Health and safety-Low-Favorable impacts Health and safety","Summary: The study’s objective was to examine the effect of four types of mandatory state workplace safety interventions on occupational injury rates in manufacturing industries. The study used a regression model to compare differences in injury rates for industries in which higher or lower percentages of the workforce were affected by the four mandatory safety requirements. The study found that the mandatory safety committee requirements were associated with statistically significant decreases in injury rates; the other three initiatives were not. The quality of the causal evidence presented in this study is low. This means we are not confident that the differences in injury rates between industries in states with the mandatory safety laws and industries in states without these laws are attributable solely to the laws.","OSHA Enforcement Activities","Other health and safety Workplace injury",Employed,Manufacturing,"United States",2001, "Assessing OSHA performance: New evidence from the construction industry","Weil, D. (2001). Assessing OSHA performance: evidence from the construction industry. Journal of Policy Analysis and Management, 20(4), 651-74.","OSHA Enforcement","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Compliance-Low-Favorable impacts Compliance","Summary: The study’s objective was to examine the effect of Occupational Safety & Health Administration (OSHA) inspections on compliance behavior among construction contractors from 1987 to 1993. Although OSHA no longer operates as it did during this period, this study provides interesting historical context. The study also contains a descriptive analysis that examined whether OSHA regulatory standards were related to causes of injuries and fatalities (analysis not included in this summary). The study used regression models to analyze the change in compliance probability between the first and subsequent inspections for a given contractor and for a given contractor at a specific work site. The study found that the probability of citation decreased with each additional inspection, with the largest difference between the first and second inspections. The quality of causal evidence presented in this study is low. Although the study provides interesting descriptive information, it does not provide evidence of a causal effect of reinspections on compliance behavior.","OSHA Enforcement Activities","Inspections Safety",Employed,Construction,"United States",2001, "Falls in Construction: Injury Rates for OSHA-Inspected Employers Before and After Citation for Violating the Washington State Fall Protection Standard","Nelson, N., Kaufman, J., Kalat, J., & Silverstein, B. (1997). Falls in construction: Injury rates for OSHA-inspected employers before and after citation for violating the Washington State Fall Protection Standard. American Journal of Industrial Medicine, 31(3), 296-302.","OSHA Enforcement","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Health and safety-Low-Favorable impacts Health and safety","Summary: The study’s objective was to determine the effect of receiving an OSHA citation for violating the Washington State Fall Protection Standard on injury claim rates among construction employers. The study used a regression model to compare injury claim rates for construction employers that had received a citation for violating the Washington State Fall Protection Standard between 1991 and 1992 to rates for those that had not received a citation for violating this standard during this time period. The study found that being cited for violating the falls in construction standard was associated with a statistically significant increase in the likelihood of experiencing a subsequent reduction in injury claim rates compared to construction employers that were not cited. The quality of the causal evidence presented in this study is low. This means we are not confident that the differences in the likelihood of experiencing a reduction in injury rates between employers that received a citation for violating the Washington State Fall Protection Standard and employers that did not receive such a citation are attributable to the citations.","OSHA Enforcement Activities","Other health and safety Workers compensation Workplace injury",Employed,Construction,"United States",1997, "The effect of OSHA lead exposure in construction standard on blood lead levels among iron workers employed in bridge rehabilitation","Levin, S., Goldberg, M., & Doucette, J. (1997). The effect of the OSHA lead exposure in construction standard on blood lead levels among iron workers employed in bridge rehabilitation. American Journal of Industrial Medicine, 31(3), 303–309.","OSHA Enforcement","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Health and safety-Low-Favorable impacts Health and safety","Summary: The study’s objective was to examine the effect of the Lead Exposure in Construction Standard imposed by the Occupational Safety & Health Administration (OSHA), which was introduced in May 1993, on the blood lead levels of iron workers employed in the renovation of a large, lead-painted, steel bridge in New York City in 1993 and 1994. The study compared the blood lead levels of iron workers in 1993 and 1994, before and after the introduction of OSHA’s Lead Exposure in Construction Standard. The study found that there was no significant difference in the maximum blood lead levels of iron workers from 1993 to 1994, but there was a decline in the increment in blood lead levels, defined as the difference between the maximum and minimum levels. The quality of causal evidence presented in this study is low. This means we are not confident that any differences in blood lead levels of iron workers before and after the introduction of the OSHA Lead Exposure in Construction Standard were attributable solely to the introduction of the standard.","OSHA Enforcement Activities","Safety Workplace injury",Employed,Construction,"United States",1997, "Re-estimating OSHA’s Effects: Have the data changed?","Ruser, J. & Smith, R. (1991). Re-estimating OSHA’s effects: Have the data changed? Journal of Human Resources, 26(2), 212-235.","OSHA Enforcement","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Health and safety-Low-No impacts Health and safety","Summary: The study’s objective was to determine the effect of OSHA inspections and inspection procedures on injury rates in manufacturing firms between 1980 and 1985. Although OSHA no longer operates as it did during this period, this study provides historical context for changes that were later made to the program. For their main analysis, the authors used a regression model to compare differences in injury rates for manufacturing plants that received inspections in March and April (“early”) and those that received inspections in November and December (“late”) of the same year. The study found that, relative to late OSHA inspections, early OSHA inspections were not associated with a statistically significantly reduction in injury rates within the year of inspection. The quality of the causal evidence presented in this study is low. This means we are not confident that the estimated relationships in this study are the result of OSHA inspections and procedures.","OSHA Enforcement Activities","Inspections Workplace injury",Employed,Manufacturing,"United States",1991, "The effect of OSHA records-check inspections on reported occupational injuries in manufacturing establishments","Ruser, J., & Smith, R. (1988). The effect of OSHA records-check inspections on reported occupational injuries in manufacturing establishments. Journal of Risk and Uncertainty, 1(4), 415–435.","OSHA Enforcement","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Health and safety-Low-Mixed impacts Health and safety","Summary: The study’s objective was to determine whether OSHA’s records-check procedure—which was introduced in 1981 in states with federal OSHA enforcement and targeted inspections based on reports of past injuries—caused manufacturing plants to underreport injuries. Although OSHA no longer operates as it did around the time of the records-check procedure’s implementation, this study provides historical context for changes that were later made to the program. The authors used several approaches, the strongest of which compared the percentage change in lost-workday injury rates in the years when the plant’s state had a records-check procedure and the years when the state did not have this procedure. The study found no statistically significant differences between the percentage change in reported injury rates in plants in states with the records-check procedure and plants in states without this procedure. However, plants in risky industries in records-check states reported a statistically significant 4.7 percent reduction in injury rates. The quality of the causal evidence presented in this study is low. This means we are not confident that any changes in reported injuries within plants in records-check states or in risky industries in records-check states could be attributed to the records-check procedure.","OSHA Enforcement Activities","Other health and safety Workplace injury",Employed,Manufacturing,"United States",1988, "Safety Regulation and Workplace Injuries","Curington, W. (1986). Safety regulation and workplace injuries. Southern Economic Journal, 53(1), 51.","OSHA Enforcement","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Health and safety-Low-Favorable impacts Health and safety","Summary: The study’s objective was to examine the effect of the introduction of OSHA regulation in 1971 on the severity and frequency of workplace injuries in manufacturing industries in New York. Although OSHA no longer operates as it did during this period, this study provides historical context for changes that were later made to the program. The study used a regression model to examine the change in the frequency and severity of injuries from the period 1964 to 1970 compared with 1971 to 1976, which represent the time periods before and after the implementation of OSHA standards. The study found that the implementation of OSHA standards was not associated with a statistically significant reduction in the average frequency or the severity of all injuries. The study found a statistically significant association between implementation of OSHA standards and a reduction in ""struck by machine"" injuries. The quality of the causal evidence presented in this study is low. This means we are not confident that the differences in injuries from the period 1964 to 1970 compared with 1971 to 1976 are attributable to the introduction of OSHA standards.","OSHA Enforcement Activities","Other health and safety Workplace injury",Employed,Manufacturing,"United States",1986, "The impact of Occupational Safety and Health regulations, 1973-1983","Viscusi, W. (1986). The impact of Occupational Safety and Health regulations, 1973-1983. RAND Journal of Economics, 17(4), 567–580.","OSHA Enforcement","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Health and safety-Low-Mixed impacts Health and safety","Summary: The study’s objective was to examine changes in the effects of OSHA inspections and penalties on injury rates in manufacturing industries between 1973 and 1983. Although OSHA no longer operates as it did during this period, this study provides historical context for changes that were later made to the program. The study used a regression model to examine the changes in injury rates in manufacturing industries associated with higher and lower rates of OSHA inspections and penalties during the prior two years. The study found that the evidence of the effectiveness of OSHA inspections and penalties in reducing injuries was mixed, and the effects of OSHA enforcement activities on most outcomes varied over time. The quality of the causal evidence presented in this study is low. This means we are not confident that the differences in injuries within industries are attributable to the inspections or penalties.","OSHA Enforcement Activities","Inspections Other health and safety Workplace injury",Employed,Manufacturing,"United States",1986, "Worker injuries: The effects of Workers’ Compensation and OSHA inspections","Robertson, L., & Keeve, J. (1983). Worker injuries: The effects of Workers' Compensation and OSHA inspections. Journal of Health Politics, Policy and Law, 8(3), 581-597.","OSHA Enforcement","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment Health and safety-Low-Favorable impacts Health and safety","Summary: The study had two objectives: (1) to examine the effect of OSHA citations on injuries (method 1) and (2) to examine the effect of changes in OSHA inspections on changes in days of work lost because of injuries (method 2). Although OSHA no longer operates as it did during the study period, the study provides historical context for the program. Method 1 used a regression model to compare injuries across three firms from 1973 to 1980. Method 2 used a different regression model to compare changes in work days lost because of injuries from 1975 to 1976 to changes in OSHA inspections during the same period, using data at the industry-by-state level. The study found that firms had 35.8 fewer injuries in the years in which they received a citation; however, citations in past years were not significantly related to current year injuries. One additional OHSA inspection was associated with a 2.8 day reduction in the number of work days lost because of injuries.  The quality of causal evidence presented by both methods in this study is low. This means we are not confident that the differences in workplace injuries or lost work days are attributable to OSHA citations or inspections.","OSHA Enforcement Activities","Inspections Workplace injury",Employed,Manufacturing,"United States",1983, "An assessment of OSHA’s recent effects on injury rates","McCaffrey, D. (1983). An assessment of OSHA’s recent effects on injury rates. Journal of Human Resources, 18(1), 131-146.","OSHA Enforcement","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Health and safety-Mod/high-No impacts Health and safety","Summary: The study’s objective was to examine the effect of OSHA inspections on injury rates in manufacturing and construction firms from 1976 to 1978. Although OSHA no longer operates as it did during this period, this study provides historical context for changes that were later made to the program. The author used a regression model to compare the differences in injury rates of manufacturing and construction firms that received inspections in March and April (“early”) with those that received inspections in November and December (“late”). The study found that, relative to late OSHA inspections, early OSHA inspections were not associated with a statistically significantly reduction in injury rates within the year of inspection. The quality of causal evidence for some analyses presented in this study is moderate because the analyses used a well-conducted nonexperimental design. This means we have confidence that these findings provide some evidence that OSHA inspections had no effect on injury rates.","OSHA Enforcement Activities","Inspections Workplace injury",Employed,"Construction, Manufacturing","United States",1983, "The Impact of OSHA Inspections on Manufacturing Injury Rates","Smith, R (1979). The Impact of OSHA Inspections on Manufacturing Injury Rates. Journal of Human Resources, 14(2),  145-170.","OSHA Enforcement","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Health and safety-Mod/high-Favorable impacts Health and safety","Summary: The study’s objective was to examine the effect of OSHA inspections on injury rates in manufacturing firms in 1973 and 1974. Although OSHA no longer operates as it did during this period, this study provides historical context for changes that were later made to the program. The authors used a regression model to compare the differences in injury rates of firms that received inspections in March and April (“early”) and those that received inspections in November and December (“late”). The study found that in 1973, firms receiving early inspections had significantly lower injury rates that year than those that were inspected later in the year. However, in 1974, firms inspected early and late in the year had similar injury rates. The quality of causal evidence presented in this study is moderate because the study used a well-conducted nonexperimental design. This means we have confidence that the effects estimated in this study are attributable at least in part to OSHA inspections. However, as with any nonexperimental study design, other factors not accounted for in the study could also have contributed to the estimated effects.","OSHA Enforcement Activities","Inspections Workplace injury",Employed,Manufacturing,"United States",1979,