Skip to main content

Small + Safe + Well: Lessons learned from a Total Worker Health® randomized intervention to promote organizational change in small business (Schwatka et al., 2022)

Review Guidelines

Absence of conflict of interest.

Citation

Schwatka, N. V., Dally, M., Shore, E., Tenney, L., Brown, C. E., Scott, J. G., Dexter, L., & Newman, L. S. (2022). Small + Safe + Well: Lessons learned from a Total Worker Health® randomized intervention to promote organizational change in small business. BMC Public Health, 22(1), 1039. https://doi.org/10.1186/s12889-022-13435-y

Highlights

  • The Small + Safe + Well (SSWell) study's objective was to examine the impact of participation in a Total Worker Health® (TWH) leadership development program on small business health and safety outcomes.  
  • The study used a randomized design that assigned businesses either to a TWH leadership program or to the waitlist control condition. Both treatment and control businesses were participating in Health Links®, a program to help businesses develop TWH policies and programs. Data was collected one year after enrollment via an assessment of business policies and programs and employee surveys on perceptions of safety and health leadership. The study analyzed whether businesses that were in the treatment condition had higher rated business policies related to TWH, and higher employee ratings of safety and health leadership.  
  • The study found no relationship between participation in the TWH leadership program and any of the primary outcomes, including businesses' TWH policies and programs score, employees’ ratings of safety leadership, or employees’ ratings of health leadership.  
  • The quality of causal evidence presented in this study is low because of compromised randomization and high levels of attrition. For analytic purposes, businesses (and their employees) that were randomly assigned to treatment but did not participate in the intervention were included in the control group, which compromises the randomization. Additionally, many businesses and employees were lost over the course of the study resulting in high levels of attrition.

Intervention Examined

Total Worker Health® (TWH)

Features of the Intervention

Total Worker Health (TWH) is a concept defined by the U.S. National Institute for Occupational Safety and Health (NIOSH) as ‘‘policies, programs, and practices that integrate protection from work-related safety and health hazards with promotion of injury and illness prevention efforts to advance worker well-being.’’ The intervention in this study consisted of participation in the usual-practice TWH program called Health Links® with the addition of a TWH leadership development program. The program is implemented with business leaders and encourages them to assess their current practices and culture surrounding TWH and use their position in leadership to improve policies and change company culture as needed. The program serves small businesses, defined as businesses with fewer than 500 employees.

Features of the Study

The SSWell study used a randomized design that assigned 97 businesses to either the treatment or the waitlist control condition. For these 97 businesses, 2,785 employees completed a baseline employee survey. This sample included all small businesses in Colorado that already participated in Health Links. Two thirds of the businesses (66/97) were assigned to the treatment condition, which consisted of Health Links plus the TWH leadership program. The remaining one third of businesses (31/97) were assigned to the waitlist control, participating in just Health Links in year one of their participation and Health Links plus the TWH leadership program in year two. 

The study included two analytic samples: a sample of businesses and a sample of employees. To be included in the final analytic sample of businesses, businesses needed to participate in the baseline, year one, and year two assessments, and needed to have at least one employee complete their year one and year two employee survey. Based on these criteria, the final analysis sample included 36 out of the initial 97 businesses. To be included in the analytic sample of employees, employees needed to complete the first- and second-year employee surveys while employed at the same business. Based on these criteria, the final sample included 250 out of the initial 2,785 employees. For the analysis, the treatment group included 13 businesses (and their employees) that received the intervention in year one (including one that was part of the original randomly selected control group). The control group included 23 businesses that were initially waitlisted and then received the intervention in year two (including nine that were originally randomly selected to receive the intervention in year one). On average, the final sample of businesses had around 110 employees and an average baseline TWH score of 46. The final sample of employees were on average 42 years old, majority white (87%), and had been at their current job for five years.   

Data were collected via an online business assessment at baseline and after one year, and via online employee surveys at baseline, one year, and two year follow ups.  The business assessment instrument, the Healthy Workplace Assessment, measures TWH policies across six benchmarks and gives organizations a score between 0 and 97. The questions in the employee survey were developed by the study authors and consisted of questions surrounding a) safety leadership and b) health leadership.  The employee survey included five secondary outcomes: 1) safety climate 2) health climate, 3) safety behavior, 4) health behavior, and 5) wellbeing. Employee surveys were distributed through a primary contact at each business.

Findings

Health and Safety 

  • The study found no relationship between a business’s participation in the TWH leadership program and the TWH policies and programs score. The study also found no relationship between a business’s participation in the TWH leadership program and employees’ ratings of safety or health leadership.

Considerations for Interpreting the Findings

The composition of the treatment and control groups in the analytic samples was not truly random because the authors included in the control group businesses (and their employees) that were assigned to treatment but did not participate in the intervention. Therefore, some businesses included in the control group are likely to be different from businesses in the treatment group because of the characteristics related to those businesses’ decision not to participate. Additionally, business and employee attrition from the original samples was high. Due to this high attrition, the study had poor statistical precision.

Causal Evidence Rating

The quality of causal evidence presented in this study is low because of compromised randomization and high levels of attrition. Businesses (and their employees) that were randomly assigned to the intervention but did not participate were included in analyses in the control group. This means we are not confident that any estimated effects would be attributable to the Total Worker Health® (TWH) leadership development program and not to other factors. Specifically, businesses that chose to engage in the intervention are likely different along some unobserved characteristics than businesses which were offered the intervention but did not participate. The study did not find statistically significant effects.

Reviewed by CLEAR

December 2024