Skip to main content

Evaluation of strategies used in the TechHire and Strengthening Working Families Initiative grant programs: Implementation and early Impacts from the TechHire and Strengthening Working Families Initiative randomized controlled trial (Tessler et al., 2021)

Review Guidelines

Absence of conflict of interest.

Citation

Tessler, B., Schaberg, K., Fink, B., & Gasper, J (2021). Evaluation of strategies used in the TechHire and Strengthening Working Families Initiative grant programs: Implementation and early Impacts from the TechHire and Strengthening Working Families Initiative randomized controlled trial. Washington, DC: U.S. Department of Labor.

Highlights

  • The study’s objective was to examine the impact of the TechHire Partnership Grants (TechHire) and the Strengthening Working Families Initiative (SWFI) on completion of training.  
  • The study used a randomized controlled trial to assign participants to the TechHire/SWFI group or the control group. Using surveys, the authors conducted statistical models to compare differences in outcomes between treatment and control group participants.  
  • The study found that individuals participating in TechHire/SWFI completed significantly more occupational skills trainings compared to individuals in the control group. 
  • This study receives a high evidence rating. This means we are confident that the estimated effects are attributable to TechHire/SWFI, and not to other factors.  

Intervention Examined

TechHire/Strengthening Working Families Initiative (SWFI)

Features of the Intervention

TechHire Partnership Grants (TechHire) and Strengthening Working Families Initiative (SWFI) were created to reduce the need for employers to hire temporary workers outside the United States through the H-1B visa program. TechHire and SWFI funded local organizations to provide accessible training, supports, and nontraditional hiring to unemployed and underemployed U.S. workers who had barriers to training and to create a pipeline for workers to fill tech jobs that employ a large number of H-1B workers. Additionally, SWFI provided childcare services to program participants. TechHire targeted individuals aged 17-29 years who were out of school; unemployed, underemployed, and incumbent workers aged 30 and above; and individuals who had a disability, low English proficiency, and criminal records as a barrier to employment. SWFI targeted parents with low income whose primary barrier to participating and completing education and skills training was access to childcare. 

Features of the Study

The study used a randomized controlled trial to examine the impact of TechHire/SWFI on completion of occupational skills training. After completing a baseline survey, individuals were randomly assigned to study groups following the randomization probability that was agreed upon at each TechHire/SWFI site. Of the 952 eligible participants, 518 were randomly assigned to receive program services from TechHire/SWFI and 434 were randomly assigned to the control group. Control group participants received training and services that were offered in the community but were not funded by federal, state, or local grants affiliated with TechHire/SWFI. Over half of the study sample were female (58%), the largest proportions were Black/African American (43%) or White (44%), less than a quarter identified as Hispanic (24%), and the average age was 29 years. Over half of the sample had education beyond high school, including some college or advanced training certificate (29%), an associate degree (11%), or a bachelor’s degree or higher (17%). The primary data source was the Wave 1 survey that was administered six months after randomization but was most commonly completed nine months after randomization. The authors compared the pooled outcomes of individuals who participated in either TechHire or SWFI to a control group using statistical models. 

Study Sites

There were five sites in the study, three TechHire sites and two SWFI sites. 

  • East Coast Florida (TechHire) 
  • New York City (TechHire) 
  • Tampa, FL (TechHire) 
  • Denver, CO (SWFI) 
  • Vermont (SWFI) 

Findings

Training

  • The study found that significantly more individuals participating in TechHire/SWFI (42.2%) completed occupational skills training compared to individuals in the control group (21.6%). 

Considerations for Interpreting the Findings

Although the study was a randomized controlled trial, the probability of assignment into the treatment or control groups varied over time. The probability of randomization into the treatment and control group at the New York City site was originally 50/50; however, during study enrollment the probability changed to 66/33. The study authors accounted for the change in their statistical models. Therefore, the study is still eligible for a high causal evidence rating. Additionally, study authors noted that individuals who completed the Wave 1 survey were significantly more likely to have higher levels of education.  

Causal Evidence Rating

The quality of causal evidence presented in this report is high because it was based on a well implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to TechHire and SWFI, and not to other factors. 

Reviewed by CLEAR

June 2024