This study was conducted by staff from Abt Global, which co-administers CLEAR. The review of this study was conducted by ICF, which co-administers CLEAR and is trained in applying the CLEAR implementation study guidelines.
Citation
Highlights
- The study’s objective was to examine the implementation of the American Apprenticeship Initiative (AAI) which provides grants to expand Registered Apprenticeship Programs. This profile focuses on the Massachusetts Apprenticeship Initiative (MAI).
- The study authors conducted an implementation evaluation using data obtained through interviews, a survey, and programmatic data obtained from DOL's Apprenticeship Quarterly Performance Report (QPR) system.
- The study found that MAI was most effective working with workforce boards and trade associations. These organizations had existing relationships with employers and could act as sponsors, which reduced the burden on employers to create and register a Registered Apprenticeship Program (RAP). MAI used AAI grant funds to register 21 apprenticeship programs across various sectors. Of these programs, most were time-based with smaller proportions of competency-based or hybrid. At the time of the study, MAI registered 206 apprentices (achieving 69% of their goal) and served 47 pre-apprentices.
- A strength of the study is the detailed information about program operations, particularly around eligibility for and the path through the pharmacy technician apprentices, related technical instruction, on-the-job learning, and the certificates and credentials awarded. However, one limitation is that the study authors do not provide details about their data collection methods.
- There was no companion impact study.
Intervention Examined
Massachusetts Apprenticeship Initiative (MAI)
Features of the Intervention
- Type of organization: State government agency
- Location: Multi-site in Massachusetts
- Population served and scale: Veterans; Women; Racial/ethnic minorities; Individuals with disabilities; Non-college aged adults; 206 apprentices and 47 pre-apprentices
- Industry focus: Information Technology; Healthcare and social assistance; Manufacturing; Educational services; Other Services (except Public Administration)
- Intervention activities: On-the-job learning (OJL); Related technical instruction (RTI)
- Organizational partnerships: Employers; Non-profits; Education
- Cost: Not included
- Fidelity: Not included
The U.S. Department of Labor’s (DOL) American Apprenticeship Initiative (AAI) provided $175 million in grants to expand Registered Apprenticeship Programs (RAPs) in areas that did not have many registered apprentices and for populations underrepresented in RAPs (e.g., women, Veterans, racial or ethnic minorities, individuals with disabilities, non-college aged adults). Beginning in 2015, DOL awarded five-year AAI grants to 46 grantees nationwide.
The Massachusetts Executive Office of Labor and Workforce Development (EOLWD) received a $2,999,999 AAI grant. The Massachusetts Apprenticeship Initiative (MAI) was implemented by the MassHire Hampden County Workforce Board and the MassHire North Shore Workforce Board. The intervention occurred in the service areas of the Hampden County and North Shore Workforce Boards covering parts of the western, central, and northeast parts of the state. MAI expanded RAPs in advanced manufacturing and created RAPs in healthcare, information technology (IT), and diesel technician fields. In 2020, MAI added a pharmacy technician pre-apprenticeship program that was already established at Quinsigamond Community College.
MAI used grant funds to reimburse employers for related technical instruction (RTI) costs, which ranged from $2,100 to $7,500 (average $4,000). AAI grant funds supported staffing at EOLWD and at the local workforce boards. Local staff conducted outreach, follow-up, training and technical assistance, and served as a program sponsor for employers, including registration with DOL.
The program targeted women, Veterans, racial and ethnic minorities, and people with disabilities. MAI used brochures and social media to recruit participants. Most of the apprentices, about 70%, were incumbent workers. MAI collaborated with several partners, such as the Northeast Advanced Manufacturing Consortium (NAMC), employers, and community college RTI providers.
Features of the Study
EOLWD was one of ten grantees selected to participate in the implementation study. Selection criteria included participation in a recruitment sub study, grantee institution type (i.e., state agency, sub-state agency, college, or sector-based organization), progress toward target enrollees, and prior history with RAPs.
In the apprenticeship program, 71% of the participants were men. Among them, 18% were under 25 years old and 58% were between 25 and 44. The racial breakdown included 32% Hispanic (of any race), 35% White, and 19% Black. Additionally, 8% were Veterans and 1% were people with disabilities. In the pre-apprenticeship program, 77% of the participants were men, 15% were under 25 years old and 57% were between 25 and 44. The racial breakdown included 30% Hispanic (of any race), 50% White, and 9% Black. Also, 15% were Veterans and there were no participants with disabilities.
Interviews were conducted in person during site visits in spring 2019 and over the phone in fall 2020 due to COVID-19 restrictions. A survey was conducted with a grantee representative between June and July 2019. Programmatic data were obtained from DOL's Apprenticeship Quarterly Performance Report (QPR) system. The study authors do not include information about the number of interviews conducted or their analytic methods.
Findings
Intervention activities/services
- The study found that the workforce boards and trade associations that acted as sponsors helped with all aspects of the apprenticeship. This included outreach, training and technical assistance, tailored RTI curriculum, reimbursements, and placement.
- MAI registered 21 apprenticeship programs using AAI grant funds in manufacturing, IT, healthcare, and other occupations (e.g., installation, maintenance, and repair). Of these programs, 89% were time-based, 10% were competency-based, and 2% were hybrid.
- At the time of the study, MAI registered 206 apprentices (69% of their 300 goal) and served 47 pre-apprentices (they did not set a goal for pre-apprentices).
Implementation Challenges and Solutions
- The study found that the employer representative for Mack Technologies' First Line Supervisor RAP noted the benefits of increasing efficiency, decreasing waste, and improving the leadership skills of employees who may have quit had they not been able to advance.
- Member workforce boards leveraged the 200 members of the NAMC to advertise and sponsor apprentices. Grant funds were used to reimburse RTI costs for these apprentices and NAMC developed training plans for employers.
- Employers in non-traditional fields were hesitant to engage with the program because they were unaware of RAPs. Even those familiar with RAPs were often hesitant thinking it would be too challenging, particularly for small and medium-sized businesses.
- To solve the challenges encountered with employers, staff increased outreach to trade associations given the associations had already built relationships with employers. Massachusetts hoped to expand apprenticeships further with additional grant funds and a tax credit. They also planned to leverage the lessons learned from implementing the MAI program in the local workforce board areas.
- COVID-19 made recruiting employers difficult since previous in-person outreach and engagement had to shift to phone, email, and social media. Additionally, many employers froze hiring. The program adapted to COVID-19 challenges by offering online OJL and RTI when possible and purchased tablets and paid for internet service for apprentices.
Considerations for Interpreting the Findings
The study authors provide details about the program operations particularly around eligibility for and the path through the pharmacy technician apprentices, covering RTI, OJL, and the certificates and credentials awarded. However, little information was provided about data collection methods and analyses in this report.