Absence of conflict of interest.
Citation
Highlights
- The study’s objective was to examine the implementation of the Michigan Opportunity and Skills Training (MOST) program, a welfare-to-work program focused on education and training for Detroit, MI AFDC recipients. The program was one of 11 welfare-to-work programs evaluated as part of the National Evaluation of Welfare-to-Work Strategies (NEWWS Evaluation).
- The study authors conducted an implementation evaluation using quantitative and qualitative data from records, surveys, observations, and interviews.
- The MOST program encouraged enrollees to participate in education and training, and to obtain education and training prior to seeking a job. Relative to other NEWWS programs, MOST staff knew less about program members and provided less help with program barriers. In addition, the program did not monitor program attendance closely, and only small proportions of participants were penalized for noncompliance.
- The data sources for evaluating the implementation of the program were clearly identified, but few details were provided on data collection and analysis. No information was available on quality assurance.
- The embedded impact study was reviewed by CLEAR in July 2022.
Intervention Examined
Michigan Opportunity and Skills Training (MOST)
Features of the Intervention
- Type of organization: State Agency (Department of Social Services)
- Location/setting: Detroit, MI
- Population served and scale: 2,226 program group members; Aid to Families with Dependent Children (AFDC) recipients
- Industry focus: Not Included
- Intervention activities: Education and training
- Organizational partnerships: Education and training providers
- Cost: MOST program-related costs: $1,561 per program group member for welfare department costs; $1,261 per program group member for non-welfare department costs.
- Fidelity: Not Included
Michigan Opportunity and Skills Training (MOST), a Welfare-to-Work program serving adults receiving Aid to Families with Dependent Children (AFDC), began in 1988. The Michigan program was part of the National Evaluation of Welfare-to-Work Strategies (NEWWS) funded by the U.S. Department of Education and the W.K. Kellogg Foundation. MOST was education-focused, aiming to increase participant education or training prior to entering the job market. Case managers assigned participants to community education and training partners. Enrolled individuals participated in education and training activities, including basic education, vocational training, or college. Participants could also be assigned to individual job search activities (usually after they completed education and training activities) or work experience. The program provided childcare payments, transportation assistance, and help with work or school-related expenses. The program was operated by the Michigan Department of Social Services (DDS), and the program's education and training providers included public and private schools, local Job Training Partnership Act offices, and community organizations. Participants included both voluntary (exempt from participation) and mandatory AFDC recipients. AFDC recipients were exempt from the program for the following reasons: had a child under age 1; was working at least 30 hours a week; was pregnant and in the second trimester; was medically excused; was living in a remote area that made program activities inaccessible; had been a resident of a mental institution within the last five years; had been using prescribed medication for mental illness; or had been enrolled in a rehabilitation program for at least 15 hours per week. Prior to December 1992, individuals were also exempt if they had three children under age 10.
Features of the Study
Evaluators selected sites that were experienced in operating welfare-to-work programs, included a focus on Human Capital Development (education and training) activities, and had large AFDC caseloads. They also selected sites with diverse geographies, demographics, labor markets, and AFDC grant levels. Two of 30 Detroit, MI study sites (Fullerton-Jeffries and Hamtramck) were selected for the evaluation. The quantitative and qualitative data used for the study came from unemployment insurance, AFDC, and Food Stamps record data; client and staff surveys; participation records; field research (observation and interviews with staff and participants); and cost data from state and local fiscal records. Detailed information on data analysis methods was not provided.
Findings
Intervention activities/services
- The study found that 72% of staff expressed a preference for "Human Capital Development" (acquire skills or education to get a job and get off assistance permanently) over a "Labor Force Attachment" approach.
- The study found that compared to other NEWWS programs, a large proportion (42%) of control group members participated in employment and training activities.
- The study found that MOST case managers tended to provide less personalized attention and encouragement to participants than other NEWWS programs.
Implementation challenges and solutions
- The study found that the MOST program struggled with monitoring participation, particularly regarding tracking attendance forms.
- The study found that MOST staff reported that childcare responsibilities took too much time, and that they did not have enough time to assess client needs.
- The study found that staff reported having inadequate training and being short-staffed.
Cost/ROI
- The study found that the cost per program group member was $1,561 for welfare department costs and $1,261 for non-welfare department costs.
Considerations for Interpreting the Findings
The data sources for evaluating the implementation of the program were clearly identified, but few details were provided on how data were analyzed. No information was available on quality assurance measures.