Absence of conflict of interest.
Citation
Glosser, A., Martinson, K., Cho, S.W., & K. Gardiner. (2018). Washington State’s Integrated Basic Education and Skills Training (I-BEST) program in three colleges: Implementation and early impact report (Report No. 2018-87). Washington, DC: Office of Planning, Research, and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.
Highlights
- The study’s objective was to examine the impact of the Washington State Integrated Basic Education and Skills Training (I-BEST) program on education outcomes.
- The study was a randomized controlled trial conducted at three community and technical colleges in Washington State. Eligible students were randomly assigned to either the treatment or control groups. The authors used statistical models to examine differences in outcomes between the groups up to 24 months after the study began.
- The study found that I-BEST participants were significantly more likely to enroll in and complete courses, earn credits, and earn credentials than control group participants.
- The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the I-BEST program, and not to other factors.
Intervention Examined
The Washington State Integrated Basic Education and Skills Training (I-BEST) Program
Features of the Intervention
Washington's State Board for Community and Technical Colleges (SBCTC) developed the I-BEST program, which started with ten colleges in the 2004-05 school year. Over the next two years, it was rolled out to other colleges so that it was operating in all 34 of Washington State’s public community and technical colleges by the 2006-07 academic year. The goal of I-BEST is to offer structured career pathways to increase access to and completion of college-level occupational training in high-demand occupational areas for students who may otherwise have to complete remedial coursework. I-BEST has three components: 1) students participate in career pathways – a series of courses designed to result in a credential for in-demand local jobs, 2) a team teaching approach using basic skills instructors and occupational instructors during at least half of the occupational training class time, and 3) additional funding to the colleges at a rate of 1.75 times the normal rate for students. The increased funding is used to offset the increased program costs including developing curriculum, instructor preparation time, and supportive services.
The three colleges participating in the study received funding to add two additional components that are not part of the core I-BEST program. This included a student advisor or "navigator" who provided academic and career planning guidance, and financial support for students who did not receive grants, helping to pay for tuition as well as supportive services (e.g., books, tools, and transportation).
Features of the Study
The study was a randomized controlled trial (RCT) conducted at three colleges in Washington State (Bellingham Technical College, Everett Community College, and Whatcom Community College). Program applicants who required developmental education were included in the study. Eligible students were randomly assigned to either the treatment or the control groups. The sample included 315 students in the treatment group and 317 students in the control group. Data sources included a baseline survey, a follow-up survey, administrative records, National Student Clearinghouse data, and program documents. The authors used statistical models to examine differences in educational outcomes (course enrollment, credits earned, and credential attainment).
Findings
Education and skills gain
- The study found a significant impact of I-BEST on students’ course enrollment over a 24-month period. A significantly higher proportion of I-BEST students (90%) were enrolled in any type of coursework, including developmental coursework, compared to control group students (68%).
- The study also found that a significantly higher proportion of I-BEST students (80%) were enrolled in in occupational training courses compared to control group students (40%).
- When compared to students in the control group, the study showed that participation in I-BEST significantly increased credit accumulation with the program group earning 13 more credits within 24 months.
- The study found that a significantly higher proportion of I-BEST students (44%) completed a certificate or degree from an SBCTC college after 24 months compared to control group students (12%).
Considerations for Interpreting the Findings
Although the study was a well-implemented randomized controlled trial, this study had several issues that should be considered when interpreting the findings. First, the authors used intent-to-treat analyses, but 27% of students in the treatment group did not participate in I-BEST. It is possible that the findings may have been different if more students had received I-BEST services. Second, colleges had flexibility in how I-BEST was designed and implemented, including how they identified students to enroll in the program and the industry focus of the I-BEST programs. This variation in implementation could have affected the results of the study. Third, the colleges were selected due to the size of their I-BEST program and their ability to participate in an RCT. The authors state the colleges were not selected to be representative of all I-BEST programs across the state of Washington. Fourth, the program evaluated in this study included two enhancements that are not typically available through I-BEST: additional financial support and advising services. Therefore, the findings from this study may not be generalizable to all I-BEST programs.
Causal Evidence Rating
The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the I-BEST program, and not to other factors.