There is no conflict of interest.
Citation
Ratledge, A., Sommo, C., Cullinan, D., O'Donoghue, R., Lepe, M., & Camo-Biogradlija, J. (2021). Motor City Momentum: Three Years of the Detroit Promise Path Program for Community College Students. MDRC.
Highlights
- The study's objective was to examine the impact of Detroit Promise Path (DPP) on education outcomes.
- The study was a randomized controlled trial that assigned Detroit Promise scholarship applicants to receive the DPP program or to the control group. The authors used statistical models to compare the outcomes of the program and control group members after three years using data from the National Student Clearinghouse (NSC) and student records from the five participating community colleges.
- The study found a positive significant relationship between the Detroit Promise Path program and the number of semesters enrolled in college and credits earned at the end of three years.
- This study receives a high evidence rating. This means we are confident that the estimated effects are attributable to the Detroit Promise Path (DPP) program, and not to other factors.
Intervention Examined
Detroit Promise Path
Features of the Intervention
In 2013, the Detroit Regional Chamber launched the Detroit Promise scholarship to help Detroit high school students enroll in local community colleges. The scholarship covered the difference between financial aid and tuition for up to three years. While the scholarship increased enrollment, many students dropped out after their first year. In 2016, the Detroit Promise Path (DPP) program was introduced by MDRC and the Detroit Regional Chamber, adding four evidence-based components to the scholarship to help students stay in college and graduate. Participants in the DPP received extra support alongside the scholarship, including: 1) required coaching sessions twice a month (the core component), 2) a $50 gift card each month for completing coaching, 3) summer engagement to connect students to summer enrollment or summer jobs, and 4) a management information system to track student participation. To qualify for the scholarship, students must graduate from a Detroit high school, enroll in a local community college within three semesters after graduation, and reside in Detroit. There are no merit-based requirements for eligibility.
Features of the Study
The study was a randomized controlled trial that assigned Detroit Promise scholarship applicants to receive the DPP or to the control group (would only receive the scholarship). In the summer of 2016 and 2017, students eligible for the Detroit Promise scholarship were informed about the study and the DPP program while applying. They were also asked to choose which of the five colleges they planned to attend. Of the 1,268 students applying for the Detroit Promise scholarship, 829 were randomly assigned to receive the DPP program (treatment group) and 439 were randomly assigned to receive the scholarship only (control group). Students enrolled in the study had an average age of 18. The majority were women (58% program group; 61% control group), Black (80% program group; 81% control group) and did not live with a parent who had a bachelor's degree (81% program group; 78% control group). The study used data from the National Student Clearinghouse (NSC) and student records from the five participating community colleges. The primary outcomes were community college persistence, credits earned, and credentials earned after three years. The authors compared the outcomes of the DPP program participants and control group participants using statistical models.
Study Sites
There were five Detroit-area community colleges that were part of the study:
- Henry Ford College
- Macomb Community College
- Oakland Community College
- Schoolcraft College
- Wayne County Community College District.
Findings
Education and skills gains
- The study found that at the end of three years, DPP participants enrolled in a significantly greater number of semesters (2.9) than control group participants (2.5).
- The study found that after three years, DPP participants earned significantly more college credits than control group participants (17.1 and 13.5, respectively).
- The study found that a significantly higher proportion of DPP participants enrolled in five or six semesters of college than the control group (30% and 21.9%, respectively).
- The study found no significant differences in the percentage of DPP participants and the percentage of control group participants earning credentials at the end of three years.
- Women in the DPP earned significantly more credits than those in the control group, (17.73 and 13.16, respectively). For men, there was no significant difference in credits earned between the DPP and control groups. Additionally, there were no significant differences between the groups for either men or women in earning credentials.
Considerations for Interpreting the Findings
The authors used an intent-to-treat approach. Students were randomly assigned before starting college, and about 19% of them (from both groups) did not enroll but were still included in the analysis. Also, students in the program group were given the option to join the DPP and were contacted by coaches, but not all eligible students took part or engaged with the program. The authors suggest that these factors may lead to an underestimation of the program's effects. Lastly, among the five colleges, one faced significant implementation challenges and had lower results in credits and credentials earned compared to the others, even showing a negative impact on credits. The authors believe that the lower level of quality and fidelity to the program model at this college contributed to the lower outcomes.
Causal Evidence Rating
The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Detroit Promise Path (DPP) program, and not to other factors.