Skip to main content

Pathways after high school: Evaluation of the Urban Alliance High School Internship Program (Theodos et al., 2017)

Absence of conflict of interest.

Citation

Theodos, B., Pergamit, M.R., Hanson, D., Edelstein, S., Daniels, R., & Srini, T. (2017). Pathways after high school: Evaluation of the Urban Alliance High School Internship Program. Washington, DC: Urban Institute.

Highlights

  • The study's objective was to examine the impact of the Urban Alliance High School Internship Program on employment, earnings, and education outcomes.  
  • The study used a randomized controlled trial to assign participants to the High School Internship Program or the control group. Data sources included student program applications, administrative data, and surveys. The authors used statistical models to compare the outcomes of treatment and control group members. 
  • The study found no significant differences between treatment and control group members in high school graduation rates, employment rates, or earnings.  
  • This study receives a high evidence rating. This means we would be confident that any estimated effects would be attributable to the Urban Alliance High School Internship Program, and not to other factors. However, the study did not find any statistically significant effects.  

Intervention Examined

Urban Alliance High School Internship Program

Features of the Intervention

The Urban Alliance High School Internship Program provides job skills training (soft and hard skills), paid work experience, and mentoring to high school seniors in lower income communities who are at risk of disconnecting from education or employment. The program takes place during the school year. The program also includes alumni services such as coaching, alumni events, and opportunities for paid internships during college breaks. While students with GPAs between 2.0 and 3.0 are targeted, the program is not restricted to high school seniors with those GPAs.  

Features of the Study

The study used a randomized controlled trial to examine the impact of the Urban Alliance High School Internship Program on employment, earnings, and education outcomes. Program applicants from the 2011-2012 and 2012-2013 school years were randomly assigned to either the treatment or control group. For every two treatment participants, one was assigned to the control group. Of the 1,062 eligible high school students, 700 were randomly assigned to the treatment group and 362 were randomly assigned to the control group. The study sample came from Urban Alliance sites in Washington, DC and Baltimore, Maryland. In Washington, DC, students were recruited to the program after Urban Alliance presented information during assemblies or in classrooms. In Baltimore, school counselors or teachers referred students. Only students in Baltimore received course credits for participating. In all, recruitment activities took place in 38 public and charter schools. Across the two sites, 65 percent of study participants were female, 95 percent were U.S. citizens, 11 percent were English-language learners, 89 percent were African American, and 75 percent had work experience. High school students assigned to the treatment group could participate in the High School Internship Program, while those assigned to the control group could not participate in the program.  

Data were obtained from baseline application forms, high school transcripts, Urban Alliance's program information, two follow-up surveys, the National Student Clearinghouse, and the National Center for Education Statistics' Integrated Postsecondary Education Data System (IPEDS). Information about neighborhood characteristics were obtained from the American Community Survey for 2008-2012. The authors used statistical models to compare differences in outcomes between treatment and control group members.  

Findings

Education and skill gains

  • The study found that high school graduation rates did not significantly differ between treatment and control group members.  

Employment

  • The study found that employment at the time of the one-year and two-year surveys did not differ significantly between treatment and control group members. 

Earnings and wages

  • The study found that earnings one and two years after the program ended were not significantly different between treatment and control group members.  

Causal Evidence Rating

The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects would be attributable to the Urban Alliance High School Internship Program and not to other factors. However, the study did not find any statistically significant effects.  

Additional Sources

Theodos, B., Pergamit, M.R., Edelstein, S., George, T., & Freiman, L. (2014). Preparing youth for college and career: A process evaluation of Urban Alliance. Theodos, B., Pergamit, M.R., Hanson, D., Edelstein, S., & Daniels, R. (2016). Embarking on College and Career: Interim Evaluation of Urban Alliance. Washington, DC: Urban Institute.

Reviewed by CLEAR

June 2024