Title,Citation,Topic_area,Study_type,Study_evidence_rating,Outcome_effectiveness,Findings,Intervention_program,Topics,Target_population,Firm_characteristics,Geographic_setting,Original_publication_date,Original_publication_link,"Review Protocol" "SUN PATH comparison group study","Dauphinee, T., & Bishwakarma, R. (2018). SUN PATH comparison group study. Albuquerque, NM: University of New Mexico, Career to Cradle Policy Institute.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Skill‐UP Network Pathways Acceleration in Technology and Healthcare (SUN PATH) program on education, earnings, and employment outcomes. The authors used a nonexperimental design to compare the outcomes of students who were in the SUN PATH program to a matched comparison group of students. The study found that SUN PATH students had higher rates of program completion, certificates/degree attainment, program retention, employment, and earnings than students in the comparison group. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the SUN PATH program, but other factors might also have contributed.","the Skill‐UP Network Pathways Acceleration in Technology and Healthcare (SUN PATH) Program","Capacity building programs Community college education and other classroom training","Adult, Dislocated or displaced worker, Other, Low-skilled, Veteran or military",,"United States",2018,https://www.skillscommons.org/bitstream/handle/taaccct/18108/SUN%20PATH%20Compa…,"Community College Review Protocol" "Third party evaluation of MoManufacturingWINS: Implementation, outcomes, and impact","Cosgrove, J. J., Cosgrove, M. S., & Bragg, D. D. (2016). Third party evaluation of MoManufacturingWINs: Implementation, outcomes, and impact. St. Louis, MO: Cosgrove & Associates and Bragg & Associates.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of Missouri’s Manufacturing Workforce Innovation Networks(MMW) program on student education and employment outcomes. The study used a nonexperimental design to compare the outcomes of students who were in MMW to a comparison group of students in other manufacturing-technology related programs. The study found that MMW participation was significantly associated with higher retention and employment rates. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention and they did not include sufficient controls. This means we are not confident that the estimated effects are attributable to MMW; other factors are likely to have contributed.","Missouri’s Manufacturing Workforce Innovation Networks (MMW)","Basic skills Capacity building programs Community college education and other classroom training","Adult, Unemployed, Other, Low-skilled, Veteran or military",,"United States",2016,https://www.skillscommons.org/bitstream/handle/taaccct/10116/ThirdPartyFinalEva…,"Community College Review Protocol" "Final evaluation of Southwest Virginia Community College’s PluggedInVA TAACCCT Grant initiative","Topper, A., Munn, W., Bor, E., Clery, S., & Smith, B. (2016). Final evaluation of Southwest Virginia Community College’s PluggedInVA TAACCCT Grant initiative. Retrieved from: https://www.skillscommons.org//handle/taaccct/15650","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the PluggedInVA (PIVA) program on education and employment outcomes. Using college administrative and state workforce data, the authors conducted a nonexperimental study to compare outcomes between students in the PIVA program with a comparison group of non-participating students. The study found no statistically significant relationships between participation in the PIVA program and education or employment outcomes. The quality of causal evidence presented in this report is low because the authors did not ensure the groups being compared were similar before the intervention or include sufficient control variables. This means we are not confident that the estimated effects are attributable to PluggedInVA; other factors are likely to have contributed.","PluggedInVA (PIVA)","Capacity building programs Community college education and other classroom training","Adult, Unemployed, Other",,"United States",2016,https://www.skillscommons.org//handle/taaccct/15650,"Community College Review Protocol" "The Green Jobs and Health Care impact evaluation: Findings from the impact study of four training programs for unemployed and disadvantaged workers","Martinson, K., Williams, J., Needels, K., Peck, L., Moulton, S., Paxton, N., Mastri, A., Copson, E., Comfort, A., & Brown-Lyons, M. (2016). The Green Jobs and Health Care impact evaluation: Findings from the impact study of four training programs for unemployed and disadvantaged workers. Retrieved from https://wdr.doleta.gov/research/FullText_Documents/ETAOP-2017-07%20Findings%20from%20the%20Impact%20Study.pdf","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine the impact of the Grand Rapids Community College (GRCC) Pathways to Prosperity program on education, earnings, and employment outcomes. The study was a randomized controlled trial. The authors used a baseline information form, the National Directory of New Hires (NDNH), a follow-up survey, and administrative program data to compare the outcomes between the treatment and control groups over an 18-month follow-up period. The study found that the GRCC Pathways to Prosperity program had a significant positive impact on completion rates for vocational training and life skills classes, and receipt of a vocational credential. The quality of causal evidence presented in this report is high because it is based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the GRCC Pathways to Prosperity program and not to other factors.","the Grand Rapids Community College (GRCC) Pathways to Prosperity Program","Basic skills Capacity building programs Community college education and other classroom training","Adult, Justice-involved, Other barriers, Unemployed, Low income",,"United States",2016,https://wdr.doleta.gov/research/FullText_Documents/ETAOP-2017-07%20Findings%20f…,"Community College Review Protocol" "Evaluation of the Illinois Network for Advanced Manufacturing: Final Report","Westat. (2016). Evaluation of the Illinois Network for Advanced Manufacturing: Final Report. Rockville, MD: Westat & GEM Software Development, Inc.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the Illinois Network for Advanced Manufacturing (INAM) program on education, earnings, and employment outcomes. The study used a nonexperimental design to compare the outcomes of students who were in the INAM program to a comparison group of students who took similar courses before the creation of INAM. Using data from college databases and the Illinois Department of Employment Security, the authors conducted statistical models to examine differences in outcomes between the groups. The study found that participation in the INAM program was significantly associated with improved rates of certificate or degree completion. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the INAM program; other factors are likely to have contributed.","the Illinois Network for Advanced Manufacturing (INAM)","Capacity building programs Community college education and other classroom training","Adult, Dislocated or displaced worker, Unemployed, Other, Veteran or military",,"United States",2016,https://www.researchgate.net/publication/315664265_Evaluation_of_the_Illinois_N…,"Community College Review Protocol" "When trying hard isn’t natural: Women’s belonging with and motivation for male-dominated STEM fields as a function of effort expenditure concerns","Smith, J., Lewis, K., Hawthorne, L., & Hodges, S. (2013). When trying hard isn’t natural: Women’s belonging with and motivation for male-dominated STEM fields as a function of effort expenditure concerns. Personality & Social Psychology Bulletin, 39(2), 131-143. [Study 3]","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Attitudes-Low-Favorable impacts Attitudes","Summary: The study examined the effect of providing information about effort requirements to succeed in a fictitious male-dominated eco-psychology master’s program on female students’ attitudes toward their ability to succeed in this field. The authors randomly assigned 48 female undergraduates to receive one of four verbal messages from an advisor about their ability to succeed in a fictitious master’s program in eco-psychology; the women also received a printed brochure distributed to all study groups. The messages varied in terms of emphasis placed on students’ ability versus level of effort. Specifically, three of the message groups conveyed that student success depended on (1) their natural ability (natural ability group), (2) putting in more effort than peers (more effort group), or (3) putting in the same high level of effort as peers (normal effort group). The advisors did not discuss effort requirements with the fourth group that served as a control group (the no information group). Students then immediately completed a questionnaire measuring self-doubt, perceived confidence, future interest in eco-psychology, and how well they thought they would fit into the program. The study found that students in the normal effort group exhibited a significantly higher sense of academic belonging to and future interest in the eco-psychology program than the other three groups. They also had higher perceived competence compared with the more effort group and exhibited lower self-doubt than the no information and more effort groups. The quality of causal evidence presented in this report is low because the authors did not include sufficient controls in their analysis to account for differences between each group, which is required of randomized controlled trials (RCTs) with high attrition. This means we are not confident that the estimated effects are attributable to the type of message the study participants received; other factors are likely to have contributed.",,"Science, Technology, Engineering, and Math (STEM) programs","Female, STEM professional",,"United States",2013,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Women in community colleges: Access to success","St. Rose, A., & Hill, C. (2013). Women in community colleges: Access to success. Washington, DC: American Association of University Women.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The authors described two programs partnering with California community colleges—the Mathematics, Engineering, Science Achievement Community College Program (MCCP) and the CalWomen Tech Program—that aim to encourage women to pursue careers in science, technology, engineering, and mathematics (STEM). The two initiatives approach this goal in different ways: MCCP prepares women to transfer from two- to four-year STEM degree programs, whereas CalWomen Tech encourages participation in non-traditional career and technical education programs in STEM, such as information technology and automotive repair. MCCP offers a wide array of academic, career, and social support services, from academic tutoring and advising to a cohort-based course progression. CalWomen Tech’s promotional materials target women, such as “women in technology” websites that highlight the employment and salary opportunities available to women who choose non-traditional career paths, and skill-building or “bridge” courses that lay the groundwork for more advanced study. In 2010, 38 percent of MCCP transfer students from two- to four-year degree programs were women. Of those transferring to programs in life sciences or mathematics, more than 50 percent were women. After partnering with CalWomen Tech, female enrollment in City College of San Francisco’s computer networking and information technology program increased from 19 percent in 2006 to 33 percent in 2008, with persistent enrollment rates through 2010. Similarly, CalWomen Tech helped Evergreen Valley College raise female retention in its automotive technology program from 58 percent to 88 percent over the course of two years.",,"Youth programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Youth, Female",,"United States",2013,http://www.aauw.org/files/2013/05/women-in-community-colleges.pdf,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Exploring women engineering faculty’s mentoring networks","Long, Z., Buzzanell, P., Kokini, K., Wilson, R., Batra, J., & Anderson, L. (2013). Exploring women engineering faculty’s mentoring networks. Proceedings of the 2013 American Society for Engineering Education Annual Conference & Exposition, Washington, DC.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study described how women in academic STEM positions (compared with corporate environments) constructed their own mentoring networks; it also explored the mentoring configurations female academics preferred as support for their careers. The authors conducted in-depth semistructured interviews with seven female engineering faculty at a single large Midwestern university, creating detailed maps of the faculty members’ mentoring networks and evaluating the nature, importance, and perceived value of each connection. The study found that the female faculty were generally dissatisfied with formal mentoring relationships and instead sought mentors on their own. Faculty selected these informal mentors from among those with whom they had an existing relationship, such as a friend or co-committee member. Mentees selected multiple mentors with mixed backgrounds and characteristics to serve different purposes (for example, discussing work-life balance or career advancement) and mentees typically had at least one mentor outside of the department or university to discuss more confidential matters. Findings were generally consistent with mentor relationships in a corporate setting.",,"Mentoring Science, Technology, Engineering, and Math (STEM) programs","Female, STEM professional",,"United States",2013,http://www.asee.org/public/conferences/20/papers/6463/download,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "An effective model for enhancing underrepresented minority participation and success in geoscience undergraduate research","Blake, R., Liou-Mark, J., & Chukuigwe, C. (2013). An effective model for enhancing underrepresented minority participation and success in geoscience undergraduate research. Journal of Geoscience Education, 61(4), 405-414.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: This study described the implementation of the National Science Foundation Research Experiences for Undergraduates (REU) program at New York City College of Technology. This year-long program aimed to retain undergraduates in STEM disciplines and prepare them for STEM careers, especially for underrepresented minority groups, including women. The authors, as directors of the REU program, described each of its components, including research, minicourses, seminars and workshops, mentoring, support and networking opportunities, and presenting at and attending conferences. Outcomes were discussed in terms of post-program experiences and achievements, as well as quotes from program participants. Overall, the authors concluded that the program was successful in terms of demonstrated interest in, attendance in, or completion of a STEM graduate program; achievement in STEM publications; and attainment of STEM awards. These outcomes were complemented by five quotes from student participants who discussed how the program changed their academic lives.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Other barriers, Female",,"United States",2013,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Women in industrial engineering: Stereotypes, persistence, and perspectives","Brawner, C., & Camacho, M. (2012). Women in industrial engineering: Stereotypes, persistence, and perspectives. Journal of Engineering Education, 101(2), 288-318.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: This study explored why more women major in industrial engineering in college than other engineering fields. The authors tabulated quantitative data from eight colleges and universities in the southeastern region of the United States using data from the Multiple-Institution Database for Investigating Engineering Longitudinal Development (MIDFIELD). They also conducted focus groups with 20 female industrial engineering students and qualitatively analyzed the content of industrial engineering department websites at the eight MIDFIELD institutions. The study found that students transferred into an industrial engineering major program after taking several semesters of coursework in another field at the university. It found no evidence that women with weak academic records were more likely to choose industrial engineering over other engineering majors. Focus group participants felt that their department had a warm, familial atmosphere, and that the major provided a more general background in engineering, which could offer them more flexible job opportunities in a variety of related fields. This was consistent with departmental websites, which marketed themselves as having a strong sense of community and collegiality, and stressed the wide range of career opportunities available to their graduates as problem solvers for society and industry.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Female",,"United States",2012,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Inside the double bind: A synthesis of empirical research on undergraduate and graduate women of color in science, technology, engineering, and mathematics","Ong, M., Wright, C., Espinosa, L., & Orfield, G. (2011). Inside the double bind: A synthesis of empirical research on undergraduate and graduate women of color in science, technology, engineering, and mathematics. Harvard Educational Review, 81(2), 172-208.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study examined existing empirical research on the challenges that minority women have faced in science, technology, engineering, and mathematics (STEM) disciplines at the undergraduate and graduate levels, emphasizing factors that promote or discourage retention and transition to employment or further study. The authors analyzed 116 empirical studies conducted from 1970 to 2008 that examine aspects of the academic and career experiences of minority women in STEM disciplines, identifying the findings of each study and synthesizing these features to pinpoint trends and opportunities for further investigation. The authors summarized the studies’ conclusions regarding the effects of academic climate, enrichment programs, self-confidence, and relationships with faculty, peers, and family on minority women’s persistence in undergraduate STEM majors, highlighting lack of recognition from peers and faculty members and complex family expectations and dynamics as factors that hinder them from completing STEM degrees. At the graduate level, many of the same influences, particularly family expectations and fraught relationships with peers and professors, present challenges for minority women in STEM disciplines. Academic and social transitions from minority-serving institutions to predominantly white institutions and the financial demands of graduate study also represent cross-cutting obstacles.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Other barriers, Female",,"United States",2011,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Gender Equity in Science and Engineering: Advancing Change in Higher Education","Bilimoria, D., & Liang, X. (2011). Gender Equity in Science and Engineering: Advancing Change in Higher Education. New York: Routledge.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to evaluate the effectiveness of the ADVANCE institutional transformation program (ADVANCE-IT) sponsored by the National Science Foundation (NSF) in advancing women’s representation among science, technology, engineering, and mathematics (STEM) faculty in U.S. colleges and universities. The authors used program implementation and outcome data obtained from 19 participating colleges and universities to examine program initiatives, actions, and outcomes of ADVANCE-IT institutions. The analysis of interest in this review compared the changes in proportions of female STEM faculty in institutions that were implementing ADVANCE-IT programs to national reference groups over the course of the program period, by faculty rank and by type of institution. The study found that the ADVANCE-IT program was effective in increasing the number of female STEM faculty at all ranks in four-year colleges and research universities. The quality of causal evidence presented in this study is low. This means we are not confident that the estimated effects are attributable to the ADVANCE-IT program. Other factors are likely to have contributed.","the ADVANCE Program","Other disparities or discrimination in employment and earnings Science, Technology, Engineering, and Math (STEM) programs","Female, STEM professional",,"United States",2011,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Are the predictors of women’s persistence in STEM painting the full picture? A series of comparative case studies","Hughes, R. (2011). Are the predictors of women’s persistence in STEM painting the full picture? A series of comparative case studies. International Journal of Gender, Science and Technology, 3(3), 548-570.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study's objective was to examine the experiences of several female science and engineering majors within the literature context on predictive factors of persistence in STEM majors and careers. The study focused on the roles of parental support and education level, academic preparation, and perceptions of the STEM culture in influencing the career trajectories of female undergraduates at a United States university in 2009–2010. The author conducted two interviews each with five women in their fourth year of college who had chosen to major in a STEM field. The first interview collected the participant’s life history, with a focus on factors and moments leading to the decision to pursue a STEM major. The second interview, conducted several months later, recorded whether the participant’s career plans had changed. The study found that the participants’ experiences did not always align with what the literature predicted, and that complex factors contributed to a woman’s decision to stay in or leave a STEM major. Although all the women who stayed in a STEM field described the use of coping strategies for persisting in a male-dominated field, these strategies differed among participants. Those who chose to leave their STEM major did not necessarily do so because of a lack of academic preparation, parental support, or competence, but rather seemed to share a feeling that they did not identify with the peers in their STEM field, who they described as “uptight,” “nerdy,” and lacking a life outside of the classroom.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Female",,"United States",2011,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Recruitment strategies for gender equity: Lessons from cohort 1 and cohort 2 advance institutions","Zajicek, A., Morimoto, S., Terdalkar, A., Hunt, V., Rencis, J., & Lisnic, R. (2011). Recruitment strategies for gender equity: Lessons from cohort 1 and cohort 2 advance institutions. Washington, DC: American Society for Engineering Education.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-No impacts Employment","Summary: The study’s objective was to evaluate the effectiveness of the ADVANCE institutional transformation program (ADVANCE-IT), sponsored by the National Science Foundation (NSF), on the recruitment of female engineering faculty at participating U.S. colleges and universities. The authors used program implementation and outcome data obtained from seven participating colleges and universities to compare the number of female engineering faculty before and after institutions participated in the intervention. The study found no statistically significant relationships between participation in the ADVANCE-IT program and the number of female assistant professors at those institutions. The quality of causal evidence presented in this study is low because the authors conducted no tests of statistical significance and did not observe outcomes for multiple periods before the intervention. This means we are not confident that the estimated effects would have been attributable to the ADVANCE-IT program; other factors are likely to have contributed.","NSF’s ADVANCE-IT Program","Science, Technology, Engineering, and Math (STEM) programs Other disparities or discrimination in employment and earnings","Female, STEM professional",,"United States",2011,http://www.asee.org/file_server/papers/attachment/file/0001/1532/Recruitment_St…,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Why so few? Women in science, technology, engineering, and mathematics","Hill, C., Corbett, C., & St. Rose, A. (2010). Why so few? Women in science, technology, engineering, and mathematics. Washington, D.C.: American Association of University Women.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: This publication summarized the obstacles facing girls and women who wish to pursue academic or professional careers in STEM fields and highlighted solutions to these challenges at the secondary, postsecondary, and professional levels. The authors presented scholars’ investigations into issues surrounding gender differences in interest, retention, or careers in STEM, drawing on both interviews with the profiled scholars and their published studies. The paper concluded that bias and stereotypes, whether implicit or explicit, hindered girls’ development in STEM. According to the paper, promoting the idea that intelligence is not fixed and innate but can expand through hard work, dubbed the growth mindset, combats the notion that boys are inherently better at math and science than girls and encourages girls to persevere. Further, women in academic and industry STEM positions continued to suffer from bias and stereotypes, which can manifest themselves through unsupportive atmospheres or distorted perceptions of female employees’ competence. Clear standards for advancement can counteract some of these tendencies.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs Other disparities or discrimination in employment and earnings","Youth, Female",,"United States",2010,http://www.aauw.org/files/2013/02/Why-So-Few-Women-in-Science-Technology-Engine…,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "The Effectiveness of Institutional Intervention on Minimizing Demographic Inertia and Improving the Representation of Women Faculty in Higher Education","Bakian, A.V., & Sullivan, K.A. (2010). The Effectiveness of Institutional Intervention on Minimizing Demographic Inertia and Improving the Representation of Women Faculty in Higher Education. International Journal of Gender, Science and Technology, 2(2), 207-234.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: This study’s objective was to examine the effect of the ADVANCE program sponsored by the National Science Foundation (NSF) on women’s representation among tenured and tenure-track faculty. The study took place at one unnamed research university. The authors compared the transition probabilities (that is, the probabilities of being hired, retained, or promoted) for men and women, before and during the period ADVANCE was in effect. The study found that the ADVANCE program enhanced women’s representation among faculty in science and engineering departments. The quality of causal evidence presented in this study is low. This means we are not confident that the estimated effects are attributable to the ADVANCE program. Other factors are likely to have contributed.","the ADVANCE Program","Other disparities or discrimination in employment and earnings Science, Technology, Engineering, and Math (STEM) programs","Female, STEM professional",,"United States",2010,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "An experimental study of the Los Angeles County repeat offender program: Its implementation and evaluation","Zhang, S.X., & Zhang, L. (2005). An experimental study of the Los Angeles County repeat offender program: Its implementation and evaluation. Criminology and Public Policy, 4(2):205–236.","Justice-Involved Youth, Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Education and skills gains-Mod/high-Mixed impacts Education and skills gains","Summary: The study examined the impact of the Los Angeles County Repeat Offender Prevention Program (ROPP) on youths’ recidivism and educational outcomes. The authors randomly assigned eligible youth to either the treatment group that received ROPP or a control group that received standard probation services. Using data from the Los Angeles Unified School District and probation records, the authors compared the educational outcomes and average recidivism rates of the two groups. The study found that ROPP had some early positive impacts on educational outcomes, but many of these gains faded after the first six months of the program. The study also found initial improvements (reductions) in recidivism for the treatment group during the first six months. There were no statistically significant effects of participation in the program on violations of probation. The quality of causal evidence presented in this report is moderate because it was based on a randomized controlled trial with high attrition that sufficiently accounted for other relevant factors. This means we are somewhat confident that the estimated effects are attributable to the Los Angeles County ROPP, but other factors might also have contributed.","The Los Angeles County Repeat Offender Prevention Program (ROPP)","Youth programs Other training and education","Youth, Justice-involved",,"United States",2005,,"Justice-Involved Youth, Opportunities for Youth Review Protocol"