Title,Citation,Topic_area,Study_type,Study_evidence_rating,Outcome_effectiveness,Findings,Intervention_program,Topics,Target_population,Firm_characteristics,Geographic_setting,Original_publication_date,Original_publication_link,"Review Protocol" "The Green Jobs and Health Care impact evaluation: Findings from the impact study of four training programs for unemployed and disadvantaged workers","Martinson, K., Williams, J., Needels, K., Peck, L., Moulton, S., Paxton, N., Mastri, A., Copson, E., Comfort, A., & Brown-Lyons, M. (2016). The Green Jobs and Health Care impact evaluation: Findings from the impact study of four training programs for unemployed and disadvantaged workers. Retrieved from https://wdr.doleta.gov/research/FullText_Documents/ETAOP-2017-07%20Findings%20from%20the%20Impact%20Study.pdf","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine the impact of the Grand Rapids Community College (GRCC) Pathways to Prosperity program on education, earnings, and employment outcomes. The study was a randomized controlled trial. The authors used a baseline information form, the National Directory of New Hires (NDNH), a follow-up survey, and administrative program data to compare the outcomes between the treatment and control groups over an 18-month follow-up period. The study found that the GRCC Pathways to Prosperity program had a significant positive impact on completion rates for vocational training and life skills classes, and receipt of a vocational credential. The quality of causal evidence presented in this report is high because it is based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the GRCC Pathways to Prosperity program and not to other factors.","the Grand Rapids Community College (GRCC) Pathways to Prosperity Program","Basic skills Capacity building programs Community college education and other classroom training","Adult, Justice-involved, Other barriers, Unemployed, Low income",,"United States",2016,https://wdr.doleta.gov/research/FullText_Documents/ETAOP-2017-07%20Findings%20f…,"Community College Review Protocol" "When trying hard isn’t natural: Women’s belonging with and motivation for male-dominated STEM fields as a function of effort expenditure concerns","Smith, J., Lewis, K., Hawthorne, L., & Hodges, S. (2013). When trying hard isn’t natural: Women’s belonging with and motivation for male-dominated STEM fields as a function of effort expenditure concerns. Personality & Social Psychology Bulletin, 39(2), 131-143. [Study 3]","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Attitudes-Low-Favorable impacts Attitudes","Summary: The study examined the effect of providing information about effort requirements to succeed in a fictitious male-dominated eco-psychology master’s program on female students’ attitudes toward their ability to succeed in this field. The authors randomly assigned 48 female undergraduates to receive one of four verbal messages from an advisor about their ability to succeed in a fictitious master’s program in eco-psychology; the women also received a printed brochure distributed to all study groups. The messages varied in terms of emphasis placed on students’ ability versus level of effort. Specifically, three of the message groups conveyed that student success depended on (1) their natural ability (natural ability group), (2) putting in more effort than peers (more effort group), or (3) putting in the same high level of effort as peers (normal effort group). The advisors did not discuss effort requirements with the fourth group that served as a control group (the no information group). Students then immediately completed a questionnaire measuring self-doubt, perceived confidence, future interest in eco-psychology, and how well they thought they would fit into the program. The study found that students in the normal effort group exhibited a significantly higher sense of academic belonging to and future interest in the eco-psychology program than the other three groups. They also had higher perceived competence compared with the more effort group and exhibited lower self-doubt than the no information and more effort groups. The quality of causal evidence presented in this report is low because the authors did not include sufficient controls in their analysis to account for differences between each group, which is required of randomized controlled trials (RCTs) with high attrition. This means we are not confident that the estimated effects are attributable to the type of message the study participants received; other factors are likely to have contributed.",,"Science, Technology, Engineering, and Math (STEM) programs","Female, STEM professional",,"United States",2013,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Exploring women engineering faculty’s mentoring networks","Long, Z., Buzzanell, P., Kokini, K., Wilson, R., Batra, J., & Anderson, L. (2013). Exploring women engineering faculty’s mentoring networks. Proceedings of the 2013 American Society for Engineering Education Annual Conference & Exposition, Washington, DC.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study described how women in academic STEM positions (compared with corporate environments) constructed their own mentoring networks; it also explored the mentoring configurations female academics preferred as support for their careers. The authors conducted in-depth semistructured interviews with seven female engineering faculty at a single large Midwestern university, creating detailed maps of the faculty members’ mentoring networks and evaluating the nature, importance, and perceived value of each connection. The study found that the female faculty were generally dissatisfied with formal mentoring relationships and instead sought mentors on their own. Faculty selected these informal mentors from among those with whom they had an existing relationship, such as a friend or co-committee member. Mentees selected multiple mentors with mixed backgrounds and characteristics to serve different purposes (for example, discussing work-life balance or career advancement) and mentees typically had at least one mentor outside of the department or university to discuss more confidential matters. Findings were generally consistent with mentor relationships in a corporate setting.",,"Mentoring Science, Technology, Engineering, and Math (STEM) programs","Female, STEM professional",,"United States",2013,http://www.asee.org/public/conferences/20/papers/6463/download,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Sex differences in application, success, and funding rates for NIH extramural programs","Pohlhaus, J.R., Jiang, H., Wagner, R.M., Schaffer, W.T., & Pinn, V.W. (2011). Sex differences in application, success, and funding rates for NIH extramural programs. Academic Medicine, 86(6), 759-767.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study's objective was to analyze gender differences in the award of National Institutes of Health (NIH) extramural grants in the 2008 fiscal year. This research was intended to inform efforts to improve diversity in award funding. Using data from the NIH Information for Management, Planning, Analysis, and Coordination electronic Research Administration database, the authors conducted cross-sectional analyses of funding rates (the percentage of applicants who received funding) and success rates (the percentage of reviewed grant applications that received funding), by career stage (early, mid, and senior) and by gender. The authors also conducted analyses specific to the prestigious R01 award—the only award not intended for a specific career stage—including a longitudinal analysis of researchers transitioning to R01 awards or applying for renewal of R01 awards. Overall, women tended to be as likely as men to receive NIH research and training awards in 2008, and applied for and received similar award amounts. In the R01 program, women had a similar success rate as men but a lower funding rate, which seemed to be caused by a lower rate of award among experienced applicants submitting proposals for award renewal. The longitudinal analysis confirmed that women were less likely than men to apply and receive funding for new or renewal R01 awards. Finally, fewer older women applied for and received funding, and recipients of multiple awards were more likely to be men. The authors suggest that these findings are consistent with national data showing fewer older women work in the field and are employed in senior positions.",,"Science, Technology, Engineering, and Math (STEM) programs Other disparities or discrimination in employment and earnings","STEM professional",,"United States",2011,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Recruitment strategies for gender equity: Lessons from cohort 1 and cohort 2 advance institutions","Zajicek, A., Morimoto, S., Terdalkar, A., Hunt, V., Rencis, J., & Lisnic, R. (2011). Recruitment strategies for gender equity: Lessons from cohort 1 and cohort 2 advance institutions. Washington, DC: American Society for Engineering Education.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-No impacts Employment","Summary: The study’s objective was to evaluate the effectiveness of the ADVANCE institutional transformation program (ADVANCE-IT), sponsored by the National Science Foundation (NSF), on the recruitment of female engineering faculty at participating U.S. colleges and universities. The authors used program implementation and outcome data obtained from seven participating colleges and universities to compare the number of female engineering faculty before and after institutions participated in the intervention. The study found no statistically significant relationships between participation in the ADVANCE-IT program and the number of female assistant professors at those institutions. The quality of causal evidence presented in this study is low because the authors conducted no tests of statistical significance and did not observe outcomes for multiple periods before the intervention. This means we are not confident that the estimated effects would have been attributable to the ADVANCE-IT program; other factors are likely to have contributed.","NSF’s ADVANCE-IT Program","Science, Technology, Engineering, and Math (STEM) programs Other disparities or discrimination in employment and earnings","Female, STEM professional",,"United States",2011,http://www.asee.org/file_server/papers/attachment/file/0001/1532/Recruitment_St…,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Gender Equity in Science and Engineering: Advancing Change in Higher Education","Bilimoria, D., & Liang, X. (2011). Gender Equity in Science and Engineering: Advancing Change in Higher Education. New York: Routledge.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to evaluate the effectiveness of the ADVANCE institutional transformation program (ADVANCE-IT) sponsored by the National Science Foundation (NSF) in advancing women’s representation among science, technology, engineering, and mathematics (STEM) faculty in U.S. colleges and universities. The authors used program implementation and outcome data obtained from 19 participating colleges and universities to examine program initiatives, actions, and outcomes of ADVANCE-IT institutions. The analysis of interest in this review compared the changes in proportions of female STEM faculty in institutions that were implementing ADVANCE-IT programs to national reference groups over the course of the program period, by faculty rank and by type of institution. The study found that the ADVANCE-IT program was effective in increasing the number of female STEM faculty at all ranks in four-year colleges and research universities. The quality of causal evidence presented in this study is low. This means we are not confident that the estimated effects are attributable to the ADVANCE-IT program. Other factors are likely to have contributed.","the ADVANCE Program","Other disparities or discrimination in employment and earnings Science, Technology, Engineering, and Math (STEM) programs","Female, STEM professional",,"United States",2011,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "The Effectiveness of Institutional Intervention on Minimizing Demographic Inertia and Improving the Representation of Women Faculty in Higher Education","Bakian, A.V., & Sullivan, K.A. (2010). The Effectiveness of Institutional Intervention on Minimizing Demographic Inertia and Improving the Representation of Women Faculty in Higher Education. International Journal of Gender, Science and Technology, 2(2), 207-234.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: This study’s objective was to examine the effect of the ADVANCE program sponsored by the National Science Foundation (NSF) on women’s representation among tenured and tenure-track faculty. The study took place at one unnamed research university. The authors compared the transition probabilities (that is, the probabilities of being hired, retained, or promoted) for men and women, before and during the period ADVANCE was in effect. The study found that the ADVANCE program enhanced women’s representation among faculty in science and engineering departments. The quality of causal evidence presented in this study is low. This means we are not confident that the estimated effects are attributable to the ADVANCE program. Other factors are likely to have contributed.","the ADVANCE Program","Other disparities or discrimination in employment and earnings Science, Technology, Engineering, and Math (STEM) programs","Female, STEM professional",,"United States",2010,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "An experimental study of the Los Angeles County repeat offender program: Its implementation and evaluation","Zhang, S.X., & Zhang, L. (2005). An experimental study of the Los Angeles County repeat offender program: Its implementation and evaluation. Criminology and Public Policy, 4(2):205–236.","Justice-Involved Youth, Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Education and skills gains-Mod/high-Mixed impacts Education and skills gains","Summary: The study examined the impact of the Los Angeles County Repeat Offender Prevention Program (ROPP) on youths’ recidivism and educational outcomes. The authors randomly assigned eligible youth to either the treatment group that received ROPP or a control group that received standard probation services. Using data from the Los Angeles Unified School District and probation records, the authors compared the educational outcomes and average recidivism rates of the two groups. The study found that ROPP had some early positive impacts on educational outcomes, but many of these gains faded after the first six months of the program. The study also found initial improvements (reductions) in recidivism for the treatment group during the first six months. There were no statistically significant effects of participation in the program on violations of probation. The quality of causal evidence presented in this report is moderate because it was based on a randomized controlled trial with high attrition that sufficiently accounted for other relevant factors. This means we are somewhat confident that the estimated effects are attributable to the Los Angeles County ROPP, but other factors might also have contributed.","The Los Angeles County Repeat Offender Prevention Program (ROPP)","Youth programs Other training and education","Youth, Justice-involved",,"United States",2005,,"Justice-Involved Youth, Opportunities for Youth Review Protocol"