Title,Citation,Topic_area,Study_type,Study_evidence_rating,Outcome_effectiveness,Findings,Intervention_program,Topics,Target_population,Firm_characteristics,Geographic_setting,Original_publication_date,Original_publication_link,"Review Protocol" "Oregon Credentials, Acceleration and Support for Employment (CASE) evaluation report: Results, key issues and implications for policy, practice and systems","Watrus, B., & Fercho, H. (2015). Oregon Credentials, Acceleration and Support for Employment (CASE) evaluation report: Results, key issues and implications for policy, practice and systems. Retrieved from https://www.roguecc.edu/Programs/CareerPathways/pdf/CASE%20final%20evaluation%20report_Final.pdf","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the Credentials, Acceleration and Support for Employment (CASE) program on education and employment outcomes. The authors used a nonexperimental design to compare the outcomes of students who were in the CASE program to a matched comparison group. The study found a positive relationship between participation in the CASE program and program completion and employment; however, the study did not include tests of statistical significance. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar or use sufficient. This means we are not confident that the estimated effects are attributable to the CASE program; other factors are likely to have contributed.","the Credentials, Acceleration and Support for Employment (CASE) Program","Capacity building programs Community college education and other classroom training","Adult, Dislocated or displaced worker, Unemployed, Other",,"United States",2020,https://www.roguecc.edu/Programs/CareerPathways/pdf/CASE%20final%20evaluation%2…,"Community College Review Protocol" "Tightened immigration policies and the self-employment dynamics of Mexican immigrants","Wang, C. (2019). Tightened immigration policies and the self-employment dynamics of Mexican immigrants. Journal of Policy Analysis & Management, 38(4), 944–977. doi:10.1002/pam.22160",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: The study’s objective was to examine the impact of immigration policies after September 11, 2001, on self-employment among Mexican immigrants.  The study used a difference-in-differences model using Current Population Survey (CPS) data from 1996 to 2006.   The study found Mexican immigrants were substantially more likely to enter self-employment after 9/11, but there was no statistically significant difference in overall rates of self-employment.   The quality of causal evidence presented in this report is low because the events of 9/11 present a confounding factor. This means we are not confident that the estimated effects are attributable to immigration policies after 9/11; other factors are likely to have contributed.  ","Post-9/11 Immigration Policies","Foreign and temporary workers","Adult, Male, Migrant worker",,,2019,https://onlinelibrary.wiley.com/doi/full/10.1002/pam.22160,"Review Protocol" "Mali Speed School Program: Long term impact","Dillon, A., Porreca, E., & Rosati, F. (2018). Mali Speed School Program: Long term impact. Understanding Children's Work (UCW) Working Paper Series. Rome, Italy: UCW","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Mali Speed School Program on child labor and education outcomes. The study used a randomized controlled trial to compare outcomes between children who participated in the Mali Speed School Program with children who did not. Using survey data, the authors conducted difference-in-differences models to examine long-term program outcomes between the groups. The study found that the percentage of children who worked in agriculture in the last seven days or wage employment in the previous 12 months was significantly lower in the treatment group than the control group. The study also found that the percentage of children enrolled in school five years after program implementation was significantly higher in the treatment group than the control group. The quality of the causal evidence presented in this study is moderate because, although it was based on a randomized controlled trial with high attrition, the authors demonstrated that the treatment and control groups were similar before the intervention. This means we are somewhat confident that the estimated effects are attributable to the Mali Speed School Program, but other factors might also have contributed.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2018,,"Child Labor Review Protocol" "Developmental students' persistence towards graduation in paired coursework programs among African American and Latino males in community colleges","Davis, E. (2018). Developmental students' persistence towards graduation in paired coursework programs among African American and Latino males in community colleges. (Doctoral dissertation). Retrieved from ProQuest Dissertations and Theses database.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of accelerated paired courses on male African American and Latino students’ academic persistence. The study used a nonexperimental design to compare the outcomes of students who completed paired coursework to students who did not. The author examined enrollment and course completion using college administrative records. The study found that students who completed paired coursework were significantly more likely to enroll in college the following semester than students in the comparison group. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the paired coursework; other factors are likely to have contributed.","Accelerated paired courses","Community college education and other classroom training","Adult, Male, Black or African American, Hispanic of any race",,"United States",2018,https://jscholarship.library.jhu.edu/handle/1774.2/59950,"Community College Review Protocol" "Integrating economic strengthening and family coaching to reduce work-related health hazards among children of poor households: Burkina Faso","Karimli, L., Rost, L., & Ismayilova, L. (2018). Integrating economic strengthening and family coaching to reduce work-related health hazards among children of poor households: Burkina Faso. Journal of Adolescent Health, 62, S6-S14.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Health and safety-Low-No impacts Health and safety","Summary: The study’s objective was to examine the impact of the Trickle Up and Trickle Up Plus programs on children’s exposure to work-related hazards and abuse, and children’s work-related health outcomes. This summary focuses on the comparison between the Trickle Up intervention group and the control group. The study was a randomized controlled trial in the Nord Region of Burkina Faso, West Africa. Using three waves of survey data administered to children and adults separately, the authors conducted statistical models to compare the outcomes of treatment and control group members. The study found that Trickle Up program participation was significantly related to a reduction of hazardous work and abuse, compared with the control group. However, the study found no statistically significant relationship between the Trickle Up program and work-related health outcomes. The quality of causal evidence presented in this report is low because it was a randomized controlled trial with unknown attrition and the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Trickle Up program; other factors are likely to have contributed.","Trickle Up Program","Child labor Health","Female, Other, Low income",,International,2018,https://www.researchgate.net/publication/322086777_Integrating_Economic_Strengt…,"Child Labor Review Protocol" "Tanzania Youth Study of the Productive Social Safety Net (PSSN) impact evaluation: Endline report.","The Tanzania Cash Plus Evaluation Team (2018). Tanzania Youth Study of the Productive Social Safety Net (PSSN) impact evaluation: Endline report. Retrieved from: https://www.unicef-irc.org/publications/942-.html","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Mixed impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Productive Social Safety Net (PSSN) program on child labor and school participation outcomes. This summary focuses on the comparison of the PSSN group (both treatment groups) versus the control group. The study was a randomized controlled trial where villages were randomly assigned to one of three study arms: conditional cash transfer (CCT) only, CCT with a supplemental public works program (PWP), and the control condition. The authors used difference-in-differences models to compare the changes in outcomes between the groups. The study found that the probability of participation in paid work outside the household significantly decreased for children in PSSN households compared to children in control households. However, the probability of participation in livestock herding significantly increased for children in PSSN households compared to children in control households. Also, the probability of attending school significantly increased for children in PSSN households compared to children in control households. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated impacts are attributable to the Productive Social Safety Net program, and not to other factors.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2018,https://www.unicef-irc.org/publications/942-.html,"Child Labor Review Protocol" "Integrating economic strengthening and family coaching to reduce work-related health hazards among children of poor households: Burkina Faso","Karimli, L., Rost, L., & Ismayilova, L. (2018). Integrating economic strengthening and family coaching to reduce work-related health hazards among children of poor households: Burkina Faso. Journal of Adolescent Health, 62, S6-S14.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Health and safety-Low-No impacts Health and safety","Summary: The study’s objective was to examine the impact of the Trickle Up and Trickle Up Plus programs on children’s exposure to work-related hazards and abuse, and children’s work-related health outcomes. This summary focuses on the comparison between the Trickle Up Plus intervention group and the control group. The study was a randomized controlled trial in the Nord Region of Burkina Faso, West Africa. Using three waves of survey data administered to children and adults separately, the authors conducted statistical models to compare the outcomes of treatment and control group members. The study found that Trickle Up Plus program participation was significantly related to a reduction of hazardous work and abuse, compared with the control group. However, the study found no statistically significant relationship between the Trickle Up program and work-related health outcomes. The quality of causal evidence presented in this report is low because it was a randomized controlled trial with unknown attrition and the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Trickle Up Plus program; other factors are likely to have contributed.","Trickle Up Plus Program","Child labor Health","Female, Other, Low income",,International,2018,https://www.researchgate.net/publication/322086777_Integrating_Economic_Strengt…,"Child Labor Review Protocol" "Tanzania Youth Study of the Productive Social Safety Net (PSSN) impact evaluation: Endline report","The Tanzania Cash Plus Evaluation Team (2018). Tanzania Youth Study of the Productive Social Safety Net (PSSN) impact evaluation: Endline report. Retrieved from: https://www.unicef-irc.org/publications/942-.html","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Mixed impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Productive Social Safety Net (PSSN) program on child labor and school participation outcomes. This summary focuses on the comparison of the conditional cash transfers with Public Works Program component treatment group versus the control group. The study was a randomized controlled trial where villages were randomly assigned to one of three study arms: conditional cash transfer (CCT) only, CCT with a supplemental public works program (PWP), and the control condition. The authors used difference-in-differences models to compare the changes in outcomes between the groups. The study found that the probability of participation in paid work outside the household significantly decreased for children in PWP households compared to children in control group households. However, the probability of participation in livestock herding significantly increased for children in PSSN households compared to children in control households. Also, the likelihood of dropping out of school significantly decreased for children in PSSN households compared to children in control households. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated impacts are attributable to the Productive Social Safety Net program, and not to other factors.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2018,https://www.unicef-irc.org/publications/942-.html,"Child Labor Review Protocol" "Tanzania Youth Study of the Productive Social Safety Net (PSSN) impact evaluation: Endline report.","The Tanzania Cash Plus Evaluation Team (2018). Tanzania Youth Study of the Productive Social Safety Net (PSSN) impact evaluation: Endline report. Retrieved from: https://www.unicef-irc.org/publications/942-.html","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor Education and skills gains-Mod/high-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Productive Social Safety Net (PSSN) program on child labor and school participation outcomes. This summary focuses on the comparison of the conditional cash transfers (CCT) only treatment group versus the control group. The study was a randomized controlled trial where villages were randomly assigned to one of three study arms: conditional cash transfer (CCT) only, CCT with a supplemental public works program (PWP), and the control condition. The authors used difference-in-differences models to compare the changes in outcomes between the groups. The study found that the probability of participation in paid work outside the household significantly decreased for children in households receiving the CCT only compared to children in control households. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated impacts are attributable to the Productive Social Safety Net program, and not to other factors.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2018,https://www.unicef-irc.org/publications/942-.html,"Child Labor Review Protocol" "SUN PATH comparison group study","Dauphinee, T., & Bishwakarma, R. (2018). SUN PATH comparison group study. Albuquerque, NM: University of New Mexico, Career to Cradle Policy Institute.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Skill‐UP Network Pathways Acceleration in Technology and Healthcare (SUN PATH) program on education, earnings, and employment outcomes. The authors used a nonexperimental design to compare the outcomes of students who were in the SUN PATH program to a matched comparison group of students. The study found that SUN PATH students had higher rates of program completion, certificates/degree attainment, program retention, employment, and earnings than students in the comparison group. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the SUN PATH program, but other factors might also have contributed.","the Skill‐UP Network Pathways Acceleration in Technology and Healthcare (SUN PATH) Program","Capacity building programs Community college education and other classroom training","Adult, Dislocated or displaced worker, Other, Low-skilled, Veteran or military",,"United States",2018,https://www.skillscommons.org/bitstream/handle/taaccct/18108/SUN%20PATH%20Compa…,"Community College Review Protocol" "Household micro-entrepreneurial activity and child work: Evidence from two African unconditional cash transfer programs","de Hoop, J., Groppo, V., & Handa, S. (2017). Household micro-entrepreneurial activity and child work: Evidence from two African unconditional cash transfer programs. Retrieved from https://sites.tufts.edu/neudc2017/files/2017/10/paper_303.pdf","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Unfavorable impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of unconditional cash transfers on child labor and school attendance in Malawi and Zambia. This summary focuses on the Zambia Multiple Categorical Targeting Group (MCTG) program. The study used a randomized controlled trial to compare outcomes between children in households that received the cash transfer with children in households that did not. The study found that children in the treatment group were significantly more likely than children in the control group to participate in livestock herding and collect water or firewood. However, program participants were significantly more likely to attend school than those in the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects are attributable to Zambia's Multiple Categorical Targeting Group program and not to other factors.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2017,,"Child Labor Review Protocol" "Does protecting older workers from discrimination make it harder to get hired? Evidence from disability discrimination laws.","Neumark, D., Song, J., & Button, P. (2017). Does protecting older workers from discrimination make it harder to get hired? Evidence from disability discrimination laws. Research on Aging, 39(1), 29-63.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Mixed impacts Employment","Summary: The study examined the impact of the strength of state disability discrimination laws on hiring rates of older men. The study used statistical models and data from the Health and Retirement Study and the Survey of Income and Program Participation to estimate the impacts. The study found no relationship between the strength of disability discrimination laws and the hiring rate for older unemployed disabled and nondisabled men. The quality of casual evidence presented in this report is low because the study is a nonexperimental analysis that did not demonstrate that the groups being compared were similar and did not account for possible differences in the analysis. This means we are not confident that the estimated effects are attributable to state disability discrimination laws; other factors are likely to have contributed.","Disability discrimination laws","Health Older workers' programs","Adult, Older worker, Male",,"United States",2017,https://journals.sagepub.com/doi/full/10.1177/0164027516656142,"Employment and Training Review Protocol" "Child schooling and child work in the presence of a partial education subsidy","de Hoop, J., Friedman, J., Kandpal, E., & Rosati, F. (2017). Child schooling and child work in the presence of a partial education subsidy. Retrieved from http://documents.worldbank.org/curated/en/501961504719564270/pdf/WPS8182.pdf","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Unfavorable impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The purpose of the study was to assess the impact of a conditional cash transfer program, the Pantawid Pamilya Pilipino Program, on children’s school attendance and participation and their participation in work inside and outside of their households. The study was a randomized controlled trial. The researchers used household surveys, administered at baseline and two and half years after the intervention began, to assess program impact on schooling and child labor outcomes between the treatment and control groups. The study found that, two and a half years after the program began, a significantly higher proportion of children participating in the program worked for pay outside of their household than children not participating in the program. However, there was a significantly greater proportion of children in the treatment group than the control group who attended school and attended school regularly. Similarly, children in the treatment group attended a significantly greater number of days of school than those in the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the the Pantawid Pamilya Pilipino Program, and not to other factors.","Pantawid Pamilya Pilipino Program","Child labor","Other, Low income",,International,2017,http://documents.worldbank.org/curated/en/501961504719564270/pdf/WPS8182.pdf,"Child Labor Review Protocol" "Household micro-entrepreneurial activity and child work: Evidence from two African unconditional cash transfer programs","de Hoop, J., Groppo, V., & Handa, S. (2017). Household micro-entrepreneurial activity and child work: Evidence from two African unconditional cash transfer programs. Retrieved from https://sites.tufts.edu/neudc2017/files/2017/10/paper_303.pdf","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Mixed impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of unconditional cash transfers on child labor and school attendance in Malawi and Zambia. This summary focuses on the Malawi Social Cash Transfer Program. The study used a randomized controlled trial to compare outcomes between children in households that received the cash transfer with children in households that did not. The study found children in the treatment group were less likely to work for pay outside of the household, had less time spent in paid work, were more likely to attend school, but had an increase in hazardous work than children in the control group; these findings were statistically significant. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects are attributable to the Malawi Social Cash Transfer Program and not to other factors.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2017,,"Child Labor Review Protocol" "The influence of Bolsa Familia conditional cash transfer program on child labor in Brazil","Pais, P. S. M., Silva, F. D. F., & Teixeira, E. C. (2017). The influence of Bolsa Familia conditional cash transfer program on child labor in Brazil. International Journal of Social Economics, 44(2), 206-221.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Unfavorable impacts Child labor","Summary: The objective of the study was to examine the impact of the Bolsa Familia conditional cash transfer program on child labor in Brazil. The study used a nonexperimental design to compare labor outcomes of children who received the conditional cash transfer with a matched comparison group of children who did not, based on data from a national household survey. The study found that the program was significantly related to an increase in child labor, with a 52.5 percent increase in hours spent on child labor for those receiving Bolsa Familia. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to Bolsa Familia; other factors are likely to have contributed.","Bolsa Familia","Child labor","Other, Low income",,International,2017,,"Child Labor Review Protocol" "The impact of the Child Grant Programme on child labour and education in Lesotho","Universita di Roma Tor Vergata, Centre for Economic and International Studies, the International Labour Organisation, UNICEF and the World Bank. (2017). The impact of the Child Grant Programme on child labour and education in Lesotho. Understanding Children's Work (UCW) Working Paper Series. Rome, Italy: UCW.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-No impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Child Grant Programme (CGP) on child labor and education outcomes in Lesotho. The study used a randomized controlled trial to compare outcomes between children in households that received the cash transfer with children in households that did not. The study found that participation in the CGP was significantly associated with increased school enrollment two years after the introduction of the program. The quality of causal evidence presented in this report is low because it was based on a randomized controlled trial with high attrition and the treatment group received a second grant payment, the Food Emergency Grant, which presents a confound. This means we are not confident that the estimated effects are attributable to Child Grant Programme (CGP); other factors are likely to have contributed.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2017,,"Child Labor Review Protocol" "Third party evaluation of MoManufacturingWINS: Implementation, outcomes, and impact","Cosgrove, J. J., Cosgrove, M. S., & Bragg, D. D. (2016). Third party evaluation of MoManufacturingWINs: Implementation, outcomes, and impact. St. Louis, MO: Cosgrove & Associates and Bragg & Associates.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of Missouri’s Manufacturing Workforce Innovation Networks(MMW) program on student education and employment outcomes. The study used a nonexperimental design to compare the outcomes of students who were in MMW to a comparison group of students in other manufacturing-technology related programs. The study found that MMW participation was significantly associated with higher retention and employment rates. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention and they did not include sufficient controls. This means we are not confident that the estimated effects are attributable to MMW; other factors are likely to have contributed.","Missouri’s Manufacturing Workforce Innovation Networks (MMW)","Basic skills Capacity building programs Community college education and other classroom training","Adult, Unemployed, Other, Low-skilled, Veteran or military",,"United States",2016,https://www.skillscommons.org/bitstream/handle/taaccct/10116/ThirdPartyFinalEva…,"Community College Review Protocol" "Wealth differentials in the impact of conditional and unconditional cash transfers on education: Findings from a community-randomised controlled trial in Zimbabwe","Fenton, R., Nyamukapa, C., Gregson, S., Robertson, L., Mushati, P., Thomas, R., & Eaton, J. W. (2016) Wealth differentials in the impact of conditional and unconditional cash transfers on education: Findings from a community-randomized controlled trial in Zimbabwe. Psychology, Health & Medicine, 21(8), 909-917","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the effects of conditional cash transfers (CCT) and unconditional cash transfers (UCT) on child labor and schooling outcomes. This summary focuses on the comparison between the CCT group and the control group. The study was a randomized controlled trial in which households were randomly assigned to receive one of two cash transfers (conditional or unconditional) or to participate in the control group that did not receive a cash transfer. Using household survey data, the authors analyzed the impact of the treatment conditions on child labor and schooling outcomes a year after the intervention began. The study found that receipt of a conditional cash transfer was significantly associated with a reduction in child work and increases in school attendance for the poorest households. The quality of causal evidence presented in this report is low because it based on a randomized controlled trial with unknown attrition and the authors did not ensure that the groups being compared were similar before receiving the cash transfer. This means we are not confident that the estimated effects are attributable to the conditional cash transfer; other factors are likely to have contributed.","Cash Transfer Program","Child labor","Other barriers, Other, Low income",,International,2016,https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5044770/,"Child Labor Review Protocol" "The effect of Social Security information on the labor supply and savings of older Americans.","Armour, P., & Lovenheim, M. F. (2016). The effect of Social Security information on the labor supply and savings of older Americans. (Working paper no. 361). Ann Arbor, MI: University of Michigan, Michigan Retirement Research Center.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Mixed impacts Employment","Summary: The study examined the impact of the Social Security statements issued by the Social Security Administration (SSA) on older men’s annual hours worked. The authors used a nonexperimental design and data from Health and Retirement Study surveys and Social Security administrative records to estimate the impacts. The study found that receiving the first Social Security Statement is associated with a decrease in self-reported annual hours worked and receiving the second Social Security Statement is associated with an increase in self-reported annual hours worked. The quality of casual evidence presented in this report is moderate because that the study was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to Social Security statements, but other factors might also have contributed.","Social Security statements","Older workers' programs Other disparities or discrimination in employment and earnings","Adult, Older worker, Male",,"United States",2016,,"Employment and Training Review Protocol" "The impact of conditional cash transfers on the amount and type of child labor","Del Carpio, X. V., Loayza, N. V., & Wada T. (2016). The impact of conditional cash transfers on the amount and type of child labor. World Development, 80, 33-47. doi:10.1016/j.worlddev.2015.11.013","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor","Summary: The study’s objective was to examine the impact of a conditional cash transfer (CCT) program on the amount and type of child labor conducted by children ages 8 to15. Types of child labor included household chores, farm labor (both at home and outside the home), and skill-forming activities defined as work in commerce, sales, or manufacturing activities outside the home. The study was a randomized controlled trial conducted in six municipalities in Nicaragua. Households from each community were randomly assigned into treatment and control groups. Treatment households received either the basic CCT or the basic CCT plus an additional a household grant for the creation of a micro business. Survey data were collected and child labor outcomes were analyzed using two statistical models. The study found that the program significantly reduced overall child labor, household chore labor, and farm labor for both treatment groups compared to the control group. The program had no effect on skill-forming labor for the treatment group that received the basic CCT but increased skill-forming labor for the children in the households that received the basic CCT plus the business grant. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial with low attrition. This means we are confident that the estimated effects are attributable to the Atención a Crisis program and not to other factors.","Atención a Crisis (“Attention to the Crisis”)","Child labor","Other, Low income",,International,2016,https://www.sciencedirect.com/science/article/pii/S0305750X15002934,"Child Labor Review Protocol" "Trade Adjustment Assistance Community College and Career Training II Grant Program (TAACCCT II): Summative Evaluation of the University of District of Columbia, Community College’s Transportation Academy","Yoder, B., & Ryland, A. (2016). Trade Adjustment Assistance Community College and Career Training II Grant Program (TAACCCT II): Summative Evaluation of the University of District of Columbia, Community College’s Transportation Academy. Retrieved from https://www.skillscommons.org/bitstream/handle/taaccct/15654/University%20of%20the%20District%20of%20Columbia%20-%20Final%20Evaluation%20-%202017.01.05.pdf?sequence=1&isAllowed=y","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Education and skills gains-Low-No impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the TAACCCT funded Transportation Academy program on education, earnings, and employment outcomes. The study used a nonexperimental design to compare education, earnings, and employment outcomes of Transportation Academy participants to a matched comparison group from three different institutional data sources. The study did not find a significant association between participation in the Transportation Academy program and education, earnings, or employment outcomes. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before intervention. This means we are not confident that the estimated effects are attributable to the Transportation Academy program; other factors are likely to have contributed.","the Transportation Academy Program","Capacity building programs Community college education and other classroom training","Adult, Unemployed, Other",,"United States",2016,https://www.skillscommons.org/bitstream/handle/taaccct/15654/University%20of%20…,"Community College Review Protocol" "Do conditional cash transfers reduce child labor?: Evidence from the Philippines","Galang, I. M. (2016). Do conditional cash transfers reduce child labor?: Evidence from the Philippines (Unpublished Master's thesis). Tokyo, Japan: The University of Tokyo.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-No impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The objective of the study was to examine the impact of the Philippines conditional cash transfer program, Pantawid Pamilyang Pilipino Program (4Ps), on child labor and school attendance. The authors used a nonexperimental design to compare the outcomes of children ages 12-14 that received the conditional cash transfers with those who did not, based on data from the 2011 Annual Poverty Indicator Survey. Using several demographic characteristics, they created a matched comparison group of families who did not receive the benefit to assess the effectiveness of the cash transfer program. The study found that receipt of the cash transfer was significantly associated with increased school attendance but not significantly associated with child labor. The quality of causal evidence presented in this report is low because the authors did not account for the outcomes of schooling and work at baseline. This means we are not confident that the estimated effects are attributable to the 4Ps program; other factors are likely to have contributed.","Pantawid Pamilya Pilipino Program","Child labor","Other, Low income",,International,2016,http://www.pp.u-tokyo.ac.jp/wp-content/uploads/2016/02/1.31-MB-1.pdf,"Child Labor Review Protocol" "Encouraging evidence on a sector-focused advancement strategy","Hendra, R., Greenberg, D. H., Hamilton, G., Oppenheim, A. Pennington, A. Schaberg, K., and Tessler, B. L. (2016). Encouraging evidence on a sector-focused advancement strategy. New York: MDRC. [Per Scholas]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the WorkAdvance sectoral training program at the Per Scholas site on employment, earnings, and education and training from 2011 to 2015. The authors investigated similar research questions with three other sites, the profiles of which are available here. The study used a randomized controlled trial design to compare the treatment group, which was able to access the WorkAdvance program at the Per Scholas site, and the control group, which was not eligible for WorkAdvance services but could access other services in the community. The authors collected data from two sources: a follow-up survey and unemployment insurance (UI) wage and employment data. The study found that the program had a statistically significant impact on quarterly earnings in the second and third years after random assignment (based on UI data) and average weekly earnings in the second year after random assignment (based on survey data). The study also found that the program did not have a significant impact on most employment outcomes. Using survey data, the authors found that members of the WorkAdvance group were significantly more likely to have obtained a degree or credential and to have completed a skills training program two years after random assignment. The quality of the causal evidence is moderate for employment and earnings outcomes based on UI data because those outcomes were based on a randomized controlled trial in which the authors did not demonstrate that they accounted for change in the probability of random assignment, but the authors did account for existing differences between the treatment and control groups. The quality of the causal evidence is moderate for education and training outcomes from the follow-up survey because those outcomes were based on a randomized controlled trial in which many people did not complete the follow-up survey, but the authors did account for existing differences between the treatment and control groups. This means we are somewhat confident that the estimated effects are attributable to the WorkAdvance program at the Per Scholas site, but other factors might also have contributed.","the WorkAdvance sectoral training program","Work based and other occupational training","STEM professional, Low income",,"Urban, United States",2016,https://files.eric.ed.gov/fulltext/ED568395.pdf,"Employment and Training Review Protocol" "Enhanced vocational rehabilitation for veterans with mild traumatic brain injury and mental illness: Pilot study","O’Connor, M. K., Mueller, L., Kwon, E., Drebing, C. E., O’Connor, A. A., Semiatin, A., & Daley, R. (2016). Enhanced vocational rehabilitation for veterans with mild traumatic brain injury and mental illness: Pilot study. Journal of Rehabilitation Research & Development, 53(3), 307-319.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of an embedded cognitive rehabilitation intervention on employment and earnings. The study was a randomized controlled trial with the authors using administrative data. The study found no statistically significant relationships between an embedded cognitive rehabilitation intervention and employment and earnings after one year. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to an embedded cognitive rehabilitation intervention; other factors are likely to have contributed.","the cognitive rehabilitation intervention","Substance abuse recovery Vocational rehabilitation","Other barriers, Male, Veteran or military",,"United States",2016,http://search.proquest.com/openview/ee479834dd8beedff02771b00bc95e0a/1?pq-origs…,"Employment and Training Review Protocol" "The influence of conditional cash transfers on eligible children and their siblings","Lincove, J. A., & Parker, A. (2016). The influence of conditional cash transfers on eligible children and their siblings. Education Economics, 24(4), 352-373.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The purpose of the study was to examine the impact of Nicaragua’s Red de Proteccion Social (RPS) conditional cash transfer (CCT) program on attending school, working, and hours worked for children ages 6 to 16. The authors used data from an experimental design where communities were randomly assigned to participate in the program. The authors used difference-in-differences to estimate the effects of the program, controlling for child and family demographics separately by child gender and child age groups. The CCT was not associated with the probability of attending school and working for boys, but was associated with a statistically significant decrease in hours worked for boys ages 6-11 (2.8 hours) and for boys as 12-13 (8.7 hours). The program was also associated with a statistically significant 15.8 percent increase in the probability of school enrollment for girls ages 6-11. The quality of the causal evidence presented in this study is moderate because, although it was based on a randomized controlled trial with high attrition, the authors demonstrated that the treatment and control groups were similar before the intervention. This means we have confidence that the estimated effects are attributable at least in part to the RPS conditional cash transfer program, although other factors could also have contributed.","Red de Protección Social (RPS)","Child labor","Other, Low income",,International,2016,http://www.janelincove.com/uploads/3/7/2/0/37205101/educaton_economics_2015.pdf,"Child Labor Review Protocol" "Final external evaluation report: Trade Adjustment and Assistance Community College and Career Training Program Clovis Community College","Caffey, D. L. (2016). Final external evaluation report: Trade Adjustment and Assistance Community College and Career Training Program Clovis Community College. Fresno, CA: Clovis Community College.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of Clovis Community College’s (CCC) inclusive Nursing and enhanced Radiologic Technology (RADT) programs on education outcomes. The study used a nonexperimental design to compare the outcomes of students who were in the inclusive Nursing or enhanced RADT programs to a comparison group of students. The study found that participation in the Nursing and enhanced RADT program was significantly associated with higher program retention rates. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention and did not include sufficient controls. This means we are not confident that the estimated effects are attributable to the inclusive Nursing or enhanced RADT program; other factors are likely to have contributed.","Inclusive Nursing and Radiologic Technology Programs","Capacity building programs Community college education and other classroom training","Adult, Other",,"United States",2016,,"Community College Review Protocol" "Eliminating child labour in El Salvador through economic empowerment and social inclusion: Impact report","de Hoop, J., Kovrova, I., & Rosati, F. C. (2016). Eliminating child labour in El Salvador through economic empowerment and social inclusion: Impact report. Retrieved from http://www.ucw-project.org/attachment/07032017224El_Salvador_IE_07042016_web.pdf","Child Labor","Study Type: Descriptive Analysis",,,"Summary: The study’s objective was to assess the effects of a women’s entrepreneurship training program on children’s participation in school and work. The study was a regression discontinuity design, using baseline and follow-up household surveys to measure program outcomes. Households were selected into the program if they had a wealth score below a cut-off point. The authors compared the outcomes of children in households above and below the cut-off score to understand the program’s effects. The study found that selection and participation in the program was significantly associated with a decrease in the percent of children working-only and not attending school, and the number of hours that children worked per week. Selection and participation in the program was also significantly related to an increase in school attendance. This study used a regression discontinuity design and therefore was reviewed using CLEAR’s descriptive study evidence review guidelines. As such, it does not receive a causal rating.","Eliminating Child Labour in El Salvador through Economic Empowerment and Social Inclusion","Child labor","Female, Parent, Low income",,International,2016,http://www.ucw-project.org/attachment/07032017224El_Salvador_IE_07042016_web.pdf,"Child Labor Review Protocol" "Evaluation of the Illinois Network for Advanced Manufacturing: Final Report","Westat. (2016). Evaluation of the Illinois Network for Advanced Manufacturing: Final Report. Rockville, MD: Westat & GEM Software Development, Inc.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the Illinois Network for Advanced Manufacturing (INAM) program on education, earnings, and employment outcomes. The study used a nonexperimental design to compare the outcomes of students who were in the INAM program to a comparison group of students who took similar courses before the creation of INAM. Using data from college databases and the Illinois Department of Employment Security, the authors conducted statistical models to examine differences in outcomes between the groups. The study found that participation in the INAM program was significantly associated with improved rates of certificate or degree completion. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the INAM program; other factors are likely to have contributed.","the Illinois Network for Advanced Manufacturing (INAM)","Capacity building programs Community college education and other classroom training","Adult, Dislocated or displaced worker, Unemployed, Other, Veteran or military",,"United States",2016,https://www.researchgate.net/publication/315664265_Evaluation_of_the_Illinois_N…,"Community College Review Protocol" "Do education and health conditions matter in a large cash transfer? Evidence from a Honduran experiment","Benedetti, F., Ibarrarán, P., & McEwan, P. J. (2016). Do education and health conditions matter in a large cash transfer? Evidence from a Honduran experiment. Economic Development and Cultural Change, 64(4), 759-793. doi:10.1086/686583","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-No impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of a conditional cash transfer on school enrollment and child labor. The study was a randomized controlled trial conducted in in low-income villages in Honduras. Villages were randomly assigned to the treatment and control groups. Baseline and follow-up survey data were collected from randomly selected households and analyzed using regression. The Bono 10,000 program significantly increased school enrollment but did not significantly reduce child labor. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Bono 10,000 program and not to other factors.","Bono 10,000","Child labor","Other, Low income",,International,2016,http://academics.wellesley.edu/Economics/mcewan/PDF/bono.pdf,"Child Labor Review Protocol" "Does “ban-the-box” help or hurt low-skilled workers? Statistical discrimination and employment outcomes when criminal histories are hidden","Doleac, J. L., & Hansen, B. (2016). Does “ban-the-box” help or hurt low-skilled workers? Statistical discrimination and employment outcomes when criminal histories are hidden. (NBER Working Paper No. 22469). Cambridge, MA: National Bureau of Economic Research.",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Unfavorable impacts Employment","Summary: The study’s objective was to examine how preventing employers from asking about an applicant’s criminal record in the early stage of the hiring process (ban-the-box) affected employment outcomes for low-skilled African American and Hispanic men ages 25 to 34. The authors use a nonexperimental difference-in-differences design to compare the employment probability of White non-Hispanic, African American non-Hispanic, and Hispanic men in areas that adopted ban-the-box policies with the employment probability of their counterparts in areas that did not adopt ban-the-box policies. The authors use a linear probability model to estimate employment outcomes. Information on study participant characteristics were from the Current Population Survey in 2004 to 2014. The study found that the probability of African American men obtaining employment was 3.4 percentage points lower among those who lived in areas with ban-the-box policies than among those who did not. In addition, the authors found that ban-the-box policies reduced the probability of African American men obtaining employment by 5.1 percentage points between one and two years after the policy went into effect, by 8.3 percentage points between three and four years afterward, and by 2.3 percentage points four or more years afterward. The study found no statistically significant relationships between ban-the-box policies and employment outcomes for Hispanic men. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the ban-the-box policies, but other factors might also have contributed.",Ban-the-Box,Reentry,"Male, Black or African American, Hispanic of any race",,"United States",2016,https://www.nber.org/papers/w22469.pdf,"Employment and Training Review Protocol" "To work for yourself, for others, or not at all? How disability benefits affect the employment decisions of older veterans","Coile, C., Duggan, M., & Guo, A. (2016). To work for yourself, for others, or not at all? How disability benefits affect the employment decisions of older veterans. Unpublished manuscript.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study examined the impact of a 2001 expansion in eligibility for Disability Compensation (DC) to cover type 2 diabetes for Vietnam-era veterans on their employment, earnings, and public benefit receipt. The authors estimated statistical models to compare outcomes among male Vietnam-era veterans who did and did not serve with on the ground using data from the Veterans Supplement to the Current Population Survey from 1995 to 2015. The study found that the expansion of eligibility for DC was associated with greater receipt of DC, a lower likelihood of working for others, and a greater likelihood of self-employment by on-the-ground veterans compared with those veterans who did not serve on the ground. The study did not find a relationship between the expansion and earnings. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to changes in eligibility for DC and not to other factors.",DC,"Other wages and benefits Veterans' reemployment","Disability, Male, Veteran or military",,"United States",2016,https://www.nber.org/papers/w23006,"Employment and Training Review Protocol" "Final evaluation of Southwest Virginia Community College’s PluggedInVA TAACCCT Grant initiative","Topper, A., Munn, W., Bor, E., Clery, S., & Smith, B. (2016). Final evaluation of Southwest Virginia Community College’s PluggedInVA TAACCCT Grant initiative. Retrieved from: https://www.skillscommons.org//handle/taaccct/15650","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the PluggedInVA (PIVA) program on education and employment outcomes. Using college administrative and state workforce data, the authors conducted a nonexperimental study to compare outcomes between students in the PIVA program with a comparison group of non-participating students. The study found no statistically significant relationships between participation in the PIVA program and education or employment outcomes. The quality of causal evidence presented in this report is low because the authors did not ensure the groups being compared were similar before the intervention or include sufficient control variables. This means we are not confident that the estimated effects are attributable to PluggedInVA; other factors are likely to have contributed.","PluggedInVA (PIVA)","Capacity building programs Community college education and other classroom training","Adult, Unemployed, Other",,"United States",2016,https://www.skillscommons.org//handle/taaccct/15650,"Community College Review Protocol" "Wealth differentials in the impact of conditional and unconditional cash transfers on education: Findings from a community-randomised controlled trial in Zimbabwe","Fenton, R., Nyamukapa, C., Gregson, S., Robertson, L., Mushati, P., Thomas, R., & Eaton, J.W. (2016). Wealth differentials in the impact of conditional and unconditional cash transfers on education: Findings from a community-randomised controlled trial in Zimbabwe. Psychology, Health & Medicine, 21(8), 909-917.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-No impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the effects of conditional cash transfers (CCT) and unconditional cash transfers (UCT) on child labor and schooling outcomes. This summary focuses on the comparison between the CCT group and the UCT group. The study was a randomized controlled trial in which households were randomly assigned to receive one of two cash transfers (conditional or unconditional) or to participate in the control group that did not receive a cash transfer. Using household survey data, the authors analyzed the impact of the treatment conditions on child labor and schooling outcomes a year after the intervention began. The study found that the CCT group had significantly higher levels of school attendance than the UCT group for the least poor households. However, the study found no statistically significant difference in the number of hours worked between the two groups. The quality of causal evidence presented in this report is low because it based on a randomized controlled trial with unknown attrition and the authors did not ensure that the groups being compared were similar before receiving the cash transfers. This means we are not confident that the estimated effects are attributable to the cash transfers; other factors are likely to have contributed.","Cash Transfer Program","Child labor","Other barriers, Other, Low income",,International,2016,https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5044770/,"Child Labor Review Protocol" "The impact of disability benefits on labor supply: Evidence from the VA’s disability compensation program","Autor, D. H., Duggan, M., Greenberg, K., & Lyle, D. S. (2016). The impact of disability benefits on labor supply: Evidence from the VA’s disability compensation program. American Economic Journal: Applied Economics, 8(3), 31-68. http://www.aeaweb.org/aej-applied/ [Impact of eligibility expansion]",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Unfavorable impacts Earnings and wages Employment-Low-Unfavorable impacts Employment Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study examined the impact of a 2001 expansion in eligibility for Disability Compensation (DC) to type 2 diabetes for Vietnam-era veterans on labor force participation, earnings, and receipt of public benefits. The authors also examined the impact of receiving DC benefits and amount on labor force participation and earnings; see profile here . The authors estimated statistical models to compare outcomes for Vietnam-era Army veterans who served with “boots on the ground” (BOG) with those who served “not on the ground” (NOG) Veterans who did not fight directly in the conflict, from before and after the implementation of the type 2 diabetes policy change in 2001. The authors used administrative data from the U.S. Army Office of Economic and Manpower Analysis, the U.S. Department of Veterans Affairs (VA), and the Social Security Administration. The implementation of expanded DC coverage and benefits in 2001 resulted in reductions in labor force participation and earnings among impacted veterans as well as increases in the receipt of disability benefits. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the expansion in eligibility for Disability Compensation (DC); other factors are likely to have contributed to the findings.",DC,"Disability insurance Veterans' reemployment","Disability, Male, Veteran or military",,"United States",2016,https://pubs.aeaweb.org/doi/pdf/10.1257/app.20150158,"Employment and Training Review Protocol" "Do conditional cash transfers reduce child labor?: Evidence from the Philippines","Galang, I. M. (2016). Do conditional cash transfers reduce child labor?: Evidence from the Philippines (Unpublished Master's thesis). Tokyo, Japan: The University of Tokyo.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-No impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The objective of the study was to examine the impact of the Philippines conditional cash transfer program, Pantawid Pamilyang Pilipino Program (4Ps), on child labor and school attendance. The authors used a nonexperimental design to compare the outcomes of children ages 12-14 that received the conditional cash transfers with those who did not, based on data from the 2011 Annual Poverty Indicator Survey. Using several demographic characteristics, they created a matched comparison group of families who did not receive the benefit to assess the effectiveness of the cash transfer program. The study found that receipt of the cash transfer was significantly associated with increased school attendance but not significantly associated with child labor. The quality of causal evidence presented in this report is low because the authors did not account for the outcomes of schooling and work at baseline. This means we are not confident that the estimated effects are attributable to the 4Ps program; other factors are likely to have contributed.","Pantawid Pamilyang Pilipino Program (4Ps)","Child labor","Other, Low income",,International,2016,http://www.pp.u-tokyo.ac.jp/wp-content/uploads/2016/02/1.31-MB-1.pdf,"Child Labor Review Protocol" "Do recent reforms of Mexico's nationwide cash transfer program affect children's work and school attendance?","Universita di Roma Tor Vergata, Centre for Economic and International Studies, the International Labour Organisation, UNICEF and the World Bank. (2016). Do recent reforms of Mexico's nationwide cash transfer program affect children's work and school attendance? Understanding Children's Work (UCW) Working Paper Series. Rome, Italy: UCW.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Unfavorable impacts Child labor Education and skills gains-Mod/high-Unfavorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the reformed Prospera cash transfer program on child work and education outcomes. The study used a randomized controlled trial to compare outcomes between children in households that received the cash transfer with children in households that did not in two urban areas in Mexico. Outcomes were compared between the treatment and control groups at six months and 18 months post-intervention. The study found that for households with eligible primary and secondary school children, the rates of children working and working for pay were significantly higher in the treatment group than in the control group at six months post-intervention. The study also found that for households with only eligible secondary school children, the rates of school attendance were significantly lower among children in the treatment group than the control group at 18 months post-intervention. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects are attributable to the reformed Prospera cash transfer program, and not to other factors.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2016,,"Child Labor Review Protocol" "Labor intensive public works and children's activities: The case of Malawi","de Hoop, J., & Rosati, F. C. (2016). Labor intensive public works and children's activities: The case of Malawi. Retrieved from http://ucw-project.org/attachment/11052017285Public_work_malawi_dehoop_rosati.pdf","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Unfavorable impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to assess the impact of Malawai’s Labour Intensive Public Works program (LIPW) on children’s school participation and involvement in paid work and household chores. The study was a randomized controlled trial where eligible villages were randomly assigned to a control group that would not receive any benefits, or to one of four treatment groups that differed by agricultural season (lean vs. post-harvest) and payment schedule (lump sum vs. installments). Using household survey data, the authors analyzed the impact of the treatment conditions on school attendance and work 3-months, 6-months, and 12-months after implementation. The study found that post-harvest program participation was significantly related to higher rates of paid work 6 months after participation for boys, whereas lean harvest program participation was significantly related to higher rates of household chores for girls one year after treatment. Lean program participation was also significantly related to school attendance 6 months after participation for all children. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to Malawi’s LIPW program, and not to other factors.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2016,http://ucw-project.org/attachment/11052017285Public_work_malawi_dehoop_rosati.p…,"Child Labor Review Protocol" "Nursing interventions to help prevent children from working on the streets","Mert, K., & Kadioglu, H. (2016). Nursing interventions to help prevent children from working on the streets. International Nursing Review 63, 429–436. doi:10.1111/inr.12301","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-No impacts Child labor","Summary: The study’s objective was to assess the impact of a program developed to prevent children under 18 years of age from working on the street. The study was an interrupted time series design conducted in one neighborhood in the city of Izmit, Turkey. The authors compared the outcomes for mothers and their children before, immediately after, and three months after participating in The Streets are Not the Solution program. The study found that participating in the program was associated with a 44 percentage point decrease from pretest to posttest in the percentage of children who worked on the streets. However, the study did not include tests of statistical significance. The quality of causal evidence presented in this report is low because the authors did not account for trends in outcomes before the intervention. This means we are not confident that the effects are attributable to the Streets are Not the Solution program; other factors are likely to have contributed.","The Streets are Not the Solution","Child labor","Female, Other, Parent",,International,2016,,"Child Labor Review Protocol" "Wealth differentials in the impact of conditional and unconditional cash transfers on education: Findings from a community-randomised controlled trial in Zimbabwe","Fenton, R, Nyamukapa, C., Gregson, S., Robertson, L., Mushati, P., Thomas, R., & Eaton, J.W. (2016). Wealth differentials in the impact of conditional and unconditional cash transfers on education: Findings from a community-randomised controlled trial in Zimbabwe. Psychology, Health & Medicine, 21(8), 909-917","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-No impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the effects of conditional cash transfers (CCT) and unconditional cash transfers (UCT) on child labor and schooling outcomes. This summary focuses on the comparison between the UCT group and the control group. The study was a randomized controlled trial in which households were randomly assigned to receive one of two cash transfers (conditional or unconditional) or to participate in the control group that did not receive a cash transfer. Using household survey data, the authors analyzed the impact of the treatment conditions on child labor and schooling outcomes a year after the intervention began. The study found that receipt of an unconditional cash transfer was significantly associated with an increases in school attendance for the poorest households, but not significantly related to child labor outcomes. The quality of causal evidence presented in this report is low because it based on a randomized controlled trial with unknown attrition and the authors did not ensure that the groups being compared were similar before receiving the cash transfers. This means we are not confident that the estimated effects are attributable to the unconditional cash transfers; other factors are likely to have contributed.","Cash Transfer Program","Child labor","Other barriers, Other, Low income",,International,2016,https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5044770/,"Child Labor Review Protocol" "The impact of disability benefits on labor supply: Evidence from the VA’s disability compensation program","Autor, D. H., Duggan, M., Greenberg, K., & Lyle, D. S. (2016). The impact of disability benefits on labor supply: Evidence from the VA’s disability compensation program. American Economic Journal: Applied Economics, 8(3), 31-68. http://www.aeaweb.org/aej-applied/ [Impact of DC enrollment and benefit amount]",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Unfavorable impacts Employment","Summary: The study examined the impact of Disability Compensation (DC) enrollment and benefit amount on labor force participation and earnings. The authors also examined the impact of the expansion of eligibility for DC benefits on labor force participation and earnings; see profile here . The authors estimated statistical models to compare outcomes for Vietnam-era Army veterans who served with “boots on the ground” (BOG) with those who served “not on the ground” (NOG) who did not fight directly in the conflict, before and after the implementation of the Type 2 diabetes policy change in 2001. The authors used administrative data from the U.S. Army Office of Economic and Manpower Analysis, the U.S. Department of Veterans Affairs (VA), and the Social Security Administration (SSA). The increases in DC enrollment due to the expansion in eligibility for DC in 2001 were associated with reductions in labor force participation and earnings. Increases in DC benefit amounts due to the expansion in eligibility were also associated with reductions in labor force participation. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to DC enrollment and benefit amounts, but other factors might also have contributed to the findings.",DC,"Disability insurance Veterans' reemployment","Disability, Male, Veteran or military",,"United States",2016,https://pubs.aeaweb.org/doi/pdf/10.1257/app.20150158,"Employment and Training Review Protocol" "Employment outcomes among African American and white women with disabilities: Examining the inequalities.","Balcazar, F. E., & Suarez-Balcazar, Y. (2015). Employment outcomes among African American and white women with disabilities: Examining the inequalities. Women, Gender, and Families of Color, 3(2), 144-164.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-No impacts Employment","Summary: The study examined the impact of adult vocational rehabilitation (VR) services on employment outcomes for African American and white women. The authors used a statistical model and data from a Midwestern state VR system to compare the odds of employment after completing VR services for older versus younger women. The study found no significant difference in employment outcomes between older and younger women who completed VR services. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before receiving VR services. This means we are not confident that the estimated effects are attributable to participation in VR services; other factors are likely to have contributed.","Vocational Rehabilitation (VR) Services","Vocational rehabilitation","Adult, Older worker, Female, Black or African American, White, Disability",,"United States",2015,,"Employment and Training Review Protocol" "Exploring the differential impact of public interventions on indigenous people: Lessons from Mexico's conditional cash transfer program","Lopez-Calva, L. F., & Patrinos, H. A. (2015). Exploring the differential impact of public interventions on indigenous people: Lessons from Mexico's conditional cash transfer program. Journal of Human Development and Capabilities, 16(3), 452-467. doi:10.1080/19452829.2015.1072378","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The objective of the study was to examine the impact of Mexico’s conditional cash transfer program (PROGRESA/Oportunidades) on child labor and school attendance for children ages 8 to 17 across 3 indigenous, Spanish-speaking, and bilingual households. Using survey data from a cluster randomized controlled trial, the authors analyzed the average program impact of the PROGRESA/Oportunidades program on indigenous households versus individuals who were bilingual or Spanish-speaking. The study found that the PROGRESA/Oportunidades program was significantly related to a decrease in child labor and an increase in school attendance for indigenous speaking children. The quality of causal evidence presented in this study is low because it was based on a randomized controlled trial with unknown attrition and the authors did not control for the required variables. As a result, we are not confident that the estimated effects are attributable to PROGRESA/Oportunidades; other factors are likely to have contributed.",PROGRESA/Oportunidades,"Child labor","Other, Low income",,"International, Rural",2015,https://www.researchgate.net/publication/242464961_Exploring_the_Differential_I…,"Child Labor Review Protocol" "Veterans’ labor force participation: What role does the VA’s disability compensation program play?","Coile, C., Duggan, M., & Guo, A. (2015). Veterans’ labor force participation: What role does the VA’s disability compensation program play? American Economic Review, 105(5), 131-136.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study examined the impact of expanding eligibility for veterans’ Disability Compensation (DC) in 2001 and 2010 on labor force participation. The authors conducted a nonexperimental analysis to compare veteran and non-veteran labor force participation over time using the March Current Population Survey data from 1980 to 2014. The study found that veteran labor force participation was generally lower than that of non-veterans in the same 10-year age range during the periods following eligibility expansions. The quality of causal evidence presented in this report is low because there could be differences in external conditions that affected the treatment group and not the comparison group. This means we are not confident that the estimated effects are attributable to veterans’ receipt of DC; other factors are likely to have contributed to the findings.",DC,"Other wages and benefits Veterans' reemployment","Disability, Male, Veteran or military",,"United States",2015,https://www.aeaweb.org/articles?id=10.1257/aer.p20151062,"Employment and Training Review Protocol" "The impact of financial education for youth in Ghana","Berry, J., Karlan, D., & Pradhan, M. (2015). The impact of financial education for youth in Ghana (Working Paper No. w21068). Cambridge, MA: National Bureau of Economic Research. doi:10.3386/w21068","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-No impacts Child labor Education and skills gains-Mod/high-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of two different financial literacy programs, Aflatoun and Honest Money Box, on child labor and school attendance of children in grades 5 and 7 in southern Ghana. This summary focuses on the comparison between the Honest Money Box program group and the control group. The study was a randomized controlled trial conducted in three districts in southern Ghana. Schools in each district were randomly assigned into one of two treatment groups and a control group. Survey data were collected at baseline and at the end of the school year. Data were analyzed using regression. The study did not find any statistically significant effects on child labor or school attendance for children participating in the Honest Money Box program. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial with low attrition. This means we would be confident that any estimated effects would be attributable to the Honest Money Box program and not to other factors. However, the study did not find statistically significant effects.","Honest Money Box Program","Child labor",Other,,International,2015,https://www.nber.org/papers/w21068.pdf,"Child Labor Review Protocol" "How do educational transfers affect child labor supply and expenditures? Evidence from Indonesia of impact and flypaper effects","De Silva, I., & Sumarto, S. (2015). How do educational transfers affect child labor supply and expenditures? Evidence from Indonesia of impact and flypaper effects. Oxford Development Studies, 43(4), 483-507. https://doi.org/10.1080/13600818.2015.1032232","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor","Summary: The objective of this study was to assess the impact of the Cash Transfer for the Poor Students Programme/Bantuan Siswa Miskin (BSM) program on child labor. The study used a nonexperimental design to assess the program’s impact. With data collected from a national survey, the authors compared the proportion of children that participated in work between those who received financial educational support in the past year before taking the survey, and matched comparison groups of children who had not received financial educational study. The study found that receipt of educational assistance was significantly associated with lower rates of child labor. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to BSM; other factors are likely to have contributed.","Cash Transfer for the Poor Students Programme/Bantuan Siswa Miskin (BSM)","Child labor","Other, Low income",,International,2015,https://mpra.ub.uni-muenchen.de/66767/,"Child Labor Review Protocol" "Third-party evaluation of the outcomes and impact of the National Information, Security, & Geospatial Technologies Consortium (NISGTC)","Bridges, K., Bishop, C., & Giani, M. (2015). Third-party evaluation of the outcomes and impact of the National Information, Security & Geospatial Technologies Consortium (NISGTC). Champaign, IL: Office of Community College Research and Leadership, University of Illinois at Urbana-Champaign.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study’s objective was to assess the impact of TAACCCT-funded programming offered at National Information Security & Geospatial Technology Consortium (NISGTC) colleges on educational and employment outcomes. Using student-level data collected by the colleges’ Institutional Research offices and states’ Unemployment Insurance data systems, the study used a nonexperimental design to compare the outcomes of students enrolled in NISGTC programs with students enrolled in similar programs of study prior to the grant. The study found that students in the NISGTC-affected programs were significantly more likely to attain credentials and have higher average quarterly earnings than students in the comparison group. The quality of causal evidence presented in this report is low because the authors did not use sufficient controls in their analysis for the education outcomes. This means we are not confident that the estimated effects are attributable to the NISGTC-affected programs; other factors are likely to have contributed.","National Information Security & Geospatial Technology Consortium (NISGTC) Programs","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Other, Low-skilled",,"United States",2015,https://occrl.illinois.edu/docs/librariesprovider4/nisgtc/nisgtc-impact.pdf,"Community College Review Protocol" "The impact of financial education for youth in Ghana","Berry, J., Karlan, D., & Pradhan, M. (2015). The impact of financial education for youth in Ghana (Working Paper No. w21068). Cambridge, MA: National Bureau of Economic Research. doi:10.3386/w21068","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-No impacts Child labor Education and skills gains-Mod/high-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of two different financial literacy programs, Aflatoun and Honest Money Box, on child labor and school attendance of children in grades 5 and 7 in southern Ghana. This summary focuses on the comparison between the Aflatoun program group and the control group. The study was a randomized controlled trial conducted in three districts in southern Ghana. Schools in each district were randomly assigned into one of two treatment groups and a control group. Survey data were collected at baseline and at the end of the school year. Data were analyzed using regression. The study did not find any statistically significant effects on child labor or school attendance for children participating in the Aflatoun program compared to the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial with low attrition. This means we would be confident that any estimated effects would be attributable to the Aflatoun program and not to other factors. However, the study did not find statistically significant effects.","Aflatoun Program","Child labor",Other,,International,2015,https://www.nber.org/papers/w21068.pdf,"Child Labor Review Protocol" "Evaluation of the social cash transfer pilot programme, Tigray region, Ethiopia-endline report","Berhane, G., Devereux, S., Hoddinott, J., Hoel, J., Roelen, K., Abay, K. Kimmel, M., Ledlie, N., & Woldu, T. (2015). Evaluation of the social cash transfer pilot programme, Tigray region, Ethiopia-endline report. New York, NY: UNICEF","Child Labor",,,"Child labor-Mod/high-Favorable impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of a conditional cash transfer program on child labor and school enrollment in two districts in Ethiopia (Abi Adi and Hintalo Wajirat). The study used a nonexperimental design to compare the outcomes of children who received the cash transfer to those who did not. Outcomes were measured using baseline and follow-up household surveys and analyzed using regression. The study found that the number of days that girls were engaged in household business (non-farm activities) significantly decreased in Abi Adi; no significant impacts were found for boys in Abi Adi or any children in the Hintalo Wajirat. The study also found that the rates of school enrollment significantly increased for girls aged 6-11 in Hintalo Wajirat; there were no significant impacts for boys in Hintalo Wajirat or any children in Abi Adi. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the conditional cash transfer program and not to other factors.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2015,,"Child Labor Review Protocol" "Distinctive and unique outreach programs: Promoting academic excellence and diversity","Monaco, P., & Morse, A. (2014). Distinctive and unique outreach programs: Promoting academic excellence and diversity. Proceedings of the 2014 American Society for Engineering Education Annual Conference & Exposition. Washington, DC: American Society for Engineering Education.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study examined a series of residential environmental engineering summer camps run by a southern technology university that were intended to stimulate interest in STEM fields, primarily for girls and underrepresented minority groups. Three different types of summer camps were offered for different populations: international mixed-gender Brazilian students, female-only, and local mixed-gender students. The authors reviewed qualitative data collected from 81 4th- through 12th-grade students participating in one of five summer camp sessions. These data included pre-session oral surveys; ongoing observations of class participation; and post-session group discussions, activity worksheets that asked for open-ended application of STEM theories to examples, and oral surveys. According to post-session discussions and surveys, across the five camp sessions, about 65 percent of camp participants, of whom 25 percent were females, expressed interest in pursuing a STEM major. The authors also reported that the females had higher levels of participation and engagement in female-only sessions compared with mixed-gender sessions.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Other barriers, Female",,"United States",2014,https://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=1&cad=rja&uact=8&…,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Who pays the high health costs of older workers? Evidence from prostate cancer screening mandates.","Bailey, J. (2014). Who pays the high health costs of older workers? Evidence from prostate cancer screening mandates. Applied Economics, 46(32), 3931-3941. doi:10.1080/00036846.2014.948673","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Unfavorable impacts Earnings and wages Employment-Mod/high-Unfavorable impacts Employment","Summary: The study examined the impact of state mandates that health insurance plans cover prostate cancer screenings on the earnings and employment of men older than age 50 The study used nonexperimental regression analyses to compare older men in states that had enacted a mandate with women, younger men, and older men living in states without a mandate. The author used data from the Current Population Survey(CPS) between 1990 and 2009. The study found that older men in states with mandates had lower wages and were less likely than the comparison group to be employed. The quality of causal evidence presented in this study is moderate, because it is a well-implemented nonexperimental study. This means we are somewhat confident that the estimated effects are attributable to the prostrate screening mandate, but other factors might also have contributed.","Prostate cancer screening mandates","Health insurance Older workers' programs","Adult, Older worker, Male",,"United States",2014,https://sites.temple.edu/jamesbailey/files/2013/08/Who-Pays-the-High-Health-Cos…,"Employment and Training Review Protocol" "A little help may be no help at all: Child labor and scholarships in Nepal","Datt, G., & Uhe, L. (2014). A little help may be no help at all: Child labor and scholarships in Nepal. Monash Business School Department of Economics Discussion Paper, 50/14.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Mixed impacts Child labor","Summary: The study’s objective was to examine the impact of school scholarships in Nepal on child labor. Using the 2010 Nepal Living Standards Survey III, the authors used a nonexperimental design to compare the labor outcomes of scholarship recipients to those who did not receive scholarships. The study found that scholarship receipt was significantly related to an increase in extended-economic work for girls. However, higher scholarship values were significantly related to a reduction in the number of hours spent in economic and extended-economic work for girls. The quality of causal evidence presented in the study is low because the authors did not control for pre-intervention outcomes. This means we are not confident that the estimated effects are attributable to the scholarship program; other factors are likely to have contributed.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2014,https://www.monash.edu/business/economics/research/publications/2014/5014childl…,"Child Labor Review Protocol" "Cash transfer programme, productive activities and labour supply: Evidence from a randomised experiment in Kenya","Asfaw, S., Davis, B., Dewbre, J., Handa, S., & Winters, P. (2014). Cash transfer programme, productive activities and labour supply: Evidence from a randomised experiment in Kenya. The Journal of Development Studies, 50(8), 1172-1196. doi: 10.1080/00220388.2014.919383","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to assess the impact of a monthly cash transfer program on household food consumption, resources, and work, including child labor. The study used survey data from a clustered randomized controlled trial. Households from seven districts in Kenya were randomly assigned to either the treatment or control group. Within those locations, 20 percent of the poorest households were recruited if they had one or more children 17 years old or younger who was an orphan or had a chronically ill parent or caregiver.  The study found a statistically significant relationship between the program and a reduction in farm labor for children ages 10-15. This relationship was significant for boys but not for girls. There was also a statistically significant relationship between the program and an increase in school enrollment for children ages 12-18. The quality of causal evidence presented in this report is low because it was based on a randomized controlled trial with high attrition and the authors did not demonstrate that groups were similar at baseline. This means we are not confident that the estimated effects are attributable to the Kenya Cash Transfer Programme for Orphans and Vulnerable Children; other factors are likely to have contributed.","Kenya Cash Transfer Programme for Orphans and Vulnerable Children (CT-OVC) Experiment","Child labor","Other barriers, Other, Low income",,International,2014,,"Child Labor Review Protocol" "Mentoring practices proven to broaden participation in STEM disciplines","Crumpton-Young, L., Elde, A., & Ambrose, K. (2014, June). Mentoring practices proven to broaden participation in STEM disciplines. Paper presented at 2014 American Society for Engineering Education Annual Conference, Indianapolis, IN.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study identified effective mentoring practices, mostly at postsecondary institutions, for women and minority students in science, technology, engineering, and mathematics (STEM) fields. The authors surveyed 25 randomly selected mentor programs or individuals who received a National Science Foundation award for being successful in mentoring students who are typically underrepresented (including women) in STEM. The survey asked award recipients to rate their performance on 22 mentoring practices using a scale ranging from not doing well to doing exceptionally well. The authors deemed those mentoring practices rated most highly as best practices. The study found that the highest-rated mentoring practices were being passionate about mentees and their development, creating opportunities for mentees, setting high expectations for mentees’ performance, providing needed support to mentees, and respecting mentees’ confidentiality. Conversely, the lowest-rated practices set the mentor in an authoritative light and included providing constant feedback to and having constant contact with mentees.",,"Mentoring Science, Technology, Engineering, and Math (STEM) programs","Youth, Female, Black or African American, Asian, Hispanic of any race, Multiracial, American Indian or Alaska Native, Native Hawaiian or other Pacific Islander",,"United States",2014,https://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=1&ved=0ahUKEwiM7t…,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Impact of a 5-week collegiate-level residential STEM summer program on secondary school students (Research to practice)","Campbell, B., Robb, S., Abbott, S., & Mutunga, S. (2014). Impact of a 5-week collegiate-level residential STEM summer program on secondary school students (Research to practice). Proceedings of the 2014 American Society for Engineering Education Annual Conference & Exposition. Washington, DC: American Society for Engineering Education.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Attitudes-Low-Favorable impacts Attitudes","Summary: The study’s objective was to examine the impact of participating in the Pennsylvania Governor’s School for the Sciences’ (PGSS) five-week residential program in summer 2013 on high school seniors’ attitudes toward and interest in science, technology, engineering, and math (STEM). Using surveys developed for the study, the authors compared the outcomes of students before and after participating in the PGSS program. The study found that female students had a significantly improved disposition toward technology and general science and a significantly higher interest in the specific fields of chemistry, computer science, and math at the end of the program, compared to the start of the program. The quality of causal evidence presented in this report is low because the authors did not observe outcomes for multiple periods before the intervention nor account for selection into the intervention. This means we are not confident that the estimated effects are attributable to the PGSS program; other factors are likely to have contributed.","the Pennsylvania Governor’s School for the Sciences (PGSS)","Science, Technology, Engineering, and Math (STEM) programs","Youth, Female",,"United States",2014,https://peer.asee.org/impact-of-a-5-week-collegiate-level-residential-stem-summ…,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Training program impacts and the onset of the Great Recession. [Adult sample]","Heinrich, C.J., and Mueser, P. (2014). Training program impacts and the onset of the Great Recession. Columbia, MO: Department of Economics, University of Missouri-Columbia, unpublished. [Adult sample]",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Mixed impacts Earnings and wages","Summary: The study’s objective was to examine whether participation in the Workforce Investment Act (WIA) Adult Program services increased participants' earnings and if so, whether those gains were greater during a recessionary period than in periods before and after the recession. The authors analyzed administrative data to compare the quarterly earnings of participants receiving services through the WIA Adult Program with those of a matched comparison group that received Wagner-Peyser Employment Services (ES). The study presented impacts separately by gender and program year. The study found that males and females receiving services from the WIA Adult Program from June to December 2007 (before the recession) earned more, on average, than the comparison group in some, but not all, of the 16 follow-up quarters examined. Males and females receiving services from July 2008 to June 2009 and from July 2009 to June 2010 (after the onset of the recession) tended to earn less, on average, than the comparison group in most of the 16 follow-up quarters. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the WIA Adult Program services, but other factors might also have contributed. The report also examined the impacts of WIA Dislocated Worker services; that profile is available here.","the Workforce Investment Act (WIA) Adult Program","Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) training programs","Dislocated or displaced worker, Female, Male",,"United States",2014,https://www.missourieconomy.org/pdfs/WDQI_MissouriReport_TrainingProgramImpacts…,"Review Protocol" "The impact of Oportunidades on school participation and child labour","Ranzani, M., & Rosati, F. (2014). The impact of Oportunidades on school participation and child labour. Rome, Italy: Understanding Children’s Work.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of Mexico’s conditional cash transfer program (Oportunidades) on school attendance and participation in work for children ages 8 to 14 (during the time of the intervention). Using survey data from a randomized controlled trial, the authors analyzed the average program impact of the Oportunidades program on schooling and work for boys and girls using a statistical model. The study found that Oportunidades significantly increased school participation for boys and girls and significantly decreased participation in work for boys only. The quality of the causal evidence presented in this study is moderate because, although it was based on a randomized controlled trial with high attrition, the authors demonstrated that the treatment and control groups were similar before the intervention. This means we have confidence that the estimated effects are attributable at least in part to Oportunidades, although other factors could also have contributed.",Oportunidades,"Child labor",Other,,International,2014,http://www.ucw-project.org/attachment/Oportunidades_school_part_child_labour_Ja…,"Child Labor Review Protocol" "Reducing child labour in Panama: An impact evaluation","Andisha, N., Chiquito-Saban, O., Emmerich, E., Figueroa, A., Jiang, Y., Lee, J. H., Manning, D., Ortega-Sanchez, A., & Gawande, K. (2014.) Reducing child labour in Panama: An impact evaluation. Journal of Development Effectiveness, 6(2), 128-146.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-No impacts Child labor","Summary: The study’s objective was to examine the impact of two components of the DESTINO program—CEC (a tutoring course) and EPA (an alternative primary school program)—on children’s participation in agricultural work in Panama. This summary focuses on the comparison between the EPA treatment group and the comparison group. The study used a nonexperimental comparison group design. Using post-intervention survey data, the authors compared the outcomes for children receiving the EPA program to children over 12, who had not received the CEC program and were not attending school. The study found that there were no significant relationships between participation in the EPA program and child work participation or hours worked. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the EPA program; other factors are likely to have contributed.","DESTINO’s EPA program","Child labor","Other barriers, Other",,International,2014,https://www.researchgate.net/publication/271673211_Reducing_child_labour_in_Pan…,"Child Labor Review Protocol" "The labor-market returns to community college degrees, diplomas, and certificates","Jepsen, C., Troske, K., & Coomes, P. (2014). The labor-market returns to community college degrees, diplomas, and certificates. Journal of Labor Economics, 32(1), 95-121.",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages","Summary: The study’s objective was to examine the effect of earning community college degrees, diplomas, and certificates on students’ later earnings. Using administrative data from the Kentucky Community and Technical College System (KCTCS), the National Student Clearinghouse, and Kentucky’s unemployment insurance program, the authors compared the outcomes of students who completed college degrees, diplomas, and certificates with those of students who did not. The study found that community college degrees, diplomas, and certificates improved earnings for those who received them, compared with those who did not receive them but were otherwise similar. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design; this is the highest causal evidence rating possible for a nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to earning community college degrees, diplomas, and certificates, but other factors might also have contributed.","the Program Under Study","Other training and education","Adult, Female, Male",,"United States",2014,,"Review Protocol" "You get what you pay for: Schooling incentives and child labor","Edmonds, E. V., & Shrestha, M. (2014). You get what you pay for: Schooling incentives and child labor. Journal of Development Economics, 111, 196-211. doi:10.1016/j.deveco.2014.09.005","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-No impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of financial schooling incentives (a scholarship and stipend) on school attendance and carpet weaving (a worst form of child labor) among youth ages 10-16 in Nepal. This summary focuses on the comparison between the scholarship treatment group and the stipend treatment group. The study was a randomized controlled trial (RCT) in which children were randomly assigned to receive one of two schooling incentives (a scholarship or stipend) or to participate in the control group that did not receive any incentives. Using administrative data from schools and survey data, the authors analyzed the impact of the treatment conditions on school attendance and child labor at the end of the school year and 16 months after the intervention ended. The study found that the stipend treatment group had significantly higher levels of school attendance than the scholarship treatment group at the end of the school year. However, the study found no statistically significant difference in rates of involvement in weaving carpets or the hours worked between the two groups. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Schooling Incentives Project, and not to other factors.","Schooling Incentives Project","Child labor Tuition assistance","Other, Low income",,International,2014,https://www.sciencedirect.com/science/article/pii/S0304387814001047,"Child Labor Review Protocol" "Training program impacts and the onset of the Great Recession. [TAA sample]","Heinrich, C.J., and Mueser, P. (2014). Training program impacts and the onset of the Great Recession. Columbia, MO: Department of Economics, University of Missouri-Columbia, unpublished. [TAA sample]",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Unfavorable impacts Earnings and wages","Summary: The study’s objective was to examine whether participation in the Trade Adjustment Assistance (TAA) Program services increased participants’ earnings and, if so, whether those gains were greater during a recessionary period than in periods before and after the recession. The authors analyzed administrative data to compare the quarterly earnings of TAA participants with those of a matched comparison group that received Wagner-Peyser Employment Services (ES). The study presented impacts separately by gender and program year. The study found that males and females who received services through the TAA Program earned less, on average, than the comparison group during almost all of the 16 follow-up quarters examined. This held regardless of whether the participants began receiving services before, during, or after the recession. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to services received through the TAA Program, but other factors might also have contributed.","the Trade Adjustment Assistance (TAA) Program","Job search assistance and supportive services Other training and education","Dislocated or displaced worker, Female, Male",,"United States",2014,https://www.empiwifo.uni-freiburg.de/sonstige-dateien/heinrich-mueser_trainingi…,"Review Protocol" "The (surprising) efficacy of academic and behavioral intervention with disadvantaged youth: Results from a randomized experiment in Chicago","Cook, P., Dodge, K., Farkas, G., Fryer, R., Guryan, J., Ludwig, J. Mayer, S., Pollack, H., & Steinberg, L. (2014). The (surprising) efficacy of academic and behavioral intervention with disadvantaged youth: Results from a randomized experiment in Chicago. Cambridge, MA: National Bureau of Economic Research.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Becoming a Man (BAM) program on youths’ academic outcomes, including grade point averages (GPAs), course failures, and achievement test scores. BAM provided mentoring and socialization activities to enhance cognitive, decision-making, and social skills. The study was a randomized controlled trial conducted in one high school on the south side of Chicago, Illinois, in 2012–2013. Eligible youth were randomly assigned to one of three conditions: (1) a treatment group receiving BAM only, in which individuals could participate in the BAM program; (2) a treatment group receiving BAM plus tutoring, in which individuals could participate in the BAM program and received daily tutoring in math; or (3) the control group, which could not participate in BAM but could access existing services at their school. The authors estimated regressions to measure the impact of the BAM program on academic achievement using administrative data from Chicago Public Schools. The study found that youth offered the opportunity to participate in BAM—either with or without supplemental tutoring—had significantly higher math achievement test scores than youth in the control group. In addition, youth in the BAM program group and the BAM plus tutoring program group had significantly higher math GPAs than members of the control group. The quality of causal evidence presented in this report is high for the GPA and course failures outcomes because it was based on a randomized controlled trial with low attrition. This means we are confident that the estimated effects are attributable to BAM and/or the tutoring sessions, and not to other factors. The quality of causal evidence is moderate for the math and reading achievement outcomes because these outcomes had high attrition but the authors included sufficient controls in their analysis. This means we are somewhat confident that the estimated effects are attributable to BAM and/or tutoring sessions, but other factors might also have contributed.","Becoming a Man","Mentoring Other training and education Youth programs Behavioral Interventions","Youth, Male, Low-skilled, Low income",,"United States, Urban",2014,http://www.nber.org/papers/w19862.pdf,"Opportunities for Youth Review Protocol" "Community college men and women: A test of three widely held beliefs about who pursues computer science","Denner, J., Werner, L., O’Connor, L., & Glassman, J. (2014). Community college men and women: A test of three widely held beliefs about who pursues computer science. Community College Review, 42(4), 342-362.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study's objective was to examine factors that affect motivation to pursue a computer and information sciences (CIS) degree, with the intention of informing strategies to increase the number of community college students, particularly females, who go on to enroll in a CIS degree program at a four-year university. Specific factors examined were programming and/or video-gaming experience; support from peers, instructors, mentors, and family members; and level and type of motivation to pursue a CIS degree. The authors administered a series of three (baseline and 6- and 18-month follow-up) surveys to students enrolled in an introductory programming class at one of 15 California community colleges and ran multiple linear regression models by gender to determine each of the three factors’ influence on the student’s plan to pursue a four-year CIS degree, comparing results for women versus men. The study found that female students, who were overall less likely to intend to pursue a four-year CIS degree, reported receiving significantly less encouragement from their peers to persist in computer science and spending less time playing computer games than male students. Predictors for women choosing to pursue a four-year CIS degree changed over time: strong immediate (baseline) predictors were interest in computer science, video gaming, and peer encouragement; a year after baseline, the strongest predictors were expectations for success and interest in solving problems.",,"Youth programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Youth, Female",,"United States",2014,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Reducing child labour in Panama: An impact evaluation","Andisha, N., Chiquito-Saban, O., Emmerich, E., Figueroa, A., Jiang, Y., Lee, J. H., Manning, D., Ortega-Sanchez, A., & Gawande, K. (2014.) Reducing child labour in Panama: An impact evaluation. Journal of Development Effectiveness, 6(2), 128-146.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor","Summary: The study’s objective was to examine the impact of two components of the DESTINO program—CEC (a tutoring course) and EPA (an alternative primary school program)—on children’s participation in agricultural work in Panama. This summary focuses on the comparison between the CEC treatment group and the comparison group. The study used a nonexperimental comparison group design. Using post-intervention survey data, the authors compared the outcomes for children in schools receiving CEC services to those that were the same age as the CEC children but did not participate in the program. The study found that participation in the CEC program was significantly associated with a reduction in the number of hours that children worked per day but not the probability of children working. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the CEC program; other factors are likely to have contributed.","DESTINO’s CEC program","Child labor","Other barriers, Other",,International,2014,https://www.researchgate.net/publication/271673211_Reducing_child_labour_in_Pan…,"Child Labor Review Protocol" "You get what you pay for: Schooling incentives and child labor","Edmonds, E. V., & Shrestha, M. (2014). You get what you pay for: Schooling incentives and child labor. Journal of Development Economics, 111, 196-211. doi:10.1016/j.jdeveco.2014.09.005","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of financial schooling incentives (a scholarship and stipend) on school attendance and carpet weaving (a worst form of child labor) among youth ages 10-16 in Nepal. This summary focuses on the comparison between the stipend treatment group and the control group. The study was a randomized controlled trial (RCT) in which children were randomly assigned to receive one of two schooling incentives (a scholarship or stipend) or to participate in the control group that did not receive any incentives. Using administrative data from schools and survey data, the authors analyzed the impact of the treatment conditions on school attendance and child labor at the end of the school year and 16 months after the intervention ended. The study found that the stipend treatment group had significantly higher levels of school attendance and lower rates of carpet weaving than the control group at the end of the school year. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Schooling Incentives Project Stipend, and not to other factors.","Schooling Incentives Project","Child labor Tuition assistance","Other, Low income",,International,2014,https://www.sciencedirect.com/science/article/pii/S0304387814001047,"Child Labor Review Protocol" "The impact of the Kenya CT-OVC programme on children's activities","de Hoop, J., Ranzani, M., Rosati, F. C. (2014). The impact of the Kenya CT-OVC programme on children’s activities (Working Paper). Retrieved from http://www.ucw-project.org/attachment/The_impact_of_the_Kenya_CT-OVC20140423_144552.pdf","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-No impacts Education and skills gains","Summary: The purpose of the study was to assess the impact of the Kenya Cash Transfer for Orphans and Vulnerable Children Program on child labor and school participation. The study used a randomized controlled trial to assess the intervention. Child outcomes were compared between the treatment and control group households, using data from follow-up surveys administered two years after the start of the intervention. The study found a 5 percent reduction in the proportion of children in the treatment group who were working in unpaid labor or conducting household chores compared to the control group. The quality of causal evidence presented in this report is low because randomization was compromised and the authors did not ensure that the groups being compared were similar before the intervention. This means that if there were significant effects, we would not be confident that they were attributable to Kenya CT-OVC; other factors are likely to have contributed.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2014,http://www.ucw-project.org/attachment/The_impact_of_the_Kenya_CT-OVC20140423_14…,"Child Labor Review Protocol" "Training program impacts and the onset of the Great Recession. [Dislocated worker sample]","Heinrich, C.J., and Mueser, P. (2014). Training program impacts and the onset of the Great Recession. Columbia, MO: Department of Economics, University of Missouri-Columbia, unpublished. [Dislocated worker sample]",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Mixed impacts Earnings and wages","Summary: The study’s objective was to examine whether participation in the Workforce Investment Act (WIA) Dislocated Worker Program services increased participants' earnings and if so, whether those gains were greater during a recessionary period than in periods before and after the recession. The authors analyzed administrative data to compare the quarterly earnings of participants receiving services through the WIA Dislocated Worker Program with those of a matched comparison group that received Wagner-Peyser Employment Services (ES). The study presented impacts separately by gender and program year. The study found that males receiving services through the WIA Dislocated Worker Program from July 2007 to December 2007 (before the recession), from January 2008 to June 2008 (at the beginning of the recession), and from July 2008 to June 2009 (during the worst of the recession) earned less than males in the comparison group in most of the 16 follow-up quarters examined. In no quarter did females participating in the WIA Dislocated Worker Program before, during, or after the recession earn more than females in the comparison group. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the WIA Dislocated Worker Program services, but other factors might also have contributed. The report also examined the impacts of WIA Adult Program services; that profile is available here.","the Workforce Investment Act (WIA) Dislocated Worker Program","Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) training programs Job search assistance and supportive services","Dislocated or displaced worker, Female, Male",,"United States",2014,https://www.missourieconomy.org/pdfs/WDQI_MissouriReport_TrainingProgramImpacts…,"Review Protocol" "The impact of earnings disregards on the behavior of low‐income families.","Matsudaira, J. D., & Blank, R. M. (2014). The impact of earnings disregards on the behavior of low‐income families. Journal of Policy Analysis and Management, 33(1), 7-35.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-No impacts Employment Public benefits receipt-Low-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of earnings disregards—the amount of earned income that is not counted when calculating whether someone is eligible for public benefits—for welfare assistance on the employment, earnings, and public assistance receipt of low-skilled single mothers. The study used a difference-in-differences approach to compare the outcomes of women before and after changes in the disregard rate within their state relative to women in other states over the same time period. The study did not find any statistically significant effects of earnings disregards on the outcomes of interest. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design; this is the highest causal evidence rating possible for a nonexperimental design. This means we would be somewhat confident that any estimated effects would be attributable to earnings disregards, but other factors might also have contributed. However, the study did not find statistically significant effects.","Earnings Disregards for Welfare Assistance","Other employment and reemployment","Female, Parent, Low income",,"United States",2014,,"Employment and Training Review Protocol" "Effects of cash transfers on child labor and schooling in Kenya","Owoko, S. A. (2014). Effects of cash transfers on child labor and schooling in Kenya (Unpublished master's thesis). Nairobi, Kenya: University of Nairobi.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The objective of the study was to assess the impact of Kenya’s Cash Transfer to the Orphaned and Vulnerable Children (CT-OVC) program on children’s participation in work and school. The study used a post-test only design to assess differences in school enrollment and work participation between 5-17 year-old children in the CT-OVC program and those who were not in the program. The study found that receipt of the cash transfer was significantly related to lower rates of child labor and higher rates of school enrollment. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to CT-OVC; other factors are likely to have contributed.","Kenya Cash Transfer for Orphans and Vulnerable Children Program (Kenya CT-OVC)","Child labor","Other barriers, Other",,International,2014,,"Child Labor Review Protocol" "Exploring gender imbalance among STEM doctoral degree recipients (Issue brief)","Gillen, A., & Tanenbaum, C. (2014, September). Exploring gender imbalance among STEM doctoral degree recipients (Issue brief). Washington, DC: American Institutes for Research.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study’s main objective was to accurately identify the nature of gender imbalances in the receipt of science, technology, engineering, and mathematics (STEM) degrees, specifically isolating imbalances at the doctoral level. Using data from the U.S. Department of Education’s Integrated Postsecondary Education Data System (IPEDS), the authors calculated the ratio of women to men earning doctoral degrees by field, controlling for the number who completed an undergraduate degree in the same field (called “prepared” students). The study found that, overall, men are overrepresented in 76 percent of doctoral fields. This means that, after controlling for the number of students who complete an undergraduate degree in a given field, more men than women are completing doctoral degrees in the same field. However, there is slightly less gender imbalance of prepared students earning doctoral degrees in all STEM fields than in non-STEM fields, even though the absolute number of men receiving STEM doctoral degrees is higher. The authors suggest that because female undergraduate STEM majors persist from undergraduate to graduate levels at almost the same rate (90 percent as often) as men, gender imbalance must be addressed earlier in the academic pipeline to address overall disparities in the receipt of STEM doctoral degrees.",,"Science, Technology, Engineering, and Math (STEM) programs","Female, Male, STEM professional",,"United States",2014,http://www.air.org/sites/default/files/downloads/report/STEM%20PhDs%20Gender%20…,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "You get what you pay for: Schooling incentives and child labor","Edmonds, E. V., & Shrestha, M. (2014). You get what you pay for: Schooling incentives and child labor. Journal of Development Economics, 111, 196-211. doi:10.1016/j.jdeveco.2014.09.005","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-No impacts Child labor Education and skills gains-Mod/high-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of financial schooling incentives (a scholarship and stipend) on school attendance and carpet weaving (a worst form of child labor) among youth ages 10-16 in Nepal. This summary focuses on the comparison between the scholarship treatment group and the control group. The study was a randomized controlled trial (RCT) in which children were randomly assigned to receive one of two schooling incentives (a scholarship or stipend) or to participate in the control group that did not receive any incentives. Using administrative data from schools and survey data, the authors analyzed the impact of the treatment conditions on school attendance and child labor at the end of the school year and 16 months after the intervention ended. The study found no statistically significant difference in rates of involvement in weaving carpets or the hours worked between the scholarship treatment and control groups. There was also no statistically significant difference in rates of school attendance or school enrollment between the two groups. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Schooling Incentives Project Scholarship, and not to other factors. However, the study did not find statistically significant effects.","Schooling Incentives Project","Child labor Tuition assistance","Other, Low income",,International,2014,https://www.sciencedirect.com/science/article/pii/S0304387814001047,"Child Labor Review Protocol" "Does promoting school attendance reduce child labour? Evidence from Burkina Faso’s Bright project","de Hoop, J. & Rosati, F. C. (2014). Does promoting school attendance reduce child labour? Evidence from Burkina Faso’s Bright project. Economics of Education Review, 39, 78-96. doi:10.1016/j.econedurev.2013.11.001","Child Labor","Study Type: Descriptive Analysis",,,"Summary: The study’s objective was to examine the impact of the BRIGHT project on school participation and child labor in Burkina Faso in West Africa. The study used a regression discontinuity design. Villages were assigned to the treatment and comparison groups based on a numeric score (a constructed index score of how likely the program would be to benefit girls). Villages above the cut-off score received the program; villages below did not receive the program. Using survey data from schools and households, the authors analyzed the impact of the program on child labor, school enrollment, and school attendance for children aged 5-12. The study found that participation in the BRIGHT project was significantly associated with an increase in the probability of children working in the family business or selling goods on the streets. However, program participation was also significantly related to an increase in school enrollment and attendance. This study used a regression discontinuity design and therefore was reviewed using CLEAR’s descriptive study evidence review guidelines. As such, it does not receive a causal rating.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2014,https://www.sciencedirect.com/science/article/pii/S0272775713001556,"Child Labor Review Protocol" "The impact of Brazil's Bolsa Familia Program on school attendance, age-grade discrepancy, and child labor","de Lima Amaral, E. F., Goncalves, G. Q., & Weiss, C. (2014). The impact of Brazil's Bolsa Familia Program on school attendance, age-grade discrepancy, and child labor. Journal of Social Science for Policy Implications, 2, 101-125","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Unfavorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The purpose of the study was to examine the impact of the Brazilian conditional cash transfer program, Bolsa Familia, on child labor and school enrollment. The authors used a nonexperimental design to compare the outcomes of children ages 7 to 14 who resided in families who met the income threshold for the Bolsa Familia program compared with those who had not, based on data from the 2010 Brazilian Census. The study found that receipt of the cash transfer was significantly associated with an increase in school enrollment. However, receipt of the transfer was also associated with significantly higher rates of work. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to Bolsa Familia program; other factors are likely to have contributed.","Bolsa Familia","Child labor","Other, Low income",,International,2014,,"Child Labor Review Protocol" "Did age discrimination protections help older workers weather the Great Recession?","Neumark, D., & Button, P. (2014). Did age discrimination protections help older workers weather the Great Recession? Journal of Policy Analysis and Management, 33(4), 566-601. doi:10.1002/pam.21762","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Unfavorable impacts Employment","Summary: The study examined whether the strong age discrimination laws moderated the impact of the Great Recession on employment outcomes of older workers. The study used statistical models and the data from the 2003–2011 Current Population Survey (CPS) and 2004–2011 Quarterly Workforce Indicators to estimate impacts. The study found that states with stronger age discrimination laws had experienced increases in unemployment rates, longer unemployment durations, and decreases in hiring rates for some types of older workers relative to younger workers in the months during and following the Great Recession. The quality of causal evidence presented in this study is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the differential effect of the Great Recession on older workers in states with strong age discrimination laws, but other factors might also have contributed.","Age Discrimination Laws","Older workers' programs Other disparities or discrimination in employment and earnings","Adult, Older worker, Female, Male",,"United States",2014,https://www.nber.org/papers/w19216,"Employment and Training Review Protocol" "The role of intensive case management services in reentry: The northern Kentucky female offender reentry project","McDonald, D., & Arlinghaus, S. L. (2014). The role of intensive case management services in reentry: The northern Kentucky female offender reentry project. Women & Criminal Justice, 24(3), 229-251.",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Mixed impacts Education and skills gains Employment-Low-Favorable impacts Employment","Summary: This study examined the impact of the Northern Kentucky Female Offender Reentry Project’s intensive case management (ICM) services on releasees’ education, employment, and recidivism outcomes. Using program data and administrative data from state and county judicial databases, the study compared outcomes of the treatment group, which received ICM services pre-release (in prison) and post-release (in the community), with outcomes of the comparison group, which only received ICM services pre-release (in prison). The study found mixed results for education, employment, and recidivism. The authors did not conduct statistical significance tests. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Female Offender Reentry Project’s pre- and post- release ICM services; other factors are likely to have contributed.","Northern Kentucky Female Offender Reentry Project’s intensive case management (ICM) services","Other employment and reemployment Reentry","Justice-involved, Female",,"United States",2014,https://doi.org/10.1080/08974454.2014.909759,"Employment and Training Review Protocol" "The economics of federal tax and employment laws: Empirical evidence from three studies.","Figinski, T. F. (2013). The economics of federal tax and employment laws: Empirical evidence from three studies. (Doctoral dissertation). Retrieved from ProQuest. Accession No. 1415455735.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment Public benefits receipt-Low-Unfavorable impacts Public benefit receipt","Summary: The study examined the impact of removing the Social Security earnings test on Social Security claims, earnings, and labor force participation for female beneficiaries. The study used a statistical model and the data from the Social Security Administration’s Benefit and Earnings Public Use File to estimate impacts. The study found that removing the earnings test was associated with an increase in Social Security claims among women who were primary or spousal beneficiaries and with an increase in average earnings and in labor force participation among women who were primary beneficiaries. The qaulity of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the change in Social Security earings test. This means we are not confident that the estimated effects are attributable to the removal of the Social Security earnings test; other factors are likely to have contributed.","Social Security 2000 Earnings Test Removal","Federal retirement benefits Older workers' programs","Adult, Older worker, Female",,"United States",2014,,"Employment and Training Review Protocol" "The impact of career mentoring and psychosocial mentoring on affective organizational commitment, job involvement, and turnover intention","Craig, C. A., Allen, M. W., Reid, M. F., Riemenschneider, C. K., & Armstrong, D. J. (2013). The impact of career mentoring and psychosocial mentoring on affective organizational commitment, job involvement, and turnover intention. Administration & Society, 45(8), 949–973. doi:10.1177/0095399712451885","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Mixed impacts Employment","Summary: This study examines the relationship between mentoring and employees’ employment outcomes. Specifically, the study examines the relationship between psychosocial mentoring and turnover intention. The authors used a statistical model in a nonexperimental analysis to determine the relationship between mentoring and employment outcomes using data from a convenience sample of information technology (IT) staff in one state agency of a state located in the south-central region of the United States. The study found a statistically significant favorable relationship between one type of mentoring, psychosocial mentoring, and turnover intention. In other words, if a respondent reported participating in psychosocial mentoring, they tended to be less likely to intend to leave the job. There was no statistically significant relationship between the other type of mentoring in the study, career mentoring, and turnover intention. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups compared were similar before the intervention. This means we are not confident that the estimated relationships are attributable to psychosocial mentoring; other factors are likely to have contributed.",,Mentoring,"STEM professional","Professional, scientific, and technical services","United States",2013,https://journals.sagepub.com/doi/10.1177/0095399712451885,"Employment and Training Review Protocol" "Preventing youth violence and dropout: A randomized field experiment (No. w19014)","Heller, S., Pollack, H. A., Ander, R., & Ludwig, J. (2013). Preventing youth violence and dropout: A randomized field experiment (No. w19014). Cambridge, MA: National Bureau of Economic Research.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Becoming a Man program on arrest and educational outcomes. The study was a randomized controlled trial. Eligible male youth from 18 public schools in disadvantaged neighborhoods were screened for eligibility. The 2,740 who met requirements were randomly assigned to one of three treatment groups or a control group. The study found that being offered the opportunity to participate in the program reduced violent crime arrests during the program year and improved schooling outcomes in both the program and follow-up years. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Becoming a Man program, and not to other factors.","Becoming a Man","Other training and education Safety Youth programs Behavioral Interventions","Youth, Disconnected youth, Male, Low income",,"United States, Urban",2013,http://faculty.chicagobooth.edu/workshops/AppliedEcon/past/pdf/jensludwigyouthv…,"Opportunities for Youth Review Protocol" "An effective model for enhancing underrepresented minority participation and success in geoscience undergraduate research","Blake, R., Liou-Mark, J., & Chukuigwe, C. (2013). An effective model for enhancing underrepresented minority participation and success in geoscience undergraduate research. Journal of Geoscience Education, 61(4), 405-414.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: This study described the implementation of the National Science Foundation Research Experiences for Undergraduates (REU) program at New York City College of Technology. This year-long program aimed to retain undergraduates in STEM disciplines and prepare them for STEM careers, especially for underrepresented minority groups, including women. The authors, as directors of the REU program, described each of its components, including research, minicourses, seminars and workshops, mentoring, support and networking opportunities, and presenting at and attending conferences. Outcomes were discussed in terms of post-program experiences and achievements, as well as quotes from program participants. Overall, the authors concluded that the program was successful in terms of demonstrated interest in, attendance in, or completion of a STEM graduate program; achievement in STEM publications; and attainment of STEM awards. These outcomes were complemented by five quotes from student participants who discussed how the program changed their academic lives.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Other barriers, Female",,"United States",2013,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Women in community colleges: Access to success","St. Rose, A., & Hill, C. (2013). Women in community colleges: Access to success. Washington, DC: American Association of University Women.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The authors described two programs partnering with California community colleges—the Mathematics, Engineering, Science Achievement Community College Program (MCCP) and the CalWomen Tech Program—that aim to encourage women to pursue careers in science, technology, engineering, and mathematics (STEM). The two initiatives approach this goal in different ways: MCCP prepares women to transfer from two- to four-year STEM degree programs, whereas CalWomen Tech encourages participation in non-traditional career and technical education programs in STEM, such as information technology and automotive repair. MCCP offers a wide array of academic, career, and social support services, from academic tutoring and advising to a cohort-based course progression. CalWomen Tech’s promotional materials target women, such as “women in technology” websites that highlight the employment and salary opportunities available to women who choose non-traditional career paths, and skill-building or “bridge” courses that lay the groundwork for more advanced study. In 2010, 38 percent of MCCP transfer students from two- to four-year degree programs were women. Of those transferring to programs in life sciences or mathematics, more than 50 percent were women. After partnering with CalWomen Tech, female enrollment in City College of San Francisco’s computer networking and information technology program increased from 19 percent in 2006 to 33 percent in 2008, with persistent enrollment rates through 2010. Similarly, CalWomen Tech helped Evergreen Valley College raise female retention in its automotive technology program from 58 percent to 88 percent over the course of two years.",,"Youth programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Youth, Female",,"United States",2013,http://www.aauw.org/files/2013/05/women-in-community-colleges.pdf,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Training and retirement patterns.","Montizaan, R., Cörvers, F., & de Grip, A. (2013). Training and retirement patterns. Applied Economics, 45(15), 1991-1999. doi:10.1080/00036846.2011.646066","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Unfavorable impacts Employment","Summary: The study’s objective was to examine the impact of firm-specific training and general training on older men’s retirement decisions The study used a nonexperimental design and data from the U.S. National Longitudinal Survey of Older Men for 1966 to 1983 to estimate impacts. The study found that workers with firm-specific training were more likely to retire within the time period studied and to have jobs with a mandatory retirement age than workers without firm-specific training. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before receiving training and did not account for self-selection into training. This means we are not confident that the estimated effects are attributable to firm-specific or general training; other factors are likely to have contributed.","Firm-specific & General Training","Work based and other occupational training","Adult, Older worker, Male",,"United States",2013,https://www.researchgate.net/publication/236021967_Training_and_retirement_patt…,"Employment and Training Review Protocol" "Why academic STEM mothers feel they have to work harder than others on the job","Kmec, J. (2013a). Why academic STEM mothers feel they have to work harder than others on the job. International Journal of Gender, Science, & Technology, 5(2), 80-101.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: This report analyzed faculty members’ perceptions of how hard they have to work at their job based on their sex and parental status, specifically in the context of science, technology, engineering, and mathematics (STEM) disciplines that are typically characterized by a masculine work culture. The objective was to contribute to the knowledge base on gender issues in academic professions and the specific challenges that working mothers in STEM fields face. The study used data from the 2011 Faculty Caregiving and Workplace and Culture survey administered online to about 300 tenure-line faculty members in all disciplines at a large public U.S. university. The author conducted regression analyses to estimate the link between faculty members’ sex, parental status, academic discipline, and their level of agreement with the statement, “My job requires me to work very hard.” The regression controlled for several factors that might affect faculty members’ perceptions of how hard they have to work at their job, such as length of time at current institution, academic rank, perceived job demand levels, feelings of being valued, marital status, age of children, household/family responsibilities, and degree to which household responsibilities are perceived to affect job performance. The study found that mothers in STEM fields were more likely to strongly agree that they have to work very hard at their job, compared to fathers in both STEM and non-STEM fields and mothers in non-STEM fields, after controlling for a number of factors related to perceptions of effort required. Specifically, fathers in STEM and non-STEM fields were 84 percent and 92 percent less likely, respectively, to strongly agree that they have to work very hard at their job than mothers in STEM fields. Similarly, mothers in non-STEM fields were about 81 percent less likely than mothers in STEM fields to agree that they have to work very hard at their job.",,"Science, Technology, Engineering, and Math (STEM) programs Other disparities or discrimination in employment and earnings","Female, Male, STEM professional, Parent",,"United States",2013,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Attracting girls to civil engineering through hands-on activities that reveal the communal goals and values of the profession","Colvin, W., Lyden, S., & León de, l. B. (2013). Attracting girls to civil engineering through hands-on activities that reveal the communal goals and values of the profession. Leadership & Management in Engineering, 13(1), 35-41.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study determined the impact of a four-week series of civil engineering workshops on Australian middle school girls’ perceptions of engineers and the engineering profession. The goal of the workshops—which included hands-on activities and discussions of engineering theory, examples, and careers—was to familiarize girls with engineering and depict it as a profession in which communal goals are central, which research shows that women value more than men. The authors asked female students in grades 5 and 6 to draw and write about an engineer (the Draw an Engineer Test [DAET]) before and after they attended the workshops. The DAET was analyzed for the engineer’s characteristics, such as gender, work activity, and themes (for example, teamwork). The students also completed feedback forms at the end of the program. The authors found that by the end of the workshops, students were more likely to draw and describe engineers as women and happy as compared with the pre-program assessment in which the students often depicted engineers as car mechanics. Participants also referenced communal goals more frequently in the follow-up assessment. Participants reported in feedback forms a preference for hands-on activities over interactive discussions.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Female",,International,2013,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Accelerating change for women faculty of color in STEM: Policy, action, and collaboration","Institute for Women’s Policy Research. (2013). Accelerating change for women faculty of color in STEM: Policy, action, and collaboration. Washington, DC: Institute for Women’s Policy Research.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: This report highlighted a 2013 convening of stakeholders who discussed barriers to becoming successful STEM faculty for black, Hispanic, and Native American women, and strategies to overcome those barriers. The Institute for Women’s Policy Research organized the convening. The report was compiled from a series of conference sessions presented at the convening by about 50 experts from various academic, political, corporate, and community sectors. Session topics included the current status of women of color in STEM, areas of progress and nonprogress, and current initiatives to increase the representation of women of color in STEM faculty positions. Attendees provided recommendations for improvement. Conference representatives identified three main barriers to the advancement of minority female faculty: workplace climate policies that did not meet the needs of female faculty of color, a lack of multicultural perspectives, and a lack of embracement of diversity in academic departments. Health, financial, and family issues and obligations; high community service demands; and a lack of social support also created unique challenges for this population. Recommendations for improvement included raising awareness of underrepresentation of minority women in STEM faculty positions, monitoring and publicizing institutions’ progress on diversity in STEM faculty, and tailoring faculty mentoring programs or tools to effectively serve female faculty of color.",,"Science, Technology, Engineering, and Math (STEM) programs Other disparities or discrimination in employment and earnings","Female, STEM professional, Black or African American, Hispanic of any race, American Indian or Alaska Native","Professional, scientific, and technical services","United States",2013,http://www.iwpr.org/publications/pubs/accelerating-change-for-women-faculty-of-…,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Teenage school attendance and cash transfers: An impact evaluation of PANES","Amarante, V., Ferrando, M., & Vigorito, A. (2013). Teenage school attendance and cash transfers: An impact evaluation of PANES. Economia, 61-93.","Child Labor","Study Type: Descriptive Analysis",,"Child labor-Low-No impacts Child labor Education and skills gains-Low-No impacts Education and skills gains","Summary: This objective of this study was to examine the impact of a conditional cash transfer program, National Plan for Social Emergency Assistance (PANES), on child labor and school attendance for children 14-17 years old in Uruguay. The primary design was a regression discontinuity design (RDD) using households within a 2 percent range of the cutoff score. The authors also used a difference-in-differences (DID) approach. The study used administrative data collected before the launch of the program and household surveys implemented in two follow-up waves (at two months and 18 months after the program ended). The authors compared the differential effects of receiving the program on outcomes for those in the treatment group versus those in the comparison group. The study found no statistically significant relationships between the PANES program and child labor or schooling. The quality of causal evidence presented in this report under the DID design is low. The RDD does not receive a causal rating.","National Plan for Social Emergency Assistance (PANES)","Child labor","Other, Low income",,International,2013,https://www.researchgate.net/publication/265975653_Teenage_School_Attendance_an…,"Child Labor Review Protocol" "From the shop floor to the kitchen floor: Maternal occupational complexity and children’s reading and math skills","Yetis-Bayraktar, A., Budig, M., & Tomaskovic-Devey, D. (2013). From the shop floor to the kitchen floor: Maternal occupational complexity and children’s reading and math skills. Work and Occupations, 40(1), 37-64.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The authors sought to determine whether the complexity of a mother’s occupation (or the quality of employment as defined by its task complexity, autonomy, and authority) affected her 6- to 13-year-old children’s math and reading test scores. The study considered both the complexity of the mother’s occupation when her children were ages 6 to 13 as well as the complexity of her occupation in her children’s earliest years (birth to age 3). The authors analyzed data from the 1984–1996 Panel Study of Income Dynamics and its 1997 Child Development Supplement to determine the relationship between maternal occupational complexity and children’s scores on the Revised Woodcock-Johnson Test of Achievement. The analysis first accounted for traits associated with mothers’ employment status, that is, whether the mother was employed. Assuming the mother was employed, the authors then assessed the association between the complexity of the mother’s occupation and her children’s performance on the reading and math sections of the test. The study found that a one-point increase on the maternal white collar occupational complexity scale was associated with a 2.49-point increase in children’s test scores, whereas a one-point increase on the blue collar occupational complexity scale corresponded to a 1.01-point gain in test scores. Maternal occupational complexity during the child’s first three years also was associated with increased test scores later in life; a one-point gain in white collar occupational complexity in the first three years of the child’s life was associated with a 3.7-point increase in test scores when the child was ages 6 to 13.",,"Other employment and reemployment","Employed, Female, Parent",,"United States",2013,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Not lack of ability but more choice: Individual and gender differences in choice of careers in science, technology, engineering, and mathematics","Wang, M., Eccles, J., & Kenny, S. (2013). Not lack of ability but more choice: Individual and gender differences in choice of careers in science, technology, engineering, and mathematics. Psychological Science, 24(5), 770-775.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: This paper examined whether people with high math and verbal abilities were more likely to work in STEM occupations at the age of 33 compared with people with high math but only moderate verbal abilities. The authors also considered whether employment in STEM occupations varied by gender. The authors surveyed 1,490 people drawn from a national longitudinal study in the United States—once in 1992 when the respondents were in 12th grade and again in 2007 when the respondents were 33 years old—to ask about occupation type. They also collected math and verbal Scholastic Assessment Test (SAT) scores for these people, as well as the number of high school mathematics courses taken and parental reports of parental education and family income. The authors used regression analyses of longitudinal survey data and other descriptive statistical techniques. The study found that students’ high school math and verbal abilities predicted whether they worked in a STEM field at age 33. Of those with moderate verbal and high math abilities, 49 percent worked in a STEM job at age 33, whereas only 34 percent of those with both high verbal and math abilities worked in a STEM job. Though more women were in the high math and high verbal abilities group than men, the likelihood of someone with both high math and verbal abilities choosing to work in a STEM occupation did not vary by gender but did vary by the individual’s self-perception on abilities in math in 12th grade. The authors argued that people with high math and high verbal abilities could find a wider variety of jobs that fit their skill sets, which might explain why fewer of those in this group pursued STEM careers than those with high math but moderate verbal abilities.",,"Science, Technology, Engineering, and Math (STEM) programs","Female, Male, STEM professional",,"United States",2013,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "When trying hard isn’t natural: Women’s belonging with and motivation for male-dominated STEM fields as a function of effort expenditure concerns","Smith, J., Lewis, K., Hawthorne, L., & Hodges, S. (2013). When trying hard isn’t natural: Women’s belonging with and motivation for male-dominated STEM fields as a function of effort expenditure concerns. Personality & Social Psychology Bulletin, 39(2), 131-143. [Study 3]","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Attitudes-Low-Favorable impacts Attitudes","Summary: The study examined the effect of providing information about effort requirements to succeed in a fictitious male-dominated eco-psychology master’s program on female students’ attitudes toward their ability to succeed in this field. The authors randomly assigned 48 female undergraduates to receive one of four verbal messages from an advisor about their ability to succeed in a fictitious master’s program in eco-psychology; the women also received a printed brochure distributed to all study groups. The messages varied in terms of emphasis placed on students’ ability versus level of effort. Specifically, three of the message groups conveyed that student success depended on (1) their natural ability (natural ability group), (2) putting in more effort than peers (more effort group), or (3) putting in the same high level of effort as peers (normal effort group). The advisors did not discuss effort requirements with the fourth group that served as a control group (the no information group). Students then immediately completed a questionnaire measuring self-doubt, perceived confidence, future interest in eco-psychology, and how well they thought they would fit into the program. The study found that students in the normal effort group exhibited a significantly higher sense of academic belonging to and future interest in the eco-psychology program than the other three groups. They also had higher perceived competence compared with the more effort group and exhibited lower self-doubt than the no information and more effort groups. The quality of causal evidence presented in this report is low because the authors did not include sufficient controls in their analysis to account for differences between each group, which is required of randomized controlled trials (RCTs) with high attrition. This means we are not confident that the estimated effects are attributable to the type of message the study participants received; other factors are likely to have contributed.",,"Science, Technology, Engineering, and Math (STEM) programs","Female, STEM professional",,"United States",2013,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Motivational pathways to STEM career choices: Using expectancy–value perspective to understand individual and gender differences in STEM fields","Wang, M., & Degol, J. (2013). Motivational pathways to STEM career choices: Using expectancy–value perspective to understand individual and gender differences in STEM fields. Developmental Review, 33(4), 1-37","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: This paper was a literature review of research about gender differences in STEM education levels and careers in the United States, including any evidence available for specific cultural, biological, and psychological theories for gender differences in STEM. The authors summarized evidence from existing studies, organized around three main types of influences on decision making: psychological (perceived self-competence, goals, and interests); socialization (societal and cultural beliefs that shape an individual’s belief and value systems); and biological (hormonal and genetic factors). The authors found evidence of psychological influences on women’s participation in STEM careers, including women preferring more people-oriented jobs than STEM careers typically provide, and women leaving more intensive STEM careers after having children because of their work–family preferences. In terms of socialization influences, the authors found evidence of the importance of school factors, including teachers’ instructional practices, the structure of schools or classrooms, and teachers’ abilities to forge positive relationships with students, in influencing female students’ interest and abilities in STEM fields. In addition, the study highlighted evidence that values, belief systems, and family support can influence girls’ interest and success in STEM fields. The study noted that other studies have found biological differences in terms of hormone production and brain organization between men and women, but that these differences have not conclusively been linked to any behavior or ability levels in men and women.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Female, Male",,"United States",2013,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "An outcome evaluation of an adult education and postsecondary alignment program: The Accelerate New Mexico experience","Rivera, M., Davis, M., Feldman, A., & Rachkowski, C. (2013). An outcome evaluation of an adult education and postsecondary alignment program: The Accelerate New Mexico experience. Problems and Perspectives in Management, 11(4), 105-120.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Attitudes-Low-Favorable impacts Attitudes","Summary: The study’s objective was to examine the impact of the Accelerate New Mexico Math Camp on outcomes for community college students, including women and minority students traditionally underrepresented in STEM. The study used course-administered assessments to compare the math competency and attitudes about math of students before and after participation in the Accelerate summer program. The authors found that students (both male and female) who participated in the Accelerate program had higher math competency and less anxiety about math after completing the program, compared with their competency and anxiety measured before enrollment in the program. The quality of causal evidence presented in this report is low. This means we are not confident that the estimated effects are attributable to the Accelerate New Mexico Math Camp program; other factors are likely to have contributed.","the Accelerate New Mexico Math Camp","Science, Technology, Engineering, and Math (STEM) programs Community college education and other classroom training Youth programs","Youth, Other barriers, Female",,"United States",2013,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Can post-employment services combined with financial incentives improve employment retention for welfare recipients?","Dorsett, R., Hendra, R., Robins, P. K., & Williams, S. (2013). Can post-employment services combined with financial incentives improve employment retention for welfare recipients? Evidence from the Texas Employment Retention and Advancement evaluation. (No. 1413-13). Madison, WI: Institute for Research on Poverty.",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Texas Employment Retention and Advancement (ERA) program on employment entry and retention in two sites: Corpus Christi and Fort Worth. The authors conducted a non-experimental study using data originally collected for a randomized controlled trial. They analyzed survey data and state Unemployment Insurance records to estimate the effects of the ERA program on employment entry and retention. The study found a positive and statistically significant relationship between participation in the ERA program and the likelihood of transitioning into employment and between ERA and employment retention at the Corpus Christi site. The quality of causal evidence presented in this report is low because the authors did not account for differences in wages or employment between the ERA and comparison groups before the beginning of the ERA program. This means we are not confident that the estimated effects are attributable to the Texas ERA program; other factors are likely to have contributed.","Texas Employment Retention and Advancement (ERA)","Job search assistance and supportive services Other wages and benefits","Unemployed, Low income, Female",,"United States",2013,http://www.niesr.ac.uk/sites/default/files/publications/dp409_0.pdf,"Review Protocol" "Exploring women engineering faculty’s mentoring networks","Long, Z., Buzzanell, P., Kokini, K., Wilson, R., Batra, J., & Anderson, L. (2013). Exploring women engineering faculty’s mentoring networks. Proceedings of the 2013 American Society for Engineering Education Annual Conference & Exposition, Washington, DC.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study described how women in academic STEM positions (compared with corporate environments) constructed their own mentoring networks; it also explored the mentoring configurations female academics preferred as support for their careers. The authors conducted in-depth semistructured interviews with seven female engineering faculty at a single large Midwestern university, creating detailed maps of the faculty members’ mentoring networks and evaluating the nature, importance, and perceived value of each connection. The study found that the female faculty were generally dissatisfied with formal mentoring relationships and instead sought mentors on their own. Faculty selected these informal mentors from among those with whom they had an existing relationship, such as a friend or co-committee member. Mentees selected multiple mentors with mixed backgrounds and characteristics to serve different purposes (for example, discussing work-life balance or career advancement) and mentees typically had at least one mentor outside of the department or university to discuss more confidential matters. Findings were generally consistent with mentor relationships in a corporate setting.",,"Mentoring Science, Technology, Engineering, and Math (STEM) programs","Female, STEM professional",,"United States",2013,http://www.asee.org/public/conferences/20/papers/6463/download,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "When trying hard isn’t natural: Women’s belonging with and motivation for male-dominated STEM fields as a function of effort expenditure concerns","Smith, J., Lewis, K., Hawthorne, L., & Hodges, S. (2013). When trying hard isn’t natural: Women’s belonging with and motivation for male-dominated STEM fields as a function of effort expenditure concerns. Personality & Social Psychology Bulletin, 39(2), 131-143. [Study 2]","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Attitudes-Low-Unfavorable impacts Attitudes","Summary: The study’s objective was to examine the impact of male-dominated marketing of a fictitious eco-psychology program on female students’ interest in pursuing the program. Authors randomly assigned 49 female students in an introductory psychology course to receive a brochure about a fictitious one-year master’s program in eco-psychology that was presented as either male-dominated or gender-neutral. Students were then asked to rate their motivation to enroll in the program. The study found that female students who read the male-dominated brochure displayed statistically significantly lower interest in pursuing the program than those in the gender-neutral group. The quality of causal evidence presented in this report is low because the authors did not include sufficient controls in their analysis to account for differences between the treatment and comparison groups. This means we are not confident that the estimated effects are attributable to type of brochure reviewed; other factors are likely to have contributed.",,"Science, Technology, Engineering, and Math (STEM) programs","Female, STEM professional",,"United States",2013,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Does Pantawid foster dependence or encourage work? Evidence from a randomized experiment","Orbeta, A., & Paqueo, V. (2013). Does Pantawid foster dependence or encourage work? Evidence from a randomized experiment. Philippine institute for Development Studies. Retrieved from http://nap.psa.gov.ph/ncs/12thncs/papers/INVITED/IPS-09%20Social%20Protection%20Statistics/IPS-09_2%20Impact_of_4Ps_on_Labor_Market_Outcomes%20AO-VP-new.pdf  ","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-No impacts Child labor","Summary: The study’s objective was to examine the impact of a conditional cash transfer program, called Pantawid Pamilya Pilipino Program (Pantawid) on child work participation and hours children worked per week. Using household survey data from a randomized controlled trial, the authors analyzed the impact of the Pantawid program on child work participation almost 24-months after implementation. The study found that there were no significant relationships between participation in the program and child work participation or hours worked per week. The quality of causal evidence presented in this report is low because it based on a randomized controlled trial with unknown attrition and the authors did not control for pre-existing differences. This means we are not confident that the estimated effects are attributable to Pantawid; other factors are likely to have contributed. However, the study did not find statistically significant effects.","Pantawid Pamilya Pilipino Program","Child labor","Other, Low income",,International,2013,http://nap.psa.gov.ph/ncs/12thncs/papers/INVITED/IPS-09%20Social%20Protection%2…,"Child Labor Review Protocol" "STEM faculty and parental leave: Understanding an institution’s policy within a national policy context through structuration theory","Schimpf, C., Santiago, M., Hoegh, J., Banerjee, D., & Pawley, A. (2013). STEM faculty and parental leave: Understanding an institution’s policy within a national policy context through structuration theory. International Journal of Gender, Science and Technology, 5(2), 103-125.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: This study summarized the role of various factors, both within and outside a university, in shaping use of the university’s parental leave policy. The authors conducted semistructured interviews in 2009–2010 with 10 science, technology, engineering and math (STEM) faculty members (7 women and 3 men) at a Midwestern university. The interviews aimed to study the barriers STEM faculty face in using the university’s parental leave policy. The authors analyzed these data using a variety of qualitative coding techniques. The study found that faculty under-used the university’s parental leave policy for several reasons. First, the opinions of their department chairs and their peers often shaped faculty’s willingness to take parental leave. If faculty felt that their department heads, fellow faculty members, laboratory personnel, and students were supportive of parental leave policies, they were more willing to participate, because they felt less pressure to maintain their typical teaching and research workload after having a child. Additionally, the authors suggested that both knowledge of the parental leave policy and understanding of what was covered, among both the faculty themselves and their supervisors and administrators, was important to ensure that the policy was applied correctly in each specific case. The study also noted that faculty saw limitations in the university’s policy because it did not cover professional obligations outside the school, including writing and revising journal articles or managing externally funded laboratory experiments.",,"Other employer services Science, Technology, Engineering, and Math (STEM) programs","STEM professional, Parent",,"United States",2013,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Gender equity issues in CTE and STEM education","Toglia, T. (2013). Gender equity issues in CTE and STEM education. TechDirections, 72, 14-18.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: This article summarized current gender equity issues in career and technical education (CTE) as well as in STEM fields for high school and college students. Using findings from various other published studies, the author discussed the progression of the Carl D. Perkins Act of 1984, which required states to employ a sex equity coordinator to mitigate gender bias and stereotypes, over the past three decades, and how it has affected women’s involvement in nontraditional careers, such as electrical work and plumbing. The study also briefly summarized other gender equity trends in CTE and STEM fields, including why women choose to not work in CTE and STEM fields and how gender disparities in various industries can be detrimental to society at large. The author found that the Perkins Act and its various reauthorizations had aimed to improve female participation in nontraditional career fields, but lack of funds limited the legislation’s influence. The author also identified additional factors influencing women’s career choices—including gender-role socialization, socioeconomic status, parents’ education level and expectations for their daughters, and advice from guidance counselors—as perpetuating gender disparities in these fields. The author concluded that gender disparities in STEM and CTE careers can lead to an underdevelopment of human resources and capital at the societal level. The study concluded with a list of suggested strategies to counter existing gender inequities in CTE and STEM, including offering mentoring programs to provide female students with role models in CTE fields, removing gender-biased images or messaging from textbooks and other educational materials, increasing parental education on nontraditional career options for women, and training guidance counselors to address gender equity issues.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Female, Male",,"United States",2013,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Do stronger age discrimination laws make Social Security reforms more effective?","Neumark, D., & Song, J. (2013). Do stronger age discrimination laws make Social Security reforms more effective? Journal of Public Economics, 108, 1-16.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Mixed impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study examined whether the strength of state age discrimination protections affected rates of Social Security benefit claiming and employment outcomes of older workers. The study used a nonexperimental design and the data on Social Security claiming and employment outcomes from the Health and Retirement Study (HRS) to estimate the impacts. The study found that among older men affected by the 1983 Social Security reform, age discrimination protections were associated with increases in employment rates between age 62 and the full retirement age and delayed benefit claiming. The quality of casual evidence presented in this report is moderate because the study was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to state age discrimination laws, but other factors might also have contributed.","The 1983 Social Security Reform","Older workers' programs Other disparities or discrimination in employment and earnings","Adult, Older worker, Male",,"United States",2013,https://ideas.repec.org/a/eee/pubeco/v108y2013icp1-16.html,"Employment and Training Review Protocol" "Perfectionism moderates stereotype threat effects on STEM majors’ academic performance","Rice, K., Lopez, F., Richardson, C., & Stinson, J. (2013). Perfectionism moderates stereotype threat effects on STEM majors’ academic performance. Journal of Counseling Psychology, 60(2), 287-293.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of “stereotype threat priming” on students’ grades in postsecondary science, technology, engineering, and mathematics (STEM) courses and on self-reported feelings of self-efficacy in science. The authors argued that women and racial minorities perform worse in certain fields, such as STEM, when they feel threatened by stereotypes implying that their gender or race makes them inferior to their male or white peers. For this study, the authors primed treatment students to think about their gender, race, and ethnicity before completing a survey to measure self-efficacy in science. This priming was intended to make feelings of stereotype threat more acute. The study randomly assigned students majoring in a STEM field to either the treatment group, which received stereotype threat priming before taking the survey, or the control group, which took the same survey but did not receive stereotype threat priming. The authors collected data from an author-generated online survey on feelings of self-efficacy and from academic records for course grades. The study found that the stereotype threat priming had no significant effects by gender when comparing outcomes for the treatment and control groups. The quality of causal evidence presented in this report is low because this is a randomized controlled trial with unknown attrition, and the authors did not control for background characteristics likely to affect the outcomes of interest. This means we are not confident that the estimated effects would have been attributable to stereotype threat priming; other factors are likely to have contributed.","the Evaluation of Stereotype Threat Priming","Science, Technology, Engineering, and Math (STEM) programs Other disparities or discrimination in employment and earnings","Other barriers, Female, STEM professional",,"United States",2013,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Impact evaluation: Combating worst forms of child labor by reinforcing policy response and promoting sustainable livelihoods and educational opportunities in Egypt, 2011-2012","ICF International. (2013). Impact evaluation: Combating worst forms of child labor by reinforcing policy response and promoting sustainable livelihoods and educational opportunities in Egypt, 2011-2012. Calverton, MD: Author.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The purpose of the study was to examine the impact of Combating Worst Forms of Child Labor by Reinforcing Policy Response and Promoting Sustainable Livelihoods and Educational Opportunities in Egypt (CWCLP) on schooling and work for children ages 6 to 11 (at the time of the baseline survey). Using survey data from a randomized controlled trial, the authors analyzed the impact of the CWCLP program on schooling and work after approximately 12-16 months of implementation (the timing of implementation varied). When compared to control group children, the study found that CWCLP participating children spent significantly less time in economic activities and unpaid household services and significantly more time in school-related activities. Participating children also had significantly higher school enrollment and significantly higher school attendance than children in the control group. The quality of causal evidence presented in this report is moderate because, although it was based on a randomized controlled trial with high attrition, the authors demonstrated that the treatment and control groups were similar before the intervention. This means we are somewhat confident that the estimated effects are attributable to the CWCLP program, but other factors might also have contributed.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2013,,"Child Labor Review Protocol" "Returning to work after prison: Final results from the Transitional Jobs Reentry Demonstration","Jacobs, E. (2012). Returning to work after prison: Final results from the Transitional Jobs Reentry Demonstration. New York: MDRC.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Transitional Jobs Reentry Demonstration (TJRD) on ex-offenders’ employment and wages. The author used a randomized controlled trial to assign former prisoners to the transitional jobs program or to a group that was offered job search assistance and compared the two groups’ employment and earnings outcomes two years after random assignment, controlling for participants’ characteristics before random assignment. The study found that members of the transitional jobs group were significantly more likely (by 29 percentage points) than control group members to be employed at any point during the two years after random assignment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the TJRD, and not to other factors.","the Transitional Jobs Reentry Demonstration (TJRD)","Job search assistance and supportive services Other employment and reemployment Reentry","Justice-involved, Unemployed, Male",,"United States",2012,http://www.mdrc.org/sites/default/files/full_626.pdf,"Employment and Training Review Protocol" "Inspiring girls and their female after school educators to pursue computer science and other STEM careers","Koch, M., & Gorges, T. (2012). Inspiring girls and their female after school educators to pursue computer science and other STEM careers. International Journal of Gender, Science and Technology, 4(3), 294-312.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Attitudes-Low-No impacts Attitudes","Summary: The study’s objective was to examine the impact of facilitating Build IT, an extracurricular information technology (IT) program for middle-school girls, on the facilitators’ interest in STEM education and careers. The authors also described outcomes for girls who participated in the facilitator-led program. The study relied on a survey administered to 31 program facilitators after they had been involved with the program for one year. The study found no statistically significant relationships between facilitating Build IT and interest in STEM education and careers. The quality of causal evidence presented in this report is low because the authors did not use a research design that supported causal inference or control for factors other than Build IT that could contribute to the observed outcomes.","Build IT","Science, Technology, Engineering, and Math (STEM) programs Youth programs","Youth, Other barriers, Female",,"United States",2012,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "The role of parents and teachers in the development of gender-related math attitudes","Gunderson, E., Ramirez, G., Levine, S., & Beilock, S. (2012). The role of parents and teachers in the development of gender-related math attitudes. Sex Roles, 66, 153-166.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study’s objective was to summarize existing literature and identify future areas for research related to the relationship between parents’ and teachers’ gender stereotypes in math and children’s mathematics performance and self-concept. The authors summarized the findings of recent studies that examined parents’, teachers’, and students’ math gender stereotypes, focusing on impressions of success—whether boys or girls had above-average ability in math or were likely to succeed in math—as well as reasons for that success, particularly natural ability and effort. The authors suggested three new directions for future research on this topic based on their review of the literature. First, research could investigate the links among parents’ and teachers’ math anxiety, self-efficacy, and teaching self-efficacy and their children’s or students’ attitudes. A second direction involved transmission of gender differences in theories of math intelligence—that is, whether mathematical ability is fixed or can improve through effort. Finally, research has shown that children identify with math gender stereotypes from a young age, but does not yet suggest a mechanism through which children acquire these stereotypes.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Female, Male",,"United States",2012,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Success of joint programs between junior and senior colleges","Krudysz, M., Walser, A., & Alting, A. (2012). Success of joint programs between junior and senior colleges. American Society for Engineering Education.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Joint/Dual (JD) program on retention and graduation rates for community college and undergraduate engineering students who were under-represented minorities and women. JD students received dual admission to a community college as well as a senior college, and transitioned into the upper division of the baccalaureate engineering program at the senior college upon successful completion of lower-division courses and degree requirements at the community college. This study used data from junior and senior colleges within a major urban university system to compare outcomes of a treatment group of JD program participants and a comparison group of transfers into the urban university system from other, nonparticipating community colleges. This study found that first- and second-year retention rates were higher for JD program participants than for transfers from other community colleges, but did not conduct statistical tests of these differences. The quality of causal evidence presented in this report is low because the authors did not include controls for relevant student characteristics in the analysis. This means we are not confident that the estimated effects are attributable to the JD program. Other factors are likely to have contributed.","the Joint/Dual Program","Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Female, Other",,"Urban, United States",2012,https://www.asee.org/public/conferences/8/papers/3558/download,"Community College Review Protocol" "The effects of hands-on activities on middle school females’ spatial skills and interest in engineering and technology-based careers","Phelps, M. (2012). The effects of hands-on activities on middle school females’ spatial skills and interest in engineering and technology-based careers. Proceedings of the 2012 American Society for Engineering Education Annual Conference & Exposition. Washington, DC: American Society for Engineering Education.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Attitudes-Low-Favorable impacts Attitudes","Summary: The study’s objective was to examine the impact of participating in technology-based three-dimensional hands-on activities on middle school girls’ interest in becoming an engineer or technologist. The activities took place at a 2006 Society of Women Engineers-sponsored event and included designing and constructing a vehicle and assembling an electrical circuit. The author conducted statistical analyses to compare self-reported career interests of girls who participated in the hands-on activities and those who did not, as measured by a program-administered survey. The study found that participation in the hands-on activities was positively related to increased interest in becoming an engineer or technologist. The quality of causal evidence presented in this report is low. This means we are not confident that the estimated effects are attributable to the hands-on activities; other factors are likely to have contributed.","the Intervention","Science, Technology, Engineering, and Math (STEM) programs Youth programs","Youth, Female","Professional, scientific, and technical services","United States",2012,https://peer.asee.org/the-effects-of-hands-on-activities-on-middle-school-femal…,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Engineering students' beliefs about research: Sex differences, personality, and career plans","Woodcock, A., Graziano, W., Branch, S., Ngambeki, I., & Evangelou, D. (2012). Engineering students' beliefs about research: Sex differences, personality, and career plans. Journal of Engineering Education, 101 (3), 495-511.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The authors explored the relationships among male and female engineering major undergraduates’ perceptions of research and researchers, their intellectual orientation toward people versus objects, and their interest in pursuing engineering research careers. The authors administered an online study to second-year or higher undergraduate students in the engineering, life sciences, and psychology departments of a large research university in the midwestern United States. They used regression analysis to identify beliefs and personality traits that predict interest in engineering research careers for male and female students. The study found that having a “Thing Orientation”—a predisposition to focus on objects and their manipulation instead of a tendency to notice and identify with others’ emotions—significantly predicts research interest and has a greater association with research interest among female engineering students than among their male classmates. The authors also sought to discover the pathway through which Thing Orientation promotes interest in a research career by identifying associations between Thing Orientation and beliefs about research. For the female students in this sample, Thing Orientation was positively associated with the beliefs that research is innovative and transformative, requires repetitive lab work, and calls for creativity and collaboration. In turn, these beliefs affect female engineering students’ interest in research careers; the belief that research is innovative and transformative is positively associated with interest in a research career.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Female, Male",,"United States",2012,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Cash transfers and children's education and labour among Malawi's poor","Miller, C., & Tsoka, M. (2012). Cash transfers and children's education and labour among Malawi's poor. Development Policy Review, 30(4), 499-522. doi:10.1111/j.1467-7679.2012.00586.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The purpose of the study was to assess the effects of an unconditional cash transfer program, the Malawi Social Cash Transfer Scheme (SCTS), on child school participation and child labor. To assess the program’s effects, the authors used a randomized controlled trial in which villages were randomly assigned to the treatment group, which would receive the intervention, and the control group, which would not. Child labor was assessed using household surveys, and schooling outcomes were assessed using household surveys and school records. To understand the program’s impact on child school and work participation, the authors compared change in these outcomes over the first year of the program. The study found that children participating in the intervention had significantly greater decreases in school absences over one year, relative to the comparison group. In addition, over one year there was a significantly lower increase in the percent of both boys and girls who worked for income if they were in the intervention group rather than the comparison group. The quality of causal evidence presented in this study is moderate because, although it was based on a randomized controlled trial with high attrition, the treatment and control groups were similar before the intervention. This means we are somewhat confident that the estimated effects are attributable to the Malawi Social Cash Transfer Scheme, but other factors might also have contributed.","Malawi Social Cash Transfer Scheme","Child labor","Other barriers, Other, Low income",,International,2012,http://interactions.eldis.org/sites/interactions.eldis.org/files/database_sp/Ma…,"Child Labor Review Protocol" "Gender and career outcomes of U.S. engineers","Frehill, L. (2012). Gender and career outcomes of U.S. engineers. International Journal of Gender, Science and Technology, 4(2), 149-166.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: This study addressed two research questions concerning the retention rates of engineers in the United States: whether more women leave the engineering field because of family-related concerns than men and whether more women than men move into managerial work. The author analyzed data from the National Science Foundation’s public use Science and Engineering Statistical Data System (SESTAT) for 2006. SESTAT includes three surveys: the National Survey of College Graduates, the National Survey of Recent College Graduates, and the Survey of Doctorate Recipients. The study sample was 17,004 people. The study found that the retention rate for women in the engineering field was 70 percent, compared with 86 percent retention for men, and more women cited family-related issues as a reason for departure than did men. However, family-related issues were not the main reason for leaving the engineering field for either gender—female respondents noted a change in career or professional interests as their main reason for departure, whereas a lack of pay or promotion opportunities were the main reasons cited by men. The study also found that women engineers were less likely to currently hold management positions compared with male respondents. For example, 49 percent of male respondents indicated that they supervised employees in their current position, compared with 33 percent of female respondents.",,"Science, Technology, Engineering, and Math (STEM) programs Other disparities or discrimination in employment and earnings","Female, Male, STEM professional",,"United States",2012,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "A study of the impact of a first-year experience initiative on first-year developmental education student success and persistence","Spencer, K. (2012). A study of the impact of a first-year experience initiative on first-year developmental education student success and persistence (Doctoral dissertation). Retrieved from ProQuest Dissertations and Theses database. (UMI No. 3542047)","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Achieving the Dream learning community program on students’ retention and completion of developmental English and math courses at a community college in Michigan. The study used students’ records to compare outcomes of developmental education students who enrolled in the Achieving the Dream program to outcomes of those who took standard developmental courses. The study found no significant differences between the treatment and comparison groups in retention rates or in completion of English or math developmental courses. The quality of causal evidence presented in this study is low because the author did not include sufficient controls in the analysis. This means we are not confident that the estimated effects are attributable to Achieving the Dream. Other factors are likely to have contributed.","Achieving the Dream","Community college education and other classroom training","Adult, Low income, Other",,"United States",2012,,"Community College Review Protocol" "From protection to production: Productive impacts of the Malawi Social Cash Transfer scheme","Covarrubias, K., Davis, B. & Winters, P. (2012). From protection to production: Productive impacts of the Malawi Social Cash Transfer scheme, Journal of Development Effectiveness, 4(1), 50-77.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to assess the impact of the Malawi Social Cash Transfer Scheme (SCTS) on household work activities, including child labor. The study used household survey data from a randomized controlled trial. Due to pre-existing baseline differences between the original treatment and control groups, the authors used a matched comparison group design to compare child schooling and labor outcomes between children in the treatment group and those in the control group. The study found that the SCTS program significantly decreased the proportion of children in paid domestic work outside of the household and the proportion of children pulled from school to work for food or money. The quality of causal evidence presented in this report is moderate because there was compromised randomization but the authors ensured that the groups being compared were similar before the intervention. This means we are somewhat confident that the estimated effects are attributable to the Malawi Social Cash Transfer Scheme (SCTS); however, other factors might have also contributed.","Malawi Social Cash Transfer Scheme","Child labor","Other, Low income",,International,2012,http://www.fao.org/fileadmin/user_upload/p2p/Publications/MalawiSCT_ProductiveI…,"Child Labor Review Protocol" "Affirmative action and the occupational advancement of minorities and women during 1973-2003","Kurtulus, F. (2012). Affirmative action and the occupational advancement of minorities and women during 1973-2003. Industrial Relations, 52(2), 213-246.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the effect of affirmative action requirements for federal contractors on the occupational employment shares of minorities and women at federal contractors and noncontractors from 1973 to 2003. The author used a nonexperimental design to examine establishments’ employment share of race, ethnicity, and gender groups in seven occupational categories over time using data from annual EEO-1 Employer Information Report files. The study found that, among firms that became federal contractors from 1973 to 2003, the share of Hispanic women, white women, African American women, and African American men significantly increased in some skilled occupational categories compared with firms that did not become federal contractors in that period. The study also found that the share of African American men and women increased significantly in manual jobs at federal contractor firms, compared with nonfederal contractor firms in that period. The quality of causal evidence presented in this report is moderate because it was based on a strong non-experimental design. This means we are somewhat confident that the estimated effects are attributable to affirmative action requirements for federal contractors, but other factors might also have contributed.","Affirmative Action Legislation","Affirmative action Executive Order 11246 (E.O. 11246) Civil Rights Act of 1964",Other,,"United States",2012,,"Employer Compliance Review Protocol" "Educational and child labour impacts of two food-for-education schemes: Evidence from a randomised trial in rural Burkina Faso","Kazianga, H., De Walque, D., & Alderman, H. (2012). Educational and child labour impacts of two food-for-education schemes: Evidence from a randomised trial in rural Burkina Faso. Journal of African Economies, 21(5), 723-760. doi:10.1093/jae/ejs010.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Compliance-Mod/high-Unfavorable impacts Compliance Education and skills gains-Mod/high-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of two food-for-education programs (a school meals program and a take home rations program) on education and labor outcomes for children. This summary focuses on the comparison between the school meals treatment group and the control group. The study was a randomized controlled trial (RCT) conducted in low-income villages in northern rural Burkina Faso, West Africa. Villages were randomly assigned to one of two treatment groups or a control group. Survey data were collected from randomly selected households located close to the schools in the villages. Outcomes were analyzed using difference-in-differences models. The study found that the school meals program significantly increased all labor (productive labor plus domestic labor/household chores) for boys enrolled at the time of survey. However, the study also found that the school meals program significantly increased school enrollment for all children. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the school meals program, and not to other factors.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2012,https://doi.org/10.1093/jae/ejs010,"Child Labor Review Protocol" "Increasing opportunities for low-income women and student parents in science, technology, engineering, and math at community colleges","Costello, C. (2012). Increasing opportunities for low-income women and student parents in science, technology, engineering, and math at community colleges. Washington, DC: Institute for Women’s Policy Research.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: This study examined the enrollment patterns for low-income women and students with children (including mostly mothers and some fathers, collectively referred to as student parents) in STEM fields at community colleges in the United States, comparing outcomes for 2000–2001 to 2008–2009. In addition, the study presented examples of promising strategies to encourage low-income women and student parents to participate in STEM education at community colleges. To assess the involvement of low-income women and student parents in STEM fields at community colleges, the author analyzed publicly available data, including data from the U.S. Department of Labor and the National Center for Education Statistics at the U.S. Department of Education. The author also completed a review of existing programs at community colleges that encourage low-income women and student parents to participate in STEM fields, and consulted with 16 experts to formulate suggestions for additional programs to support these students in STEM fields. The study found that in the 2008–2009 school year, women earned 22 percent of associate’s degrees awarded in STEM fields—a 7 percentage point reduction in the proportion of STEM associate degrees earned by women eight years earlier. The study also found that, in 2008, roughly one-third of community college students were parents and student parents with children younger than 12 who ultimately earned a baccalaureate or master’s degree in a STEM field were more likely to have attended a community college at some point than students without young children. Given the decline in women’s share of STEM associate degrees earned over the study observation period, as well as the high proportion of student parents in STEM fields who attend community colleges (compared with students without young children), the author highlighted potential strategies to increase and improve the involvement of low-income women and student parents in STEM fields at community colleges, including targeted recruitment, financial support, child care services, strong developmental education options, and specific counseling and academic support for women. These recommendations were informed by information gathered from existing programs and consultation with experts.",,"Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Female, Male, Parent, Low income",,"United States",2012,http://www.iwpr.org/initiatives/student-parent-success-initiative/increasing-op…,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Educational and child labour impacts of two food-for-education schemes: Evidence from a randomised trial in rural Burkina Faso","Kazianga, H., De Walque, D., & Alderman, H. (2012). Educational and child labour impacts of two food-for-education schemes: Evidence from a randomised trial in rural Burkina Faso. Journal of African Economies, 21(5), 723-760. doi:10.1093/jae/ejs010.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor Education and skills gains-Mod/high-Mixed impacts Education and skills gains","Summary: The study’s objective was to examine the impact of two food-for-education programs (a school meals program and a take home rations program) on education and labor outcomes for children. This summary focuses on the comparison between the take home rations treatment group and the control group. The study was a randomized controlled trial (RCT) conducted in low-income villages in northern rural Burkina Faso, West Africa. Villages were randomly assigned to one of two treatment groups or a control group. Survey data were collected from randomly selected households located close to the schools in the villages. Outcomes were analyzed using difference-in-differences models. The study found that the take home rations program significantly decreased productive labor for all children, with a larger decrease for girls than boys. For children enrolled in school at the time of the survey, the program significantly decreased productive labor for all children. The study also found that the take home rations program significantly increased school enrollment for all children. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the take home rations program, and not to other factors.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2012,https://doi.org/10.1093/jae/ejs010,"Child Labor Review Protocol" "Women in industrial engineering: Stereotypes, persistence, and perspectives","Brawner, C., & Camacho, M. (2012). Women in industrial engineering: Stereotypes, persistence, and perspectives. Journal of Engineering Education, 101(2), 288-318.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: This study explored why more women major in industrial engineering in college than other engineering fields. The authors tabulated quantitative data from eight colleges and universities in the southeastern region of the United States using data from the Multiple-Institution Database for Investigating Engineering Longitudinal Development (MIDFIELD). They also conducted focus groups with 20 female industrial engineering students and qualitatively analyzed the content of industrial engineering department websites at the eight MIDFIELD institutions. The study found that students transferred into an industrial engineering major program after taking several semesters of coursework in another field at the university. It found no evidence that women with weak academic records were more likely to choose industrial engineering over other engineering majors. Focus group participants felt that their department had a warm, familial atmosphere, and that the major provided a more general background in engineering, which could offer them more flexible job opportunities in a variety of related fields. This was consistent with departmental websites, which marketed themselves as having a strong sense of community and collegiality, and stressed the wide range of career opportunities available to their graduates as problem solvers for society and industry.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Female",,"United States",2012,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Are conditional cash transfers effective in urban areas? Evidence from Mexico","Behrman, J. R., Gallardo-Garcıa, J., Parker, S. W., Todd, P. E., & Velez-Grajales, V. (2012). Are conditional cash transfers effective in urban areas? Evidence from Mexico. Education Economics, 20(3), 233-259.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of Mexico’s conditional cash transfer program (PROGRESA/Oportunidades) on school enrollment and employment in paid activities for children ages 6 to 18 in urban areas. The study used a nonexperimental design to evaluate schooling and work outcomes from PROGRESA/Oportunidades program 1 and 2 years after implementation in urban areas. The study found that PROGRESA/Oportunidades was significantly related to reduced labor rates for boys who were 12-14 in the first and second year, and girls ages 15 to 18 in the first year. The program was also significantly related to an increase in school enrollment for boys and girls. The quality of causal evidence presented in this study is low because the authors did not ensure that the groups were similar before program participation. This means we are not confident that the estimated effects are attributable to PROGRESA/Oportunidades; other factors are likely to have contributed.",PROGRESA/Oportunidades,"Child labor","Other, Low income",,"International, Urban",2012,,"Child Labor Review Protocol" "Women, men, and academic performance in science and engineering: The gender difference in undergraduate grade point averages","Sonnert, G., & Fox, M. (2012). Women, men, and academic performance in science and engineering: The gender difference in undergraduate grade point averages. Journal of Higher Education, 83(1), 73-101.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study tested a hypothesis that women have higher undergraduate grade point averages (GPAs) than their male peers (referred to as a GPA advantage), and that the difference is most pronounced in STEM fields with fewer female students and fewer female faculty members. In addition, the authors tested a second hypothesis that women’s GPA advantage was driven by institution type, with larger advantages existing at institutions offering specific programs supporting women in science and engineering, compared with institutions without such programs. The authors used data from the Integrated Postsecondary Data System and from a survey of 499 university and college registrars in the United States to examine the academic performance of undergraduate students in biology, the physical sciences, and engineering from 1984 to 2000. They used regression models to compare the GPAs of male and female students over time both across and within the three fields, controlling for the percentage of female majors, degree recipients, and faculty within each field at each institution in a given year. The study found that women’s GPAs across the three fields were, on average, 0.1 points (on a 4.0-point scale) higher than men’s during the study period. The study also found that in the physical sciences field, the percentage of female degree recipients was significantly associated with women’s GPA advantage—when more women earned degrees in physical sciences, the GPA advantaged diminished; however, this finding did not hold in the biology or engineering fields. The study found that the strongest predictor of women’s GPA advantage across fields was the type of institution, with a larger advantage occurring at nonresearch institutions compared with research institutions. In addition, the study found that at nonresearch institutions with programs specifically supporting women in science and engineering, women’s GPA advantage was even larger.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Female, Male",,"United States",2012,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "The more things change, the more they stay the same? Prior achievement fails to explain gender inequality in entry into STEM college majors over time","Riegle-Crumb, C., King, B., Grodsky, E., & Muller, C. (2012). The more things change, the more they stay the same? Prior achievement fails to explain gender inequality in entry into STEM college majors over time. American Educational Research Journal, 49(6), 1048-1073.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study explored whether U.S. students’ prior achievement in math and science contributed to higher enrollment rates for men versus women in physical science and engineering degree programs in the 1980s, 1990s, and 2000s. The authors analyzed data from the High School and Beyond Study (1980s), the National Education Longitudinal Study (1990s), and the Educational Longitudinal Study (2000s) to determine whether gender was correlated with college major choice, after controlling for three different measures of prior academic achievement. The study found that female students were approximately 20 percentage points less likely to declare a science, technology, engineering, and mathematics (STEM) major than male students. However, prior achievement in math and science, as measured by GPA, average standardized test scores, and position along the test score distribution, did very little to explain this gender gap. The study found that girls’ higher performance in English versus math and science only somewhat accounted for the gender gap in college major choice. Factors such as ethnicity and socioeconomic status were more influential.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Female",,"United States",2012,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Transformative graduate education programs: An analysis of impact on STEM and non-STEM Ph.D. completion","Kniola, D., Chang, M., & Olsen, D. (2012). Transformative graduate education programs: An analysis of impact on STEM and non-STEM Ph.D. completion. Higher Education, 63(4), 473–495. doi:10.1007/s10734-011-9453-8","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to determine whether universities participating in Transformative Graduate Education Programs (TGPs) conferred a greater number of science, technology, engineering, and mathematics (STEM) doctoral degrees, particularly to women and underrepresented candidates of color. The study also examined whether TGPs resulted in a greater number of non-STEM doctoral degrees, but that is not the focus of this review. The authors analyzed data from the Integrated Postsecondary Education Data System to estimate the impact of a university’s participation in one of seven TGPs during the 2003–2005 period, controlling for institutional characteristics. The study found that TGPs were associated with a higher number of doctoral degrees awarded in STEM fields to women across all institutions. The quality of causal evidence presented in this report is low. This means we are not confident that the estimated effects are attributable to universities’ participation in TGPs. Other factors are likely to have contributed.","Transformative Graduate Education Programs (TGPs)","Science, Technology, Engineering, and Math (STEM) programs","Other barriers, Female, STEM professional",,"United States",2012,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Effect of the Mchinji Social Cash Transfer Pilot Scheme on children's schooling, work and health outcomes: A multilevel study using experimental data","Luseno, W. K. (2012). Effect of the Mchinji Social Cash Transfer Pilot Scheme on children's schooling, work and health outcomes: A multilevel study using experimental data (Doctoral dissertation). University of North Carolina at Chapel Hill, Chapel Hill, North Carolina. Retrieved from ProQuest Dissertations & Theses A&I (Accession No. 1240627043).","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Mixed impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The objective of the study was to examine the impact of the Mchinji Social Cash Transfer Pilot Scheme (SCTPS) on child labor and school outcomes.  The study was a randomized controlled trial conducted in the Mchinji district of Malawi. Within the district, eight villages were randomly assigned to either the treatment or control groups. Using survey data, the author compared the child labor and school outcomes of children ages 6-17 in households that received the cash transfer with those that did not receive the cash transfer. The study found that when compared to the control group, children in the Mchinji SCTPS program had significantly: 1) increased school enrollment; 2) fewer school absences; and 3) worked fewer hours outside of the home. An unexpected finding was that children participating in the Mchinji SCTPS also had significantly higher rates of domestic work when compared to children in the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Mchinji Social Cash Transfer Pilot Scheme and not to other factors.","Mchinji Social Cash Transfer Pilot Scheme (SCTPS)","Child labor","Other barriers, Other, Low income",,International,2012,https://cdr.lib.unc.edu/indexablecontent/uuid:7052544c-df44-46b5-aa01-500991b72…,"Child Labor Review Protocol" "Expanding Your Horizons: The impact of a one-day STEM conference on middle school girls’ and parents’ attitude toward STEM careers","Massi, L., Reilly, C., Johnson, D., & Castner, L. (2012). Expanding Your Horizons: The impact of a one-day STEM conference on middle school girls’ and parents’ attitude toward STEM careers. Proceedings of the 2012 American Society for Engineering Education Annual Conference & Exposition. Washington, DC: American Society for Engineering Education.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Attitudes-Low-No impacts Attitudes","Summary: The study’s objective was to estimate the effects of a one-day annual conference on middle school girls’ (grades 6–8) and their parents’ interest in and knowledge of science, technology, engineering, and mathematics (STEM). The goal of the conference, which was held at a large metropolitan, public university in central Florida, was to encourage young girls to consider STEM careers. The authors administered a single questionnaire to conference attendees that asked about attendees’ knowledge of and interest in STEM before and after the conference. The survey was included in backpacks distributed at the beginning of the day, and participants were reminded to complete it at the end of the day. Of the 214 middle school girls and 103 parent attendees, 80 percent of the girls and 37 percent of the parents turned in a completed survey. The authors did not conduct any statistical tests to measure changes in knowledge of and interest in STEM before and after participating in the conference. The quality of causal evidence presented in this report is low because the authors measured pre-intervention knowledge of and interest in STEM after participation in the intervention, which may be subject to recall bias. This means we are not confident that any estimated effects would be attributable to the Expanding Your Horizons (EYH) conference, but other factors are likely to have contributed. Further, the authors did not conduct statistical analysis to measure whether observed changes in outcomes were actually significant.","the Expanding Your Horizons (EYH) Conference","Science, Technology, Engineering, and Math (STEM) programs Youth programs","Youth, Female",,"United States",2012,https://www.asee.org/public/conferences/8/papers/3204/download,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Exploring bias in math teachers’ perceptions of students’ ability by gender and race/ethnicity","Riegle-Crumb, C., & Humphries, M. (2012). Exploring bias in math teachers’ perceptions of students’ ability by gender and race/ethnicity. Gender & Society, 26(2), 290-322.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: This study aimed to inform the literature on gender stereotypes in classrooms by studying whether teachers displayed bias by underestimating the ability of 10th-grade female and minority students in high school math classes, even after taking into account students’ grades and test scores. The study analyzed survey data from students and teachers across the United States who were part of the Educational Longitudinal Study of 2002, which followed 15,000 10th-grade students through college and into the labor force. The authors estimated multinomial logistic regression models to determine whether teachers were more likely to underestimate the academic ability of female, black, and Hispanic students compared to white male students, controlling for grade point average (GPA), test scores, and student, teacher, and school characteristics. Results were generated separately for students in low-level, average-level, and advanced-level high school math courses. The study found that in low-level and advanced-level math classes, teachers were less likely to say that the course was too easy for white female students as compared to white male students. In average-level math classes, teachers were both less likely to say that the course was too easy and more likely to say that it was too difficult for white female students, compared to white male students. These findings did not extend to minority female students nor to minority male students, who, after controlling for GPA and test scores, were just as likely to be rated by teachers as being in a course that was too easy or too difficult for them as white male students.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Other barriers, Female",,"United States",2012,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Poverty alleviation and child labor","Edmonds, E. V., & Schady, N. (2012). Poverty alleviation and child labor. American Economic Journal: Economic Policy, 4(4), 100-124.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The purpose of the study was to examine the impact of unconditional cash transfers on child labor, within the Bono de Desarrollo Humano (BDH) program. The study was a randomized controlled trial, where households within each local parish were randomly assigned to either the treatment group, who are eligible for the cash transfers, or the control group, who are not. The authors compared child labor and school enrollment outcomes, using a follow-up survey administered over a year after the program began. The study found that children were significantly less likely to participate in child labor and more likely to be enrolled in school if they were assigned to the treatment group than if they were assigned to the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Bono de Desarrollo Humano program, and not to other factors.","Bono de Desarrollo Humano (BDH) program","Child labor","Other, Low income",,International,2012,https://www.aeaweb.org/articles?id=10.1257/pol.4.4.100,"Child Labor Review Protocol" "Adolescent girls’ experiences and gender-related beliefs in relation to their motivation in math/science and English","Leaper, C., Farkas, T., & Brown, C. (2012). Adolescent girls’ experiences and gender-related beliefs in relation to their motivation in math/science and English. Journal of Youth and Adolescence, 41(3), 268-282.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study examined factors that influence teenage girls’ academic motivation in math, science, and English. The authors analyzed survey data from 579 girls ages 13 to 18 years old in Georgia and California to estimate predictors of the girls’ academic motivation in math, science, and English. The survey asked about the youths’ (1) academic motivation for each subject; (2) grades in these subjects; (3) perceptions of support from family and peers in these subjects; (4) attitudes on gender identity, measured by perceived parental and peer pressure to conform with traditional gender roles, the degree to which the youth perceived themselves to be so-called typical girls, and youths’ level of contentedness with the gender expectations they face; (5) opinions on gender egalitarianism of specific tasks, such as making decisions for the family; and (6) exposure to feminism, as measured by whether the youth had heard of the women’s rights movement and feminism through media or conversations with family or friends, as well as whether the youth knew that their mothers, teachers, or classmates identified as feminists. The study found that the following factors were positively associated with the girls’ motivation in math and science: mother and peer support in these subjects, belief in gender equality, less pressure from parents to conform to gender norms, holding gender-egalitarian beliefs, and exposure to feminism ideas and/or feminists.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Female",,"United States",2012,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Evolution of a faculty mentoring program for STEM women","Nemiro, J., Hacker, B., Tucker, S., Ferrel, M., Prall, D., & Dejonghe, E. (2011). Evolution of a faculty mentoring program for STEM women. International Journal of Gender, Science and Technology, 3(3), 644-658.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: This case study described implementation of a STEM mentoring program for female faculty at a polytechnic institution, including sucesses, challenges, and lessons learned. After each of three phases of program implementation, study authors administered participant surveys to capture satisfaction and usefulness of the program. They also accessed administrative data on current employment status of female STEM faculty at the institution. The surveys reflected that 80 percent of participants were satisfied with the program, finding it valuable for networking with colleagues, accessing department or college resources, and gaining advice on teaching strategies and achieving a work/life balance. A preliminary look at teacher retention showed program participants staying at the college at a higher rate than female STEM faculty who did not participate in the mentoring program.",,"Mentoring Science, Technology, Engineering, and Math (STEM) programs","Female, STEM professional",,"United States",2011,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Programs for undergraduate women in science and engineering: Issues, problems, and solutions","Fox, M., Sonnert, G., & Nikiforova, I. (2011). Programs for undergraduate women in science and engineering: Issues, problems, and solutions. Gender & Society, 25(5), 589-615.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The authors summarized the goals, concerns, and activities of undergraduate programs for women in science and engineering. They focused on whether the programs considered individual-level concerns, such as self-esteem and academic ability, or structural barriers, such as faculty, campus, and administrative attitudes toward women, as the primary obstacles facing women in these fields. In 2002, the authors surveyed the directors of undergraduate programs for women in science and engineering, obtaining 38 responses out of 48 programs nationwide. They analyzed the survey responses by translating rating scales into mean scores and comparing those means using paired sample t-tests. The study found that directors of undergraduate programs for women in science and engineering generally conceived of the central problem facing their students as structural rather than individual. The activities these programs provided, however, focused predominantly on shoring up individual skills and self-confidence—for instance through social gatherings and links to support services—rather than addressing the structural issues they viewed as paramount.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Female",,"United States",2011,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Middle school girls’ perceptions of engineers before and after a female only summer enrichment program","Hirsch, L., Berliner-Heyman, S., Cano, R., Kimmel, H., & Carpinelli, J. (2011). Middle school girls’ perceptions of engineers before and after a female only summer enrichment program. Paper presented at the 2011 IEEE Frontiers in Education Conference.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: In a study performed over the course of a summer engineering program for 4th- through 8th-grade girls, the authors sought to determine whether participants’ attitudes toward engineering changed from the beginning to end of the program and whether traditional surveys fully captured participants’ growth over the course of such an experience. The authors administered two tests, the Middle School Attitude to Mathematics, Science and Engineering Survey (MATE) and the Draw an Engineer Test (DAET), to about 100 participants in a summer 2009 New Jersey Institute of Technology engineering program for 4th- to 8th-grade girls. The MATE comprises seven psychological subscales focused on students’ interest in various aspects of engineering, attitudes toward mathematics and science, problem-solving, knowledge of engineering, and perceptions of males’ and females’ relative competence in mathematics and science; the DAET prompts respondents to draw an engineer at work and summarize their drawing in a sentence. Participants took both tests before beginning and after completing the program. The study found that girls’ knowledge of engineering increased significantly; at the beginning of the study, fewer than half of the participants could name one or more kinds of engineers, but by the end of the program more than 85 percent of participants correctly identified at least one kind of engineer. Differences in pre- and post-program engineer drawings and descriptions suggested more nuanced changes in girls’ understanding of engineering. For example, the proportion of responses depicting engineers communicating with others more than doubled, from only 12 percent before the program to 30 percent afterward. The authors concluded that the DAET complements the MATE and warranted further study as a measure of children’s changing perceptions of science and scientists.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Female",,"United States",2011,http://fie-conference.org/fie2011/papers/1471.pdf,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Stemming inequality? Employment and pay of female and minority scientists and engineers in the federal and private sectors","Oh, S., & Lewis, G. (2011). Stemming inequality? Employment and pay of female and minority scientists and engineers in the federal and private sectors. Social Science Journal, 48(2), 397-403.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study investigated the relationships among sector (federal or private); science, technology, engineering, and mathematics (STEM) occupation; gender or racial minority status; and earnings to determine whether federal- or private-sector STEM positions offer the greatest financial opportunities for female and racial minority STEM professionals. The authors compared the earnings of male and female STEM and non-STEM public sector employees in 1983 and 2003 using a 1 percent sample of the Office of Personnel Management’s Central Personnel Data File. To compare public- and private-sector outcomes, the authors also analyzed a 5 percent sample of the 2000 U.S. Census, examining differences in STEM and non-STEM public and private employees’ salaries by gender and race. The study found that women in public sector STEM positions earned 7.2 percent less than men in comparable public sector positions in 1983 even after controlling for education, STEM field, tenure, age, and race. This gender pay gap disappeared in the 2003 sample. Race and gender pay disparities, measured as the average difference in pay between racial minorities or women and white men, are smaller in the federal than the private sector and for STEM relative to non-STEM occupations. For example, in 1999, black male federal STEM employees earned 8.3 percent less than white men, compared to a pay gap of 10.9 percent for black male private sector STEM employees. For black men in non-STEM occupations, the pay gap relative to white men was 11.1 percent in the public sector and 20.6 percent in the private sector.",,"Science, Technology, Engineering, and Math (STEM) programs Other disparities or discrimination in employment and earnings","Other barriers, Female, STEM professional","Professional, scientific, and technical services","United States",2011,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Gender Equity in Science and Engineering: Advancing Change in Higher Education","Bilimoria, D., & Liang, X. (2011). Gender Equity in Science and Engineering: Advancing Change in Higher Education. New York: Routledge.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to evaluate the effectiveness of the ADVANCE institutional transformation program (ADVANCE-IT) sponsored by the National Science Foundation (NSF) in advancing women’s representation among science, technology, engineering, and mathematics (STEM) faculty in U.S. colleges and universities. The authors used program implementation and outcome data obtained from 19 participating colleges and universities to examine program initiatives, actions, and outcomes of ADVANCE-IT institutions. The analysis of interest in this review compared the changes in proportions of female STEM faculty in institutions that were implementing ADVANCE-IT programs to national reference groups over the course of the program period, by faculty rank and by type of institution. The study found that the ADVANCE-IT program was effective in increasing the number of female STEM faculty at all ranks in four-year colleges and research universities. The quality of causal evidence presented in this study is low. This means we are not confident that the estimated effects are attributable to the ADVANCE-IT program. Other factors are likely to have contributed.","the ADVANCE Program","Other disparities or discrimination in employment and earnings Science, Technology, Engineering, and Math (STEM) programs","Female, STEM professional",,"United States",2011,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "STEM development: A study of 6th-12th grade girls’ interest and confidence in mathematics and science (Doctoral dissertation, Iowa State University)","Heaverlo, C. (2011). STEM development: A study of 6th-12th grade girls’ interest and confidence in mathematics and science (Doctoral dissertation, Iowa State University). Retrieved from http://lib.dr.iastate.edu/cgi/viewcontent.cgi?article=1035&context=etd","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study’s objective was to determine whether middle and high school girls’ levels of interest and confidence in science and mathematics differed and to identify factors that promote their interest and confidence in these subjects. The author administered a survey to the 6th–12th grade attendees of the three April 2009 sessions of Iowa State University’s Taking the Road Less Traveled Career Conference. The author performed descriptive statistical analyses. The study found that middle and high school girls’ interest and confidence in science and mathematics did not differ. Teacher influence was a statistically significant predictor of all four outcomes examined—math interest, science interest, math confidence, and science confidence. In particular, math teacher influence predicted math interest and confidence, and science teacher influence predicted science interest and confidence. The availability of extracurricular science, technology, engineering, and mathematics activities also predicted math interest and confidence.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Female",,"United States",2011,http://lib.dr.iastate.edu/cgi/viewcontent.cgi?article=1035&context=etd,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Underneath it all: Gender role identification and women chemists’ career choices","Grunert, M., & Bodner, G. (2011). Underneath it all: Gender role identification and women chemists’ career choices. Science Education International, 22(4), 292-301.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: This study examined the career perspectives and decisions of women earning doctorates in chemistry in the United States. Specifically, the study looked at the factors women considered when making career decisions, their perceptions of different careers, and the factors that motivated their career choices. The researchers conducted three interviews with each of 10 participants at two large research universities in the Midwest. All participants were one or two years away from completing their doctorate in chemistry. The study analyzed the data collected to develop a career decision-making model for women in chemistry doctorate programs. The study found that most participants made career decisions based on their perceptions of the lifestyle required to be successful. Most participants believed that a tenure-track position in a chemistry department was at odds with the traditional female role of primary caretaker in the home. Both single and married women believed that pursuing a research-intensive career would require sacrificing time with family and delaying having children, whereas the sole lesbian participant stated that she did not feel confined to a traditional female family role and was not opposed to the heavy work requirement of a tenure-track university position. The study also found that women perceived female faculty in their departments to exhibit masculine traits, and believed that it would be necessary to adopt a more masculine personality to be respected and successful in a chemistry department.",,"Science, Technology, Engineering, and Math (STEM) programs","Female, STEM professional",,"United States",2011,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Questioning a white male advantage in STEM: Examining disparities in college major by gender and race/ethnicity","Riegle-Crumb, C., & King, B. (2011). Questioning a white male advantage in STEM: Examining disparities in college major by gender and race/ethnicity. Educational Researcher, 39(9), 656-664.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study's objective was to examine differences in students’ likelihood of majoring in a science, technology, engineering, and mathematics (STEM) field, based on gender and ethnicity. The study used statistical methods to estimate the likelihood of majoring in the physical sciences or engineering, or in the biological sciences, versus non-STEM fields. The authors also examined this likelihood for traditionally underrepresented groups (white, black, and Hispanic women and black and Hispanic men) compared to white men. The analyses controlled for student socioeconomic factors, delayed college entry, academic preparation, and attitudes toward math. Data sources included students’ high school transcripts and surveys conducted through the Educational Longitudinal Study of 2002. The study found that white and Hispanic women were less likely to major in the physical sciences or engineering, versus a non-STEM major, than white men. Black women were also less likely to major in a physical science or engineering field than white men, but the gap was slightly smaller. In contrast to the large gender gaps evident in the choice of physical science and engineering majors, there were no differences between the gender/ethnicity groups in the likelihood of majoring in a biological sciences field compared to a non-STEM field. The study found that academic preparation and attitudes toward math rarely explained why men were more likely to choose a STEM major than women.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Female, Male, White, Black or African American, Hispanic of any race",,"United States",2011,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Arguing separate but equal: A study of argumentation in public single-sex science classes in the United States","Glasser, H. (2011). Arguing separate but equal: A study of argumentation in public single-sex science classes in the United States. International Journal of Gender, Science and Technology, 3(1), 70-92.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: In a study performed at a public coeducational middle school during the 2007–2008 school year, the author sought to determine whether students in single-sex science classes learned “the same science” by experiencing the same instructional approaches and earning the same grades as those in mixed-gender classes. The author attended both the boys’ and girls’ science classes, and collected data from audio and video recordings, reviews of students’ work, and interviews with students and teachers. He analyzed these data using a variety of coding schemes, with particular emphasis on argumentation, defined for the purpose of the study as a whole-class scientific discussion involving the teacher that contained both a challenge and a defense. He also examined more than seven hours of video recordings from each class section and counted the instances of argumentation occurring in each class. Finally, the author reviewed students’ grades in the course. Although argumentation was not a primary feature of either boys’ or girls’ science classes, with no more than five instances of argumentation per hour of instruction in either case, the author found that boys’ science classes contained more than three times as many instances of argumentation than did girls’ classes. Over the sample lessons considered in this study, the boys produced 22 instances of argumentation, compared with only 7 in the girls’ class. There were no differences in students’ grades by gender.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Female, Male",,"United States",2011,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "WomenLEAD: Leadership development for female faculty in business and engineering","Hodges, J., Pearson, A., & Reese, D. (2011). WomenLEAD: Leadership development for female faculty in business and engineering. International Journal of Gender, Science and Technology, 3(2), 331-337.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study’s main objective was to describe and promote the implementation of WomenLEAD, a program offered at a business and engineering college to foster leadership development in female faculty by providing advice and support. WomenLEAD consisted of eight sessions focused on challenges faced by female faculty for advancement, such as work-life balance, gender biases, and communication differences. At the end of the program, the authors, who created and implemented the WomenLEAD program, administered a participant survey to elicit participants’ feedback on the degree to which each of the sessions influenced participants’ awareness and understanding of issues relevant to their leadership development. The participants’ survey suggested that WomenLEAD increased women’s awareness and understanding of issues covered in each session, such as communicating with power, career challenges, and leadership qualities. Comments on the survey indicated appreciation for the support network of women the program created. The program intends to continue this networking through continued formal and informal gatherings and to expand it to female faculty at other colleges.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Female",,"United States",2011,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Women in STEM: A gender gap to innovation","Beede, D., Julian, T., Langdon, D., McKittrick, G., Khan, B., & Doms, M. (2011). Women in STEM: A gender gap to innovation. Washington, DC: Economics and Statistics Administration, U.S. Department of Commerce.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: This issue brief highlighted the 2009 gender gap in STEM degrees, jobs, and earnings in the United States. The authors used data from the 2009 U.S. Census Bureau’s American Community Survey to examine how educational attainment, wages, and participation in STEM occupations differed by gender. Regression analyses that controlled for factors such as age, educational attainment, and region, were used to compare differences in STEM earnings and wage gaps. The authors found that women continued to be underrepresented in STEM degrees and jobs, but there were reasons to encourage women to pursue STEM: the gap in STEM jobs between women and men decreased as educational attainment increased; there was a 7 percent smaller gender gap in hourly earnings for STEM jobs over non-STEM jobs (14 percent smaller in engineering jobs); women held a disproportionally small number of STEM degrees compared with men; and 14 percent fewer women than men with STEM undergraduate degrees ended up in STEM jobs.",,"Science, Technology, Engineering, and Math (STEM) programs Other disparities or discrimination in employment and earnings","STEM professional",,"United States",2011,http://templatelab.com/women-in-stem-a-gap-to-innovation/,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "How to recruit women and girls to the science, technology, engineering, and math (STEM) classroom","Milgram, D. (2011). How to recruit women and girls to the science, technology, engineering, and math (STEM) classroom. Technology and Engineering Teacher, 71(3), 4-11.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study's objective was to suggest successful strategies for increasing the number of women and girls in STEM classes. The author used studies of other programs and lessons learned from personal experience to inform a set of suggested strategies for improving the recruitment of women and girls into STEM classes. The author suggested that women and girls benefit from seeing female role models in STEM, receiving positive encouraging messages, and being assured that women in STEM can maintain a work/life balance. The author also described specific strategies that schools and programs should implement to improve recruitment of females, including reaching out to counselors and communicating the program’s emphasis on recruiting females, personally encouraging female students, developing outreach materials that display females and that incorporate the color pink, and taking into account how females’ perceptions of and motivations toward STEM differ from those of males.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Female",,"United States",2011,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Inquiry-based science and technology enrichment program: Green earth enhanced with inquiry and technology","Kim, H. (2011). Inquiry-based science and technology enrichment program: Green earth enhanced with inquiry and technology. Journal of Science Education & Technology, 20(6), 803-814.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Attitudes-Low-Favorable impacts Attitudes","Summary: The study’s objective was to examine the impact of the Inquiry-based Science and Technology Enrichment Program (InSTEP)—a week-long, half-day summer science curriculum for female 8th-grade students—on participants’ interest and confidence in studying science. The author used a survey to compare students’ attitudes about science before and after participating in InSTEP. The author found that among the female 8th-grade students who chose to enroll in InSTEP, interest in science increased, gender stereotypes about science and scientists were undermined, and overall attitudes toward science improved by the end of the program. There were no significant differences in students’ anxiety about taking science courses. The quality of causal evidence presented in this report is low. This means we are not confident that the estimated effects are attributable to InSTEP; other factors are likely to have contributed.","Inquiry-based Science and Technology Enrichment Program (InSTEP)","Science, Technology, Engineering, and Math (STEM) programs Youth programs","Youth, Female",,"United States",2011,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Are the predictors of women’s persistence in STEM painting the full picture? A series of comparative case studies","Hughes, R. (2011). Are the predictors of women’s persistence in STEM painting the full picture? A series of comparative case studies. International Journal of Gender, Science and Technology, 3(3), 548-570.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study's objective was to examine the experiences of several female science and engineering majors within the literature context on predictive factors of persistence in STEM majors and careers. The study focused on the roles of parental support and education level, academic preparation, and perceptions of the STEM culture in influencing the career trajectories of female undergraduates at a United States university in 2009–2010. The author conducted two interviews each with five women in their fourth year of college who had chosen to major in a STEM field. The first interview collected the participant’s life history, with a focus on factors and moments leading to the decision to pursue a STEM major. The second interview, conducted several months later, recorded whether the participant’s career plans had changed. The study found that the participants’ experiences did not always align with what the literature predicted, and that complex factors contributed to a woman’s decision to stay in or leave a STEM major. Although all the women who stayed in a STEM field described the use of coping strategies for persisting in a male-dominated field, these strategies differed among participants. Those who chose to leave their STEM major did not necessarily do so because of a lack of academic preparation, parental support, or competence, but rather seemed to share a feeling that they did not identify with the peers in their STEM field, who they described as “uptight,” “nerdy,” and lacking a life outside of the classroom.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Female",,"United States",2011,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Same bureaucracy, different outcomes in human capital? How indigenous and rural non-indigenous areas in Panama responded to the CCT","Arriaz, I., & Rozo, S. (2011). Same bureaucracy, different outcomes in human capital? How indigenous and rural non-indigenous areas in Panama responded to the CCT. Inter-American Development Bank, Office of Evaluation & Oversight.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of Red de Oportunidades (RdO), a conditional cash transfer program in Panama, on child labor and school enrollment. The authors used cross-sectional data to compare the treatment group to the comparison group on several outcomes, including child labor (if the child worked in the previous week) and school enrollment (if the child was enrolled in formal schooling). In the analyses for rural areas, the study found that the receipt of the RdO was significantly associated with a decrease in child labor by 6.2 percentage points and an increase in school enrollment by 8.8 percentage points. In the analyses for the indigenous areas, the receipt of RdO was significantly associated with an increase in school enrollment by 6.3 percentage points, but not related to child labor. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Red de Oportunidades (RdO) program; other factors are likely to have contributed.","Red de Oportunidades (RdO)","Child labor","Other, Low income",,"International, Rural",2011,https://papers.ssrn.com/sol3/papers.cfm?abstract_id=1847124,"Child Labor Review Protocol" "STEMing the tide: Using in-group experts to inoculate women’s self-concept in science, technology, engineering, and mathematics (STEM)","Stout, J., Dasgupta, N., Hunsinger, M., & McManus, M. (2011). STEMing the tide: Using in-group experts to inoculate women’s self-concept in science, technology, engineering, and mathematics (STEM). Journal of Personality and Social Psychology, 100, 255-270. [one of three studies described in a single report]","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Attitudes-Low-Unfavorable impacts Attitudes","Summary: The study’s objective was to examine the impact of reading a paragraph-long biography of a female engineer on female engineering majors’ implicit and explicit attitudes toward math and English, their self-efficacy in engineering, their identification with the engineers in the assigned text, and their intention to pursue a career in engineering. The study used computerized tasks to measure outcomes for female students who read a paragraph-long biography of a female engineer compared with those of female students who read either (1) biographies of male engineers or (2) a description of engineering innovations with no mention of the engineer’s gender. The study found that attitudes of female students who read the female biography did not favor math over English or vice versa, whereas those who read the male biography or the description of engineering innovations demonstrated negative implicit attitudes toward math and a preference for English over math. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to reading a paragraph-long biography about female engineers, and not to other factors.",,"Science, Technology, Engineering, and Math (STEM) programs Youth programs","Youth, Female",,"United States",2011,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Do conditional cash transfers for schooling generate lasting benefits? A five-year followup of PROGRESA/Oportunidades","Behrman, J. R., Parker, S. W., & Todd, P. E. (2011). Do conditional cash transfers for schooling generate lasting benefits? A five-year followup of PROGRESA/Oportunidades. Journal of Human Resources, 46(1), 93-122. doi:10.3368/jhr.46.1.93","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor Child labor-Low-Favorable impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of Mexico’s conditional cash transfer program (PROGRESA/Oportunidades) on long-term schooling and work for children ages 9 to 15 (during the time of the intervention). Using survey data from a randomized controlled trial, the authors analyzed the impact of the PROGRESA/Oportunidades program on schooling and work 18-months after implementation. The authors also used a nonexperimental design to evaluate schooling and work outcomes five-and-a-half years post-implementation. The study found that 18 months of program exposure significantly increased the school grade completion by 2.4 percent for boys and 2.7 percent for girls. The 18-month program exposure significantly decreased participation in work by 4.1 percent for boys but had no significant effect for girls. The study found a statistically significant relationship between the program and increased school grade completion five-and-a-half years post-implementation for all groups except for girls aged 17-19. It also found a statistically significant relationship between the program and a reduction in child labor for boys aged 15-16 in 2003 but did not find a significant relationship between the program for girls or for any other age groups of boys. The quality of causal evidence presented in this report is high for short-term outcomes (18 months) because they are based on a well-implemented randomized controlled trial but low for longer-term outcomes (five-and-a-half years) because the authors did not account for the outcomes of schooling and work at baseline.",PROGRESA/Oportunidades,"Child labor","Other, Low income",,International,2011,https://www.mcgill.ca/isid/files/isid/behrman_et_al_2011.pdf,"Child Labor Review Protocol" "Inside the double bind: A synthesis of empirical research on undergraduate and graduate women of color in science, technology, engineering, and mathematics","Ong, M., Wright, C., Espinosa, L., & Orfield, G. (2011). Inside the double bind: A synthesis of empirical research on undergraduate and graduate women of color in science, technology, engineering, and mathematics. Harvard Educational Review, 81(2), 172-208.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study examined existing empirical research on the challenges that minority women have faced in science, technology, engineering, and mathematics (STEM) disciplines at the undergraduate and graduate levels, emphasizing factors that promote or discourage retention and transition to employment or further study. The authors analyzed 116 empirical studies conducted from 1970 to 2008 that examine aspects of the academic and career experiences of minority women in STEM disciplines, identifying the findings of each study and synthesizing these features to pinpoint trends and opportunities for further investigation. The authors summarized the studies’ conclusions regarding the effects of academic climate, enrichment programs, self-confidence, and relationships with faculty, peers, and family on minority women’s persistence in undergraduate STEM majors, highlighting lack of recognition from peers and faculty members and complex family expectations and dynamics as factors that hinder them from completing STEM degrees. At the graduate level, many of the same influences, particularly family expectations and fraught relationships with peers and professors, present challenges for minority women in STEM disciplines. Academic and social transitions from minority-serving institutions to predominantly white institutions and the financial demands of graduate study also represent cross-cutting obstacles.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Other barriers, Female",,"United States",2011,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Removing the barriers to full professor: A mentoring program for associate professors","Buch, K., Huet, Y., Rorrer, A., & Roberson, L. (2011). Removing the barriers to full professor: A mentoring program for associate professors. Change: The Magazine of Higher Learning, 43(6), 38-45.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The objective of the study was to develop and assess a program to facilitate associate professors’ promotion to full professor, paying particular attention to female associate professors in STEM disciplines. The authors initiated the study in 2008 with a comprehensive needs assessment of University of North Carolina-Charlotte associate professors’ attitudes toward and perceptions of the promotion process. Based on the responses, they developed a series of peer and vertical mentoring programs, including a program focused on female associate professors in STEM disciplines. Two years after launching the needs assessment, the authors administered a follow-up survey to gauge the program’s progress. The initial needs assessment found substantial gender differences in associate professors’ perceptions of the promotion process. Women were significantly more likely than men to believe that departmental standards for promotion were unclear, that their department chair did not provide career support or guidance, and that factors such as race and gender would influence the promotion process. Responses to the follow-up survey marked a significant increase in the proportion of associate professors reporting having a mentor and lessening of gender disparities regarding perceptions of the promotion process. Those who indicated that they had a mentor were significantly more likely than those who did not to perceive incentives for promotion and to believe that promotion criteria were clear.",,"Mentoring Science, Technology, Engineering, and Math (STEM) programs Other disparities or discrimination in employment and earnings","Female, STEM professional",,"United States",2011,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Recruitment strategies for gender equity: Lessons from cohort 1 and cohort 2 advance institutions","Zajicek, A., Morimoto, S., Terdalkar, A., Hunt, V., Rencis, J., & Lisnic, R. (2011). Recruitment strategies for gender equity: Lessons from cohort 1 and cohort 2 advance institutions. Washington, DC: American Society for Engineering Education.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-No impacts Employment","Summary: The study’s objective was to evaluate the effectiveness of the ADVANCE institutional transformation program (ADVANCE-IT), sponsored by the National Science Foundation (NSF), on the recruitment of female engineering faculty at participating U.S. colleges and universities. The authors used program implementation and outcome data obtained from seven participating colleges and universities to compare the number of female engineering faculty before and after institutions participated in the intervention. The study found no statistically significant relationships between participation in the ADVANCE-IT program and the number of female assistant professors at those institutions. The quality of causal evidence presented in this study is low because the authors conducted no tests of statistical significance and did not observe outcomes for multiple periods before the intervention. This means we are not confident that the estimated effects would have been attributable to the ADVANCE-IT program; other factors are likely to have contributed.","NSF’s ADVANCE-IT Program","Science, Technology, Engineering, and Math (STEM) programs Other disparities or discrimination in employment and earnings","Female, STEM professional",,"United States",2011,http://www.asee.org/file_server/papers/attachment/file/0001/1532/Recruitment_St…,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Sex differences in application, success, and funding rates for NIH extramural programs","Pohlhaus, J.R., Jiang, H., Wagner, R.M., Schaffer, W.T., & Pinn, V.W. (2011). Sex differences in application, success, and funding rates for NIH extramural programs. Academic Medicine, 86(6), 759-767.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study's objective was to analyze gender differences in the award of National Institutes of Health (NIH) extramural grants in the 2008 fiscal year. This research was intended to inform efforts to improve diversity in award funding. Using data from the NIH Information for Management, Planning, Analysis, and Coordination electronic Research Administration database, the authors conducted cross-sectional analyses of funding rates (the percentage of applicants who received funding) and success rates (the percentage of reviewed grant applications that received funding), by career stage (early, mid, and senior) and by gender. The authors also conducted analyses specific to the prestigious R01 award—the only award not intended for a specific career stage—including a longitudinal analysis of researchers transitioning to R01 awards or applying for renewal of R01 awards. Overall, women tended to be as likely as men to receive NIH research and training awards in 2008, and applied for and received similar award amounts. In the R01 program, women had a similar success rate as men but a lower funding rate, which seemed to be caused by a lower rate of award among experienced applicants submitting proposals for award renewal. The longitudinal analysis confirmed that women were less likely than men to apply and receive funding for new or renewal R01 awards. Finally, fewer older women applied for and received funding, and recipients of multiple awards were more likely to be men. The authors suggest that these findings are consistent with national data showing fewer older women work in the field and are employed in senior positions.",,"Science, Technology, Engineering, and Math (STEM) programs Other disparities or discrimination in employment and earnings","STEM professional",,"United States",2011,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Residential treatment for homeless female veterans with psychiatric and substance use disorders: Effect on 1-year clinical outcomes","Harpaz-Rotem, I., Rosenheck, R. A., & Desai, R. (2011). Residential treatment for homeless female veterans with psychiatric and substance use disorders: Effect on 1-year clinical outcomes. Journal of Rehabilitation Research & Development, 48(8), 891-899.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The study examined the impact of community residential treatment on female veterans’ employment and health outcomes. The study team used statistical tests to examine the differences between two groups: (1) people who were offered at least 30 or more days of residential treatment (RT) services at Veterans Affairs (VA) medical centers and (2) people who were not offered these services or were offered these services for less than 30 days. The data for this study came from case managers, discharge summaries, interviews, and standardized self-reported measures. The study showed that receiving RT services was associated with a greater number of days worked but with mixed results on health outcomes. The quality of causal evidence presented in this report is moderate because it is based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the RT program, but other factors might also have contributed to the effects.","Residential Treatment","Health Veterans' reemployment","Female, Veteran or military",,"United States",2011,https://www.researchgate.net/profile/Ilan_Harpaz-Rotem/publication/51784250_Res…,"Employment and Training Review Protocol" "Do female and male role models who embody STEM stereotypes hinder women’s anticipated success in STEM?","Cheryan, S., Siy, J., Vichayapai, M., Drury, B. & Kim, S. (2011). Do female and male role models who embody STEM stereotypes hinder women’s anticipated success in STEM? Social Psychological and Personality Science, 2(6), 656-664.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Attitudes-Low-Favorable impacts Attitudes","Summary: The study’s objective was to examine the impact of interacting with an upper-level college role model on female students’ beliefs that they could succeed as a computer science major. The study used a randomized controlled trial to assign female students majoring in a discipline other than computer science to meet with one of four different types of upper-level students who varied by gender and whether they embodied perceived stereotypes of computer science majors. The authors administered a questionnaire to estimate impacts of the different intervention conditions. The study found that women who interacted with a stereotypical computer science role model believed they would be less successful as a computer science major compared with women who interacted with a nonstereotypical computer science role model and with women who did not interact with a role model. The quality of causal evidence provided in this study is low because the study had high attrition and the authors did not demonstrate baseline equivalence between the samples or include adequate controls to ensure the resulting groups were similar on all relevant characteristics. This means we are not confident that the effects estimated in this study are attributable to role model interaction; other factors are likely to have contributed.",,"Mentoring Science, Technology, Engineering, and Math (STEM) programs Youth programs","Youth, Female",,"United States",2011,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Surprising possibilities imagined and realized through information technology: Encouraging high school girls’ interests in information technology","Forssen, A., Lauriski-Karriker, T., Harriger, A., & Moskal, B. (2011). Surprising possibilities imagined and realized through information technology: Encouraging high school girls’ interests in information technology. Journal of STEM Education: Innovations and Research, 12(5-6), 46-57.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study examined the overall and gender-specific impact of the Surprising Possibilities Imagined and Realized through Information Technology (SPIRIT) program on high school students’ attitudes toward information technology (IT), with special focus on increasing female students’ confidence and abilities in using technology. The SPIRIT program, which took place during two weeks in summer 2009 at a large Midwestern university, had female and male students use a three-dimensional programming environment called Alice to create animations for storytelling. Participants also completed other hands-on activities and heard presentations from professionals on the use of IT in their jobs. The authors administered 20-item baseline and follow-up surveys to students on general attitudes toward and gender stereotypes in IT and compared responses before and after the SPIRIT program. Of the76 students who attended the program, 74 participated in the study. Because the program aimed to increase girls’ interests in IT, the study sample was 70 percent female. The study found that, after attending the SPIRIT program, female students demonstrated no change in general attitudes toward IT, but showed a significant reduction in believing the gender stereotype that women do not perform as well as men in IT. In looking at emergent themes of open-ended survey responses, the authors found that women’s attitudes toward the characteristics of a person with a career in IT changed from a focus on the person’s skills or intelligence before participation in SPIRIT to a more diverse description of characteristics after participation in the program. Similarly, female students provided a more expansive set of example IT careers after participation in SPIRIT. The authors did not conduct statistical tests on these differences.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Female",,"United States",2011,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Understanding the factors affecting degree completion of doctoral women in the science and engineering fields","Ampaw, F., & Jaeger, A. (2011). Understanding the factors affecting degree completion of doctoral women in the science and engineering fields. New Directions for Institutional Research, 152, 59-73.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: This study aimed to determine if student characteristics; financial aid receipt; and labor market conditions (such as unemployment, weekly wages, and professors’ salary) predicted doctoral degree completion in science, engineering, or math differently for men and women. Following students enrolled in a doctoral program at an academic institution in the southeastern United States, the study used data from the institution in which study participants were enrolled, Bureau of Labor Statistics data on unemployment and weekly earnings, and expected earnings information from the National Faculty Salary Survey by Discipline and Rank in Four Year Colleges and Universities. Nonlinear regression models were used to estimate the effects on doctoral degree completion. The study found that 9 percent more males than females in the study completed their doctoral degree, although women tended to be younger at the start of their degree. International students, but not minority students overall, were more likely to complete their degree than white domestic students. Regarding financial aid, students who held research assistantships were 67 percent more likely to finish their degree than students without an assistantship, but males were much more likely to acquire an assistantship than females. Regarding labor market conditions, students were more likely to complete a degree in fields with high unemployment and higher expected earnings.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs Preventing discrimination","Youth, Female, Male",,"United States",2011,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "The role of living–learning programs in women’s plans to attend graduate school in STEM fields","Szelényi, K., & Inkelas, K. (2011). The role of living–learning programs in women’s plans to attend graduate school in STEM fields. Research in Higher Education, 52(4), 349-369.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Attitudes-Low-Favorable impacts Attitudes","Summary: The study’s objective was to assess the impact of participating in a female-only STEM living-learning program on undergraduate female STEM majors’ intentions to pursue graduate studies in a STEM field. The authors conducted regression analysis using data from the 2004–2007 National Study of Living Learning Programs (NSLLP) to determine if women who participated in female-only STEM living-learning programs were more likely than women in other living arrangements to express plans to attend graduate school in a STEM field. The study found that the female undergraduate STEM majors living in a female-only STEM living-learning community were more likely to have plans to attend graduate school in a STEM field than female STEM majors living in coeducational STEM living-learning communities, non-STEM living-learning communities, or traditional residence halls. The quality of causal evidence presented in this report is low because the authors’ analysis did not account for important individual characteristics related to the outcome that could differ across groups. This means we are not confident that the estimated effects are attributable to female-only STEM living-learning programs. Other factors are likely to have contributed.","STEM Living-Learning Programs","Science, Technology, Engineering, and Math (STEM) programs Youth programs","Youth, Female",,"United States",2011,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Who wants to have a career in science or math? Exploring adolescents’ future aspirations by gender and race/ethnicity","Riegle-Crumb, C., Moore, C., & Ramos-Wada, A. (2011). Who wants to have a career in science or math? Exploring adolescents’ future aspirations by gender and race/ethnicity. Science Education, 95(3), 458-476.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study's objective was to examine whether different gender and racial/ethnic subgroups of 8th-grade students in the United States varied in their aspirations of pursuing a career in science or math. The study further sought to observe how students’ attitudes toward and achievement in science and math helped explain any disparities in career aspirations by gender and race/ethnicity. The authors conducted a regression analysis that estimated the likelihood of different gender and race/ethnicity subgroups stating that they “would like a job that involves using science/math,” controlling for their attitudes toward and achievement in science/math. Career aspirations for groups traditionally underrepresented in science, technology, engineering, and mathematics—including white, black, and Hispanic girls and black and Hispanic boys—were compared to those of white boys. The study used data from the 2003 Trends in International Mathematics and Science Study, specifically looking at a nationally representative sample of 8th-grade students in the United States. In the primary analysis of science aspirations, no female and/or racial minorities had a statistically different likelihood of aspiring to a career in science than white boys. Black boys had comparable career aspirations to white boys even before controlling for any other factors, and Hispanic and white boys were similar after controlling for socioeconomic factors. Both white and Hispanic girls had similar career aspirations to white boys after controlling for enjoyment of science. In the primary analysis of math aspirations, all female subgroups were significantly less likely to aspire to a math career than white boys, even after controlling for general school attitudes, test scores, enjoyment in the subject, and belief in their own math ability. Black and Hispanic boys were as likely as white boys to be interested in pursuing a career in math before controlling for any of those factors.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs Other disparities or discrimination in employment and earnings","Youth, Other barriers, Female, Male",,"United States",2011,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Establishing the foundation for future organizational reform and transformation at a large private university to expand the representation of women faculty","Bailey, M., Marchetti, C., DeBartolo, E., Mozrall, J., Williams, G., Baum, S., & LaLonde, S. (2011). Establishing the foundation for future organizational reform and transformation at a large private university to expand the representation of women faculty. Proceedings of the 2011 American Society for Engineering Education Annual Conference & Exposition, Washington, DC.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: This paper described the ADVANCE IT-Catalyst study that examined the barriers facing female STEM faculty members at six Rochester Institute of Technology (RIT) colleges, compared with men at RIT and women at similar universities. The research examined faculty rank, tenure, career track, leadership opportunities, and salary, and aimed to inform RIT’s efforts to recruit, retain, and advance female STEM faculty. The authors used institutional records from 2004 to 2010 to measure trends in recruitment, retention, advancement, and compensation, by faculty gender. A career-life survey administered to gather information on STEM faculty’s teaching and research experiences, including career satisfaction and work-life balance, complemented the institutional data. The authors tested for statistically significant differences in responses between men and women. Finally, the study benchmarked university policies and survey results against policies and survey results at other similar universities. In terms of retention, the study found that female faculty hired from 2002 to 2009 were twice as likely to have left RIT by 2010 than male faculty and, overall, the institution had a significantly lower percentage of female science and engineering tenured and tenure-track faculty in 2010 than the national average. In terms of leadership advancement and salary, the percentage of STEM leadership positions held by women in 2010 was proportional to the percentage of STEM faculty who were women. The study found that salary adjustments made by the university during the study period reduced the salary gap for female assistant and associate professors, but actually increased the gap for full professors. In the survey, women reported having to exert more effort and make more personal sacrifices to advance their careers than men, though most women felt that the tenure process was fair. Finally, the benchmarking study of policies and benefits found that RIT lagged behind other universities in terms of tenure clock extension, mentoring, and maternity leave.",,"Science, Technology, Engineering, and Math (STEM) programs Other disparities or discrimination in employment and earnings","Female, STEM professional",,"United States",2011,http://www.asee.org/public/conferences/1/papers/2271/download,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Three essays on investments in children's human capital","Bustelo, M. (2011). Three essays on investments in children's human capital (Doctoral dissertation). Retrieved from https://core.ac.uk/download/pdf/4837518.pdf","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Child labor-Mod/high-No impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of a Nicaraguan conditional cash transfer program, Red de Proteccion Social (RPS), on child work participation and school enrollment. The study was a randomized controlled trial that took place in Nicaragua. Data were obtained from a baseline and two follow-up surveys administered to treatment and control group households. The study found that the RPS program significantly increased school enrollment for targeted children by 18% in the first year post-intervention and 14% in the second year post-intervention. The study found no statistically significant relationships between RPS and work participation for targeted children. The quality of the causal evidence presented in this study is moderate because, although it was based on a randomized controlled trial with unknown attrition, the author demonstrated that the treatment and control groups were similar before the intervention. This means we have confidence that the estimated effects are attributable at least in part to Red de Proteccion Social, although other factors could also have contributed.","Red de Protección Social (RPS)","Child labor",Other,,International,2011,https://www.ideals.illinois.edu/bitstream/handle/2142/29654/Bustelo_Monserrat.p…,"Child Labor Review Protocol" "Pipelines and pathways: Women of color in undergraduate STEM majors and the college experiences that contribute to persistence","Espinosa, L. (2011). Pipelines and pathways: Women of color in undergraduate STEM majors and the college experiences that contribute to persistence. Harvard Educational Review, 81(2), 209-240.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study's objective was to examine how undergraduate women of color’s precollege characteristics and college experiences and the characteristics of their undergraduate institutions affected their persistence in STEM majors throughout college compared with white women. The author used data from the Higher Education Research Institute Cooperative Institutional Research Program at the University of California, Los Angeles, to model whether college experiences mediated some of the effect of precollege characteristics and institutional settings on persistence in STEM majors, as hypothesized. Survey data were collected when students entered college in 2004 and again in the spring of 2008, during students’ fourth year of college. The study included a sample of 1,250 women of color and 891 white women at four-year colleges and universities across the United States who were first-time, full-time students. Results were estimated separately for women of color and white women. The study found that both white women and women of color persisted in STEM at a rate of 57 percent from the time they stated an intent to major in STEM at college entrance to the spring semester of their fourth year, and that high school grade point average was a significant predictor of persistence for both groups. As hypothesized, college experiences had a significant effect on the persistence of women of color in STEM: those who found satisfaction with their curriculum, engaged in peer discussion on course content outside the classroom, joined a major-related club, tutored another student, participated in research programs, and intended to major in engineering were more likely to persist in a STEM major; the same factors were significant for white women, with the exception of joining a major-related club. In addition, women of color who attended a private college and an institution with a higher percentage of students majoring in STEM were more likely to stay in a STEM major; the opposite was true for women of color who attended a highly selective institution. For white women, these institutional factors were not significant predictors of persistence in STEM.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Other barriers, Female",,"United States",2011,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "What predicts middle school girls’ interest in computing?","Denner, J. (2011). What predicts middle school girls’ interest in computing? International Journal of Gender, Science and Technology, 3(1), 54-69.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: This paper analyzed white and Latina middle school girls’ interest in and knowledge of careers in computer science following their participation in a voluntary after-school and summer school program in central California. The author administered a survey to 140 program participants and conducted stepwise multiple regressions to identify factors that significantly affected the girls’ interest in computing classes and careers. The author also ran secondary analyses to address possible indirect or mediating influences on the girls’ interest in computing classes and careers. The study found that three factors significantly predicted girls’ interest in computing classes and careers: (1) a youth’s level of technological curiosity, (2) perceived support from school peers and teachers to pursue computing classes and degrees, and (3) feelings that computers were relevant to her life. The study also found that although perceived parental support and gender stereotypes did not directly predict the girls’ interest in computing classes and careers, these factors did indirectly predict girls’ interest in computing.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Female, White, Hispanic of any race",,"United States",2011,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Living-learning programs for women in STEM","Inkelas, K. (2011). Living-learning programs for women in STEM. New Directions for Institutional Research 152, 27-37.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study’s objective was to review the evidence of the effects of living-learning programs (LLPs)—shared residences at postsecondary institutions designed to bridge in- and out-of-class learning and establish tight-knit communities—on academic and other outcomes for women in STEM disciplines. The author reviewed studies that compared the short- and long-term academic outcomes of female STEM majors who participated in LLPs, particularly women-only STEM LLPs, to male and female STEM majors who did not participate in such programs. Many of these studies relied on the 2007 National Study of Living-Learning Programs, which encompassed programs at more than 50 U.S. colleges and universities and represented the responses of 22,519 students; other university-specific studies from Michigan State University, the University of Wisconsin-Madison, and the University of Michigan were included. The study found that participants in a women-only STEM LLPs were more likely to attend graduate school in a STEM field than were female STEM majors who participated in coeducational STEM LLPs, non-STEM LLPs, or no LLP, by 35, 31, and 29 percent, respectively. Participants in a women-only STEM LLP at the University of Michigan were more likely to persist in STEM majors than were male or female nonparticipants with similar academic interests and achievement.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Female",,"United States",2011,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Program Keluarga Harapan: Main findings from the impact evaluation of Indonesia’s pilot household conditional cash transfer program","World Bank. (2011). Program Keluarga Harapan: Main findings from the impact evaluation of Indonesia’s pilot household conditional cash transfer program. Retrieved from http://documents.worldbank.org/curated/en/589171468266179965/Program-Keluarga-Harapan-impact-evaluation-of-Indonesias-Pilot-Household-Conditional-Cash-Transfer-Program","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Child labor-Mod/high-Unfavorable impacts Child labor Education and skills gains-Mod/high-Mixed impacts Education and skills gains","Summary: The study’s objective was to examine the impact of a conditional cash transfer program, Program Keluarga Harapan (PKH), on child school and work participation. The study was a randomized controlled trial (RCT) that compared outcomes between the treatment and control groups using household surveys conducted before and two years after initial program implementation. The study found a significant increase in time spent working in family enterprises for children 13-15 and children 7-12 in the treatment group compared to the control group. The study found that relative to the control group, children aged 13-15 who participated in the program had significantly larger increases in the hours attending school two years after program implementation began. However, school enrollment rates significantly decreased for children aged 7-12 who participated in the program. The quality of causal evidence presented in this report is moderate because randomization was compromised but the authors ensured that the groups being compared were similar before the intervention. This means we are somewhat confident that the estimated effects are attributable to Program Keluarga Harapan, but other factors might also have contributed.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2011,http://documents.worldbank.org/curated/en/589171468266179965/Program-Keluarga-H…,"Child Labor Review Protocol" "Mothers of invention: Gender, motherhood, and new dimensions of productivity in the science profession","Whittington, K. (2011). Mothers of invention: Gender, motherhood, and new dimensions of productivity in the science profession. Work and Occupations, 38(3), 417-456.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study's objective was to determine whether women, specifically mothers, in STEM academic or industry jobs were less likely to participate in the patenting process than fathers and childless men in the same field. In addition, the study sought to examine whether previous experience with patenting reduced gender or motherhood inequalities in patenting participation. The study analyzed survey data from the April 1995 and April 2001 waves of the Survey of Doctorate Recipients, a longitudinal study of research doctorates conducted by the National Science Foundation. The author restricted the sample to scientists in four-year colleges and in business or industry who worked in computer and mathematical sciences, life sciences, physical sciences, and engineering; were active in applied and basic research, development, or design; and worked full time. Respondents were asked if they had been named as an inventor on a U.S. patent application in the past five or six years. The author estimated logistic regression models to determine whether females, and specifically mothers, were less likely to have received a patent in the past five or six years. The author also conducted additional analyses to determine if previous experience with patenting affected patenting participation. The study found that in academia, among those surveyed at both rounds, mothers were no less likely to patent than males, including fathers, or childless females after controlling for prior patenting experience. In industry, among those surveyed in both rounds, married, childless women were less likely to patent than childless women, even after controlling for prior patenting experience. The authors estimated numerous other models that found mixed effects of gender, marital status, and parenthood on the likelihood of scientists participating in patenting activities.",,"Science, Technology, Engineering, and Math (STEM) programs Other disparities or discrimination in employment and earnings","Female, STEM professional, Parent",,"United States",2011,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "The impact of conditional cash transfer program on human capital formation in Brazil","Helfand, S.M., & Souza, A.P. (2010). The impact of conditional cash transfer program on human capital formation in Brazil. University of California, Riverside, CA: Sao Paulo School of Economics.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-No impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to analyze the impact of Brazil’s Bolsa Escola program on school enrollment, school progression, and child labor for children ages 6 to 15 in rural areas. Using data from the 2001 and 2003 Brazilian Census, the authors used a structural model to examine the average program impact of the Bolsa Escola program. The study found that the Bolsa Escola program was significantly associated with an increase in school enrollment and school progression. However, the study did not find a statistically significant relationship between program participation and child labor. The quality of causal evidence presented in the study is low because the authors did not control for pre-intervention outcomes. This means we are not confident that the estimated effects are attributable to the Bolsa Escola program; other factors are likely to have contributed.","Bolsa Escola","Child labor","Other, Low income",,International,2010,,"Child Labor Review Protocol" "Reducing the gender achievement gap in college science: A classroom study of values affirmation","Miyake, A., Kost-Smith, L., Finkelstein, N., Pollock, S., Cohen, G., & Ito, T. (2010). Reducing the gender achievement gap in college science: A classroom study of values affirmation. Science, 330 (6008), 1234–1237.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to assess the effect of values affirmation on female students’ performance in an introductory college physics course. Students in the course were randomly assigned to either a treatment group, in which they completed a writing exercise affirming their personal values, or a control group, in which they described values that might be important to others. The authors collected exam scores and course grades for students in both study groups. The study found that, although male students’ exam scores remained higher than female students’ scores, the gender gap was significantly smaller for students in the values affirmation group than for students in the control group. The quality of causal evidence presented in this report is low because it was a randomized controlled trial with high attrition that did not control for background characteristics likely to have affected the outcomes of interest. This means we are not confident that the estimated effects are attributable to values affirmation; other factors are likely to have contributed.","Values Affirmation","Science, Technology, Engineering, and Math (STEM) programs Youth programs","Youth, Female",,"United States",2010,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Leveling the intra-household playing field: Compensation and specialization in child labor allocation","Del Carpio, X. V., & Macours, K. (2010). Leveling the intra-household playing field: Compensation and specialization in child labor allocation. In R. K. Akee, E. V. Edmonds, & K. Tatsiramos (Eds.), Child Labor and the Transition Between School and Work (pp. 259-295). Bingley, UK: Emerald Publishing Limited.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Mixed impacts Child labor","Summary: The study’s objective was to examine the impact of Atención a Crisis (""Attention to the Crisis”), a conditional cash transfer (CCT) program, on the allocation of child labor within poor households with two or more children. This summary focuses on the comparison between the treatment group receiving the basic CCT plus the business grant and the control group. The study was a randomized controlled trial (RCT) in northwest Nicaragua. The authors analyzed data from a household survey given at baseline and nine months into the program. The authors compared household allocation of child labor by age and gender of children in households with two or more children. The study found that in households receiving the basic CCT plus the business grant, economic labor significantly decreased for boys but not girls. Boys decreased their hours per week in economic work (including agricultural, livestock, and non-agricultural economic activity) by 1.8 hours compared to girls. Older boys, aged 10-15, showed a larger reduction in economic work by 3.3 hours a week compared to their siblings. However, older girls, aged 10-15, showed an increase in economic work by 1.5 hours a week and domestic work of an hour a week compared to their siblings. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial with low attrition. This means we are confident that the estimated effects are attributable to Atención a Crisis, and not to other factors.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2010,https://openknowledge.worldbank.org/bitstream/handle/10986/4020/WPS4822.pdf?seq…,"Child Labor Review Protocol" "Persistence of women and minorities in STEM field majors: Is it the school that matters?","Griffith, A. (2010). Persistence of women and minorities in STEM field majors: Is it the school that matters? Economics of Education Review, 29, 911-922.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study examined institutional and student factors that had the greatest effect on students’ decisions to persist in STEM majors, emphasizing factors promoting STEM degree completion for female and minority students. The author analyzed STEM persistence to the fourth year of undergraduate study in two data sets: the 1988 National Education Longitudinal Study and the 1999 National Longitudinal Survey of Freshmen (NLSF). In each data set, the author separately examined factors that predicted STEM degree completion for male, female, minority, and nonminority students who indicated at matriculation that they intended to pursue STEM majors. Students’ academic backgrounds were most likely to predict persistence in STEM. For both women and minorities in both data sets, a higher ratio of first-year STEM grade point average to total first-year grade point average was associated with a statistically significantly higher probability of completing a STEM degree. For minority students in the NLSF sample, taking more STEM Advanced Placement courses in high school also promoted persistence in postsecondary STEM study. No institutional factors were statistically significant predictors of STEM degree completion for either women or minorities.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Other barriers, Female",,"United States",2010,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Productive safety net program and children’s time use between work and schooling in Ethiopia","Woldehanna T. (2010). Productive safety net program and children’s time use between work and schooling in Ethiopia. In J. Cockburn & J. Kabubo-Mariara (Eds.). Child Welfare in Developing Countries (pp. 157-209). New York, NY: Springer.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Public Work Program (PWP) on child labor and schooling outcomes in rural Ethiopia. The study used a matched-comparison group design. Using data from a household survey, the author compared time spent in child labor and schooling among PWP participants and non-participants. The study found that participation in PWP was significantly associated with a lower amount of time spent on child care and household chores. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Public Work Program; other factors are likely to have contributed.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2010,https://rd.springer.com/chapter/10.1007/978-1-4419-6275-1_6,"Child Labor Review Protocol" "Climate for retention to graduation: A mixed methods investigation of student perceptions of engineering departments and programs","Wao, H., Lee, R., & Borman, K. (2010). Climate for retention to graduation: A mixed methods investigation of student perceptions of engineering departments and programs. Journal of Women and Minorities in Science and Engineering, 16(4), 293-317.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study's objective was to determine what characteristics of a college department (referred to as the climate) were conducive to retaining women and underrepresented minorities enrolled in an engineering program through graduation. The study took place at four engineering programs in Florida universities during the 2007–2008 academic year. The authors administered a Likert scale survey to a convenience sample of undergraduate students enrolled in engineering programs that measured nine aspects of the department’s climate (for example, faculty involvement or support, diversity, and student integration with department) as well as the student’s intent to leave the program. The authors then used regression analysis to determine which of the nine aspects of climate predicted a student’s intent to leave the program. In-person interviews and six focus groups supplemented survey findings. The study found that the aspects of college department climate predictive of a student’s intent to leave the program were institutional support (or the level of support and services provided by the institution to help students succeed), social and academic fit (or how well the student felt he or she was a part of the department), and personal agency and peer support (or one’s own involvement in the learning process and a peer atmosphere that encouraged success). There were no statistically significant differences in findings by gender or ethnicity, although interview and focus group data point toward complexities in how women and minorities experienced climate, suggesting that they might be more inclined than majority groups to rely on social support and fit than institutional support.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Other barriers, Female",,"United States",2010,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Work after prison: One-year findings from the Transitional Jobs Reentry Demonstration","Redcross, C., Bloom, D., Jacobs, E., Manno, M., Muller-Ravett, S., Seefeldt, D., Yahner, J., Young Jr., A., & Zweig, J. (2010). Work after prison: One-year findings from the Transitional Jobs Reentry Demonstration. New York: MDRC.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Transitional Jobs Reentry Demonstration (TJRD) on ex-offenders’ employment and wages. The study used a randomized controlled trial to assign former prisoners to either the transitional jobs program or to a control group that was offered job search assistance. The authors compared the two groups’ employment and earnings outcomes one year after random assignment, controlling for participants’ characteristics before random assignment. The study found that members of the transitional jobs group were 8.6 percentage points more likely than control group members to be employed during all four quarters of the year after random assignment, but 8.9 percentage points less likely to have unsubsidized employment during the year after random assignment. Transitional jobs group members’ total earnings from all jobs were $1,419 higher, on average, than those of control group members during the year after random assignment, but their total earnings from unsubsidized jobs were $625 lower. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the TJRD, and not to other factors.","the Transitional Jobs Reentry Demonstration (TJRD)","Job search assistance and supportive services Other employment and reemployment Reentry","Justice-involved, Male, Low income",,"United States",2010,http://files.eric.ed.gov/fulltext/ED514698.pdf,"Employment and Training Review Protocol" "Reducing child labour through conditional cash transfers: Evidence from Nicaragua's Red de Protección Social","Gee, K.A. (2010). Reducing child labour through conditional cash transfers: Evidence from Nicaragua's Red de Protección Social. Development Policy Review, 28(6), 711-732.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor","Summary: The study’s objective was to examine the impact of a conditional cash transfer program, Red de Protección Social (RPS), in Nicaragua on child labor outcomes for children who are working. The study was an expansion of an earlier randomized controlled trial (RCT). The author used survey data from the RCT taken before the program started (2000) and two years after (2002) to examine the probability and duration of child work. The study found that the receipt of the cash transfer significantly reduced the probability that a child would work by approximately 10.6 percent and, for a child that was working, significantly reduced the hours worked per week by approximately 3.65 hours, on average. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Red de Protección Social program, and not to other factors.","Red de Protección Social (RPS)","Child labor","Other, Low income",,"International, Rural",2010,,"Child Labor Review Protocol" "Why so few? Women in science, technology, engineering, and mathematics","Hill, C., Corbett, C., & St. Rose, A. (2010). Why so few? Women in science, technology, engineering, and mathematics. Washington, D.C.: American Association of University Women.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: This publication summarized the obstacles facing girls and women who wish to pursue academic or professional careers in STEM fields and highlighted solutions to these challenges at the secondary, postsecondary, and professional levels. The authors presented scholars’ investigations into issues surrounding gender differences in interest, retention, or careers in STEM, drawing on both interviews with the profiled scholars and their published studies. The paper concluded that bias and stereotypes, whether implicit or explicit, hindered girls’ development in STEM. According to the paper, promoting the idea that intelligence is not fixed and innate but can expand through hard work, dubbed the growth mindset, combats the notion that boys are inherently better at math and science than girls and encourages girls to persevere. Further, women in academic and industry STEM positions continued to suffer from bias and stereotypes, which can manifest themselves through unsupportive atmospheres or distorted perceptions of female employees’ competence. Clear standards for advancement can counteract some of these tendencies.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs Other disparities or discrimination in employment and earnings","Youth, Female",,"United States",2010,http://www.aauw.org/files/2013/02/Why-So-Few-Women-in-Science-Technology-Engine…,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Leveling the intra-household playing field: Compensation and specialization in child labor allocation","Del Carpio, X. V., & Macours, K. (2010). Leveling the intra-household playing field: Compensation and specialization in child labor allocation. In R. K. Akee, E. V. Edmonds, & K. Tatsiramos (Eds.), Child Labor and the Transition Between School and Work (pp. 259-295). Bingley, UK: Emerald Publishing Limited.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor","Summary: The study’s objective was to examine the impact of Atención a Crisis (""Attention to the Crisis”), a conditional cash transfer (CCT) program, on the allocation of child labor within poor households with two or more children. This summary focuses on the comparison between the treatment group receiving the basic CCT and the control group. The study was a randomized controlled trial (RCT) in northwest Nicaragua. The authors analyzed data from a household survey given at baseline and nine months into the program. The authors compared household allocation of child labor by age and gender of children in households with two or more children. The study found that in households receiving the basic CCT, economic labor significantly decreased for boys but not girls. Boys decreased their hours per week in economic work (including agricultural, livestock, and non-agricultural economic activity) by 1.1 hours compared to girls. Older boys aged, 10-15, also showed a larger, significant reduction in economic work of 3.0 hours a week compared to their siblings. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial with low attrition. This means we are confident that the estimated effects are attributable to Atención a Crisis, and not to other factors.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2010,https://openknowledge.worldbank.org/bitstream/handle/10986/4020/WPS4822.pdf?seq…,"Child Labor Review Protocol" "Productive safety net program and children’s time use between work and schooling in Ethiopia","Woldehanna T. (2010). Productive safety net program and children’s time use between work and schooling in Ethiopia. In J. Cockburn & J. Kabubo-Mariara (Eds.). Child Welfare in Developing Countries (pp. 157-209). New York, NY: Springer.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Direct Support Program (DSP) on child labor and schooling outcomes in Ethiopia. The study used a matched-comparison group design. Using data from a household survey, the author compared time spent in child labor and schooling among DSP participants and non-participants. The study found that participation in the DSP was significantly associated with a lower amount of total time spent in work outside home, time spent in unpaid work outside the home and a composite measure of total work (paid and unpaid outside the home plus child care and household chores). The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Direct Support Program; other factors are likely to have contributed.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2010,https://rd.springer.com/chapter/10.1007/978-1-4419-6275-1_6,"Child Labor Review Protocol" "The impact of conditional cash transfer programs on household work decisions in Brazil","Ferro, A. R., Lúcia Kassouf, A., & Levison, D. (2010). The impact of conditional cash transfer programs on household work decisions in Brazil. In R. K. Akee, E. V. Edmonds, & K. Tatsiramos (Eds.), Child Labor and the Transition between School and Work (pp. 193-218). Bingley, UK: Emerald Publishing Limited.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The purpose of the study was to examine the impact of the Bolsa Escola program, which provided conditional cash transfers to families in Brazil, on child labor and school enrollment. The authors used a nonexperimental matched comparison group design to compare the outcomes of children ages 6-15 that received the conditional cash transfers with those who had applied but who had not received it (waitlisted families), based on data from Brazil’s national household survey. The study found that receipt of the Bolsa Escola benefit was significantly related to higher rates of school enrollment and lower rates of child labor. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Bolsa Escola program; other factors are likely to have contributed.","Bolsa Escola","Child labor","Other, Low income",,International,2010,http://www.anpec.org.br/encontro2009/inscricao.on/arquivos/000-dde4869521f17def…,"Child Labor Review Protocol" "Does prison-based adult basic education improve postrelease outcomes for male prisoners in Florida?","Cho, R. M., & Tyler, J. H. (2010). Does prison-based adult basic education improve postrelease outcomes for male prisoners in Florida? Crime & Delinquency, 59(7), 975-1005. [Study 1, Contrast 4: participation in adult basic education vs. no participation in adult basic education.]",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Unfavorable impacts Earnings and wages Employment-Low-Mixed impacts Employment","Summary: The study examined the impact of participation in prison-based adult basic education on post-release employment, earnings, and recidivism for incarcerated people who read below the 9th-grade level. The authors also investigated similar research questions for other contrasts, the profiles of which are available here. The authors used a statistical model to compare outcomes for treatment and comparison group members, drawing on data from the Florida Department of Corrections, The Florida Department of Law Enforcement, and the Florida Education and Training Placement Information Program. The study found statistically significant relationships between participation in an adult basic education course and post-release employment and earnings. Compared with people who did not participate in adult basic education, those who did had lower earnings and both lower and higher employment depending on the statistical model used. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups compared were similar before the intervention. This means we are not confident that the estimated relationships are attributable to participated in an adult basic education program; other factors are likely to have contributed.","Adult basic education","Basic skills Reentry","Justice-involved, Male",,"United States",2010,https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4288462/,"Employment and Training Review Protocol" "Reentry experiences of confined juvenile offenders: Characteristics, service receipt and outcomes of juvenile male participants in the SVORI multi-site evaluation. The multi-site evaluation of the Serious and Violent Offender Reentry Initiative.","Hawkins, S., Lattimore, P., Dawes, D., & Visher, C. (2010). Reentry experiences of confined juvenile offenders: Characteristics, service receipt and outcomes of juvenile male participants in the SVORI multi-site evaluation. The multi-site evaluation of the Serious and Violent Offender Reentry Initiative. NCJ 230423. Research Triangle Park, NC: RTI.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Education and skills gains-Mod/high-Mixed impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment","Summary: The study examined the impact of the Serious and Violent Offender Reentry Initiative (SVORI) on employment, education, and recidivism among juvenile incarcerated males. The study used propensity scores to match participants in SVORI to nonparticipants who were similar on observed characteristics. The study used data from interviews collected at multiple time points through 15 months after release. The study found that SVORI participants were more likely than nonparticipants to be enrolled in school 3 months post-release (68 and 52 percent, respectively) and were more likely than nonparticipants to have a job with benefits 15 months post-release (69 and 40 percent, respectively). The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the SVORI program, but other factors might also have contributed.","Serious and Violent Offender Reentry Initiative (SVORI)","Other employment and reemployment Other health and safety Reentry Substance abuse recovery Youth programs","Youth, Justice-involved, Disconnected youth, Male",,"United States",2010,https://www.ncjrs.gov/pdffiles1/nij/grants/230423.pdf,"Opportunities for Youth Review Protocol" "Women in the academy: Female leadership in STEM education and the evolution of a mentoring web","Gorman, S., Durmowicz, M., Roskes, E., & Slattery, S. (2010). Women in the academy: Female leadership in STEM education and the evolution of a mentoring web. Forum on Public Policy Online, 2010(2), 1-21.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The authors described the Stevenson University School of the Sciences in Maryland as an example of an academic institution that deviated widely from the norm of female under-representation in STEM departments, not only among enrolled students but among faculty members and departmental leadership. They proposed several institutional mechanisms for this unusual success, including mentoring programs for several groups: academic leadership, faculty seeking promotion, new faculty, and students. At the time of publication, two School of the Sciences faculty members had applied for promotion under the Faculty Mentoring and Evaluation Committee system, a formalized mentoring structure through which each faculty member received support and professional guidance from a mentor group comprising the mentee’s department chair and at least two faculty peers, one from outside the department. Both faculty members were successful. Preliminary assessments of student mentoring programs that paired freshman biology or chemistry majors with upper-class students in their department suggest that participation augmented both mentors’ and mentees’ sense of community, support, and encouragement. In some cases, the program also promoted retention in the discipline.",,"Youth programs Mentoring Science, Technology, Engineering, and Math (STEM) programs","Youth, Female",,"United States",2010,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Productive safety net program and children’s time use between work and schooling in Ethiopia","Woldehanna T. (2010). Productive safety net program and children’s time use between work and schooling in Ethiopia. In J. Cockburn & J. Kabubo-Mariara (Eds.). Child Welfare in Developing Countries (pp. 157-209). New York, NY: Springer.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Agricultural Extension Support Program (AEP) on child labor and schooling outcomes in rural Ethiopia. The study used a matched-comparison group design. Using data from a household survey, the author compared time spent in child labor and schooling among AEP participants and non-participants. The study found that AEP participation was significantly related to lower amounts of time spent in paid work and in a combined measure of all work, as well as greater amounts of time spent in school. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Agricultural Extension Support Program; other factors are likely to have contributed.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2010,https://rd.springer.com/chapter/10.1007/978-1-4419-6275-1_6,"Child Labor Review Protocol" "Can Social Security explain trends in labor force participation of older men in the United States?","Blau, D. M., & Goodstein, R. M. (2010). Can Social Security explain trends in labor force participation of older men in the United States? Journal of Human Resources, 45(2), 328-363.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The study examined the impact of changes in Social Security Administration (SSA) retirement rules on men’s labor force participation rates in the 1960s–1980s and 1990s–2000s. The study used regression analyses to predicted labor force participation rates using actual and counterfactual SSA retirement rules. These analyses use data from the Current Population Survey (CPS) and the Survey of Income and Program Participation (SIPP) for the period from 1962 to 2005 merged with data from SSA on taxable earnings. The study found that changes in the delayed retirement credit and full retirement age in 1983 could explain one-quarter to one-half of the increase in labor force participation in the early 2000s. The quality of causal evidence presented in this report is moderate, because it is a well-implemented nonexperimental study. This means we are somewhat confident that the estimated effects are attributable to SSA reforms, but other factors might also have contributed.","Social Security Administration Reforms","Federal retirement benefits Older workers' programs","Adult, Older worker, Male",,"United States",2010,http://jhr.uwpress.org/content/45/2/328.abstract,"Employment and Training Review Protocol" "The Effectiveness of Institutional Intervention on Minimizing Demographic Inertia and Improving the Representation of Women Faculty in Higher Education","Bakian, A.V., & Sullivan, K.A. (2010). The Effectiveness of Institutional Intervention on Minimizing Demographic Inertia and Improving the Representation of Women Faculty in Higher Education. International Journal of Gender, Science and Technology, 2(2), 207-234.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: This study’s objective was to examine the effect of the ADVANCE program sponsored by the National Science Foundation (NSF) on women’s representation among tenured and tenure-track faculty. The study took place at one unnamed research university. The authors compared the transition probabilities (that is, the probabilities of being hired, retained, or promoted) for men and women, before and during the period ADVANCE was in effect. The study found that the ADVANCE program enhanced women’s representation among faculty in science and engineering departments. The quality of causal evidence presented in this study is low. This means we are not confident that the estimated effects are attributable to the ADVANCE program. Other factors are likely to have contributed.","the ADVANCE Program","Other disparities or discrimination in employment and earnings Science, Technology, Engineering, and Math (STEM) programs","Female, STEM professional",,"United States",2010,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Does prison-based adult basic education improve postrelease outcomes for male prisoners in Florida?","Cho, R. M., & Tyler, J. H. (2010). Does prison-based adult basic education improve postrelease outcomes for male prisoners in Florida? Crime & Delinquency, 59(7), 975-1005. [Comparison 3: participation in adult basic education vs. involuntary dropout of adult basic education.]",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study examined the impact of prison-based adult basic education courses on post-release employment and earnings for incarcerated people who read below the 9th-grade level. The authors also investigated similar research questions for other contrasts, the profiles of which are available here. The authors used a statistical model to compare outcomes for treatment and comparison group members, drawing on data from the Florida Department of Corrections, The Florida Department of Law Enforcement, and the Florida Education and Training Placement Information Program. The study found statistically significant, positive relationships between participation in an adult basic education course and post-release employment and earnings. Those who participated in adult basic education tended to have higher employment rates and earnings than did those who involuntarily dropped out of adult basic education. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to adult basic education; other factors are likely to have contributed.","Adult basic education","Basic skills Reentry","Justice-involved, Male",,"United States",2010,https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4288462/,"Employment and Training Review Protocol" "Prisoner reentry experiences of adult females: Characteristics, Service Receipt, and Outcomes of Participants in the SVORI multi-site evaluation.","Lindquist, C. H., Lattimore, K. B., & Visher C. A. (2009) Prisoner reentry experiences of adult females: Characteristics, Service Receipt, and Outcomes of Participants in the SVORI multi-site evaluation. Research Triangle Park, NC: RTI International.",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Low-Favorable impacts Employment Public benefits receipt-Low-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of a violent prisoner reentry program, the Serious and Violent Offender Reentry Initiative (SVORI), on several outcomes of female prisoners reentering society, including employment, public benefit receipt, and recidivism. The authors used a matched comparison group design, using propensity-score weights, to analyze impacts of the SVORI program for females released from prison. The authors collected four waves of survey data to analyze impacts from before release up to 15 months after release. In addition, the authors obtained state administrative data describing recidivism at 24 months after release. The study found that people in the SVORI group were more likely to be employed after release than those in the comparison group, but it found no significant differences between the groups in public benefit receipt or recidivism outcomes. The quality of causal evidence presented in this report for the recidivism outcomes based on survey data is moderate because it was based on a well-implemented nonexperimental design. This means we are confident that any estimated effects would have been attributable to SVORI and not to other factors had the study found statistically significant effects. The quality of causal evidence presented in this report for the recidivism outcomes based on administrative data and for the employment and public benefit receipt outcomes is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects on employment are attributable to SVORI; other factors are likely to have contributed.","the Serious and Violent Offender Reentry Initiative (SVORI)",Reentry,"Justice-involved, Female",,"United States",2010,https://www.ncjrs.gov/App/AbstractDB/AbstractDBDetails.aspx?id=252453,"Employment and Training Review Protocol" "Does prison-based adult basic education improve postrelease outcomes for male prisoners in Florida?","Cho, R. M., & Tyler, J. H. (2010). Does prison-based adult basic education improve postrelease outcomes for male prisoners in Florida? Crime & Delinquency, 59(7), 975-1005. [Comparison #2: completion of adult basic education vs. no participation in adult basic education.]",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Unfavorable impacts Earnings and wages Employment-Low-Mixed impacts Employment","Summary: The study examined the impact of prison-based adult basic education courses on post-release employment, earnings, and recidivism for incarcerated people who read below the 9th-grade level. The authors also investigated similar research questions for other contrasts, the profiles of which are available here. The authors used a statistical model to compare outcomes for treatment and comparison group members, drawing on data from the Florida Department of Corrections, The Florida Department of Law Enforcement, and the Florida Education and Training Placement Information Program. The study found statistically significant relationships between completing an adult basic education course and post-release earnings and employment, where those who completed adult basic education tended to have lower earnings and lower employment over the full study period, but higher employment in the first year after release compared than did those who did not participate in adult basic education while incarcerated. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups compared were similar before the intervention. This means we are not confident that the estimated relationships are attributable to the completion of an adult basic education course; other factors are likely to have contributed.","Adult basic education","Basic skills Reentry","Justice-involved, Male",,"United States",2010,https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4288462/,"Employment and Training Review Protocol" "Leveling the intra-household playing field: Compensation and specialization in child labor allocation","Del Carpio, X. V., & Macours, K. (2010). Leveling the intra-household playing field: Compensation and specialization in child labor allocation. In R. K. Akee, E. V. Edmonds, & K. Tatsiramos (Eds.), Child Labor and the Transition Between School and Work (pp. 259-295). Bingley, UK: Emerald Publishing Limited.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor","Summary: The study’s objective was to examine the impact of Atención a Crisis (""Attention to the Crisis”), a conditional cash transfer program, on the allocation of child labor within poor households with two or more children. This summary focuses on the comparison between all treatment groups and the control group. The study was a randomized controlled trial (RCT) in northwest Nicaragua. The authors analyzed data from a household survey given at baseline and nine months into the program. The authors compared household allocation of child labor by age and gender of children in households with two or more children. The study found that in treatment households, economic labor significantly decreased for boys but not girls. Boys significantly decreased their hours per week in economic work (including agricultural, livestock, and non-agricultural economic activity) by 1.3 hours compared to girls. Older boys aged, 10-15, showed a larger, significant reduction in economic work by 2.8 hours a week compared to their siblings. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial with low attrition. This means we are confident that the estimated effects are attributable to Atención a Crisis, and not to other factors.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2010,https://openknowledge.worldbank.org/bitstream/handle/10986/4020/WPS4822.pdf?seq…,"Child Labor Review Protocol" "Child education and work choices in the presence of a conditional cash transfer programme in rural Colombia","Attanasio, O., Fitzsimons, E., Gomez, A., Gutierrez, M. I., Meghir, C., & Mesnard, A. (2010). Child education and work choices in the presence of a conditional cash transfer programme in rural Colombia. Economic Development and Cultural Change, 58(2), 181-210. doi:10.1086/648188.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The objective of this study was to examine the impact of the conditional cash transfer program, Familias en Acción, on children’s work and school participation in Columbia. The study used a nonexperimental design to compare labor and schooling outcomes of children who received the conditional cash transfer with a comparison group of children who did not, based on data from a survey. The study found that receipt of the cash transfer was significantly associated with a decrease in the likelihood of participating in domestic work for urban children aged 10 to 17, a decrease in the hours spent in income-generating work for urban children aged 14 to 17, and a decrease in the hours spent in domestic work for all but rural children aged 14 to 17. Receipt of the cash transfer was also significantly related to an increase in the hours spent in school for all children in urban and rural areas. The quality of causal evidence presented in the study is low because the authors did not control for pre-intervention outcomes. This means we are not confident that the estimated effects are attributable to the Familias en Acción program; other factors are likely to have contributed.","Familias en Acción","Child labor","Other, Low income",,"International, Rural",2010,http://openaccess.city.ac.uk/5381/1/Child_Education.pdf,"Child Labor Review Protocol" "Change the gender composition of high school computing courses (case study 2): Attracting females and minority students through targeted recruiting","Cohoon, J.M. (2010). Change the gender composition of high school computing courses (case study 2): Attracting females and minority students through targeted recruiting. Boulder, CO: National Center for Women & Information Technology.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The study's objective was to describe several critical components to targeted recruitment for information technology courses, with a particular focus on the recruitment of girls and women. The author described the strategies used by one high school computer science teacher to increase the enrollment of girls in his Advanced Placement Computer Science course. The author then suggested several components that are necessary for any targeted recruitment strategy to be successful. The study recommended having a strategic recruiting plan that outlined the goal, partners, evaluation plan, and materials of the recruiting effort. The goal should be specific and quantifiable, and partnerships should be based on existing contacts who work with the target audience. The recruitment message should focus on the interests and concerns of the target audience, and should be conveyed in multiple ways and delivered through a credible source. The study summarized these recommendations in a recruiting quick list.",,"Youth programs Science, Technology, Engineering, and Math (STEM) programs","Youth, Female",,"United States",2010,http://www.ncwit.org/sites/default/files/resources/changegendercompositionhighs…,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Does prison-based adult basic education improve postrelease outcomes for male prisoners in Florida?","Cho, R. M., & Tyler, J. H. (2010). Does prison-based adult basic education improve postrelease outcomes for male prisoners in Florida? Crime & Delinquency, 59(7), 975-1005. [Comparison 1: completion of adult basic education course vs. involuntary dropout of adult basic education course.]",Reentry,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study examined the impact of prison-based adult basic education courses on post-release employment and earnings for incarcerated people who read below the 9th-grade level. The authors also investigated similar research questions for other contrasts, the profiles of which are available here. The authors used a statistical model to compare outcomes for treatment and comparison group members, drawing on data from the Florida Department of Corrections, the Florida Department of Law Enforcement, and the Florida Education and Training Placement Information Program. The study found statistically significant relationships between completing an adult basic education course and post-release employment, where those who completed an adult basic education course tended to have higher employment rates after release from incarceration than did those who dropped out of adult basic education. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the completion of an adult basic education course; other factors are likely to have contributed.","Adult basic education","Basic skills Reentry","Justice-involved, Male",,"United States",2010,https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4288462/,"Employment and Training Review Protocol" "Limiting child labor through behavior-based income transfers: An experimental evaluation of the PETI program in rural Brazil","Yap, Y. T., Sedlacek, G., & Orazem, P. F. (2009). Limiting child labor through behavior-based income transfers: An experimental evaluation of the PETI program in rural Brazil. In P. F. Orazem, G. Sedlacek, & Z. Tzannatos (Eds.), Child Labor and Education in Latin America (pp. 147-165). New York, NY: Palgrave Macmillan. doi.org/10.1057/9780230620100_10","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Programa de Erradicacao do Trabalho Infantil (PETI) or Program to Eradicate Child Labor on child labor and hours in school. The authors used an experimental design to compare the outcomes of children ages 7 to 14 residing in municipalities who received income transfers with those residing in municipalities who did not receive income transfers. Based on data from Brazil’s national household survey, the authors used statistical models to assess the impact of the program in each group. The PETI program was significantly associated with an increase in time in school and less time in work for participating children. The quality of causal evidence presented in this report is low because it is a randomized controlled trial with unknown attrition and the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the PETI program; other factors are likely to have contributed.","Programa de Erradicacao do Trabalho Infantil (PETI) or Program to Eradicate Child Labor","Child labor","Other, Low income",,"International, Rural",2009,,"Child Labor Review Protocol" "The impact of Ethiopia’s Productive Safety Net Program on schooling and child labor","Hoddinott, J., Gilligan, D. O., & Taffesse, A. S. (2009). The impact of Ethiopia’s Productive Safety Net Program on schooling and child labor. Retrieved from http://ssrn.com/abstract=1412291","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Unfavorable impacts Child labor Education and skills gains-Low-No impacts Education and skills gains","Summary: The purpose of the study was to assess the impact of Ethiopia’s Productive Safety Net Program (PSNP) on child labor and school attendance, along with the potential added benefit of participation in the Other Food Security Program (OFSP). This summary focuses on the comparison between the group receiving both the PSNP and OFSP benefit and the comparison group. The study used a nonexperimental design to compare the outcomes of children ages 6-16 that received the cash transfers with those who did not, based on data from the Food Security Program Survey. Using several demographic characteristics, the authors created a matched comparison group of households who did not receive the benefit to assess the effectiveness of the cash transfer program. The study found a significant relationship between receipt of benefits from both PSNP and OFSP and an increase in domestic chores for girls. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention.This means we are not confident that the estimated effects are attributable to the Productive Safety Net Program or the Other Food Security Program; other factors are likely to have contributed.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2009,http://ssrn.com/abstract=1412291,"Child Labor Review Protocol" "The strength of weak enforcement: The impact of discrimination charges, legal environments, and organizational conditions on workforce segregation","Hirsh, C. (2009). The strength of weak enforcement: The impact of discrimination charges, legal environments, and organizational conditions on workforce segregation. American Sociological Review, 74, 245-271.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Compliance-Low-Favorable impacts Compliance","Summary: The study’s objective was to assess two approaches to mitigating employment discrimination: direct Equal Employment Opportunity Commission (EEOC) enforcement and indirect, industry-level EEOC enforcement. The author applied a fixed-effects regression analysis to a national random sample of private U.S. employment establishments required to report race and gender data to the EEOC from 1990 to 2002. The study found that EEOC settlements mandating policy changes or monetary payouts within an industry were associated with statistically significant decreases in sex segregation within establishments in the industry, but had limited effects on race segregation. The quality of causal evidence presented in this report is low because the authors did not establish that firms subject to different levels of enforcement activities were similar before those activities. This means we are not confident that the estimated effects are attributable to either direct or indirect EEOC enforcement; other factors are likely to have contributed.","Equal Employment Opportunity Commission Enforcement","Civil Rights Act of 1964 Equal Employment Opportunity Act of 1972",Other,,"United States",2009,,"Employer Compliance Review Protocol" "Own and sibling effects of contiditional cash transfer programs: Theory and evidence from Cambodia","Ferreira, F. H. G., Filmer, D., & Schady, N. (2009). Own and sibling effects of conditional cash transfer programs: Theory and evidence from Cambodia (Policy Research Working Paper 5001, Impact Evaluationo Series). Washington, DC: The World Bank.","Child Labor","Study Type: Descriptive Analysis",,,"Summary: The objective of this study was to examine the impact of the CESSP Scholarship Program (CSP), a conditional cash transfer valued at 2-3 percent of household expenditure, on children’s and their ineligible siblings’ school enrollment and work participation in Cambodia. This study is an intent-to-treat regression discontinuity design. Data were collected from applications at all 100 CSP schools, as well as from household surveys at five randomly selected schools and households in five provinces, eighteen months after application. The cutoff score that was used to decide who would receive the scholarship offer was based on the application forms; 26 questions correlated with how likely the child was to drop out of school. Enrollment and work outcomes were compared for students around the cutoff score who did, and did not, receive a scholarship offer and their siblings. The study found children who received the scholarships were significantly more likely to be enrolled in school and less likely to work for pay than those that did not receive the scholarship. However, girls that received the scholarships were significantly more likely to work without pay. This study uses a regression discontinuity design and therefore was reviewed using CLEAR’s descriptive study evidence review guidelines. As such it does not receive a causal rating.","CESSP Scholarship Program (CSP)","Child labor Tuition assistance","Other, Low income",,International,2009,,"Child Labor Review Protocol" "Using appreciative inquiry as a tool to instigate transformational change in recruiting and developing women faculty in STEM disciplines","Nemiro, J., Hacker, B., Ferrel, M., & Guthrie, R. (2009). Using appreciative inquiry as a tool to instigate transformational change in recruiting and developing women faculty in STEM disciplines. International Journal of Gender, Science and Technology, 1(1), 5-35.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Descriptive Analysis",,,"Summary: The authors’ main objective was to develop recommendations for recruiting and developing female faculty in STEM disciplines. The authors conducted a series of eight focus groups with science and engineering faculty at a university in the United States to discuss what the organization currently did well and what it could do well in the future, and drew out common themes across the discussions. The authors recommended the following best practices for institutions to better recruit female faculty in STEM: (1) create clear and transparent job postings; (2) promote the benefits that the department, university, and community have to offer potential candidates; and (3) actively recruit candidates (for example, by developing relationships with universities and pursuing candidates before they apply for a position). The authors also suggested best practices for developing female faculty, including training staff at all levels on the cognitive biases against women, creating within-organization mentoring and networking opportunities for female faculty in STEM, developing family-friendly policies such as leave and flexible schedules, allotting time and funding for professional development, and actively developing women for leadership positions.",,"Science, Technology, Engineering, and Math (STEM) programs","Female, STEM professional",,"United States",2009,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Improving 24-month abstinence and employment outcomes for substance-dependent women receiving Temporary Assistance for Needy Families with intensive case management.","Morgenstern, J., Neighbors, C., Kuerbis, A., Riordan, A., Blanchard, K., McVeigh, K., Morgan, T., & McCrady, B. (2009). Improving 24-month abstinence and employment outcomes for substance-dependent women receiving Temporary Assistance for Needy Families with intensive case management. American Journal of Public Health, 99(2), 328-333.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact on employment of an intensive case management (ICM) program for substance-dependent women receiving Temporary Assistance for Needy Families (TANF). Women identified as substance-dependent were randomly assigned to either the ICM or usual care treatment programs. The primary data sources were daily self-reports and follow-up interviews conducted 3, 9, 15, and 24 months after random assignment. The study found that women in the ICM group were generally significantly more likely than women in the usual care group to be employed full-time, particularly at the 24-month follow-up period. In addition, the study found a significantly higher rate of improvement in employment outcomes for the ICM group compared with the usual care group. The quality of causal evidence presented in this report is low because it was based on a randomized controlled trial with high attrition and the authors did not account for differences between the two groups in their analysis. This means we are not confident that the estimated effects are attributable to the ICM or usual care program; other factors are likely to have contributed.","Intensive Case Management (ICM) and Usual Care Programs","Other employment and reemployment Substance abuse recovery","Female, Low income",,"United States",2009,,"Employment and Training Review Protocol" "The impact of Ethiopia’s Productive Safety Net Program on schooling and child labor","Hoddinott, J., Gilligan, D. O., & Taffesse, A. S. (2009). The impact of Ethiopia’s Productive Safety Net Program on schooling and child labor. Retrieved from http://ssrn.com/abstract=1412291","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-No impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The purpose of the study was to assess the impact of Ethiopia’s Productive Safety Net Program (PSNP) on child labor and school attendance, along with the potential added benefit of participation in the Other Food Security Program (OFSP). This summary focuses on the comparison between the group receiving a certain amount of the PSNP benefit and the comparison group. The study used a nonexperimental design to compare the outcomes of children ages 6-16 that received the cash transfers with those who did not, based on data from the Food Security Program Survey. Using several demographic characteristics, the authors created a matched comparison group of households who did not receive the benefit to assess the effectiveness of the cash transfer program. The study found that for boys ages 6-16, there was a significant relationship between households receiving a certain amount of cash transfer and increased school attendance rates. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Productive Safety Net Program; other factors are likely to have contributed.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2009,http://ssrn.com/abstract=1412291,"Child Labor Review Protocol" "The impact of Ethiopia’s Productive Safety Net Program on schooling and child labor","Hoddinott, J., Gilligan, D. O., & Taffesse, A. S. (2009). The impact of Ethiopia’s Productive Safety Net Program on schooling and child labor. Retrieved from http://ssrn.com/abstract=1412291","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-No impacts Child labor Education and skills gains-Low-No impacts Education and skills gains","Summary: The purpose of the study was to assess the impact of Ethiopia’s Productive Safety Net Program (PSNP) on child labor and school attendance, along with the potential added benefit of participation in the Other Food Security Program (OFSP). This summary focuses on the comparison between the group receiving the PSNP benefit and the comparison group. The study used a nonexperimental design to compare the outcomes of children ages 6-16 that received the cash transfers with those who did not, based on data from the Food Security Program Survey. Using several demographic characteristics, the authors created a matched comparison group of households who did not receive the benefit to assess the effectiveness of the cash transfer program. The study did not find a significant relationship between receipt of benefits from PSNP and the number of hours worked (in domestic labor, agricultural labor, or total labor hours) or school attendance rates. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention.This means we are not confident that the estimated effects are attributable to the Productive Safety Net Program; other factors are likely to have contributed.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2009,http://ssrn.com/abstract=1412291,"Child Labor Review Protocol" "Supporting young women to enter engineering: Long-term effects of a middle school engineering outreach program for girls","Demetry, C., Hubelbank, J., Blaisdell, S., Sontgerath, S., Nicholson, M.E., Rosenthal, E., & Quinn, P. (2009). Supporting young women to enter engineering: Long-term effects of a middle school engineering outreach program for girls. Journal of Women and Minorities in Science and Engineering 15, 119-142.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to assess the long-term impact of Camp Reach, a summer engineering enrichment program for middle school girls, on enrollment in STEM courses in high school and college. Admission to Camp Reach was determined through a lottery of girls who applied to the program and met eligibility requirements. Six to seven years later, the authors administered a survey to 109 girls who had been admitted to the program and 107 girls who had not. Many girls in the control group attended other, similar programs. The study found that members of the control group who had attended other summer science or engineering programs at Worcester Polytechnic Institute (WPI) were significantly more likely to have taken high school calculus than were members of the Camp Reach Partial group. There were no statistically significant differences on taking physics, computer science, other science and engineering courses, or planning to major in engineering in high school. The quality of causal evidence presented in this report is low because the authors adjusted the research sample after random assignment and did not include adequate controls to ensure that the resulting groups were similar on all relevant attributes. This means we are not confident that the estimated effects were attributable to Camp Reach; other factors are likely to have contributed.","Camp Reach","Science, Technology, Engineering, and Math (STEM) programs Youth programs","Youth, Female",,"United States",2009,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "The impact of cash transfers on child labor and school enrollment in Brazil","Cardoso, E., & de Souza, A. F. (2009). The impact of cash transfers on child labor and school enrollment in Brazil. In P. F. Orazem, G. Sedlacek, & Z. Tzannatos (Eds.), Child labor and education in Latin America: An Economic perspective. Houndmills, U.K. and New York: Palgrave Macmillan.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-No impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of two Brazilian income transfer programs (Minimum Income and Bolsa Escola) on child labor and school enrollment. The authors used a nonexperimental design to compare the outcomes of children ages 10 to 15 that received the conditional cash transfers with those who had not, based on data from the 2000 Brazilian Census. Using several demographic characteristics, they created a matched comparison group of families who had not received the transfers but who had similar characteristics to the treatment group to assess the effectiveness of the cash transfer program. The study found that the income transfer programs were significantly associated with an increase in school enrollment but not significantly associated with child labor. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the income transfer programs; other factors are likely to have contributed.","Income Transfer Programs (Minimum Income Program and Bolsa Escola)","Child labor","Other, Low income",,International,2009,https://ideas.repec.org/p/van/wpaper/0407.html,"Child Labor Review Protocol" "Evaluating the direct and indirect effects of a conditional income support program: The case of Progresa","Badillo Bautista, C. (2009). Evaluating the direct and indirect effects of a conditional income support program: The case of Progresa (Doctoral dissertation). Retrieved from ProQuest Dissertations & Theses A&I. (Accession No. 1314572898)","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor","Summary: The objective of the study was to examine the impact of Mexico’s conditional cash transfer program (PROGRESA/Oportunidades) on child labor for children ages 8 to 17. Using survey data from a cluster randomized controlled trial, the authors analyzed the average program impact of the PROGRESA/Oportunidades program using a difference-in- differences (DID) regression model for the child labor outcome and cross-sectional models to estimate spillover effects on child labor. The study found the number of children aged 12-16 who worked significantly decreased in cash transfer participating households compared to control households. The quality of causal evidence presented in this study is high because it is based on a well-implemented, low attrition randomized controlled trial. This means we are confident that the estimated effects are attributable to PROGRESA/Oportunidades and not to other factors.",PROGRESA/Oportunidades,"Child labor","Other, Low income",,"Rural, International",2009,,"Child Labor Review Protocol" "Education and child labor: Experimental evidence from a Nicaraguan conditional cash transfer program","Maluccio, J. A. (2009). Education and child labor: Experimental evidence from a Nicaraguan conditional cash transfer program. In P. F. Orazem, G. Sedlacek, & Z. Tzannatos (Eds.), Child labor and education in Latin America: An economic perspective (pp. 187-204). New York, NY: Palgrave Macmillan. doi.org/10.1057/9780230620100_12","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Red de Proteccion Social (RPS) cash transfer program on school attendance and enrollment and on child labor for children aged 7-13 in rural Nicaragua. Using panel survey data collected before and one year after program implementation, the author measured the impact of RPS using a randomized controlled trial (RCT). The study found that participation in RPS was significantly related to a reduction in child labor and a significant increase in school enrollment and attendance. The quality of the causal evidence presented in this report is low because, while it was based on an RCT, attrition was high and the authors did not demonstrate that the groups were similar at baseline. This means we are not confident that the estimated effects are attributable to the Red de Proteccion Social; other factors are likely to have contributed.","Red de Protección Social (RPS)","Child labor","Other, Low income",,"International, Rural",2009,,"Child Labor Review Protocol" "The repeal of the retirement earnings test and the labor supply of older men.","Engelhardt, G. V., & Kumar, A. (2009). The repeal of the retirement earnings test and the labor supply of older men. Journal of Pension Economics & Finance, 8(4), 429-450.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study examined the impact of the repeal of the earnings test under the Senior Citizens Freedom to Work Act of 2000 on the labor supply and earnings of older men ages 62 to 72. The authors used a nonexperimental approach and data from the Health and Retirement Study to compare labor force participation, annual hours of work, retirement behavior, and earnings of men who were and were not subject to the repeal of the earnings test. The study found that the policy change was associated with a significant increase in older men’s average annual hours of work. The policy change was also associated with a change in the distribution of real earnings in that a smaller proportion of older men had earnings at or below the earnings test threshold. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Senior Citizens Freedom to Work Act of 2000; other factors are likely to have contributed.","Senior Citizens Freedom to Work Act of 2000","Older workers' programs Other disparities or discrimination in employment and earnings","Adult, Older worker, Male",,"United States",2009,,"Employment and Training Review Protocol" "Assessment of the impact of WorkSource job search services","Lee, K., Weeks, G., Bodeutsch, G., Clay-Poole, S., Garoflo, T., Petritz, M., Stromsdorfer, E., Field, J., Paterson, T., & Jennings, K. (2009). Assessment of the impact of WorkSource job search services. Washington: Washington State Employment Security Department Labor Market and Economic Analysis.",Reemployment,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study’s objective was to assess the effectiveness of Washington State WorkSource job search services. WorkSource services included staff-assisted job matching, provision of labor market information, job search and placement assistance, and initial assessments. Using a nonexperimental design, the authors compared the employment and earnings of Unemployment Insurance (UI) claimants who received at least one WorkSource service with those of UI claimants who did not receive any WorkSource services using state UI administrative records for more than 64,000 Washington State UI claimants with no UI-reported wage earnings in the third quarter of 2007. The study found that WorkSource services were associated with a higher probability of employment and higher earnings growth for men and women who were intermittently (rather than continuously) employed in the baseline period. The quality of causal evidence presented in this report is low. This means we are not confident that the estimated effects are attributable to WorkSource services. Other factors are likely to have contributed.","JSA services","RESEA Job search assistance and supportive services","Unemployed, Female, Male",,"United States",2009,https://esdorchardstorage.blob.core.windows.net/esdwa/Default/ESDWAGOV/labor-ma…,"Reemployment Review Protocol" "Impact of the Uruguayan conditional cash transfer program","Borraz, F., & González, N. (2009). Impact of the Uruguayan conditional cash transfer program. Cuadernos de economia, 46(134), 243-271. doi:10.4067/S0717-68212009000200006","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to analyze the impact of a conditional cash transfer program (Ingreso Ciudadano) on school attendance (ages 8 to 14) and child labor (ages 6 to 14) among children in Uruguay from 2005 to 2007. Using the annual Uruguayan National Household Survey with cross sectional data from 2006 and 2007, the authors compared school attendance and child labor for households who received the conditional cash transfer to a group of non-participating households who had similar characteristics. The study found no statistically significant relationship between the conditional cash transfer program and school attendance. However, the study found a statistically significant relationship between the program and a reduction in child labor for females in the Montevideo region, but not for males in any region or females in the rest of the country. The quality of causal evidence presented in this report is low because the authors did not demonstrate that groups were similar at baseline. This means we are not confident that the estimated effects are attributable to Ingreso Ciudadano; other factors are likely to have contributed.","Ingreso Ciudadano","Child labor","Other, Low income",,International,2009,https://scielo.conicyt.cl/pdf/cecon/v46n134/art06.pdf,"Child Labor Review Protocol" "Conditional cash transfers in education: Design features, peer and sibling effects. Evidence from a randomized experiment in Columbia","Barrera-Osorio, F., Bertrand, M., Linden, L.L., & Perze-Calle, F. (2008). Conditional cash transfers in education: Design features, peer and sibling effects. Evidence from a randomized experiment in Columbia (World Bank Policy Research Working Paper 4580). Washington, DC: World Bank.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Child labor-Mod/high-No impacts Child labor Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of Subsidios Condicionados a la Asistencia Escolar, a conditional cash transfer program (CCT), on school participation and child labor. This summary focuses on the comparison between the treatment group receiving the basic CCT and the control group in Suba. The study was a randomized controlled trial in two districts in Columbia (San Cristobal and Suba). The authors compared the differential effects of receiving the cash transfer on outcomes for those in the treatment group versus those in the control group. The study found that students in the basic treatment group had a significant increase in self-reported school attendance compared to students in the control group. The study did not find any significant differences in child labor or school enrollment between students receiving the basic treatment and the control group. The quality of causal evidence presented in this report is moderate because there was compromised randomization but the authors ensured that the groups being compared were similar before the intervention. This means we are somewhat confident that the estimated effects are attributable to the Subsidios Condicionados a la Asistencia Escolar, but other factors might also have contributed.","Subsidios Condicionados a la Asistencia Escolar (Conditional Subsidies for School Attendance)","Child labor","Other, Low income",,International,2008,http://siteresources.worldbank.org/EDUCATION/Resources/278200-1099079877269/547…,"Child Labor Review Protocol" "State age protection laws and the Age Discrimination in Employment Act.","Lahey, J. State age protection laws and the Age Discrimination in Employment Act. (2008). The Journal of Law and Economics, 51(3), 433-460.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-Unfavorable impacts Employment","Summary: The study examined the impact of enforcement of age discrimination laws on the employment and earnings of older male workers The author used a nonexperimental regression model and data from the Current Population Survey to estimate the impact. The study found that males older than 50 in states with age discrimination laws were 0.2 percentage points less likely to be hired compared with those in states without their own age discrimination laws. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the state laws on age discrimination, but other factors might also have contributed.","Age Discrimination Employment Act (ADEA)","Older workers' programs Other disparities or discrimination in employment and earnings","Adult, Older worker, Male",,"United States",2008,https://www.jstor.org/stable/10.1086/589670?seq=1#page_scan_tab_contents,"Employment and Training Review Protocol" "Conditional cash transfers in education: Design features, peer and sibling effects. Evidence from a randomized experiment in Columbia","Barrera-Osorio, F., Bertrand, M., Linden, L.L., & Perze-Calle, F. (2008). Conditional cash transfers in education: Design features, peer and sibling effects. Evidence from a randomized experiment in Columbia (World Bank Policy Research Working Paper 4580). Washington, DC: World Bank.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Child labor-Mod/high-No impacts Child labor Education and skills gains-Mod/high-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of Subsidios Condicionados a la Asistencia Escolar, a conditional cash transfer program (CCT), on school participation and child labor. This summary focuses on the comparison between the savings treatment group and the control group in San Cristobal. The study was a randomized controlled trial in two districts in Columbia (San Cristobal and Suba). The authors compared the differential effects of receiving the cash transfer on outcomes for those in the treatment group versus those in the control group. The study did not find any significant differences in child labor, school attendance, or school enrollment between students receiving the savings treatment and the control group. The quality of causal evidence presented in this report is moderate because there was compromised randomization but the authors ensured that the groups being compared were similar before the intervention. This means we are somewhat confident that the estimated effects are attributable to the Subsidios Condicionados a la Asistencia Escolar, but other factors might also have contributed. However, the study did not find statistically significant effects.","Subsidios Condicionados a la Asistencia Escolar (Conditional Subsidies for School Attendance)","Child labor","Other, Low income",,International,2008,http://siteresources.worldbank.org/EDUCATION/Resources/278200-1099079877269/547…,"Child Labor Review Protocol" "How did the elimination of the US earnings test above the normal retirement age affect labour supply expectations?","Michaud, P., & Van Soest, A. (2008). How did the elimination of the US earnings test above the normal retirement age affect labour supply expectations? Fiscal Studies, 29(2), 197-231. doi:10.1111/j.1475-5890.2008.00073.x","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The authors used a nonexperimental approach and the data from Health and Retirement Study data from 1996 to 2002 and Social Security earnings history to estimate the impact. The study examined the impact of repealing the earnings test from Social Security recipients between full retirement age and age 70 on older workers’ subjective probability of retirement. The authors used a nonexperimental approach and the data from Health and Retirement Study data from 1996 to 2002 and Social Security earnings history to estimate the impact. The study found that after the repeal of the earnings test, the subjective probability of working of full-time past age 65 for older male workers who were likely to have most of their projected Social Security benefits reduced under the earnings test has increased their expected probability of working relative to those who were not likely to be affected. •The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design.This means we are somewhat confident that the estimated effects are attributable to the repeal of the earnings test, but other factors might also have contributed.","Social Security Earnings Test","Federal retirement benefits Older workers' programs","Adult, Older worker, Male",,"United States",2008,,"Employment and Training Review Protocol" "Conditional cash transfers in education: Design features, peer and sibling effects. Evidence from a randomized experiment in Columbia","Barrera-Osorio, F., Bertrand, M., Linden, L.L., & Perze-Calle, F. (2008). Conditional cash transfers in education: Design features, peer and sibling effects. Evidence from a randomized experiment in Columbia (World Bank Policy Research Working Paper 4580). Washington, DC: World Bank.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor Education and skills gains-Mod/high-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of Subsidios Condicionados a la Asistencia Escolar, a conditional cash transfer program (CCT), on school participation and child labor. This summary focuses on the comparison between the treatment group receiving the basic CCT and the control group in San Cristobal. The study was a randomized controlled trial in two districts in Columbia (San Cristobal and Suba). The authors compared the differential effects of receiving the cash transfer on outcomes for those in the treatment group versus those in the control group. The study found that students in grades 6-10 who received the basic treatment worked significantly fewer hours in the last week than students in the control group. The study did not find any significant differences in school attendance or school enrollment between students receiving the basic treatment and the control group. The quality of causal evidence presented in this report is moderate because there was compromised randomization but the authors ensured that the groups being compared were similar before the intervention. This means we are somewhat confident that the estimated effects are attributable to the Subsidios Condicionados a la Asistencia Escolar, but other factors might also have contributed.","Subsidios Condicionados a la Asistencia Escolar (Conditional Subsidies for School Attendance)","Child labor","Other, Low income",,International,2008,http://siteresources.worldbank.org/EDUCATION/Resources/278200-1099079877269/547…,"Child Labor Review Protocol" "The effect of the social security earnings test on male labor supply: New evidence from survey and administrative data.","Haider, S. J., & Loughran, D. S. (2008). The effect of the social security earnings test on male labor supply: New evidence from survey and administrative data. Journal of Human Resources, 43(1), 57-87.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Mixed impacts Earnings and wages Employer benefits receipt-Low-Favorable impacts Employer benefits receipt","Summary: The study’s objective is to examine the impact of 1983 and 2000 policy changes that removed the Social Security earnings test for certain age groups on the earnings and employment outcomes of affected men The study is a nonexperimental analysis that examines the correlations between the 1983 and 2000 policy changes and earnings and employment status. The study compares the outcomes of men affected by the policy changes with the outcomes of men of similar ages not affected by the policy changes. The study finds that the 1983 policy change is associated with few changes to the observed outcomes and that the 2000 policy change is associated with higher earnings and hours worked per week for affected men. The quality of causal evidence presented in this report is low because the study does not demonstrate that men affected by the policy changes are similar to the men not affected by the policy change, nor does it control for possible differences. This means we are not confident that the estimated effects are attributable to the 1983 and 2000 policy changes; other factors are likely to have contributed.","Social Security Earnings Test","Federal retirement benefits Older workers' programs","Adult, Older worker, Male",,"United States",2008,http://jhr.uwpress.org/content/43/1/57.refs,"Employment and Training Review Protocol" "The heterogeneous impact of CCT programmes on child labor: The case of Tekoporã in Paraguay","Hirata, G. I. (2008). The heterogeneous impact of CCT programmes on child labor: The case of Tekoporã in Paraguay. Brazil: International Poverty Centre/UNDP.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Tekoporã conditional cash transfer program on children’s participation in non-domestic labor and school attendance. The author used a nonexperimental design to compare the outcomes of children ages 4 to 14 that received the conditional cash transfers with those who did not, based on data from a program eligibility questionnaire and a follow-up survey. The author used statistical models to estimate the effects of the program. The study found no significant relationship between the Tekoporã program and the number of children in the household who participated in non-domestic labor. However, the program was significantly related to decisions between school and work, with a decrease in the probability that children would “only work” or “neither work nor attend school.” The quality of causal evidence presented in this report is low because the author did not account for trends in outcomes before the intervention or adequately control for time-varying characteristics that might influence the outcome. This means we are not confident that the estimated effects are attributable to Tekoporã; other factors are likely to have contributed.",Tekoporã,"Child labor","Other, Low income",,International,2008,http://www.ucw-project.org/attachment/hirata.pdf,"Child Labor Review Protocol" "Workforce Investment Act non-experimental net impact evaluation final report","Heinrich, C., Mueser, P., Troske, K., & Benus, J. (2008). Workforce Investment Act non-experimental net impact evaluation final report. Columbia, MD: IMPAQ International, LLC.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages","Summary: The report’s objective was to examine the effects of participation in the Workforce Investment Act (WIA) Adult and Dislocated Worker programs on average earnings and employment. Results for earnings of participants ages 22 to 26 were presented separately and are the focus of this review. The effectiveness of the programs was evaluated using a matched comparison group design. Outcomes were examined up to 10 quarters after WIA participants entered the Adult or Dislocated Worker programs. The study found that participants in the WIA Adult Program under age 26 earned significantly more than those in the comparison group every quarter after program entry. In the WIA Dislocated Worker program, participants under age 26 began earning significantly more than those in the comparison group a year following program entry. The quality of the causal evidence presented in this study is moderate. This means we have confidence that the effects estimated in this study are attributable at least in part to WIA programs. However, as in any nonexperimental study, other factors not accounted for in the analysis might have contributed to the estimated effects.","the Workforce Investment Act (WIA)","Basic skills Community college education and other classroom training Job search assistance and supportive services Other training and education Work based and other occupational training","Adult, Youth, Dislocated or displaced worker, Female, Male",,"United States",2008,http://www.nawdp.org/Content/NavigationMenu/ResearchReports/2009-10-WIANon-Expe…,"Opportunities for Youth Review Protocol" "The outcomes of policies designed to eliminate discrimination","Choe, C. (2008). The outcomes of policies designed to eliminate discrimination (Doctoral dissertation). University of Arizona.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Unfavorable impacts Earnings and wages Employment-Low-Unfavorable impacts Employment","Summary: The study’s objective was to examine the impact of the Americans with Disabilities Act (ADA) of 1990 on the employment and wages of men with disabilities relative to men without disabilities. The study used data from the Survey of Income and Program Participation (SIPP) from 1984, 1990, 1996, and 2001. The analysis attempted to determine how much of the difference in wages between men with and without disabilities was explained by background characteristics and how much was not; the portion that was not was interpreted as the effect of discrimination. The study found that neither the employment nor wages of men with disabilities improved relative to men without disabilities following passage of the ADA. Instead, employment and wage differentials both increased. However, the unexplained portion of the wage gap narrowed significantly after the ADA, consistent with a decrease in discrimination, among other explanations. The quality of causal evidence presented in this report is low because the author did not establish the comparability of men with and without disabilities before passage of the ADA. This means we are not confident that the estimated effects are attributable to the ADA. Other factors are likely to have contributed.","the Americans with Disabilities Act of 1990","Americans with Disabilities Act (ADA)","Disability, Male",,"United States",2008,,"Employer Compliance Review Protocol" "Conditional cash transfers in education: Design features, peer and sibling effects. Evidence from a randomized experiment in Columbia","Barrera-Osorio, F., Bertrand, M., Linden, L.L., & Perze-Calle, F. (2008). Conditional cash transfers in education: Design features, peer and sibling effects. Evidence from a randomized experiment in Columbia (World Bank Policy Research Working Paper 4580). Washington, DC: World Bank.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor Education and skills gains-Mod/high-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of Subsidios Condicionados a la Asistencia Escolar, a conditional cash transfer program (CCT), on school participation and child labor. This summary focuses on the comparison between the tertiary treatment group and the control group in Suba. The study was a randomized controlled trial in two districts in Columbia (San Cristobal and Suba). The authors compared the differential effects of receiving the cash transfer on outcomes for those in the treatment group versus those in the control group. The study found that students in the tertiary treatment group worked significantly less in the past week than students in the control group. They were also significantly more likely to report their primary activity as studying and less likely to report their primary activity as work or home versus students in the control group. The study did not find any significant differences in school attendance or school enrollment between students receiving the tertiary treatment and the control group. The quality of causal evidence presented in this report is moderate because there was compromised randomization but the authors ensured that the groups being compared were similar before the intervention. This means we are somewhat confident that the estimated effects are attributable to the Subsidios Condicionados a la Asistencia Escolar, but other factors might also have contributed.","Subsidios Condicionados a la Asistencia Escolar (Conditional Subsidies for School Attendance)","Child labor","Other, Low income",,International,2008,http://siteresources.worldbank.org/EDUCATION/Resources/278200-1099079877269/547…,"Child Labor Review Protocol" "Increasing retention of women engineering students","Sullivan, K., & Davis, R. (2007). Increasing retention of women engineering students. American Society for Engineering Education. Proceedings of the 2007 American Society for Engineering Education Annual Conference and Meeting. Washington, DC: American Society for Engineering Education.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Attitudes-Low-No impacts Attitudes Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine how participating in a study-designed program called the Jornada Intervention affected undergraduate female engineering students’ attitudes toward and persistence in studying engineering. Program activities included receiving a handheld computer and an invitation to participate in meetings to share experiences using the computer and suggestions for improving the user’s experience. The study used a comparison group design to compare outcomes for the treatment group with those of women who enrolled in engineering in adjacent years. Data sources included an attitudinal survey administered for the first analysis and administrative records to measure students’ graduation rates for the second analysis. In the first analysis, the study found no significant differences in attitudes toward engineering between the treatment and comparison groups. For the second analysis, though results were not presented and methods were not described, the authors reported that they uncovered significant differences in persistence between the treatment and comparison groups. They noted that program participants were significantly more likely to graduate in engineering than both (1) women from the same year who did not participate in the program and (2) women who enrolled in engineering in adjacent years. The quality of causal evidence presented in this report is low because it does not include control variables to adjust for differences between treatment and comparison groups. This means we are not confident that the estimated effects are attributable to the intervention; other factors are likely to have contributed.","Jornada Intervention","Science, Technology, Engineering, and Math (STEM) programs Youth programs","Youth, Female",,"United States",2007,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "A cure for discrimination? Affirmative action and the case of California’s Proposition 209.","Myers, C. (2007). A cure for discrimination? Affirmative action and the case of California’s Proposition 209. Industrial and Labor Relations Review, 60(3), 379-396.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Unfavorable impacts Employment","Summary: The study’s objective was to gauge the impact of California’s Proposition 209, a 1996 repeal of affirmative action, on employment, unemployment, labor force participation, and wages among women and racial minorities. The author used a nonexperimental design and estimated a difference-in-difference-in-differences regression model on monthly Current Population Survey data from 1994 to 2001. The study found that the employment rate of all minorities in California relative to white men dropped 2.8 percentage points from 1995 to 1999, a statistically significant decrease. The quality of causal evidence presented in this report is low because the author did not control for pre-intervention minority employment trends in California relative to the rest of the United States or preemptive hiring decisions that might have anticipated the law’s passage. This means we are not confident that the estimated effects are attributable to California’s affirmative action repeal through Proposition 209. Other factors are likely to have contributed.","California's Proposition 209","Affirmative action",Other,,"United States",2007,,"Employer Compliance Review Protocol" "Effects of learning about gender discrimination on adolescent girls’ attitudes toward and interest in science","Weisgram, E., & Bigler, R. (2007). Effects of learning about gender discrimination on adolescent girls’ attitudes toward and interest in science. Psychology of Women Quarterly, 31, 262-269.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Attitudes-Mod/high-Favorable impacts Attitudes","Summary: The study’s objective was to examine the impact of learning about gender discrimination in the sciences on girls’ attitudes toward and interest in science. The study included middle school girls who attended a conference designed to improve their attitudes toward and interest in science. Participants were randomly assigned to the treatment condition, which included standard conference sessions on science careers and a session on gender discrimination in the sciences, or to the control group that attended only the standard sessions. The authors administered pre- and post-conference surveys to measure the impact of the intervention. The study found significant increases in reported science self-efficacy and science utility value among the girls in the treatment condition, whereas girls in the control condition experienced a decrease in egalitarian attitudes toward science. The quality of causal evidence provided in this study is high because it was a well-implemented randomized controlled trial with low attrition. This means we are confident that the estimated effects are attributable to the intervention and not to other factors.",,"Preventing discrimination Science, Technology, Engineering, and Math (STEM) programs Youth programs","Youth, Female",,"United States",2007,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Long-term effects of a middle school engineering outreach program for girls: A controlled study.","Hubelbank, J., Demetry, C., Nicholson, S., Blaisdell, S., Quinn, P., Rosenthal, E., & Sontgerath, S. (2007). Long-term effects of a middle school engineering outreach program for girls: A controlled study. In Proceedings, American Society for Engineering Education Annual Conference & Exhibition.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to assess the long-term impact of Camp Reach, a summer engineering enrichment program for middle school girls, on enrollment in STEM courses in high school and college. Admission to Camp Reach was determined through a lottery of girls who applied to the program and met eligibility requirements. Six to seven years later, the authors administered a survey to 88 girls who had been admitted to the program and 41 girls who had not. The study found that Camp Reach attendees were significantly more likely to have taken computer science and other science or engineering courses in high school than those who did not attend. The quality of causal evidence presented in this report is low because the authors adjusted the research sample after random assignment and did not include adequate controls to ensure that the resulting groups were similar on all relevant attributes. This means we are not confident that the estimated effects are attributable to Camp Reach; other factors are likely to have contributed.","Camp Reach","Science, Technology, Engineering, and Math (STEM) programs Youth programs","Youth, Female",,"United States",2007,https://www.wpi.edu/Images/CMS/News/1106_LONG_TERM_EFFECTS_OF_A_MIDDLE_SCHOOL_E…,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Protecting education for the poor in times of crisis: An evaluation of a scholarship programme in Indonesia","Sparrow, R. (2007). Protecting education for the poor in times of crisis: An evaluation of a scholarship programme in Indonesia. Oxford Bulletin of Economics and Statistics, 69, 99-122. doi: 10.1111/j.1468-0084.2006.00438.x","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of Jaring Prengaman Sosial (JPS), a scholarship program in Indonesia, on child labor and school enrollment. The author used data from an annual Indonesian national survey to estimate an instrumental variable (IV) regression model to examine if scholarship receipt affected school enrollment, and probit models to examine the effects on child labor and school attendance. The study found that the receipt of a scholarship was significantly associated with a decrease in child labor and an increase in school attendance. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before receiving the JPS in the probit model and no evidence was provided on the strength of the instrument used in the IV model. This means we are not confident that the estimated effects are attributable to the Jaring Pengaman Sosial (JPS) scholarship program; other factors are likely to have contributed.","Jaring Prengaman Sosial","Child labor Tuition assistance","Other, Low income",,International,2007,https://pdfs.semanticscholar.org/8f79/add16372936ea1e388e3a9c82e320435a87d.pdf,"Child Labor Review Protocol" "Evaluating multi-treatment programs: Theory and evidence from the U.S. Job Training Partnership Act experiment.","Plesca, M., & Smith, J. (2007). Evaluating multi-treatment programs: Theory and evidence from the U.S. Job Training Partnership Act experiment. Empirical Economics, 32, 491-528.",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Job Training Partnership Act (JTPA) on earnings and employment for disadvantaged adults. The authors conducted a randomized controlled trial. They analyzed data from one baseline survey, two follow-up surveys, and earnings and employment records. The study found that men in the treatment group had earned more at the 30-month follow-up than men in the control group, and that women in the treatment group experienced significantly better earnings and employment outcomes at several points compared to the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to JTPA, and not to other factors.","Job Training Partnership Act","Other training and education Supported employment or other employment supports Job search assistance and supportive services","Adult, Female, Male, Low-skilled, Low income",,"United States",2007,,"Review Protocol" "Cash transfers, conditions, school enrollment, and child work: Evidence from a randomized experiment in Ecuador","Schady, N. & Araujo, M. C. (2006). Cash transfers, conditions, school enrollment, and child work: Evidence from a randomized experiment in Ecuador. Policy Research Working Paper No. 3930. Washington, DC: The World Bank. Retrieved from https://openknowledge.worldbank.org/handle/10986/8452  ","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The purpose of the study was to assess the impact of the Bono de Desarrollo Humano (BDH) program on child labor and school enrollment for children 6-17 years old. The study used a randomized controlled trial to compare the outcomes of children in households assigned to participate in the program to outcomes of those who did not participate. The study found a significant relationship between being selected for the BDH program and whether children worked and hours per week children worked; both were significantly lower for those in the treatment group than those in the control group. The study also found that children selected into the BDH program had significantly higher rates of school enrollment and significantly lower rates of having dropped out since the program began. The quality of causal evidence presented in this report is low because it is a randomized controlled trial with unknown attrition and the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Bono de Desarrollo Humano program; other factors are likely to have contributed.","Bono de Desarrollo Humano (BDH) program","Child labor","Other, Low income",,International,2006,https://openknowledge.worldbank.org/handle/10986/8452,"Child Labor Review Protocol" "The labor market effects of sex and race discrimination laws.","Neumark, D., & Stock, W. (2006). The labor market effects of sex and race discrimination laws. Economic Inquiry, 44(3), 385-419.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Unfavorable impacts Employment","Summary: The study’s objective was to examine the effect of state-level sex and race discrimination laws passed before 1960 on employment and earnings outcomes for women and African Americans. The authors used a triple difference estimator including state, year, and subgroup variables. The primary data source was U.S. Census data from 1940 to 1960. The study found that sex-related equal pay laws had negative, statistically significant effects on women’s employment relative to men and a growing positive effect on women’s earnings relative to men over time. Racial discrimination laws had no significant immediate effects on employment or earnings for African American men compared with white men in the short term, but there were positive effects after the laws were in effect for a number of years. The quality of causal evidence presented in this report is low. This means we are not confident that the estimated effects were attributable to the state sex and race discrimination laws; other factors are likely to have contributed.","State Sex and Race Discrimination Laws","Affirmative action","Female, Male, Black or African American",,"United States",2006,,"Employer Compliance Review Protocol" "Employee development, commitment, and intention to turnover: A test of “employability” policies in action","Benson, G.S. (2006). Employee development, commitment, and intention to turnover: A test of “employability” policies in action. Human Resource Management Journal, 16(2), 173–192.","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the relationship between employees’ intent to leave (that is, employees’ stated intentions to leave the firm in the next year) and their participation in on-the-job training and company-sponsored training classes. The author used a statistical model to examine the association between employees’ participation in on-the-job and company-sponsored training classes and their intention to leave the firm in the next year, using data from an employee survey. The study found that participation in on-the-job training was associated with a reduction in employees’ intent to leave, but there was no significant relationship between participation in company sponsored training and intent to turnover. The quality of causal evidence presented in this report is low because the author did not ensure that groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the work-based training; other factors are likely to have contributed.","the on-the-job training","Work based and other occupational training","Employed, STEM professional","Professional, scientific, and technical services","United States",2006,https://doi.org/10.1111/j.1748-8583.2006.00011.x,"Employment and Training Review Protocol" "Enforcement of civil rights law in private workplaces: The effects of compliance reviews and lawsuits over time","Kalev, A., & Dobbin, F. (2006). Enforcement of civil rights law in private workplaces: The effects of compliance reviews and lawsuits over time. Law & Social Equity, 31(4), 855-903.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the effectiveness of compliance reviews by the Office of Federal Contract Compliance Programs (OFCCP) and lawsuits initiated by individuals or the Equal Employment Opportunity Commission (EEOC) in reducing discrimination against women and African Americans in management positions. The authors applied a fixed-effects regression model to workforce data in the EEO-1 Employer Information Reports. These data were supplemented by a survey of compliance enforcement activities administered to a random sample of establishments drawn from the EEO-1 reports. The study found that compliance reviews begun in the 1970s increased an establishment’s share of women and African Americans employed as managers, not only in the 1970s but also through the 1980s and 1990s. The quality of causal evidence presented in this report is low because the study did not adequately control for existing differences between the study groups. This means we are not confident that the estimated effects are attributable to OFCCP compliance reviews or to lawsuits. Other factors are likely to have contributed.","the Civil Rights Act of 1964 and Affirmative Action Executive Orders","Civil Rights Act of 1964 Equal Employment Opportunity Act of 1972 Executive Order 11246 (E.O. 11246)","Female, Black or African American",,"United States",2006,,"Employer Compliance Review Protocol" "A comparison of two Welfare-to-Work strategies among African American women in Atlanta, Georgia. (Unpublished doctoral dissertation).","Wilson-Brewster, V.L. (2006). A comparison of two Welfare-to-Work strategies among African American women in Atlanta, Georgia. (Unpublished doctoral dissertation). Capella University, Minneapolis, Minnesota.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the effectiveness of two welfare-to-work programs—the Labor Force Attachment (LFA) program and the Human Capital Development (HCD) program—on the employment and earnings of African American women 25, 35, and 45 years old in Atlanta. The author analyzed a subsample of participants in the National Evaluation of Welfare-to-Work Strategies (NEWWS) study. The study was a randomized controlled trial that assigned individuals within a geographic location to one of three groups: LFA, HCD, or a control group. The study found that women in the 35-year-old group who participated in LFA or HCD had higher earnings and needed less time to find a job than those in the other age cohorts. The quality of causal evidence presented in this report is low because the study was a randomized controlled trial with unknown attrition and the authors did not account for preexisting differences between the groups being compared in their analysis. This means we are not confident that the estimated effects are attributable to LFA or HCD programs; other factors are likely to have contributed.","Labor Force Attachment (LFA) and Human Capital Development (HCD)","Other employment and reemployment Other training and education","Female, Black or African American, Low income, Parent",,"United States, Urban",2006,,"Employment and Training Review Protocol" "The effects of welfare-to-work program activities on labor marker outcomes","Dyke, A., Heinrich, C., Mueser, P., & Troske, K. (2005). The effects of welfare-to-work program activities on labor marker outcomes. Institute for Research on Poverty, 1295(5). [Missouri]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages","Summary: The study’s objective was to examine the impact of Missouri’s welfare-to-work program training activities on the quarterly earnings of women ages 18 to 65 years in single-parent households who were cash recipients of Temporary Assistance for Needy Families (TANF). Using data from the state’s administrative records and unemployment insurance program, the authors compared the quarterly earnings of women who took part in the training activities with those who enrolled in the welfare-to-work program but never took part in any of the training. The study found that those taking part in the training activities experienced an initial (quarter 1) reduction in their quarterly earnings, compared with those who did not take part in the training activities. However, both cumulative (based on all 16 quarters of follow-up) and average (based on quarters 11 to 15) quarterly earnings increased for those who took part in the training activities compared with those who did not. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the welfare-to-work program training activities, but other factors might also have contributed.","the Welfare-to-Work Program","Job search assistance and supportive services","Female, Low income, Parent",,"United States",2005,http://repec.iza.org/dp1520.pdf,"Employment and Training Review Protocol" "4 schools for WIE","Erkut, S., Marx, F., & Wellesley College Center for Research on Women. (2005). 4 schools for WIE. Evaluation report. Wellesley, MA: Wellesley Centers for Women.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Attitudes-Low-Mixed impacts Attitudes","Summary: The study’s objective was to determine the effect of the 4 Schools for Women in Engineering (WIE) strategy on 8th-grade students’ attitudes toward STEM careers. The strategy involved forming teams of mostly female engineering professors, students, and practitioners to train middle school teachers on engineering and gender-inclusive teaching methods and to serve as in-class role models for students. The authors administered a study-designed survey at the beginning and end of the school year to a single cohort of students to measure changes in outcomes following implementation of the intervention. The authors estimated program impacts using regression models and paired t-tests. The study found that students’ attitudes toward science improved after the intervention, but attitudes toward engineering worsened. There was no change in students’ attitudes toward math. The quality of causal evidence presented in this report is low. This means we are not confident that the estimated effects are attributable to the 4 Schools for WIE strategy; other factors are likely to have contributed.","4 Schools for Women in Engineering","Science, Technology, Engineering, and Math (STEM) programs Youth programs","Youth, Female",,"United States",2005,http://files.eric.ed.gov/fulltext/ED500754.pdf,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Persistent Problems Demand Consistent Solutions: Evaluating Policies to Mitigate Occupational Segregation by Gender","Mastracci, S.H. (2005). Persistent Problems Demand Consistent Solutions: Evaluating Policies to Mitigate Occupational Segregation by Gender. Review of Radical Political Economics, 37(1), 23-38.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to determine the effect of two competitive grants that funded activities to support women in nontraditional occupations on women’s probability of employment in those occupations. Nontraditional occupations are those in which women represent fewer than one-quarter of all employed people in the occupation (for example, dentists or construction workers). The author estimated the grants’ impact on female employment in nontraditional occupations through a differences-in-differences model using Current Population Survey Merged Outgoing Rotation Groups data from 1990 to 1999. The study found that the grants were associated with increases in women’s chances of obtaining employment in a nontraditional occupation. The quality of causal evidence presented in this report is low because the author did not control or account for pretreatment trends in the outcome variables of interest. This means we are not confident that the estimated effects are attributable to the grants; other factors are likely to have contributed.","the NEW and WANTO Grant Programs","Other disparities or discrimination in employment and earnings Science, Technology, Engineering, and Math (STEM) programs",Female,,"United States",2005,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "An analysis of the impact of affirmative action programs on self-employment in the construction industry.","Blanchflower, D.G., & Wainwright, J. (2005). An analysis of the impact of affirmative action programs on self-employment in the construction industry. Working paper no. 11793. Cambridge, MA: National Bureau of Economic Research.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of City of Richmond v. J.A. Croson Co. (referred to as the Croson decision) in 1989, which weakened affirmative action policies, on self-employment, with a focus on the construction industry, by race, ethnicity, and gender. The study used a nonexperimental analyses to compare self-employment before and after the Croson decision. The authors used national data from the Current Population Survey (CPS) and the 2000 decennial U.S. Census. The study found that gender disparities in self-employment rates have declined since the Croson decision in all industries, but have declined most in construction. In contrast, racial and ethnic disparities in self-employment have declined since the Croson decision in all industries except construction. The quality of causal evidence presented in this study is low because the authors did not control for trends in self-employment or earnings before the Croson decision. This means we are not confident that the estimated effects are attributable to the Croson decision. Other factors are likely to have contributed.","City of Richmond v. J.A. Croson Co.","Affirmative action",Other,Construction,"United States",2005,http://www.nber.org/papers/w11793.pdf,"Employer Compliance Review Protocol" "More than robots: An evaluation of the FIRST robotics competition participant and institutional impacts","Melchior, A., Cohen, F., Cutter, T., & Leavitt, T. (2005). More than robots: An evaluation of the FIRST robotics competition participant and institutional impacts. Waltham, MA: Brandeis University Center for Youth and Communities Heller School for Social Policy and Management.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the FIRST Robotics Competition (FRC) on participants’ education and career outcomes. The FRC was a six-week competition in which teams of high school male and female students (with the help of mentors) used a set of standard parts to build a robot. Students showcased these robots by competing against teams from other high schools. The authors used propensity-score matching to create treatment and comparison groups and conducted an analysis of retrospective survey data to measure education and career outcomes of FRC participants who graduated from the program from 1999 to 2003. They administered a researcher-designed survey to students in the treatment group in 2004 and collected data from a national survey—the Beginning Postsecondary Student Survey (BPSS)—to measure outcomes for the comparison group, who began college in 1995-1996. The study found that a higher percentage of female FRC participants majored in engineering compared with females in the comparison group. The quality of causal evidence presented in this report is low because the authors did not demonstrate equivalency of the treatment and comparison groups on all required measures. This means we are not confident that the estimated effects are attributable to the FRC; other factors are likely to have contributed.","FIRST Robotics Competition","Science, Technology, Engineering, and Math (STEM) programs Youth programs","Youth, Female, Male",,"United States",2005,http://www.techfire225.com/uploads/6/3/7/1/6371896/first_study.pdf,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Implementation and outcome evaluation of the Intensive Aftercare Program: Final report","Wiebush, R., Wagner, D., McNulty, B., Wang, Y., & Le, T. (2005). Implementation and outcome evaluation of the Intensive Aftercare Program: Final report. National Council on Crime and Delinquency. Washington, DC: U.S. Department of Justice, Office of Justice Programs.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence",,"Summary: The study’s objective was to measure the impact of participation in an Intensive Aftercare Program (IAP) for high-risk youth from juvenile justice facility placements on recidivism. The authors used a random assignment design and multivariate regression analysis to estimate impacts on aggregate recidivism scores, the sum of all subsequent offenses, weighted by severity. Data for the study were collected from standardized forms, surveys, risk assessment tests, and state agency and police records. The study found no statistically significant effects of the program on participants’ aggregate recidivism scores. The quality of causal evidence presented in this report is moderate for some outcomes and low for other outcomes. This means we have little confidence that any estimated effects would be attributable to the IAP. However, the study found few statistically significant effects.","the Intensive Aftercare Program (IAP)","Reentry Youth programs","Youth, Justice-involved, Disconnected youth, Male",,"United States",2005,http://files.eric.ed.gov/fulltext/ED484683.pdf,"Opportunities for Youth Review Protocol" "Teaching strategies designed to change the undergraduate experience for college women learning chemistry","Khan, S. (2005). Teaching strategies designed to change the undergraduate experience for college women learning chemistry. Journal of Women and Minorities in Science and Engineering 11, 365-387.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of three teaching innovations—a contract, confidence-building exercises, and encouragement to apply for science internships—on performance in an Organic Chemistry II course at an all-female college. The author compared the final exam scores, final grades, and internship acceptance rates of students enrolled in the course that included these interventions to outcomes for students who had taken the course without these interventions in the three prior years. All courses were taught by the same professor and used the same syllabus. The study identified no statistically significant relationships between the three teaching innovations and students’ outcomes. The quality of causal evidence presented in this report is low. This means we are not confident that the estimated effects are attributable to the teaching innovations; other factors are likely to have contributed.","Innovative Teaching for Women in STEM","Science, Technology, Engineering, and Math (STEM) programs","Youth, Female",,"United States",2005,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "The effects of welfare-to-work program activities on labor market outcomes","Dyke, A., Heinrich, C., Mueser, P., & Troske, K. (2005). The effects of welfare-to-work program activities on labor market outcomes. Institute for Research on Poverty, 1295(5). [North Carolina]","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages","Summary: The study’s objective was to examine the impact of North Carolina’s welfare-to-work program training activities on the quarterly earnings of women ages 18 to 65 years in single-parent households who were cash recipients of Temporary Assistance for Needy Families (TANF). Using data from the state’s administrative records and unemployment insurance program, the authors compared the quarterly earnings of women who took part in the training activities with those who enrolled in the welfare-to-work program but never took part in any of the training. The study found that those taking part in any of the training activities experienced an initial (quarter 1) reduction in their quarterly earnings, compared with those who did not take part in the training activities. However, those who took part in the assessment or intensive training activities experienced an increase in both their cumulative (based on 16 quarters of follow-up) and average (based on quarters 11 to 15 of follow-up) quarterly earnings, compared with those who did not take part in any training activities. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the welfare-to-work program, but other factors might also have contributed.","the Welfare-to-Work Program","Job search assistance and supportive services","Female, Low income, Parent",,"United States",2005,http://repec.iza.org/dp1520.pdf,"Employment and Training Review Protocol" "Do scientists help people? Beliefs about scientists and the influence of pro-social context on girls’ attitudes toward physics","Yanowitz, K. (2004). Do scientists help people? Beliefs about scientists and the influence of pro-social context on girls’ attitudes toward physics. Journal of Women and Minorities in Science and Engineering, 10(4), 393-399.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Attitudes-Mod/high-No impacts Attitudes","Summary: The study’s objective was to examine the impact of reading a passage featuring a pro-social context on careers in physics on female students’ interest in science. The authors randomly assigned 88 5th- and 6th-grade girls to four conditions. In the treatment condition, participants read a story describing a female physicist who entered that profession to benefit society. Participants assigned to the control conditions read different stories. After reading these stories, the participants responded to a short survey asking how much they liked the story and how interested they were in becoming physicists. The study found no relationship between the treatment story and participants’ interest in becoming physicists. The quality of causal evidence presented in this study is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects would be attributable to the scientists’ stories and not to other factors. However, the study did not find statistically significant effects.",,"Science, Technology, Engineering, and Math (STEM) programs Youth programs","Youth, Female",,"United States",2004,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "The effects of the Americans with Disabilities Act: A longitudinal model analysis","Moon, S., Chung, K, & Yang, D. (2003). The effects of the Americans with Disabilities Act: A longitudinal model analysis. Clinical Research and Regulatory Affairs, 20(4), 433-445.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Mixed impacts Employment","Summary: The study’s objective was to examine the impact of the Americans with Disabilities Act (ADA), both the original 1992 legislation and its 1994 extension, on working hours and employment among men with disabilities.  The authors applied a multiple regression model to panel data from the 1989–1995 Survey of Income and Program Participation (SIPP). The study found that working hours and employment decreased on average among all men with disabilities, regardless of their labor force participation, relative to men without disabilities after the ADA was first implemented in 1992. In contrast, relative working hours and employment increased for labor force participants who self-reported a disability after the law’s 1994 extension went into effect. The quality of causal evidence presented in this report is low because the authors did not control for possible disparities in pre-intervention trends in working hours and employment among men with and without disabilities. This means we are not confident that the estimated effects are attributable to the ADA; other factors are likely to have contributed.","the Americans with Disabilities Act of 1990","Americans with Disabilities Act (ADA)","Disability, Male",,"United States",2003,,"Employer Compliance Review Protocol" "The heterogeneous impact of conditional cash transfers","Galiani, S., & McEwan, P. J. (2013). The heterogeneous impact of conditional cash transfers. Journal of Public Economics, 103, 85-96. doi:10.1016/j.jpubeco.2013.04.004","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Honduran Programa de Asignación Familiar (PRAF-II) conditional cash transfer program on child labor and school enrollment. The authors used census data from a randomized sample of municipalities to compare the outcomes of children who received the conditional cash transfer to those who did not. The authors used statistical models to estimate program effects. The study found a significant relationship between the PRAF-II and child labor, with work outside the home decreasing by 3 percentage points and work inside the home decreasing by 4 percentage points. Program participation was also significantly related to an 8-percentage point increase in school enrollment. The quality of causal evidence presented in this report is low because it is a randomized controlled trial with unknown attrition and the authors did not account for preexisting differences between the groups before program participation. This means we are not confident that the estimated effects are attributable to the Programa de Asignación Familiar; other factors are likely to have contributed.",,"Compensation and Workplace Conditions Other Worker Protections Child labor","Other, Low income",,International,2003,https://doi.org/10.1016/j.jpubeco.2013.04.004,"Child Labor Review Protocol" "Student enrollment in high school AP sciences and calculus: how does it correlate with STEM careers?","Robinson, M. (2003). Student enrollment in high school AP sciences and calculus: how does it correlate with STEM careers? Bulletin of Science, Technology & Society, 23, 265–273.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: This study’s objective was to examine differences in the intended choice of college science, technology, engineering, and mathematics (STEM) majors between females and males enrolled in high school advanced placement (AP) science and calculus courses. The study used survey data from eight high schools to examine the percentage of AP students who chose a STEM field as their intended college major. The authors compared outcomes for minority and nonminority males and females. The study found that among students taking AP science or calculus classes, males were generally more likely than females to plan to choose a college major in engineering but less likely to plan to choose a college major in medicine. The quality of causal evidence presented in this study is low. This means we are not confident that the estimated effects are attributable to AP courses. Other factors are likely to have contributed.","the Advanced Placement (AP) Program","Science, Technology, Engineering, and Math (STEM) programs Youth programs","Youth, Female, Male",,"United States",2003,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "Alleviating women’s mathematics stereotype threat through salience of group achievements","McIntyre, R., Paulson, R., & Lord, C. (2003). Alleviating women’s mathematics stereotype threat through salience of group achievements. Journal of Experimental Social Psychology, 39, 83-90.","Women in Science, Technology, Engineering, & Math (STEM)","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of alleviating women’s stereotype threat—that is, the idea that men outperform women in mathematics—on women’s subsequent performance on a difficult mathematics test. The study contained two experiments in which participants were randomly assigned to either a treatment condition, which received an intervention to alleviate women’s stereotype threat, or a control condition, which did not receive the intervention. The primary outcome of interest was an adjusted score for a study-administered mathematics test consisting of difficult questions from the Graduate Record Examination (GRE), an entry test for graduate school. The study found that women in the treatment group scored 2.0 to 2.5 points higher on the math test than women in the control condition. These results were statistically significant. The quality of causal evidence presented in this study is high because it was a well-conducted randomized controlled trial. This means that we are confident that the estimated effects are attributable to the intervention, and not to other factors.",,"Preventing discrimination Science, Technology, Engineering, and Math (STEM) programs Youth programs","Youth, Female",,"United States",2003,,"Women in Science, Technology, Engineering, & Math (STEM) Review Protocol" "The impact of Equal Employment Opportunity Commission enforcement on the wages of African American and white women, 1988–1996","Wilhelm, S. (2002). The impact of Equal Employment Opportunity Commission enforcement on the wages of African American and white women, 1988–1996. The Review of Black Political Economy, 30(2), 25-51.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages","Summary: The study’s objective was to examine the impact of employment discrimination charges filed with the Equal Employment Opportunity Commission (EEOC) on the wages of African American and white women. The author used regression analyses to compare the effects of sex- and race-based discrimination charges within an industry in a given year on the wages of African American and white women from 1988 to 1996. Data came from the Current Population Survey and the EEOC National Database. The study found that increases in employment discrimination charges based on sex were positively correlated with increases in wages for both African American and white women.  The quality of causal evidence provided in this study is low because the study did not adequately control for existing differences between the study groups. This means that we are not confident that the estimated effects are attributable to EEOC enforcement. Other factors are likely to have contributed.","Equal Employment Opportunity Commission Enforcement","Equal Employment Opportunity Act of 1972","Female, Black or African American, White",,"United States",2002,,"Employer Compliance Review Protocol" "The labor market impact of state-level anti-discrimination laws","Collins, W. (2001). The labor market impact of state-level anti-discrimination laws. National Bureau of Economic Research working paper no. 8310. Cambridge, MA: NBER.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Mixed impacts Employment","Summary: This study’s objective was to assess the impact of state-level fair employment legislation, enacted in the 1940s through the 1960s, on labor market outcomes including income, unemployment, and labor force participation, by gender and race. The study used a nonexperimental design, drawing on data from the 1940, 1950, and 1960 decennial U.S. Censuses for 19 non-southern states. The study found that state-level fair employment laws adopted in the 1940s had larger positive effects on the relative income of African American workers than those adopted in the 1950s. In contrast, laws adopted in the 1950s led to larger increases in African American male unemployment but larger increases in African American women’s labor force participation. Only states that implemented the laws in the 1940s experienced a narrowed income gap between white and African American workers. The quality of causal evidence presented in this report is low because the author did not demonstrate that the states that adopted fair employment legislation when they did were comparable to those that did not adopt or adopted at a later time. This means we are not confident that the estimated effects are attributable to state-level fair employment legislation. Other factors are likely to have contributed.","State-level Fair Employment Legislation","Affirmative action","Black or African American, Female, Male",,"United States",2001,http://www.nber.org/papers/w8310.pdf,"Employer Compliance Review Protocol" "The unintended consequences of the Americans with Disabilities Act","DeLeire, T. (2000). The unintended consequences of the Americans with Disabilities Act. Regulation 23(1), 21–24.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Unfavorable impacts Employment","Summary: The study’s objective was to examine the effect of the Americans with Disabilities Act (ADA) on the employment rate for men with disabilities. Using data from the Survey of Income and Program Participation from 1985 to 1995, the author compared the change in employment for men with disabilities ages 18 to 65 pre- and post-ADA with the change in employment for men without disabilities over the same period. The study found that the employment rate for men with disabilities was 8 percentage points lower relative to men without disabilities after ADA, with particularly large differences for those with mental disabilities or low education levels. The quality of causal evidence provided in this study is low. This means that we are not confident that the estimated effects are attributable to the ADA; other factors are likely to have contributed.","the Americans with Disabilities Act of 1990","Americans with Disabilities Act (ADA)","Disability, Male",,"United States",2000,,"Employer Compliance Review Protocol" "An evaluation of an urban community college Single Parent and Displaced Homemaker Program (Doctoral dissertation)","Rice, L. M. (1999). An evaluation of an urban community college Single Parent and Displaced Homemaker Program (Doctoral dissertation). Old Dominion University. DOI: 10.25777/tqh7-3c76","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study's objective was to examine the impact of the Single Parent and Displaced Homemaker Program on education outcomes by students at an urban community college. The study used a nonexperimental design to compare the outcomes of program participants to those on the waiting list. Using data from the community college’s Students Information System, the author conducted statistical tests to examine the differences between groups. The study found that participation in the Single Parent and Displaced Homemaker Program was significantly related to increased retention rates and number of credits taken. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Single Parent and Displaced Homemaker Program; other factors are likely to have contributed.","the Single Parent and Displaced Homemaker Program","Employment and Training Services Training and Education Capacity building programs Community college education and other classroom training Other training and education","Adult, Other barriers, Female, Parent",,"Urban, United States",1999,https://digitalcommons.odu.edu/urbanservices_education_etds/50/,"Community College Review Protocol" "The impact of federal civil rights policy on black economic progress: Evidence from the Equal Employment Opportunity Act of 1972","Chay, K. (1998). The impact of federal civil rights policy on black economic progress: Evidence from the Equal Employment Opportunity Act of 1972. Industrial and Labor Relations Review, 51(4), 608-632.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the 1972 Equal Employment Opportunity Act (EEOA) on employment, earnings, and occupational outcomes of African American men. The study used a non-experimental design that used regression analysis for impact evaluation. The author used data from the 1968–1980 Current Population Survey (CPS). This study found that the 1972 EEOA had positive impacts on the employment, earnings, and occupational status of African American men in the South in industries with more than 50 percent of workers employed in small establishments covered by the law. The quality of causal evidence presented in this study is moderate because it was based on a strong non-experimental design. This means we are somewhat confident that the estimated effects are attributable to the 1972 EEOA, but other factors might also have contributed.","the 1972 Equal Employment Opportunity Act","Civil Rights Act of 1964 Equal Employment Opportunity Act of 1972","Male, Black or African American","Small business","United States",1998,,"Employer Compliance Review Protocol"