Title,Citation,Topic_area,Study_type,Study_evidence_rating,Outcome_effectiveness,Findings,Intervention_program,Topics,Target_population,Firm_characteristics,Geographic_setting,Original_publication_date,Original_publication_link,"Review Protocol" "WIOA impacts on community college student success (Doctoral dissertation).","Crumpton, J. A. (2019). WIOA impacts on community college student success (Doctoral dissertation). Retrieved from ProQuest Dissertations and Theses database. (UMI No. 13861007).","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of a workforce development program administered by a community college under the Workforce Innovation and Opportunity Act (WIOA) on education outcomes. This summary focuses on the comparison between the community college WIOA program participants and the state workforce WIOA program participants. The author used a nonexperimental design to compare WIOA program student education outcomes (measured by degree or certificate attainment) to the outcomes of participants in WIOA programs administered by entities other than community colleges (throughout the state). Data from the community college and the State Board for Workforce Development were used to examine education success rates over the course of three years (2014-2017). The study found that WIOA program participants were significantly more likely to attain a degree or certificate than participants who entered the WIOA program through a state workforce development board. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention.This means we are not confident that the estimated effects are attributable to the WIOA program; other factors are likely to have contributed","Workforce Innovation and Opportunity Act (WIOA) program","Basic skills Capacity building programs Community college education and other classroom training Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) training programs","Adult, Low income",,"Rural, United States",2019,https://search.proquest.com/openview/f270d29734cd670349c3aed2866ce41a/1?pq-orig…,"Community College Review Protocol" "WIOA impacts on community college student success (Doctoral dissertation).","Crumpton, J. A. (2019). WIOA impacts on community college student success (Doctoral dissertation). Retrieved from ProQuest Dissertations and Theses database. (UMI No. 13861007).","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of a workforce development program administered by a community college under the Workforce Innovation and Opportunity Act (WIOA) on education outcomes. This summary focuses on the comparison between WIOA program participants and non-participants. The author used a nonexperimental design to compare WIOA program student education outcomes (measured by degree or certificate attainment) to the outcomes of students with similar backgrounds (Pell Grant recipients) who were not enrolled in WIOA. Data from the community college were used to examine education success rates over the course of three years (2014-2017). The study found that WIOA program participants were significantly more likely to attain a degree or certificate than students who were not enrolled in the WIOA program. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention.This means we are not confident that the estimated effects are attributable to the WIOA Program; other factors are likely to have contributed","Workforce Innovation and Opportunity Act (WIOA) program","Basic skills Capacity building programs Community college education and other classroom training Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA) training programs","Adult, Low income",,"Rural, United States",2019,https://search.proquest.com/openview/f270d29734cd670349c3aed2866ce41a/1?pq-orig…,"Community College Review Protocol" "Information technology career preparation for rural areas.","Hahs-Vaughn, D. L., Swan, B., & Clark, M. H. (2019). Information technology career preparation for rural areas. Community College Journal of Research and Practice, 1-13.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the Florida Information Technology Careers for Rural Areas (XCEL-IT) program on education, employment, and earnings outcomes. The authors used a nonexperimental design to compare the differences in outcomes between XCEL-IT program participants and a comparison group. The study found that XCEL-IT program participation was significantly related to program completion. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the XCEL-IT program; other factors are likely to have contributed.","the Florida Information Technology Careers for Rural Areas (XCEL-IT)","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Unemployed, Veteran or military",,"Rural, United States",2019,,"Community College Review Protocol" "Exploring the differential impact of public interventions on indigenous people: Lessons from Mexico's conditional cash transfer program","Lopez-Calva, L. F., & Patrinos, H. A. (2015). Exploring the differential impact of public interventions on indigenous people: Lessons from Mexico's conditional cash transfer program. Journal of Human Development and Capabilities, 16(3), 452-467. doi:10.1080/19452829.2015.1072378","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The objective of the study was to examine the impact of Mexico’s conditional cash transfer program (PROGRESA/Oportunidades) on child labor and school attendance for children ages 8 to 17 across 3 indigenous, Spanish-speaking, and bilingual households. Using survey data from a cluster randomized controlled trial, the authors analyzed the average program impact of the PROGRESA/Oportunidades program on indigenous households versus individuals who were bilingual or Spanish-speaking. The study found that the PROGRESA/Oportunidades program was significantly related to a decrease in child labor and an increase in school attendance for indigenous speaking children. The quality of causal evidence presented in this study is low because it was based on a randomized controlled trial with unknown attrition and the authors did not control for the required variables. As a result, we are not confident that the estimated effects are attributable to PROGRESA/Oportunidades; other factors are likely to have contributed.",PROGRESA/Oportunidades,"Child labor","Other, Low income",,"International, Rural",2015,https://www.researchgate.net/publication/242464961_Exploring_the_Differential_I…,"Child Labor Review Protocol" "Enhanced Early Head Start with employment services: 42-month impacts from the Kansas and Missouri sites of the Enhanced Services for the Hard-to-Employ Demonstration and Research Project","Hsueh, J., and Farrell, M. (2012). Enhanced Early Head Start with employment services: 42-month impacts from the Kansas and Missouri sites of the Enhanced Services for the Hard-to-Employ Demonstration and Research Project. OPRE Report 2012-05. Washington DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of Enhanced Early Head Start (EHS) participation on employment, earnings, and public assistance receipt for low-income families with young children. The study used a randomized controlled trial design, assigning eligible families to either the Enhanced EHS program or existing services. To estimate the program’s impacts, the authors used administrative employment and earnings data, as well as a 42-month follow-up survey emphasizing respondents’ employment, income, and public assistance receipt. Outcomes were adjusted for characteristics before random assignment. The study found that the longest period of continuous employment during the 3.5-year follow-up period was, on average, 2.5 months shorter for mothers in the Enhanced EHS group than mothers in the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to Enhanced EHS services, and not to other factors.","Enhanced Early Head Start","Other employment and reemployment","Low income, Parent",,"United States, Rural",2012,http://www.acf.hhs.gov/sites/default/files/opre/kansas_missouri.pdf,"Employment and Training Review Protocol" "Same bureaucracy, different outcomes in human capital? How indigenous and rural non-indigenous areas in Panama responded to the CCT","Arriaz, I., & Rozo, S. (2011). Same bureaucracy, different outcomes in human capital? How indigenous and rural non-indigenous areas in Panama responded to the CCT. Inter-American Development Bank, Office of Evaluation & Oversight.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of Red de Oportunidades (RdO), a conditional cash transfer program in Panama, on child labor and school enrollment. The authors used cross-sectional data to compare the treatment group to the comparison group on several outcomes, including child labor (if the child worked in the previous week) and school enrollment (if the child was enrolled in formal schooling). In the analyses for rural areas, the study found that the receipt of the RdO was significantly associated with a decrease in child labor by 6.2 percentage points and an increase in school enrollment by 8.8 percentage points. In the analyses for the indigenous areas, the receipt of RdO was significantly associated with an increase in school enrollment by 6.3 percentage points, but not related to child labor. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Red de Oportunidades (RdO) program; other factors are likely to have contributed.","Red de Oportunidades (RdO)","Child labor","Other, Low income",,"International, Rural",2011,https://papers.ssrn.com/sol3/papers.cfm?abstract_id=1847124,"Child Labor Review Protocol" "Reducing child labour through conditional cash transfers: Evidence from Nicaragua's Red de Protección Social","Gee, K.A. (2010). Reducing child labour through conditional cash transfers: Evidence from Nicaragua's Red de Protección Social. Development Policy Review, 28(6), 711-732.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor","Summary: The study’s objective was to examine the impact of a conditional cash transfer program, Red de Protección Social (RPS), in Nicaragua on child labor outcomes for children who are working. The study was an expansion of an earlier randomized controlled trial (RCT). The author used survey data from the RCT taken before the program started (2000) and two years after (2002) to examine the probability and duration of child work. The study found that the receipt of the cash transfer significantly reduced the probability that a child would work by approximately 10.6 percent and, for a child that was working, significantly reduced the hours worked per week by approximately 3.65 hours, on average. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Red de Protección Social program, and not to other factors.","Red de Protección Social (RPS)","Child labor","Other, Low income",,"International, Rural",2010,,"Child Labor Review Protocol" "Child education and work choices in the presence of a conditional cash transfer programme in rural Colombia","Attanasio, O., Fitzsimons, E., Gomez, A., Gutierrez, M. I., Meghir, C., & Mesnard, A. (2010). Child education and work choices in the presence of a conditional cash transfer programme in rural Colombia. Economic Development and Cultural Change, 58(2), 181-210. doi:10.1086/648188.","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The objective of this study was to examine the impact of the conditional cash transfer program, Familias en Acción, on children’s work and school participation in Columbia. The study used a nonexperimental design to compare labor and schooling outcomes of children who received the conditional cash transfer with a comparison group of children who did not, based on data from a survey. The study found that receipt of the cash transfer was significantly associated with a decrease in the likelihood of participating in domestic work for urban children aged 10 to 17, a decrease in the hours spent in income-generating work for urban children aged 14 to 17, and a decrease in the hours spent in domestic work for all but rural children aged 14 to 17. Receipt of the cash transfer was also significantly related to an increase in the hours spent in school for all children in urban and rural areas. The quality of causal evidence presented in the study is low because the authors did not control for pre-intervention outcomes. This means we are not confident that the estimated effects are attributable to the Familias en Acción program; other factors are likely to have contributed.","Familias en Acción","Child labor","Other, Low income",,"International, Rural",2010,http://openaccess.city.ac.uk/5381/1/Child_Education.pdf,"Child Labor Review Protocol" "Evaluating the direct and indirect effects of a conditional income support program: The case of Progresa","Badillo Bautista, C. (2009). Evaluating the direct and indirect effects of a conditional income support program: The case of Progresa (Doctoral dissertation). Retrieved from ProQuest Dissertations & Theses A&I. (Accession No. 1314572898)","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Child labor-Mod/high-Favorable impacts Child labor","Summary: The objective of the study was to examine the impact of Mexico’s conditional cash transfer program (PROGRESA/Oportunidades) on child labor for children ages 8 to 17. Using survey data from a cluster randomized controlled trial, the authors analyzed the average program impact of the PROGRESA/Oportunidades program using a difference-in- differences (DID) regression model for the child labor outcome and cross-sectional models to estimate spillover effects on child labor. The study found the number of children aged 12-16 who worked significantly decreased in cash transfer participating households compared to control households. The quality of causal evidence presented in this study is high because it is based on a well-implemented, low attrition randomized controlled trial. This means we are confident that the estimated effects are attributable to PROGRESA/Oportunidades and not to other factors.",PROGRESA/Oportunidades,"Child labor","Other, Low income",,"Rural, International",2009,,"Child Labor Review Protocol" "Limiting child labor through behavior-based income transfers: An experimental evaluation of the PETI program in rural Brazil","Yap, Y. T., Sedlacek, G., & Orazem, P. F. (2009). Limiting child labor through behavior-based income transfers: An experimental evaluation of the PETI program in rural Brazil. In P. F. Orazem, G. Sedlacek, & Z. Tzannatos (Eds.), Child Labor and Education in Latin America (pp. 147-165). New York, NY: Palgrave Macmillan. doi.org/10.1057/9780230620100_10","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Programa de Erradicacao do Trabalho Infantil (PETI) or Program to Eradicate Child Labor on child labor and hours in school. The authors used an experimental design to compare the outcomes of children ages 7 to 14 residing in municipalities who received income transfers with those residing in municipalities who did not receive income transfers. Based on data from Brazil’s national household survey, the authors used statistical models to assess the impact of the program in each group. The PETI program was significantly associated with an increase in time in school and less time in work for participating children. The quality of causal evidence presented in this report is low because it is a randomized controlled trial with unknown attrition and the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the PETI program; other factors are likely to have contributed.","Programa de Erradicacao do Trabalho Infantil (PETI) or Program to Eradicate Child Labor","Child labor","Other, Low income",,"International, Rural",2009,,"Child Labor Review Protocol" "Education and child labor: Experimental evidence from a Nicaraguan conditional cash transfer program","Maluccio, J. A. (2009). Education and child labor: Experimental evidence from a Nicaraguan conditional cash transfer program. In P. F. Orazem, G. Sedlacek, & Z. Tzannatos (Eds.), Child labor and education in Latin America: An economic perspective (pp. 187-204). New York, NY: Palgrave Macmillan. doi.org/10.1057/9780230620100_12","Child Labor","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Child labor-Low-Favorable impacts Child labor Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Red de Proteccion Social (RPS) cash transfer program on school attendance and enrollment and on child labor for children aged 7-13 in rural Nicaragua. Using panel survey data collected before and one year after program implementation, the author measured the impact of RPS using a randomized controlled trial (RCT). The study found that participation in RPS was significantly related to a reduction in child labor and a significant increase in school enrollment and attendance. The quality of the causal evidence presented in this report is low because, while it was based on an RCT, attrition was high and the authors did not demonstrate that the groups were similar at baseline. This means we are not confident that the estimated effects are attributable to the Red de Proteccion Social; other factors are likely to have contributed.","Red de Protección Social (RPS)","Child labor","Other, Low income",,"International, Rural",2009,,"Child Labor Review Protocol" "Testing case management in a rural context: An impact analysis of the Illinois Future Steps program: Findings from the Rural Welfare-to-Work Strategies Demonstration evaluation.","Meckstroth, A., Person, A., Moore, Q., Burwick, A., McGuirk, A., Ponza, M., Marsh, S., Novak, T., Zhao, Z., & Wheeler, J. (2008). Testing case management in a rural context: An impact analysis of the Illinois Future Steps program: Findings from the Rural Welfare-to-Work Strategies Demonstration evaluation. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Future Steps rural welfare-to-work program on employment, earnings, and public benefit receipt. The authors randomly assigned Temporary Assistance for Needy Families (TANF) and Food Stamps recipients required to work to either a treatment group, which received job search and other services, or a control group, which did not. The authors evaluated the treatment’s impact using Illinois administrative data and follow-up surveys. The authors found that the Future Steps program increased the likelihood of being employed 30 months after enrollment by 8.6 percentage points. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the Future Steps rural welfare-to-work program and not to other factors.","the Future Steps Rural Welfare-to-Work Program","Job search assistance and supportive services Other employment and reemployment","Low income",,"Rural, United States",2008,http://www.acf.hhs.gov/sites/default/files/opre/testing_case.pdf,"Employment and Training Review Protocol" "The employment and training outcomes of a job training partnership act program in a community college setting","Carter, D. L. (1999). The employment and training outcomes of a job training partnership act program in a community college setting (Unpublished doctoral dissertation). University of Florida.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages","Summary: The study's objective was to examine the impact of a Job Training Partnership Act (JTPA) funded vocational training program at a community college in North Florida on earnings outcomes. The author used an interrupted time series design to compare outcomes of participants before and after they participated in the JTPA program. Data for the study were compiled from the community college's existing JTPA records. The study found that participation in JTPA funded training was significantly related to higher post-training wages. The quality of causal evidence presented in this report is low because the author did not observe outcomes for multiple periods before or after the program nor account for selection into the intervention. This means we are not confident that the estimated effects are attributable to the JTPA funded vocational training program; other factors are likely to have contributed.","Job Training Partnership Act","Employment and Training Services Training and Education Basic skills Capacity building programs Community college education and other classroom training","Youth, Adult, Other barriers, Dislocated or displaced worker, Low income",,"Rural, United States",1999,,"Community College Review Protocol"