Title,Citation,Topic_area,Study_type,Study_evidence_rating,Outcome_effectiveness,Findings,Intervention_program,Topics,Target_population,Firm_characteristics,Geographic_setting,Original_publication_date,Original_publication_link,"Review Protocol" "Oregon Credentials, Acceleration and Support for Employment (CASE) evaluation report: Results, key issues and implications for policy, practice and systems","Watrus, B., & Fercho, H. (2015). Oregon Credentials, Acceleration and Support for Employment (CASE) evaluation report: Results, key issues and implications for policy, practice and systems. Retrieved from https://www.roguecc.edu/Programs/CareerPathways/pdf/CASE%20final%20evaluation%20report_Final.pdf","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the Credentials, Acceleration and Support for Employment (CASE) program on education and employment outcomes. The authors used a nonexperimental design to compare the outcomes of students who were in the CASE program to a matched comparison group. The study found a positive relationship between participation in the CASE program and program completion and employment; however, the study did not include tests of statistical significance. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar or use sufficient. This means we are not confident that the estimated effects are attributable to the CASE program; other factors are likely to have contributed.","the Credentials, Acceleration and Support for Employment (CASE) Program","Capacity building programs Community college education and other classroom training","Adult, Dislocated or displaced worker, Unemployed, Other",,"United States",2020,https://www.roguecc.edu/Programs/CareerPathways/pdf/CASE%20final%20evaluation%2…,"Community College Review Protocol" "SUN PATH comparison group study","Dauphinee, T., & Bishwakarma, R. (2018). SUN PATH comparison group study. Albuquerque, NM: University of New Mexico, Career to Cradle Policy Institute.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-Favorable impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Skill‐UP Network Pathways Acceleration in Technology and Healthcare (SUN PATH) program on education, earnings, and employment outcomes. The authors used a nonexperimental design to compare the outcomes of students who were in the SUN PATH program to a matched comparison group of students. The study found that SUN PATH students had higher rates of program completion, certificates/degree attainment, program retention, employment, and earnings than students in the comparison group. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the SUN PATH program, but other factors might also have contributed.","the Skill‐UP Network Pathways Acceleration in Technology and Healthcare (SUN PATH) Program","Capacity building programs Community college education and other classroom training","Adult, Dislocated or displaced worker, Other, Low-skilled, Veteran or military",,"United States",2018,https://www.skillscommons.org/bitstream/handle/taaccct/18108/SUN%20PATH%20Compa…,"Community College Review Protocol" "Evaluation of the Illinois Network for Advanced Manufacturing: Final Report","Westat. (2016). Evaluation of the Illinois Network for Advanced Manufacturing: Final Report. Rockville, MD: Westat & GEM Software Development, Inc.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the Illinois Network for Advanced Manufacturing (INAM) program on education, earnings, and employment outcomes. The study used a nonexperimental design to compare the outcomes of students who were in the INAM program to a comparison group of students who took similar courses before the creation of INAM. Using data from college databases and the Illinois Department of Employment Security, the authors conducted statistical models to examine differences in outcomes between the groups. The study found that participation in the INAM program was significantly associated with improved rates of certificate or degree completion. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the INAM program; other factors are likely to have contributed.","the Illinois Network for Advanced Manufacturing (INAM)","Capacity building programs Community college education and other classroom training","Adult, Dislocated or displaced worker, Unemployed, Other, Veteran or military",,"United States",2016,https://www.researchgate.net/publication/315664265_Evaluation_of_the_Illinois_N…,"Community College Review Protocol" "Final evaluation of Southwest Virginia Community College’s PluggedInVA TAACCCT Grant initiative","Topper, A., Munn, W., Bor, E., Clery, S., & Smith, B. (2016). Final evaluation of Southwest Virginia Community College’s PluggedInVA TAACCCT Grant initiative. Retrieved from: https://www.skillscommons.org//handle/taaccct/15650","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the PluggedInVA (PIVA) program on education and employment outcomes. Using college administrative and state workforce data, the authors conducted a nonexperimental study to compare outcomes between students in the PIVA program with a comparison group of non-participating students. The study found no statistically significant relationships between participation in the PIVA program and education or employment outcomes. The quality of causal evidence presented in this report is low because the authors did not ensure the groups being compared were similar before the intervention or include sufficient control variables. This means we are not confident that the estimated effects are attributable to PluggedInVA; other factors are likely to have contributed.","PluggedInVA (PIVA)","Capacity building programs Community college education and other classroom training","Adult, Unemployed, Other",,"United States",2016,https://www.skillscommons.org//handle/taaccct/15650,"Community College Review Protocol" "Third party evaluation of MoManufacturingWINS: Implementation, outcomes, and impact","Cosgrove, J. J., Cosgrove, M. S., & Bragg, D. D. (2016). Third party evaluation of MoManufacturingWINs: Implementation, outcomes, and impact. St. Louis, MO: Cosgrove & Associates and Bragg & Associates.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of Missouri’s Manufacturing Workforce Innovation Networks(MMW) program on student education and employment outcomes. The study used a nonexperimental design to compare the outcomes of students who were in MMW to a comparison group of students in other manufacturing-technology related programs. The study found that MMW participation was significantly associated with higher retention and employment rates. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention and they did not include sufficient controls. This means we are not confident that the estimated effects are attributable to MMW; other factors are likely to have contributed.","Missouri’s Manufacturing Workforce Innovation Networks (MMW)","Basic skills Capacity building programs Community college education and other classroom training","Adult, Unemployed, Other, Low-skilled, Veteran or military",,"United States",2016,https://www.skillscommons.org/bitstream/handle/taaccct/10116/ThirdPartyFinalEva…,"Community College Review Protocol" "Trade Adjustment Assistance Community College and Career Training II Grant Program (TAACCCT II): Summative Evaluation of the University of District of Columbia, Community College’s Transportation Academy","Yoder, B., & Ryland, A. (2016). Trade Adjustment Assistance Community College and Career Training II Grant Program (TAACCCT II): Summative Evaluation of the University of District of Columbia, Community College’s Transportation Academy. Retrieved from https://www.skillscommons.org/bitstream/handle/taaccct/15654/University%20of%20the%20District%20of%20Columbia%20-%20Final%20Evaluation%20-%202017.01.05.pdf?sequence=1&isAllowed=y","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Education and skills gains-Low-No impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the TAACCCT funded Transportation Academy program on education, earnings, and employment outcomes. The study used a nonexperimental design to compare education, earnings, and employment outcomes of Transportation Academy participants to a matched comparison group from three different institutional data sources. The study did not find a significant association between participation in the Transportation Academy program and education, earnings, or employment outcomes. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before intervention. This means we are not confident that the estimated effects are attributable to the Transportation Academy program; other factors are likely to have contributed.","the Transportation Academy Program","Capacity building programs Community college education and other classroom training","Adult, Unemployed, Other",,"United States",2016,https://www.skillscommons.org/bitstream/handle/taaccct/15654/University%20of%20…,"Community College Review Protocol" "Final external evaluation report: Trade Adjustment and Assistance Community College and Career Training Program Clovis Community College","Caffey, D. L. (2016). Final external evaluation report: Trade Adjustment and Assistance Community College and Career Training Program Clovis Community College. Fresno, CA: Clovis Community College.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of Clovis Community College’s (CCC) inclusive Nursing and enhanced Radiologic Technology (RADT) programs on education outcomes. The study used a nonexperimental design to compare the outcomes of students who were in the inclusive Nursing or enhanced RADT programs to a comparison group of students. The study found that participation in the Nursing and enhanced RADT program was significantly associated with higher program retention rates. The quality of causal evidence presented in this report is low because the author did not ensure that the groups being compared were similar before the intervention and did not include sufficient controls. This means we are not confident that the estimated effects are attributable to the inclusive Nursing or enhanced RADT program; other factors are likely to have contributed.","Inclusive Nursing and Radiologic Technology Programs","Capacity building programs Community college education and other classroom training","Adult, Other",,"United States",2016,,"Community College Review Protocol" "Third-party evaluation of the outcomes and impact of the National Information, Security, & Geospatial Technologies Consortium (NISGTC)","Bridges, K., Bishop, C., & Giani, M. (2015). Third-party evaluation of the outcomes and impact of the National Information, Security & Geospatial Technologies Consortium (NISGTC). Champaign, IL: Office of Community College Research and Leadership, University of Illinois at Urbana-Champaign.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-No impacts Employment","Summary: The study’s objective was to assess the impact of TAACCCT-funded programming offered at National Information Security & Geospatial Technology Consortium (NISGTC) colleges on educational and employment outcomes. Using student-level data collected by the colleges’ Institutional Research offices and states’ Unemployment Insurance data systems, the study used a nonexperimental design to compare the outcomes of students enrolled in NISGTC programs with students enrolled in similar programs of study prior to the grant. The study found that students in the NISGTC-affected programs were significantly more likely to attain credentials and have higher average quarterly earnings than students in the comparison group. The quality of causal evidence presented in this report is low because the authors did not use sufficient controls in their analysis for the education outcomes. This means we are not confident that the estimated effects are attributable to the NISGTC-affected programs; other factors are likely to have contributed.","National Information Security & Geospatial Technology Consortium (NISGTC) Programs","Capacity building programs Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Other, Low-skilled",,"United States",2015,https://occrl.illinois.edu/docs/librariesprovider4/nisgtc/nisgtc-impact.pdf,"Community College Review Protocol" "Affirmative action and the occupational advancement of minorities and women during 1973-2003","Kurtulus, F. (2012). Affirmative action and the occupational advancement of minorities and women during 1973-2003. Industrial Relations, 52(2), 213-246.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the effect of affirmative action requirements for federal contractors on the occupational employment shares of minorities and women at federal contractors and noncontractors from 1973 to 2003. The author used a nonexperimental design to examine establishments’ employment share of race, ethnicity, and gender groups in seven occupational categories over time using data from annual EEO-1 Employer Information Report files. The study found that, among firms that became federal contractors from 1973 to 2003, the share of Hispanic women, white women, African American women, and African American men significantly increased in some skilled occupational categories compared with firms that did not become federal contractors in that period. The study also found that the share of African American men and women increased significantly in manual jobs at federal contractor firms, compared with nonfederal contractor firms in that period. The quality of causal evidence presented in this report is moderate because it was based on a strong non-experimental design. This means we are somewhat confident that the estimated effects are attributable to affirmative action requirements for federal contractors, but other factors might also have contributed.","Affirmative Action Legislation","Affirmative action Executive Order 11246 (E.O. 11246) Civil Rights Act of 1964",Other,,"United States",2012,,"Employer Compliance Review Protocol" "A study of the impact of a first-year experience initiative on first-year developmental education student success and persistence","Spencer, K. (2012). A study of the impact of a first-year experience initiative on first-year developmental education student success and persistence (Doctoral dissertation). Retrieved from ProQuest Dissertations and Theses database. (UMI No. 3542047)","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Achieving the Dream learning community program on students’ retention and completion of developmental English and math courses at a community college in Michigan. The study used students’ records to compare outcomes of developmental education students who enrolled in the Achieving the Dream program to outcomes of those who took standard developmental courses. The study found no significant differences between the treatment and comparison groups in retention rates or in completion of English or math developmental courses. The quality of causal evidence presented in this study is low because the author did not include sufficient controls in the analysis. This means we are not confident that the estimated effects are attributable to Achieving the Dream. Other factors are likely to have contributed.","Achieving the Dream","Community college education and other classroom training","Adult, Low income, Other",,"United States",2012,,"Community College Review Protocol" "Success of joint programs between junior and senior colleges","Krudysz, M., Walser, A., & Alting, A. (2012). Success of joint programs between junior and senior colleges. American Society for Engineering Education.","Community College","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains","Summary: The study’s objective was to examine the impact of the Joint/Dual (JD) program on retention and graduation rates for community college and undergraduate engineering students who were under-represented minorities and women. JD students received dual admission to a community college as well as a senior college, and transitioned into the upper division of the baccalaureate engineering program at the senior college upon successful completion of lower-division courses and degree requirements at the community college. This study used data from junior and senior colleges within a major urban university system to compare outcomes of a treatment group of JD program participants and a comparison group of transfers into the urban university system from other, nonparticipating community colleges. This study found that first- and second-year retention rates were higher for JD program participants than for transfers from other community colleges, but did not conduct statistical tests of these differences. The quality of causal evidence presented in this report is low because the authors did not include controls for relevant student characteristics in the analysis. This means we are not confident that the estimated effects are attributable to the JD program. Other factors are likely to have contributed.","the Joint/Dual Program","Community college education and other classroom training Science, Technology, Engineering, and Math (STEM) programs","Adult, Female, Other",,"Urban, United States",2012,https://www.asee.org/public/conferences/8/papers/3558/download,"Community College Review Protocol" "The strength of weak enforcement: The impact of discrimination charges, legal environments, and organizational conditions on workforce segregation","Hirsh, C. (2009). The strength of weak enforcement: The impact of discrimination charges, legal environments, and organizational conditions on workforce segregation. American Sociological Review, 74, 245-271.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Compliance-Low-Favorable impacts Compliance","Summary: The study’s objective was to assess two approaches to mitigating employment discrimination: direct Equal Employment Opportunity Commission (EEOC) enforcement and indirect, industry-level EEOC enforcement. The author applied a fixed-effects regression analysis to a national random sample of private U.S. employment establishments required to report race and gender data to the EEOC from 1990 to 2002. The study found that EEOC settlements mandating policy changes or monetary payouts within an industry were associated with statistically significant decreases in sex segregation within establishments in the industry, but had limited effects on race segregation. The quality of causal evidence presented in this report is low because the authors did not establish that firms subject to different levels of enforcement activities were similar before those activities. This means we are not confident that the estimated effects are attributable to either direct or indirect EEOC enforcement; other factors are likely to have contributed.","Equal Employment Opportunity Commission Enforcement","Civil Rights Act of 1964 Equal Employment Opportunity Act of 1972",Other,,"United States",2009,,"Employer Compliance Review Protocol" "A cure for discrimination? Affirmative action and the case of California’s Proposition 209.","Myers, C. (2007). A cure for discrimination? Affirmative action and the case of California’s Proposition 209. Industrial and Labor Relations Review, 60(3), 379-396.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Unfavorable impacts Employment","Summary: The study’s objective was to gauge the impact of California’s Proposition 209, a 1996 repeal of affirmative action, on employment, unemployment, labor force participation, and wages among women and racial minorities. The author used a nonexperimental design and estimated a difference-in-difference-in-differences regression model on monthly Current Population Survey data from 1994 to 2001. The study found that the employment rate of all minorities in California relative to white men dropped 2.8 percentage points from 1995 to 1999, a statistically significant decrease. The quality of causal evidence presented in this report is low because the author did not control for pre-intervention minority employment trends in California relative to the rest of the United States or preemptive hiring decisions that might have anticipated the law’s passage. This means we are not confident that the estimated effects are attributable to California’s affirmative action repeal through Proposition 209. Other factors are likely to have contributed.","California's Proposition 209","Affirmative action",Other,,"United States",2007,,"Employer Compliance Review Protocol" "An analysis of the impact of affirmative action programs on self-employment in the construction industry.","Blanchflower, D.G., & Wainwright, J. (2005). An analysis of the impact of affirmative action programs on self-employment in the construction industry. Working paper no. 11793. Cambridge, MA: National Bureau of Economic Research.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of City of Richmond v. J.A. Croson Co. (referred to as the Croson decision) in 1989, which weakened affirmative action policies, on self-employment, with a focus on the construction industry, by race, ethnicity, and gender. The study used a nonexperimental analyses to compare self-employment before and after the Croson decision. The authors used national data from the Current Population Survey (CPS) and the 2000 decennial U.S. Census. The study found that gender disparities in self-employment rates have declined since the Croson decision in all industries, but have declined most in construction. In contrast, racial and ethnic disparities in self-employment have declined since the Croson decision in all industries except construction. The quality of causal evidence presented in this study is low because the authors did not control for trends in self-employment or earnings before the Croson decision. This means we are not confident that the estimated effects are attributable to the Croson decision. Other factors are likely to have contributed.","City of Richmond v. J.A. Croson Co.","Affirmative action",Other,Construction,"United States",2005,http://www.nber.org/papers/w11793.pdf,"Employer Compliance Review Protocol"