Title,Citation,Topic_area,Study_type,Study_evidence_rating,Outcome_effectiveness,Findings,Intervention_program,Topics,Target_population,Firm_characteristics,Geographic_setting,Original_publication_date,Original_publication_link,"Review Protocol" "Synthesis Report: Behavioral Finance Synthesis: Findings",,"Behavioral Finance: Retirement",,,,"Findings: People have relatively limited knowledge about saving for retirement and can be induced to save more when provided with additional information. Making retirement more salient, by having people think of themselves in retirement or providing a target retirement date, can increase intentions to save and alter investment choices. People can become overwhelmed by the number of investment options they face; when this occurs, they tend to use simple rules to make decisions.",,"Employer provided retirement benefits","Adult, Older worker",,"United States",,,"Behavioral Finance: Retirement Review Protocol" "Synthesis Report: Research Synthesis: Employment Programs and Demonstrations for SSI and SSDI Beneficiaries",,"Disability Employment Policy",,,,"Findings: Evidence echoes previous literature reviews on the challenges of generating substantive impacts, though customized supports to well-targeted populations show some potential. The most effective interventions provided intensive, customized supports and services focused on job training, placement, and retention to narrowly defined target populations. Interventions that provided support services or incentives to help beneficiaries keep more of their benefits when working had small or no impacts on employment, even if spending on services was high. There is no evidence of SSI or SSDI caseload reductions, even among interventions that improved employment and/or earnings. Little is known about interventions for improving earnings of people with TBI and PTSD. Recruiting beneficiaries to participate in demonstrations was difficult, which limited the generalizability of study findings. Fidelity to the demonstration model is important. Work incentives and supports can be difficult to implement in the context of SSA’s existing work incentives, creating potential confusion for beneficiaries and program staff. A strong technical assistance component, with incentives for service providers to accept the assistance, is important to successful implementation. Demonstrations should be pilot tested before being implemented on a national scale.",,,Disability,,,,,"Disability Employment Policy Review Protocol" "The impact of Medicare Part D on self-employment.","Moulton, J. G., Diebold, J. C., & Scott, J. C. (2017). The impact of Medicare Part D on self-employment. Research on Aging, 39(1), 64-85.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The study examined the effect of the introduction of Medicare Part D on self-employment. The authors used a nonexperimental approach and data from the American Community Survey to estimate the impact. The authors found that self-employment significantly increased by 0.5 percentage points after the program began. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects on self-employment are attributable to the introduction of Medicare Part D, although other factors might also have contributed.","Medicare Part D","Federal retirement benefits Older workers' programs","Adult, Older worker",,"United States",2017,,"Employment and Training Review Protocol" "Does protecting older workers from discrimination make it harder to get hired? Evidence from disability discrimination laws.","Neumark, D., Song, J., & Button, P. (2017). Does protecting older workers from discrimination make it harder to get hired? Evidence from disability discrimination laws. Research on Aging, 39(1), 29-63.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Mixed impacts Employment","Summary: The study examined the impact of the strength of state disability discrimination laws on hiring rates of older men. The study used statistical models and data from the Health and Retirement Study and the Survey of Income and Program Participation to estimate the impacts. The study found no relationship between the strength of disability discrimination laws and the hiring rate for older unemployed disabled and nondisabled men. The quality of casual evidence presented in this report is low because the study is a nonexperimental analysis that did not demonstrate that the groups being compared were similar and did not account for possible differences in the analysis. This means we are not confident that the estimated effects are attributable to state disability discrimination laws; other factors are likely to have contributed.","Disability discrimination laws","Health Older workers' programs","Adult, Older worker, Male",,"United States",2017,https://journals.sagepub.com/doi/full/10.1177/0164027516656142,"Employment and Training Review Protocol" "The effect of the Affordable Care Act on labor transitions among older workers.","Camilleri, S. E. (2017). The effect of the Affordable Care Act on labor transitions among older workers. In Three papers on the Affordable Care Act (Doctoral dissertation). North Carolina State University, Raleigh, NC.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-No impacts Employment","Summary: The study examined the impact of the Affordable Care Act (ACA) on the employment outcomes of older workers. The author used data from the Current Population Survey for 2011–2016 and regression analyses to estimate impacts. The study found that the ACA was not associated with employment outcomes among older workers. The quality of causal evidence presented in this report is moderate because the study is based on a well-implemented nonexperimental design. This means we are somewhat confident that any estimated effects are attributable to the ACA, but other factors might also have contributed.","Affordable Care Act (ACA)","Older workers' programs Health insurance","Adult, Older worker",,"United States",2017,,"Employment and Training Review Protocol" "The impact of disability benefits on labor supply: Evidence from the VA’s disability compensation program","Autor, D. H., Duggan, M., Greenberg, K., & Lyle, D. S. (2016). The impact of disability benefits on labor supply: Evidence from the VA’s disability compensation program. American Economic Journal: Applied Economics, 8(3), 31-68. http://www.aeaweb.org/aej-applied/ [Impact of eligibility expansion]",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Unfavorable impacts Earnings and wages Employment-Low-Unfavorable impacts Employment Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study examined the impact of a 2001 expansion in eligibility for Disability Compensation (DC) to type 2 diabetes for Vietnam-era veterans on labor force participation, earnings, and receipt of public benefits. The authors also examined the impact of receiving DC benefits and amount on labor force participation and earnings; see profile here . The authors estimated statistical models to compare outcomes for Vietnam-era Army veterans who served with “boots on the ground” (BOG) with those who served “not on the ground” (NOG) Veterans who did not fight directly in the conflict, from before and after the implementation of the type 2 diabetes policy change in 2001. The authors used administrative data from the U.S. Army Office of Economic and Manpower Analysis, the U.S. Department of Veterans Affairs (VA), and the Social Security Administration. The implementation of expanded DC coverage and benefits in 2001 resulted in reductions in labor force participation and earnings among impacted veterans as well as increases in the receipt of disability benefits. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the expansion in eligibility for Disability Compensation (DC); other factors are likely to have contributed to the findings.",DC,"Disability insurance Veterans' reemployment","Disability, Male, Veteran or military",,"United States",2016,https://pubs.aeaweb.org/doi/pdf/10.1257/app.20150158,"Employment and Training Review Protocol" "The impact of disability benefits on labor supply: Evidence from the VA’s disability compensation program","Autor, D. H., Duggan, M., Greenberg, K., & Lyle, D. S. (2016). The impact of disability benefits on labor supply: Evidence from the VA’s disability compensation program. American Economic Journal: Applied Economics, 8(3), 31-68. http://www.aeaweb.org/aej-applied/ [Impact of DC enrollment and benefit amount]",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Unfavorable impacts Employment","Summary: The study examined the impact of Disability Compensation (DC) enrollment and benefit amount on labor force participation and earnings. The authors also examined the impact of the expansion of eligibility for DC benefits on labor force participation and earnings; see profile here . The authors estimated statistical models to compare outcomes for Vietnam-era Army veterans who served with “boots on the ground” (BOG) with those who served “not on the ground” (NOG) who did not fight directly in the conflict, before and after the implementation of the Type 2 diabetes policy change in 2001. The authors used administrative data from the U.S. Army Office of Economic and Manpower Analysis, the U.S. Department of Veterans Affairs (VA), and the Social Security Administration (SSA). The increases in DC enrollment due to the expansion in eligibility for DC in 2001 were associated with reductions in labor force participation and earnings. Increases in DC benefit amounts due to the expansion in eligibility were also associated with reductions in labor force participation. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to DC enrollment and benefit amounts, but other factors might also have contributed to the findings.",DC,"Disability insurance Veterans' reemployment","Disability, Male, Veteran or military",,"United States",2016,https://pubs.aeaweb.org/doi/pdf/10.1257/app.20150158,"Employment and Training Review Protocol" "Job insecurity, unemployment insurance and on-the-job search. Evidence from older American workers.","Gutierrez, I. A. (2016). Job insecurity, unemployment insurance and on-the-job search. Evidence from older American workers. Labour Economics, 41, 228-245. doi:10.1016/j.labeco.2016.05.011","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-No impacts Employment","Summary: The study examined the impact of the potential wage replacement rate through Unemployment Insurance (UI) on the probability of transitioning to non-employment. The study used a nonexperimental design and data from the Health and Retirement Study (HRS) from 1996–2006 and 2010–2012 to identify workers who expected job loss during the baseline survey and who experienced job transitions by the follow-up survey two years later. The study found no statistically significant relationships between potential wage replacement rates and transitions to non-employment. The quality of causal evidence presented in this report is low because the analyses do not sufficiently account for other factors that might contribute to the estimated effects. This means we are not confident that the estimated effects are attributable to the potential wage replacement rate through UI; other factors are likely to have contributed.","Unemployment Insurance (UI)","Older workers' programs Unemployment Insurance","Adult, Older worker, Employed",,"United States",2016,,"Employment and Training Review Protocol" "Spousal labor market effects from government health insurance: Evidence from a veterans affairs expansion.","Boyle, M. A. & Lahey, J. N. (2016). Spousal labor market effects from government health insurance: Evidence from a veterans affairs expansion. Journal of Health Economics, Elsevier, 45(C), 63-76.","Older Workers, Veterans","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Mod/high-No impacts Employment","Summary: The study examined the impact of the expansion of health insurance for veterans through the U.S. Department of Veterans Affairs (VA) in the mid-1990s (as a result of the implementation of the Veteran’s Health Care Eligibility Reform Act) on the employment and earnings of non-covered spouses. The authors used a statistical model and data from the Census Bureau’s March Current Population Survey and the Health and Retirement Study to compare the employment and earnings of wives of male veterans with wives of non-veterans of the same ages before and after the expansion of health insurance for veterans through the VA. The study found no statistically significant associations between the expansion of health insurance for veterans and the employment of their wives and mixed evidence on associations between the expansion of health insurance for veterans and the earnings of their wives. The quality of causal evidence presented in this report is moderate for the employment outcomes because it was based on a well-implemented nonexperimental design. This means we would be somewhat confident that any estimated effects would be attributable to the expansion of health insurance for veterans through the VA, but other factors might also have contributed. The quality of causal evidence presented in this report is low for earnings outcomes because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the expansion of health insurance for veterans through the VA; other factors are likely to have contributed.","Veteran Health Insurance Expansion","Health Older workers' programs Veterans' reemployment","Adult, Older worker, Veteran or military",,"United States",2016,,"Older Workers, Veterans Review Protocol" "To work for yourself, for others, or not at all? How disability benefits affect the employment decisions of older veterans","Coile, C., Duggan, M., & Guo, A. (2016). To work for yourself, for others, or not at all? How disability benefits affect the employment decisions of older veterans. Unpublished manuscript.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study examined the impact of a 2001 expansion in eligibility for Disability Compensation (DC) to cover type 2 diabetes for Vietnam-era veterans on their employment, earnings, and public benefit receipt. The authors estimated statistical models to compare outcomes among male Vietnam-era veterans who did and did not serve with on the ground using data from the Veterans Supplement to the Current Population Survey from 1995 to 2015. The study found that the expansion of eligibility for DC was associated with greater receipt of DC, a lower likelihood of working for others, and a greater likelihood of self-employment by on-the-ground veterans compared with those veterans who did not serve on the ground. The study did not find a relationship between the expansion and earnings. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to changes in eligibility for DC and not to other factors.",DC,"Other wages and benefits Veterans' reemployment","Disability, Male, Veteran or military",,"United States",2016,https://www.nber.org/papers/w23006,"Employment and Training Review Protocol" "Men and women expecting to work longer: Do changing work conditions matter?","Moen, P., Kojola, E., Kelly, E.L., & Karakaya, Y. (2016). Men and women expecting to work longer: Do changing work conditions matter? Work, Aging and Retirement, 2(3), 321-344.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of a work flexibility intervention called STAR (Support. Transform. Achieve. Results) on workers’ expectations of retirement age and bridge jobs. The study is a randomized controlled trial that uses surveys of workers before the intervention and five years post-intervention. The study found that receiving STAR was associated with higher expectations of working at age 65 and retiring at age 67 or older. The quality of causal evidence presented in this report is low because, although it was based on a randomized controlled trial, it had unknown attrition and the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to STAR; other factors are likely to have contributed.","STAR (Support. Transform. Achieve. Results.)","Work based and other occupational training Other employer services","Adult, Older worker",,"United States",2016,https://experts.umn.edu/en/publications/men-and-women-expecting-to-work-longer-…,"Employment and Training Review Protocol" "The effect of Social Security information on the labor supply and savings of older Americans.","Armour, P., & Lovenheim, M. F. (2016). The effect of Social Security information on the labor supply and savings of older Americans. (Working paper no. 361). Ann Arbor, MI: University of Michigan, Michigan Retirement Research Center.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Mixed impacts Employment","Summary: The study examined the impact of the Social Security statements issued by the Social Security Administration (SSA) on older men’s annual hours worked. The authors used a nonexperimental design and data from Health and Retirement Study surveys and Social Security administrative records to estimate the impacts. The study found that receiving the first Social Security Statement is associated with a decrease in self-reported annual hours worked and receiving the second Social Security Statement is associated with an increase in self-reported annual hours worked. The quality of casual evidence presented in this report is moderate because that the study was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to Social Security statements, but other factors might also have contributed.","Social Security statements","Older workers' programs Other disparities or discrimination in employment and earnings","Adult, Older worker, Male",,"United States",2016,,"Employment and Training Review Protocol" "The effect of health reform on retirement.","Levy, H., Buchmueller, T. C., & Nikpay, S. (2015). The effect of health reform on retirement (Research Paper 329). Ann Arbor, MI: Michigan Retirement Research Center.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the expansion of Medicaid to low-income adults in 2014 on retirement rates of workers ages 55 to 64. The authors used a nonexperimental analysis to compare those who lived in an expansion state to those who lived in other states. The study used data from the monthly Current Population Survey from January 2005 through July 2015. The study found no statistically significant relationships between Medicaid expansion and retirement. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the expansion of Medicaid; other factors are likely to have contributed.","Medicaid expansion","Health insurance Older workers' programs","Adult, Older worker, Low income",,"United States",2015,https://deepblue.lib.umich.edu/handle/2027.42/116062,"Employment and Training Review Protocol" "The impact of a randomly assigned time and place management initiative on work and retirement expectations.","Cahill, K. E., James, J. B., & Pitt-Catsouphes, M. (2015). The impact of a randomly assigned time and place management initiative on work and retirement expectations. Work, Aging and Retirement, 1(4), 350-368.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Unfavorable impacts Employment","Summary: The study examined the impact of a time and place management (TPM) initiative at a medical provider on retirement expectations among workers ages 50 and older. The study was a randomized control trial and used a series of surveys and administrative data to estimate the impact. The study found that, when surveyed 12 months after randomization, employees in the treatment group were statistically significantly more likely to expect to directly exit their job as opposed to staying in their current job within the next five years. The quality of causal evidence presented in this report is moderate because the study was a randomized controlled trial with high attrition, but the authors did demonstrate that the treatment and control groups were similar before the intervention. This means we are somewhat confident that the estimated effects are attributable to TPM, but other factors might also have contributed.","Time and Placement Management (TPM)","Older workers' programs","Older worker","Health care and social assistance",,2015,https://hrs.isr.umich.edu/publications/biblio/8231,"Employment and Training Review Protocol" "Employment outcomes among African American and white women with disabilities: Examining the inequalities.","Balcazar, F. E., & Suarez-Balcazar, Y. (2015). Employment outcomes among African American and white women with disabilities: Examining the inequalities. Women, Gender, and Families of Color, 3(2), 144-164.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-No impacts Employment","Summary: The study examined the impact of adult vocational rehabilitation (VR) services on employment outcomes for African American and white women. The authors used a statistical model and data from a Midwestern state VR system to compare the odds of employment after completing VR services for older versus younger women. The study found no significant difference in employment outcomes between older and younger women who completed VR services. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before receiving VR services. This means we are not confident that the estimated effects are attributable to participation in VR services; other factors are likely to have contributed.","Vocational Rehabilitation (VR) Services","Vocational rehabilitation","Adult, Older worker, Female, Black or African American, White, Disability",,"United States",2015,,"Employment and Training Review Protocol" "Veterans’ labor force participation: What role does the VA’s disability compensation program play?","Coile, C., Duggan, M., & Guo, A. (2015). Veterans’ labor force participation: What role does the VA’s disability compensation program play? American Economic Review, 105(5), 131-136.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study examined the impact of expanding eligibility for veterans’ Disability Compensation (DC) in 2001 and 2010 on labor force participation. The authors conducted a nonexperimental analysis to compare veteran and non-veteran labor force participation over time using the March Current Population Survey data from 1980 to 2014. The study found that veteran labor force participation was generally lower than that of non-veterans in the same 10-year age range during the periods following eligibility expansions. The quality of causal evidence presented in this report is low because there could be differences in external conditions that affected the treatment group and not the comparison group. This means we are not confident that the estimated effects are attributable to veterans’ receipt of DC; other factors are likely to have contributed to the findings.",DC,"Other wages and benefits Veterans' reemployment","Disability, Male, Veteran or military",,"United States",2015,https://www.aeaweb.org/articles?id=10.1257/aer.p20151062,"Employment and Training Review Protocol" "The effect of a severe health shock on work behavior: Evidence from different health care regimes.","Datta Gupta, N., Kleinjans, K. J., & Larsen, M. (2015). The effect of a severe health shock on work behavior: Evidence from different health care regimes. Social Science and Medicine, 136-137, 44-51.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the national health policies of the United States and Denmark on employment of older workers after a health shock, defined as a new cancer or cardiovascular disease diagnosis. The authors used a nonexperimental approach to compare the impact of a health shock on the likelihood of nonemployment in the United States’ private multipayer system with Denmark’s nationalized universal health care model. The authors used the data from the RAND Health and Retirement Study survey from 1994 to 2002 and Danish population registers for 1993 to 2001. The study found no differences between the United States and Denmark in the relationship between a health shock and employment for older workers. The quality of causal evidence presented in this report is low because the authors did not account for unobserved differences between the countries. This means we are not confident that differences in the association between health shocks and employment in the United States and Denmark are attributable to the national health care policies; other factors are likely to have contributed.","National Healthcare Policy","Health Older workers' programs","Adult, Older worker",,"International, United States",2015,https://www.sciencedirect.com/science/article/pii/S0277953615002816,"Employment and Training Review Protocol" "How much does access to health insurance influence the timing of retirement?","Coe, N. B., & Goda, G. S. (2015). How much does access to health insurance influence the timing of retirement? (SIEPR Discussion Paper No. 14-007). Stanford, CA: Stanford Institute for Economic Policy Research. City, ST: Publisher.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Unfavorable impacts Employment Public benefits receipt-Low-No impacts Public benefit receipt","Summary: The study examined the impact of state-level reforms of health insurance on early retirement and Social Security retirement benefit claims. The authors used 1996–2010 data from the Health and Retirement Study (HRS) and statistical models to compare the outcomes of individuals in states with state-level reforms of health insurance with those in non-reform states. The study found that employed individuals in states with non-group health insurance reform were significantly more likely to retire at age 63. The quality of causal evidence presented in this report is low because the authors did not demonstrate that individuals in states with state-level reforms of health insurance were similar to those in non-reform states. This means we are not confident that the estimated effects are attributable to the non-group health insurance reform; other factors are likely to have contributed.","Retiree Health Insurance","Health insurance Older workers' programs","Adult, Older worker",,"United States",2015,,"Employment and Training Review Protocol" "What factors contributed to changes in employment during and after the great recession?","Farooq, A., & Kugler, A. D. (2015). What factors contributed to changes in employment during and after the great recession? IZA Journal of Labor Policy, 4(3), 1-28.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: This study examined the impact of the Work Opportunity Tax Credit (WOTC) on employment for veterans with disabilities and unemployed veterans. The study used a nonexperimental design to examine the effects of the WOTC on employment, based on data from the Annual Social and Economic (ASEC) supplement of the Current Population Survey from 2003 to 2013. The study showed no statistically significant relationships between the WOTC and employment for veterans with disabilities or for unemployed veterans. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that any estimated effects are attributable to the WOTC; other factors likely contributed to the outcomes. However, the study did not show any statistically significant effects.","the Work Opportunity Tax Credit","Veterans' reemployment Work Opportunity Tax Credit (WOTC)","Disability, Veteran or military",,"United States",2015,https://link.springer.com/article/10.1186/s40173-014-0029-y,"Employment and Training Review Protocol" "Who pays the high health costs of older workers? Evidence from prostate cancer screening mandates.","Bailey, J. (2014). Who pays the high health costs of older workers? Evidence from prostate cancer screening mandates. Applied Economics, 46(32), 3931-3941. doi:10.1080/00036846.2014.948673","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Unfavorable impacts Earnings and wages Employment-Mod/high-Unfavorable impacts Employment","Summary: The study examined the impact of state mandates that health insurance plans cover prostate cancer screenings on the earnings and employment of men older than age 50 The study used nonexperimental regression analyses to compare older men in states that had enacted a mandate with women, younger men, and older men living in states without a mandate. The author used data from the Current Population Survey(CPS) between 1990 and 2009. The study found that older men in states with mandates had lower wages and were less likely than the comparison group to be employed. The quality of causal evidence presented in this study is moderate, because it is a well-implemented nonexperimental study. This means we are somewhat confident that the estimated effects are attributable to the prostrate screening mandate, but other factors might also have contributed.","Prostate cancer screening mandates","Health insurance Older workers' programs","Adult, Older worker, Male",,"United States",2014,https://sites.temple.edu/jamesbailey/files/2013/08/Who-Pays-the-High-Health-Cos…,"Employment and Training Review Protocol" "Net impact and benefit-cost estimates of the workforce development system in Washington State. (Upjohn Institute Technical Report No. 13-029). [VOC]","Hollenbeck, K., & Huang, W-J. (2014). Net impact and benefit-cost estimates of the workforce development system in Washington State. (Upjohn Institute Technical Report No. 13-029). Kalamazoo, MI: W.E. Upjohn Institute for Employment Research. Retrieved from W.E. Upjohn Institute for Employment Research website: http://dx.doi.org/10.17848/tr13-029. [VOC]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-Favorable impacts Employment Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of Vocational Rehabilitation (VOC) programs on the employment rate, earnings, and benefit receipt of adults with disabilities in Washington State. The authors used a nonexperimental method to compare the short-term (3 quarters after program exit) and long-term (9 to 12 quarters after program exit) employment, earnings, and Unemployment Insurance benefits between those who took part in VOC programs relative to those who were eligible, but did not receive services from VOC programs. The study found that, compared with those who did not receive services from VOC programs, VOC program participants had higher employment and earnings. Receipt of benefits was lower in the short-term for VOC program participants relative to those who did not receive VOC program services. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before program participation. This means we are not confident that the estimated effects are attributable to VOC programs; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Vocational Rehabilitation (VOC) Programs","Unemployment Insurance Vocational rehabilitation",Disability,,"United States",2014,http://research.upjohn.org/cgi/viewcontent.cgi?article=1032&context=up_technica…,"Employment and Training Review Protocol" "The impact of rehabilitation and counseling services on the labor market activity of Social Security Disability (SSDI) beneficiaries","Weathers, R., & Bailey, M. (2014). The impact of rehabilitation and counseling services on the labor market activity of Social Security Disability (SSDI) beneficiaries. Journal of Policy Analysis & Management, 33(3), 623-648.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine up to 36 month employment and earnings impacts of the Accelerated Benefits Demonstration (ABD), an effort to provide immediate health insurance and employment and benefits counseling to new, uninsured Social Security Disability Insurance (SSDI) recipients during the 24 month Medicare eligibility waiting period.  About 2,000 eligible people were randomly assigned to participate in the ABD. Evaluation data sources included a baseline telephone interview, a 12-month follow-up survey, the Master Beneficiary Record data file, the Summary Earnings Record data file, and Ticket to Work SSA administrative records. The authors estimated the impacts on earnings and employment outcomes for each of three years following enrollment. The study found positive impacts on employment and earnings for those receiving ABD telephonic services. The quality of causal evidence presented in this study is high because it is a well-implemented randomized controlled trial. This means that we are confident that the estimated effects are attributable to the intervention and not to other factors.","Accelerated Benefits Demonstration","Disability insurance Health insurance Supplemental security income (SSI) Vocational rehabilitation",Disability,,"United States",2014,,"Disability Employment Policy Review Protocol" "Cognitive Symptom Management and Rehabilitation Therapy (CogSMART) for veterans with traumatic brain injury: Pilot randomized controlled trial","Twamley, E., Jak, A., Delis, D., Bondi, M., & Lohr, J. (2014). Cognitive Symptom Management and Rehabilitation Therapy (CogSMART) for veterans with traumatic brain injury: Pilot randomized controlled trial. Journal of Rehabilitation Research and Development, 51(1), 59-70.","Disability Employment Policy, Veterans","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of adding Cognitive Symptom Management and Rehabilitation Therapy (CogSMART) to standard supported employment programming for veterans with a history of traumatic brain injury (TBI) and persistent related postconcussive symptoms. Veterans were referred to the program and completed a series of baseline neurocognitive and neuropsychological assessments to determine eligibility. Eligible veterans were randomly assigned to either the CogSMART treatment group, which received supported employment, enhanced by CogSMART sessions, or to a control group that did not participate in CogSMART sessions. The study found that veterans in the CogSMART group demonstrated statistically significant reductions in postconcussive symptoms and improvements in prospective memory functioning. Although a higher proportion of the treatment group entered competitive employment within 14 weeks of starting the program—50 percent compared to 26 percent in the control group—the difference was not statistically significant. The quality of causal evidence presented in this study is low because it is a randomized controlled trial with high or unknown attrition and no control variables included in the analysis. This means we are not confident that the estimated effects are attributable to CogSMART. Other factors are likely to have contributed.","Cognitive Symptom Management and Rehabilitation Therapy","Vocational rehabilitation Veterans' reemployment","Disability, Veteran or military",,"United States",2014,,"Disability Employment Policy, Veterans Review Protocol" "Actions against poverty: The impact of career technical education","Rabren, K., Carpenter, J., Dunn, C., & Carney, J. (2014). Actions against poverty: The impact of career technical education. Career Development and Transition for Exceptional Individuals, 37(1), 29-39.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of participation in career or technical education (career tech) on post-high school employment for people with specific learning or intellectual disabilities who lived in relatively high-poverty areas. The authors estimated regression models comparing employment outcomes for youth who participated in career tech with those who did not, while controlling for differences in demographic characteristics. The study found that career tech participants were 0.235 times more likely than those in the comparison group to be employed when leaving high school. Career tech participants were also 0.064 times more likely to be employed at any point within the first year after high school (0.066 times for those who were unemployed upon leaving high school). These findings were statistically significant. The quality of causal evidence presented in this report is low because the study did not control for students’ degree of disadvantage. This means we are not confident that the estimated effects are attributable to career tech participation; other factors are likely to have contributed.","Career Tech","Other employment and reemployment Other training and education Youth programs","Youth, Disability, Other barriers",,"United States",2014,,"Employment and Training Review Protocol" "Did age discrimination protections help older workers weather the Great Recession?","Neumark, D., & Button, P. (2014). Did age discrimination protections help older workers weather the Great Recession? Journal of Policy Analysis and Management, 33(4), 566-601. doi:10.1002/pam.21762","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Unfavorable impacts Employment","Summary: The study examined whether the strong age discrimination laws moderated the impact of the Great Recession on employment outcomes of older workers. The study used statistical models and the data from the 2003–2011 Current Population Survey (CPS) and 2004–2011 Quarterly Workforce Indicators to estimate impacts. The study found that states with stronger age discrimination laws had experienced increases in unemployment rates, longer unemployment durations, and decreases in hiring rates for some types of older workers relative to younger workers in the months during and following the Great Recession. The quality of causal evidence presented in this study is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the differential effect of the Great Recession on older workers in states with strong age discrimination laws, but other factors might also have contributed.","Age Discrimination Laws","Older workers' programs Other disparities or discrimination in employment and earnings","Adult, Older worker, Female, Male",,"United States",2014,https://www.nber.org/papers/w19216,"Employment and Training Review Protocol" "Given time it worked: Positive outcomes from a SSDI benefit offset pilot after the initial evaluation period","Delin, B., Hartman, E., & Sell, C. (2014). Given time it worked: Positive outcomes from a SSDI benefit offset pilot after the initial evaluation period. Journal of Disability Policy Studies, 1-11.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of Wisconsin’s Benefit Offset Pilot Demonstration (BOPD), which provided a more-generous work incentive for Social Security Disability Insurance (SSDI) recipients, on recipients’ employment status and earnings. Although the original evaluation of BOPD was a randomized controlled trial, this study focused on the outcomes of a nonrandom subset of BOPD participants who had completed a trial work period (TWP). Data sources included Wisconsin Unemployment Insurance administrative records and Social Security Administration (SSA) administrative data to evaluate study sample outcomes for 2009 and 2010. The study found that treatment group members who completed a TWP were significantly more likely to be employed or earn at least three times more than the substantial gainful activity (SGA) amount than control group TWP completers over the eight quarters of follow-up. However, there were no significant impacts on earnings. The quality of the causal evidence presented in this report is moderate because it is based on a well-implemented nonexperimental design. This means we have confidence that the effects estimated in this study are attributable at least in part to the BOPD. However, as with any nonexperimental analysis, other factors not accounted for in the study could also have contributed to the estimated effects.","the Benefit Offset Pilot Demonstration","Disability insurance Other wages and benefits Supplemental security income (SSI)",Disability,,"United States",2014,,"Disability Employment Policy Review Protocol" "The economics of federal tax and employment laws: Empirical evidence from three studies.","Figinski, T. F. (2013). The economics of federal tax and employment laws: Empirical evidence from three studies. (Doctoral dissertation). Retrieved from ProQuest. Accession No. 1415455735.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment Public benefits receipt-Low-Unfavorable impacts Public benefit receipt","Summary: The study examined the impact of removing the Social Security earnings test on Social Security claims, earnings, and labor force participation for female beneficiaries. The study used a statistical model and the data from the Social Security Administration’s Benefit and Earnings Public Use File to estimate impacts. The study found that removing the earnings test was associated with an increase in Social Security claims among women who were primary or spousal beneficiaries and with an increase in average earnings and in labor force participation among women who were primary beneficiaries. The qaulity of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the change in Social Security earings test. This means we are not confident that the estimated effects are attributable to the removal of the Social Security earnings test; other factors are likely to have contributed.","Social Security 2000 Earnings Test Removal","Federal retirement benefits Older workers' programs","Adult, Older worker, Female",,"United States",2014,,"Employment and Training Review Protocol" "Earnings and disability program participation of Youth Transition Demonstration Participants after 24 months","Hemmeter, J. (2014). Earnings and disability program participation of Youth Transition Demonstration Participants after 24 months. Social Security Bulletin, 74(1), 1–26.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: This study’s objective was to measure 24-month impacts for the six Youth Transition Demonstration (YTD) sites that used a randomized evaluation. YTD projects provided services to help youth with disabilities improve their education and employment outcomes and become more economically self-sufficient. Data were collected from the Master Earnings File (MEF), Supplemental Security Record (SSR), Master Beneficiary Record (MBR), and Numerical Identification System (Numident) file. The authors estimated program impacts on measures of paid employment and Social Security disability benefit receipt. The study found that, in three of the sites examined, YTD participants were more likely to have at least some earnings in the first calendar years after random assignment; this was also the case for three sites in the second calendar year after random assignment. However, YTD had no statistically significant impacts on average earnings during either calendar year. In four of the six sites, YTD participants were more likely to receive Supplemental Security Income (SSI) 24 months after random assignment. The quality of the causal evidence presented in this report is high because it is based on a well-implemented randomized controlled trial. This means we can be confident that the estimated impacts are attributable to YTD, and not other factors.","the Youth Transition Demonstration","Disability insurance Supplemental security income (SSI) Youth programs","Disability, Youth",,"United States",2014,http://www.ssa.gov/policy/docs/ssb/v74n1/v74n1p1.html,"Disability Employment Policy Review Protocol" "CogSMART compensatory cognitive training for traumatic brain injury: Effects over 1 year","Twamley, E. W., Thomas, K. R., Gregory, A. M., Jak, A. J., Bondi, M. W., Delias, D. C., & Lohr, J. B. (2014). CogSMART compensatory cognitive training for traumatic brain injury: Effects over 1 year. Journal of Head Trauma Rehabilitation, 30(6), 391-401.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of Cognitive Symptom Management and Rehabilitation Therapy (CogSMART) and enhanced supported employment (ESE) on employment, earnings, and health outcomes. The authors conducted a randomized controlled trial that randomly assigned participants to the intervention and comparison groups. Employment data came from weekly reports on job attainment, hours worked, and wages earned. The study did not find any statistically significant relationships between CogSMART plus ESE and employment, earnings, or health outcomes. The quality of causal evidence presented in this report is low because the study had a confounding factor. Specifically, one interventionist delivered CogSMART plus ESE and another interventionist implemented services to the comparison group, which makes it impossible to separate the effect of CogSMART plus ESE from the effect of the individual interventionists. This means we are not confident that the estimated effects are attributable to CogSMART plus ESE; other factors are likely to have contributed to the findings.","CogSMART Plus ESE","Health Job search assistance and supportive services Supported employment or other employment supports Veterans' reemployment","Disability, Veteran or military",,"United States",2014,https://doi.org/10.1097/HTR.0000000000000076,"Employment and Training Review Protocol" "Retiree health insurance for public school employees: Does it affect retirement?","Fitzpatrick, M. D. (2014). Retiree health insurance for public school employees: Does it affect retirement? Journal of Health Economics, 38, 88-98.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Mixed impacts Employment","Summary: The study’s objective was to examine the impact of an Illinois Public Schools retiree health insurance program on the retirement rates of eligible staff ages 55 to 75. The study used a nonexperimental approach to compare the retirement rates of eligible staff with those of staff who were not eligible and staff in years prior to the introduction of the health insurance program who would have been eligible. The author used data from the Illinois Public Schools' Teacher Service Record database from 1970 to 1992. The study found that eligibility for the program was associated with an overall decrease in retirement age, with eligible staff more likely to retire at ages 55 or 56, but less likely to retire after age 65 compared with those who were not eligible for the program. The quality of the causal evidence presented in this report is low because the study is a nonexperimental analysis that does not account for possible differences in the groups. This means we are not confident that the estimated effects are attributable to the Illinois Public Schools Teachers Retirement Health Insurance Plan; other factors are likely to have contributed.","Illinois Public Schools Teachers Retirement Health Insurance Plan","Employer provided retirement benefits Health insurance Older workers' programs","Adult, Older worker",,"United States",2014,https://www.nber.org/papers/w19524,"Employment and Training Review Protocol" "Linking Youth Transition Support Services: Results from Two Demonstration Projects","Camacho, Christa B., & Hemmeter, Jeffrey. (2013). Linking Youth Transition Support Services: Results from Two Demonstration Projects. Social Security Bulletin, 73(1).","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: This study explored the findings of a 2003–2009 evaluation of the Youth Transition Demonstration (YTD) program, which offered employment and self-sufficiency services and other support services to transition-age youth with disabilities. The study used a sample of youth ages 14 to 25 with disabilities, who were served by 2 of the 10 YTD projects in operation. It summarized the outcomes of 2 YTD projects and described the experiences of one youth from each of the 2 projects who successfully completed the program. The study found that youth who received enhanced transition services and used YTD waivers of Social Security Administration program rules had many YTD program successes; however, the project duration was too short to yield long-term findings. Although the outcomes reported in this article were not causal, they suggested that youth with disabilities can enter the workforce and achieve some self-sufficiency.",,"Disability insurance Supplemental security income (SSI) Youth programs","Youth, Disability",,"United States",2013,http://www.ssa.gov/policy/docs/ssb/v73n1/v73n1p59.html,"Disability Employment Policy Review Protocol" "The link between pensions and retirement timing: Lessons from California teachers.","Brown, K. M. (2013). The link between pensions and retirement timing: Lessons from California teachers. Journal of Public Economics, 98(C), 1-14.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study examined the impact of pension reform under the California State Teachers’ Retirement System (CalSTRS) on retirement timing. The author used a statistical model and data from retirement-eligible employees in Los Angeles Unified School District from 1997 to 2000 to estimate the impact. The study found public school employees were more likely to work an extra year in response to changes in pension plans that provided additional bonuses tied to age and tenure. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the changes in CalSTRS. This means we are not confident that the estimated effects are attributable to the changes in CalSTRS; other factors are likely to have contributed.","CalSTRS Defined Benefit Program","Older workers' programs Other wages and benefits","Adult, Older worker",,"United States",2013,https://eml.berkeley.edu//~saez/course/brown_jpube13.pdf,"Employment and Training Review Protocol" "The impact of uncapping of mandatory retirement on postsecondary institutions.","Weinberg, S. L., & Scott, M. A. (2013). The impact of uncapping of mandatory retirement on postsecondary institutions. Educational Researcher, 42(6), 338-348.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study examined the impact of uncapping mandatory retirement on retirement ages at postsecondary institutions The study used a statistical model to examine the age of retirement before and after the policy change in 1993. It used data on faculty’s employment and retirement from a research university with multiple schools. The study found that uncapping was associated with a statistically significant increase in the retirement age among those who retired from the university. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar nor did they control for differences between the groups. This means we are not confident that the estimated effects are attributable to the federal Age Discrimination in Employment Act (ADEA); other factors are likely to have contributed.","Age Discrimination Employment Act (ADEA)","Federal retirement benefits Older workers' programs","Adult, Older worker",,"United States",2013,https://www.researchgate.net/publication/258134776_The_Impact_of_Uncapping_of_M…,"Employment and Training Review Protocol" "Predictors of financial self-sufficiency among Social Security beneficiaries with psychiatric disabilities","Russinova, Zlatka, Rogers, E. Sally, Langer Ellison, Marsha, Bloch, Philippe, Lyass, Asya, & Wewiorski, Nancy. (2013). Predictors of financial self-sufficiency among Social Security beneficiaries with psychiatric disabilities. Journal of Vocational Rehabilitation, 38, 49–66.","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: This study explored factors associated with the capacity of Social Security recipients with psychiatric disabilities to leave the Social Security disability rolls due to substantial gainful work activity. Data were from a survey conducted from May 2004 to January 2005 as part of a subsequent study of 213 participants in an earlier intervention that offered mental health treatment and assistance in finding competitive jobs to adults with psychiatric disabilities. Results suggested that people with higher occupational status, higher levels of proactive coping skills, and without medical comorbidities were more likely than other beneficiaries with psychiatric disabilities to terminate Social Security disability benefits and achieve financial self-sufficiency due to gainful employment.",,"Health Disability insurance Supplemental security income (SSI) Job search assistance and supportive services",Disability,,"United States",2013,,"Disability Employment Policy Review Protocol" "Initial impacts of the Ticket to Work program for young new Social Security disability awardees: Estimates based on randomly assigned mail months","Stapleton, D., Mamun, A., & Page, J. (2013). Initial impacts of the Ticket to Work program for young new Social Security disability awardees: Estimates based on randomly assigned mail months. Princeton, NJ: Mathematica Policy Research, Center for Studying Disability Policy.","Disability Employment Policy, Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment","Summary: This study examined impacts of the Ticket to Work (TTW) program, a work incentive program for Social Security disability recipients, on achieving Social Security Disability Insurance (SSDI) return-to-work earnings benchmarks and SSDI benefit suspension or termination for work. The study sample included SSDI recipients who entered the rolls from July 1999 to October 2003, were ages 18 to 39, and were not concurrently receiving Supplemental Security Income (SSI). The authors used data from the Ticket Research File (TRF), a Social Security administrative data file, for the analysis. The study found that TTW did not have a statistically significant impact on SSDI return to work earnings benchmarks or the number of SSDI recipients who had their benefits suspended or terminated due to work. The quality of the causal evidence presented in this report is moderate, the highest possible rating for a nonexperimental study. This means we are somewhat confident that the estimated effects are attributable to TTW, but other factors might have contributed.","Ticket to Work","Disability insurance Supplemental security income (SSI) Supported employment or other employment supports","Disability, Low income",,"United States",2013,http://www.mathematica-mpr.com/~/media/publications/pdfs/disability/ttw_initial…,"Disability Employment Policy, Low-Income Adults Review Protocol" "Does retiree health insurance encourage early retirement?","Nyce, S., Schieber, S. Shoven, J. B., Slavov, S., & Wise, D. A. (2013). Does retiree health insurance encourage early retirement? Journal of Public Economics, 104, 40-51.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Unfavorable impacts Employment","Summary: The study’s objective was to examine the impact of employer-provided retiree health insurance on early retirement. The authors used a nonexperimental design to compare early retirement outcomes of employees who are eligible for retiree health insurance with that of those who have no coverage. The study found that people who were employed at age 57 and eligible for employer-subsidized retiree health coverage were significantly more likely to retire at ages 62 to 64 (before becoming eligible for Medicare at age 65) compared with those with no coverage. The quality of causal evidence presented in this report is low because the authors did not account for other factors that could have affected the difference between the treatment and comparison groups. This means we are not confident that the estimated effects are attributable to retiree health insurance; other factors are likely to have contributed.","Retiree Health Insurance","Employer provided retirement benefits Older workers' programs","Adult, Older worker",,"United States",2013,https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3770310/,"Employment and Training Review Protocol" "Return-to-Work Outcomes among Social Security Disability Insurance Program Beneficiaries","Ben-Shalom, Yonatan, and Mamun, Arif. (2013). Return-to-Work Outcomes among Social Security Disability Insurance Program Beneficiaries. Princeton, NJ: Mathematica Policy Research, Center for Studying Disability Policy.","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: This study followed a sample of working-age Social Security Disability Insurance (DI) program recipients for five years after their first benefit award to describe how certain factors helped or hindered their return-to-work outcomes. The study used linear probability models to estimate how individual and environmental factors were associated with achieving return-to-work milestones, across seven primary impairment groups: affective disorders, other psychiatric disorders, intellectual disability, sensory impairments, back disorders, other musculoskeletal disorders, and other physical disorders. The study found that the probability of achieving employment milestones increased with sensory impairments, being black, years of education, and DI award at initial adjudication level. It decreased with age at DI award, back and other musculoskeletal disorders, higher levels of DI benefits at award, receipt of Supplemental Security Income or Medicare at time of DI award, age, and higher state unemployment rates, among other factors. The study also found that differences across age and impairment group persisted after accounting for other characteristics.",,"Disability insurance Supplemental security income (SSI)",Disability,,"United States",2013,,"Disability Employment Policy Review Protocol" "The impact of a written benefits analysis by Utah benefit counseling/WIPA program on vocational rehabilitation outcomes","Wilhelm, S., and McCormick, S. (2013). The impact of a written benefits analysis by Utah benefit counseling/WIPA program on vocational rehabilitation outcomes. Journal of Vocational Rehabilitation 39, 219–222.","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: This report examined whether a written benefits analysis provided as part of the Utah Benefits Planning Assistance & Outreach Program Vocational Rehabilitation (VR) program was associated with the employment and earnings outcomes and closure status of VR clients that received the benefits analysis compared with those who did not. For people who had at least one change in employment status over the study period, a multivariate analysis tested the difference in employment between the two groups. On average, those who received a written analysis were 18.4 percent more likely to be employed than those who did not. However, for those employed at least one of the quarters, having a written analysis was not associated with an increase in their earnings.",,"Vocational rehabilitation",Disability,,"United States",2013,,"Disability Employment Policy Review Protocol" "Training and retirement patterns.","Montizaan, R., Cörvers, F., & de Grip, A. (2013). Training and retirement patterns. Applied Economics, 45(15), 1991-1999. doi:10.1080/00036846.2011.646066","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Unfavorable impacts Employment","Summary: The study’s objective was to examine the impact of firm-specific training and general training on older men’s retirement decisions The study used a nonexperimental design and data from the U.S. National Longitudinal Survey of Older Men for 1966 to 1983 to estimate impacts. The study found that workers with firm-specific training were more likely to retire within the time period studied and to have jobs with a mandatory retirement age than workers without firm-specific training. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before receiving training and did not account for self-selection into training. This means we are not confident that the estimated effects are attributable to firm-specific or general training; other factors are likely to have contributed.","Firm-specific & General Training","Work based and other occupational training","Adult, Older worker, Male",,"United States",2013,https://www.researchgate.net/publication/236021967_Training_and_retirement_patt…,"Employment and Training Review Protocol" "A randomized controlled trial to improve health among women receiving welfare in the U.S.: The relationship between employment outcomes and the economic recession.","Kneipp, S., Kairalla, J. & Sheely, A. (2013). A randomized controlled trial to improve health among women receiving welfare in the U.S.: The relationship between employment outcomes and the economic recession. Social Science & Medicine, 80, 130-140.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the impact of the Public Health Nurse (PHN) intervention on employment outcomes. The authors conducted a randomized controlled trial. Researchers used self-reported job beginning and ending dates to determine whether a participant was employed over a nine-month period. The authors found no statistically significant effect of PHN on any employment in the first nine months after random assignment. The quality of causal evidence presented in this study is high because it was based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects would be attributable to PHN and not to other factors. However, the study did not find statistically significant effects.","Public Health Nurse Intervention","Other employment and reemployment","Disability, Low income",,"United States",2013,,"Employment and Training Review Protocol" "Trends in the Composition and Outcomes of Young Social Security Disability Awardees","Ben-Shalom, Yonatan, and Stapleton, David. (2013). Trends in the Composition and Outcomes of Young Social Security Disability Awardees. Michigan Retirement Research Center (MRRC) working paper, WP 2013-284. Retrieved from http://www.mrrc.isr.umich.edu/publications/papers/pdf/wp284.pdf.","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: A large share of new Social Security Disability (SSD) recipients—workers with disabilities and adult children with disabilities—are younger than 40. Better information on the backgrounds, impairments, personal characteristics, and employment outcomes of these recipients would help policymakers develop programs tailored to the needs and circumstances of various subgroups of such recipients. This study used administrative data on young SSD awardees first awarded benefits from 1996 to 2007 to examine trends in their composition and outcomes. Most of the data come from the 2009 version of the Disability Analysis File, a data file originally constructed to support analysis of the effects of the Ticket to Work program. The study found that the composition of young SSD awardees changed substantially during this period. It also found that young awardees differed from older SSD awardees along many dimensions other than age. The findings raised several important policy issues. Most important, policymakers have to consider other options for the support of youth and young adults with disabilities—options that do not discourage work while promoting dependence.",,"Disability insurance Supplemental security income (SSI)","Disability, Youth",,"United States",2013,,"Disability Employment Policy Review Protocol" "Can benefits and work incentives counseling be a path to future economic self-sufficiency for SSI/SSDI beneficiaries?","Nazarov, Z. (2013). Can benefits and work incentives counseling be a path to future economic self-sufficiency for SSI/SSDI beneficiaries? Center for Retirement Research Working Paper 17.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages","Summary: This study’s objective was to determine whether benefits and work incentives counseling provided by New York State’s vocational rehabilitation (VR) agency increased earnings and increased the number of hours worked among Social Security disability benefit recipients. The primary data source for this study was New York State administrative data. The author conducted an instrumental variables analysis and a propensity score matching analysis. Weekly earnings for individuals who received benefits and work incentives counseling were higher than earnings among nonrecipients, with differences estimated between 40 and 31 percent by instrumental variables analysis, and between 12.5 and 10.9 percent by propensity score matching. The effect of benefits and work incentives counseling on case closure was estimated to be positive under both methods but was not statistically significant. The quality of causal evidence provided in this study is moderate. This means we are somewhat confident that the estimated effects are attributable to the counseling, but other factors might also have contributed.","the Vocational Rehabilitation (VOC) Programs","Disability insurance Supplemental security income (SSI) Vocational rehabilitation",Disability,,"United States",2013,http://crr.bc.edu/working-papers/can-benefits-and-work-incentives-counseling-be…,"Disability Employment Policy Review Protocol" "Do stronger age discrimination laws make Social Security reforms more effective?","Neumark, D., & Song, J. (2013). Do stronger age discrimination laws make Social Security reforms more effective? Journal of Public Economics, 108, 1-16.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Mixed impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study examined whether the strength of state age discrimination protections affected rates of Social Security benefit claiming and employment outcomes of older workers. The study used a nonexperimental design and the data on Social Security claiming and employment outcomes from the Health and Retirement Study (HRS) to estimate the impacts. The study found that among older men affected by the 1983 Social Security reform, age discrimination protections were associated with increases in employment rates between age 62 and the full retirement age and delayed benefit claiming. The quality of casual evidence presented in this report is moderate because the study was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to state age discrimination laws, but other factors might also have contributed.","The 1983 Social Security Reform","Older workers' programs Other disparities or discrimination in employment and earnings","Adult, Older worker, Male",,"United States",2013,https://ideas.repec.org/a/eee/pubeco/v108y2013icp1-16.html,"Employment and Training Review Protocol" "BOND implementation and evaluation: First-year snapshot of earnings and benefit impacts for Stage 1","Stapleton, D., Wittenburg, D., Gubits, D., Judkins, D., Mann, D.R., & McGuirk, A. (2013). BOND implementation and evaluation: First-year snapshot of earnings and benefit impacts for Stage 1. Cambridge, MA: Abt Associates, Inc.; Princeton, NJ: Mathematica Policy Research.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Public benefits receipt-Mod/high-No impacts Public benefit receipt Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to measure eight-month impacts for Stage 1 of the Benefit Offset National Demonstration (BOND), which tested whether a more-generous work incentive for Social Security Disability Insurance (SSDI) recipients affected their employment rates, earnings, and reliance on benefits.  The study was a randomized controlled trial; eligible SSDI recipients were randomly assigned to the treatment group, which was eligible for the benefit offset, or a control group that was not. The authors analyzed data from the Master Earnings File (MEF), Master Beneficiary Record (MBR), and Supplemental Security Record (SSR). The study found that the BOND intervention had no significant impact on total earnings or total SSDI benefits paid over the eight-month follow-up period. The quality of causal evidence presented in this report is high because it is based on a well-conducted randomized controlled trial. This means we are confident that the effects estimated in the study are attributable solely to the BOND, and not to other factors.","the Benefit Offset National Demonstration","Disability insurance Other wages and benefits Supplemental security income (SSI)",Disability,,"United States",2013,http://www.ssa.gov/disabilityresearch/documents/BOND_Deliverable%2024c1_DRAFT_S…,"Disability Employment Policy Review Protocol" "Income tax and older American workers’ job transition into self-employment.","Choi, S. (2012). Income tax and older American workers’ job transition into self-employment. Korea and the World Economy, 13(2), 189-214.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Unfavorable impacts Employment","Summary: The study examined the effect of a progressive income tax on the likelihood of transitioning to self-employment among older workers. The study used a nonexperimental approach (the exponential hazard model) that compared the likelihood of transitioning from a wage job to self-employment based on the marginal taxes a worker would expect to pay. The author used the data from the Health and Retirement Study in 1992 matched to the Social Security Administration Master Earnings File from 1980 to 1991, which contains W-2 records of earnings from both wage work and self-employment. The study found that a more progressive tax (that is, a tax schedule that increases sharply toward the higher end) or higher marginal tax rates reduces the likelihood of entering self-employment. The quality of causal evidence presented in this report is low because the author did not ensure that the groups with higher or lower marginal tax rates were similar before a change in the tax schedule. This means we are not confident that the estimated effects are attributable to changes in marginal taxes; other factors are likely to have contributed.","Progressive Income Tax","Other employment and reemployment","Adult, Older worker, Employed",,"United States",2012,,"Employment and Training Review Protocol" "The efficacy of supported employment for middle-aged and older people with schizophrenia.","Twamley, E. W., Vella, L., Burton, C. Z., Becker, D. R., Bell, M. D., & Jeste, D. V. (2012). The efficacy of supported employment for middle-aged and older people with schizophrenia. Schizophrenia Research, 135(1-3), 100-104.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study examined the impact of Individual Placement and Support (IPS) on competitive employment for older people with schizophrenia The study was a randomized controlled trial (RCT) conducted at a community mental health clinic and used weekly work logs cross-referenced with pay stubs to measure employment outcomes over a 12-month period. The study found that IPS was positively associated with employment and earnings. The quality of causal evidence presented in this report is low because the RCT has a confounding factor. This means we are not confident that the estimated effects are attributable to the IPS program; other factors are likely to have contributed.","Individual Placement and Support and Vocational Rehabilitation Program","Health Individuals facing barriers to employment Job search assistance and supportive services","Adult, Older worker, Disability",,"United States",2012,https://psycnet.apa.org/record/2011-30184-001,"Employment and Training Review Protocol" "The impact of work incentive benefits counseling on employment outcomes: Evidence from two return-to-work demonstrations","Delin, Barry S., Hartman, Ellie C., & Sell, Christopher W. (2012). The impact of work incentive benefits counseling on employment outcomes: Evidence from two return-to-work demonstrations. Journal of Vocational Rehabilitation, 36, 97-107. DOI:10.3233/JVR-2012-0585.","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: This study investigated the influence that different amounts of work incentive benefits counseling had on employment outcomes for people receiving Social Security disability benefits. The study used data from two similar Social Security Administration (SSA) sponsored return-to-work projects implemented in Wisconsin since 1999 to address two research questions: (1) Does the amount (dosage) of work incentive benefits counseling influence employment outcomes? and (2) What factors, including prior employment outcomes, influence the dosage of work incentive benefits counseling services received? Although conclusions based on data from two relatively small projects located in a single state cannot fully settle the issue, results from linear regression models suggested that receiving higher dosages of benefits counseling services led to better employment outcomes. The study also showed that participants with stronger pre-enrollment employment outcomes received more service (a higher dosage of benefits counseling) than those who had weaker ones.",,"Disability insurance Other wages and benefits Supplemental security income (SSI)",Disability,,"United States",2012,,"Disability Employment Policy Review Protocol" "The effects of hiring tax credits on employment of disabled veterans","Heaton, P. (2012). The effects of hiring tax credits on employment of disabled veterans. Santa Monica, CA: Rand Corporation. Occasional Paper. Retrieved from https://www.rand.org/content/dam/rand/pubs/occassional papers/2012/RAND_OP 366.pdf.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study examined the impact of the 2007 Work Opportunity Tax Credit (WOTC) on the employment and earnings outcomes among veterans with disabilities. The authors used a nonexperimental approach and data from the American Community Survey Public Use Microdata Sample to compare the employment and earnings outcomes of veterans who were eligible for the WOTC with those of veterans who were not. The study found an approximately 2 percentage point increase in employment, a 0.58 hour increase in weekly hours, and a 40 percent increase in wage income among veterans with disabilities who were eligible for WOTC compared to veterans and nonveterans with other characteristics. The quality of causal evidence presented in this report is moderate because it relied on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the WOTC program, but other factors might also have contributed to the findings.","Work Opportunity Tax Credit","Veterans' reemployment Work Opportunity Tax Credit (WOTC)","Disability, Veteran or military",,"United States",2012,https://www.rand.org/pubs/occasional_papers/OP366.html,"Employment and Training Review Protocol" "The Social Security Administration’s Youth Transition Demonstration Projects: Interim report on West Virginia Youth Works","Fraker, T., Mamun, A., Manno, M., Martinez, J., Reed, D., Thompkins, A., & Wittenburg, D. (2012). The Social Security Administration’s Youth Transition Demonstration Projects: Interim report on West Virginia Youth Works. Princeton, NJ: Mathematica Policy Research.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Education and skills gains-Mod/high-No impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to measure 12-month impacts of the West Virginia Youth Works project, one of six project sites of the larger Social Security Administration (SSA)-sponsored Youth Transition Demonstration (YTD) that used a randomized evaluation. Youth Works provided services to help youth with disabilities improve their education and employment outcomes and become more economically self-sufficient. Data were collected from a baseline survey and 12-month follow-up survey, the Ticket Research File (TRF), and the Master Earnings File (MEF). The authors estimated program impacts on measures of paid employment, educational attainment, and Social Security disability benefit receipt. The study found that Youth Works had positive impacts on employment, earnings, and total income after one year of implementation. There were no impacts on educational attainment and Social Security disability benefit receipt. The quality of causal evidence presented in the study is high for the education, employment, and SSA benefit receipt outcomes because they are based on a well-implemented randomized controlled trial with low attrition. However, the quality of causal evidence is moderate for earnings and total income because sample attrition for these outcomes was high.","the Youth Transition Demonstration Projects, West Virginia Youth Works Program","Disability insurance Supplemental security income (SSI) Youth programs","Youth, Disability",,"United States",2012,http://www.mathematica-mpr.com/~/media/publications/pdfs/disability/ytd_wv_inte…,"Disability Employment Policy Review Protocol" "The Social Security Administration’s Youth Transition Demonstration projects: Interim report on West Virginia Youth Works","Fraker, T., Mamun, A., Manno, M., Martinez, J., Reed, D., Thompkins, A., & Wittenburg, D. (2012). The Social Security Administration’s Youth Transition Demonstration projects: Interim report on West Virginia Youth Works. Report submitted to the Social Security Administration. Washington, DC: Mathematica Policy Research.","Disability Employment Policy","Study Type: Implementation Analysis",,,"Summary: This report presented an interim implementation and impact analysis on the West Virginia Youth Works Youth Transition Demonstration (YTD) project. The program sought to help youth with disabilities ages 14 through 25 who lived in 19 specific West Virginia counties to maximize their economic self-sufficiency. The study examined implementation of Youth Works, focusing on major aspects of service delivery, including the background, local context, and service environment. It provided information on participants’ characteristics and satisfaction with the program. The authors conducted qualitative analysis of staff and participant interviews, including data collected from site visits, and descriptive quantitative analysis of participants’ baseline and follow-up survey data and service utilization data from a management information system. Overall, the study found that Youth Works faced some substantial challenges, but that all participants received some project services and most received at least one contact for each of the four types of service: benefits planning, employment, education, and case management. Study findings related to implementation challenges and solutions are potentially applicable to other current or future projects that provide employment-related services to youth with disabilities.","the Youth Transition Demonstration Projects, West Virginia Youth Works Program","Supplemental security income (SSI) Youth programs Vocational rehabilitation","Youth, Disability",,"United States",2012,http://www.mdrc.org/sites/default/files/WV%20YTD%20Report%2012-3-2012.pdf,"Disability Employment Policy Review Protocol" "Effectiveness of supported employment for veterans with spinal cord injuries: Results from a randomized multisite study","Ottomanelli, L., Goetz, L. L., Suris, A., McGeough, C., Sinnott, P. L., Toscano, R., … Thomas, F. P. (2012). Effectiveness of supported employment for veterans with spinal cord injuries: Results from a randomized multisite study. Archives of Physical Medicine and Rehabilitation, 93(5), 740-747.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The study aimed to examine the impact of supported employment on the employment outcomes of veterans with spinal cord injuries. The study included a randomized controlled trial and collected self-reported data directly from veterans and chart review data from the spinal cord injury centers in six Veterans Affairs Medical Centers (VAMCs) to obtain demographic information. The study found statistically significant positive impacts on employment as a result of supported employment compared to treatment as usual. The quality of causal evidence presented in the report is high because it used a well-implemented experimental design. This means that we are confident that the estimated effects are attributable to supported employment and not to other factors.","Individual Placement and Support (IPS) model of supported employment","Veterans' reemployment","Disability, Veteran or military",,"United States",2012,https://doi.org/10.1016/j.apmr.2012.01.002,"Employment and Training Review Protocol" "The Social Security Administration’s Youth Transition Demonstration projects: Interim report on Broadened Horizons, Brighter Futures","Fraker, T., Honeycutt, T., Mamun, A., Manno, M., Martinez, J., O’Day, B., Reed, D., & Thompkins, A. (2012). The Social Security Administration’s Youth Transition Demonstration projects: Interim report on Broadened Horizons, Brighter Futures. Princeton, NJ: Mathematica Policy Research.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Mod/high-No impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: This study’s objective was to measure 12-month impacts of the Florida Broadened Horizons, Brighter Futures (BHBF) program, one of six project sites of the larger Youth Transition Demonstration (YTD) projects that used randomized evaluations.  The Social Security Administration (SSA) sponsored the evaluation. BHBF provided services to help youth with severe disabilities improve their employment outcomes and become more economically self-sufficient. Data were collected from baseline and 12-month follow-up surveys, the Ticket Research File (TRF), and Master Earnings File (MEF). The authors estimated program impacts on measures of paid employment, educational attainment, and Social Security disability benefit receipt. The study found that BHBF had statistically significant impacts on employment and Social Security disability benefit receipt at the 12-month follow-up. There were no impacts on educational attainment or earnings. The quality of causal evidence presented in this report is high because it is based on a well-conducted randomized controlled trial. This means we are confident that the effects estimated in the study are attributable solely to BHBF, and not to other factors.","the Youth Transition Demonstration Projects, Broadended Horizons, Brighter Futures","Disability insurance Supplemental security income (SSI) Youth programs","Youth, Disability",,"United States",2012,http://www.mathematica-mpr.com/~/media/publications/pdfs/disability/ytd_miami_i…,"Disability Employment Policy Review Protocol" "The Social Security Administration’s Youth Transition Demonstration Projects: Interim report on Broadened Horizons, Brighter Futures","Fraker, T., Honeycutt, T., Mamun, A., Manno, M., Martinez, J., O’Day, B., Reed, D., & Thompkins. A. (2012). The Social Security Administration’s Youth Transition Demonstration Projects: Interim report on Broadened Horizons, Brighter Futures. Report submitted to the Social Security Administration. Washington, DC: Mathematica Policy Research.","Disability Employment Policy","Study Type: Implementation Analysis",,,"Summary: This report presented an interim implementation and impact analysis on the Broadened Horizons, Brighter Futures (BHBF) Youth Transition Demonstration (YTD) project. The program sought to help youth with disabilities ages 16 through 22 who received Supplemental Security Income and resided in Miami-Dade County maximize their self-sufficiency. The study examined implementation of BHBF, focusing on major aspects of service delivery, including the background, local context and service environment. It also provided information on participants’ characteristics and satisfaction with the program. The authors conducted qualitative analysis of staff and participant interviews, including data collected from site visits; and descriptive quantitative analysis of participants’ baseline and follow-up survey data and service utilization data from a management information system. The study found that participants began receiving services soon after enrollment. Some services were more challenging to implement than others, but all participants received some project services and most received at least one of the four major types of service: benefits planning, employment, education, and case management.  Study findings related to implementation challenges and solutions are potentially applicable to other current or future projects that provide employment-related services to youth with disabilities.","the Youth Transition Demonstration Projects, Broadended Horizons, Brighter Futures","Supplemental security income (SSI) Youth programs Vocational rehabilitation","Youth, Disability",,"United States",2012,http://www.mdrc.org/sites/default/files/interim_report_broadened_horizons.pdf,"Disability Employment Policy Review Protocol" "Effectiveness of supported employment for veterans with spinal cord injuries: Results from a randomized multisite study","Ottomanelli, L., Goetz, L. L., Suris, A., McGeough, C., Sinnott, P. L., Toscano, R., … Thomas, F. P. (2012). Effectiveness of supported employment for veterans with spinal cord injuries: Results from a randomized multisite study. Archives of Physical Medicine and Rehabilitation, 93(5), 740-747. [CONTRAST 1: Non-experimental study]",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study examined the impact of supported employment on the employment outcomes for veterans with spinal cord injuries. The authors used statistical comparisons in a non-experimental analysis to estimate the relationship between supported employment services and employment, drawing on self-reported data for employment information and chart review data from the spinal cord injury centers in six Veterans Affairs Medical Centers to obtain demographic information . The study found statistically significant positive relationships between supported employment and veterans’ employment outcomes compared to treatment as usual. The quality of causal evidence presented in the report is low because there are preexisting differences between the intervention and comparison groups. This means we are not confident that the estimated effects are attributable to supported employment; other factors are likely to have contributed.","Individual Placement and Support (IPS) model of supported employment","Veterans' reemployment","Disability, Veteran or military",,"United States",2012,https://doi.org/10.1016/j.apmr.2012.01.002,"Employment and Training Review Protocol" "A randomized controlled trial of supported employment among veterans with posttraumatic stress disorder","Davis, L., Leon, A., Toscano, R., Drebing, C., Ward, L., Parker, P., ..., & Drake, R. (2012). A randomized controlled trial of supported employment among veterans with posttraumatic stress disorder. Psychiatric Services, 63(5), 464-470.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of individual placement and support (IPS) on competitive employment, earnings, and income for U.S. military veterans with posttraumatic stress disorder (PTSD). The study was a randomized controlled trial conducted at the Tuscaloosa Veterans Affairs (VA) Medical Center. Treatment group members received IPS services, whereas the control group received standard Vocational Rehabilitation Program (VRP) services. Data sources included patients’ records from the clinical research coordinator and daily logs completed by participants. The study found that IPS had positive impacts on competitive employment and gross income. The quality of causal evidence presented in this report is high because it is based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to IPS, and not other factors.","Individual Placement and Support and Vocational Rehabilitation Program","Vocational rehabilitation Veterans' reemployment Supported employment or other employment supports","Disability, Veteran or military",,"United States",2012,,"Disability Employment Policy Review Protocol" "Tax elasticity of labor earnings for older individuals","Alpert, A. & Powell, D. (2012). Tax elasticity of labor earnings for older individuals. (Report no. 2012-272). Ann Arbor, MI: University of Michigan Retirement Research Center, University of Michigan.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study examined the impact of tax changes on people’s employment, retirement, and labor income outcomes. The study uses a nonexperimental approach and the data from the Health and Retirement Study to estimate the effect. The study found positive statistically significant relationships between increases in after-tax labor income and the employment of men and women as well as the delay in retirement for men. The study also found a positive statistically significant relationship between increases in the marginal net-of-tax rate and earnings for women. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to tax changes from the Economic Growth and Tax Relief Reconciliation Act (EGTRRA), the Jobs and Growth Tax Relief Reconciliation Act (JGTRRA), and their marriage tax penalty relief provision, but other factors might also have contributed.","Tax Changes","Older workers' programs Other employment and reemployment","Adult, Older worker",,"United States",2012,https://deepblue.lib.umich.edu/bitstream/handle/2027.42/94533/wp272.pdf?sequenc…,"Employment and Training Review Protocol" "Demonstration to Maintain Independence and Employment (DMIE): Final report","Whalen, D., Gimm, G., Ireys, H., Gilman, B., & Croake, S. (2012). Demonstration to Maintain Independence and Employment (DMIE): Final report. Princeton, NJ: Mathematica Policy Research.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The report’s objective was to examine the impacts of the Demonstration to Maintain Independence and Employment (DMIE). DMIE was implemented in Hawaii, Kansas, Minnesota, and Texas with the aim of preventing or delaying people with disabilities from leaving the workforce and applying for Social Security Disability Insurance (SSDI) and Supplemental Security Income (SSI) benefits.  The study was a randomized controlled trial examining DMIE’s impact on employment, earnings, benefit applications and receipt, and health status. Study data sources included the Ticket Research File (TRF), Master Earnings File (MEF), and survey data. Because DMIE recruitment methods, participant populations, and services offered varied substantially across states, the authors reported impacts separately for each state and for Minnesota and Texas pooled together. With few exceptions, DMIE did not achieve statistically significant impacts on employment, annual earnings, or disability benefit applications. In Hawaii, DMIE participants worked fewer hours and reported fewer instrumental activities of daily living limitations. In Minnesota and Texas, the program reduced federal disability benefit receipt. The quality of the causal evidence is high for most outcomes examined, which means that we are confident that the estimated impacts are attributable solely to the DMIE. However, for some outcomes, including the hours worked in Hawaii, the quality of the causal evidence is moderate, which means that factors other than DMIE might have contributed to the estimated effects.","Demonstration to Maintain Independence and Employment (DMIE)","Health Disability insurance Supplemental security income (SSI) Vocational rehabilitation",Disability,,"United States",2012,http://www.mathematica-mpr.com/~/media/publications/PDFs/disability/dmie_final…,"Disability Employment Policy Review Protocol" "The Social Security Administration’s Youth Transition Demonstration Projects: Interim report on the Career Transitions Program","Fraker, T., Baird, P., Mamun, A., Manno, M., Martinez, J., Reed, D., & Thompkins, A. (2012). The Social Security Administration’s Youth Transition Demonstration Projects: Interim report on the Career Transitions Program. Princeton, NJ: Mathematica Policy Research.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: This study’s objective was to measure 12-month impacts of the Maryland Career Transitions Program (CTP), one of six project sites of the larger Social Security Administration (SSA)-sponsored Youth Transition Demonstration (YTD) projects that used a randomized evaluation. CTP provided services to help youth with severe emotional disturbances or significant mental illness improve their education and employment outcomes and become more self-sufficient. Data were collected from a baseline survey and 12-month follow-up survey, the Ticket Research File (TRF), and the Master Earnings File (MEF). The authors estimated program impacts on measures of paid employment, educational attainment, and Social Security disability benefit receipt. The study found that CTP did not achieve any statistically significant impacts on employment, earnings, total income, or Social Security disability benefit receipt during the 12-month follow-up period. However, CTP participants were more likely to enroll in postsecondary education than members of the control group. The quality of causal evidence presented in the study is high for the education and SSA benefit receipt outcomes because they are based on a well-implemented randomized controlled trial with low attrition. However, the quality of causal evidence is moderate for employment, earnings, and total income because sample attrition for these outcomes was high.","the Youth Transition Demonstration Projects, Career Transitions Program","Disability insurance Supplemental security income (SSI) Youth programs",Disability,,"United States",2012,http://www.mathematica-mpr.com/~/media/publications/PDFs/disability/YTD_CTP_Int…,"Disability Employment Policy Review Protocol" "The Social Security Administration’s Youth Transition Demonstration Projects: Interim report on Transition WORKS","Fraker, T., Black, A., Mamun, A., Manno, M., Martinez, J., O’Day, B., O’Toole, M., Rangarajan, A., & Reed, D. (2011). The Social Security Administration’s Youth Transition Demonstration Projects: Interim report on Transition WORKS. Princeton, NJ: Mathematica Policy Research.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-No impacts Education and skills gains Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: This study’s objective was to measure 12-month impacts of the Transition WORKS, one of six project sites of the larger Social Security Administration (SSA)–sponsored Youth Transition Demonstration (YTD) projects that used a randomized evaluation.  Transition WORKS provided services to help youth with severe disabilities improve their education and employment outcomes and become more economically self-sufficient. Data were collected from a baseline survey and 12-month follow-up survey, the Ticket Research File (TRF), and Master Earnings File (MEF). The authors estimated program impacts on measures of paid employment, educational attainment, and Social Security disability benefit receipt.  The study found that Transition WORKS did not achieve any statistically significant impacts on paid employment, educational attainment, or Social Security disability benefit during the 12-month follow-up period. The quality of causal evidence presented in this report is high because it is based on a well-conducted randomized controlled trial. This means we are confident that the effects estimated in the study would be attributable solely to Transition WORKS, and not to other factors.","the Youth Transition Demonstration Projects, Transition WORKS","Disability insurance Supplemental security income (SSI) Youth programs","Youth, Disability",,"United States",2011,http://www.ssa.gov/disabilityresearch/documents/Erie%20Final%20Interim%20Report…,"Disability Employment Policy Review Protocol" "Influencing the disability trajectory for workers with serious mental illness: Lessons from Minnesota’s Demonstration to Maintain Independence and Employment","Linkins, K. W., Brya, J. J., Oelschlaeger, A., Simonson, B., Lahiri, S., McFeeters, J., Schutze, M., Jonas, J., & Mowry, M. A. (2011). Influencing the disability trajectory for workers with serious mental illness: Lessons from Minnesota’s Demonstration to Maintain Independence and Employment. Journal of Vocational Rehabilitation, 34(2), 107-118.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-No impacts Employment Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The report’s objective was to examine the impacts of the Demonstration to Maintain Independence and Employment (DMIE) in the Minnesota site. The DMIE was designed to prevent or delay people with disabilities from leaving the workforce and applying for Social Security Disability Insurance (SSDI) and Supplemental Security Income (SSI) benefits. The study was a randomized controlled trial examining DMIE’s impacts on earnings, benefits applications, and activities of daily living (ADLs). Data sources included participant surveys and health care and employment service utilization information. Impacts were evaluated 12 months after sample members’ enrollment. The study found that program participants did not work more hours per month or earn more over the follow-up period than control group members, but were less likely to apply for SSDI or SSI benefits. The program also decreased the number of ADL limitations. The quality of causal evidence provided in this study is low. This means that we cannot be confident that the estimated effects are attributable to Minnesota’s DMIE; other factors are likely to have contributed.","Demonstration to Maintain Independence and Employment (DMIE) in Minnesota","Health Disability insurance Supplemental security income (SSI) Vocational rehabilitation",Disability,,"United States",2011,,"Disability Employment Policy Review Protocol" "Longitudinal Outcomes of an Early Cohort of Ticket to Work Participants","Livermore, Gina A., & Roche, Allison. (2011). Longitudinal Outcomes of an Early Cohort of Ticket to Work Participants. Social Security Bulletin, 71(3).","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: This study followed a cohort of working-age Supplemental Security Income and Social Security Disability Insurance recipients participating in the Ticket to Work (TTW) program for several years to assess their service use, health status, employment, and income. The study used a longitudinal sample of 767 TTW participants who were followed in each of the 2004, 2005, and 2006 rounds of the National Beneficiary Survey, conducted as part of the TTW evaluation. The sample was representative of TTW participants who were enrolled in the program at some point from January to June 2003 and resided in the 13 states where TTW was first implemented in 2002. The findings showed that about 20 percent of TTW participants achieved employment at levels that would significantly reduce their disability benefits. Another 40 percent achieved some employment success, but the remaining 40 percent reported no earnings during 2003–2005. Many participants experienced significant changes in their health status across survey rounds, which might have affected their ability to actively participate in TTW and to become employed. Many also experienced significant employment and income instability. The findings suggested that employment among TTW participants was associated with reduced poverty.",,"Health Disability insurance Supplemental security income (SSI) Supported employment or other employment supports",Disability,,"United States",2011,http://www.ssa.gov/policy/docs/ssb/v71n3/v71n3p105.html,"Disability Employment Policy Review Protocol" "Person-centered planning in a transition program for Bronx youth with disabilities","Croke, Erin E., & Thompson, Ashleigh B. (2011). Person-centered planning in a transition program for Bronx youth with disabilities. Children and Youth Services Review. DOI:10.1016/j.childyouth.2010.11.025.","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: This report used qualitative and quantitative methods to explore findings of a 2003–2010 Youth Transition Demonstration (YTD) project. YTD offered a series of interventions, including Social Security Administration benefits counseling, education and employment assistance, and person-centered planning (PCP) to transition-age youth with disabilities. The study found that the PCP component was linked to improved educational and employment outcomes for youth. The study also found that although 65 percent of youth enrolled in the project participated in at least one PCP session, youth from lower-income families were less likely to participate in PCP, as were youth with mood disorders. Youth focused on relationships, personal strengths, and goals during these sessions, which proved an important part of their transition process. The study also described the intervention and made recommendations for the future use of PCP.",,"Disability insurance Supplemental security income (SSI) Youth programs","Youth, Disability",,"United States",2011,,"Disability Employment Policy Review Protocol" "Disability Benefits Suspended or Terminated Because of Work","Schimmel, Jody, & Stapleton, David C. (2011). Disability Benefits Suspended or Terminated Because of Work. Social Security Bulletin, 71(3).","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: This study produced statistics on the first month of suspension or termination for work for Social Security Disability Insurance (DI) and Supplemental Security Income (SSI)-only recipients. It also estimated the number of months people spent in nonpayment status following suspension or termination for work (NSTW) before their return to the rolls, attainment of the full retirement age, or death—in each year from 2002 through 2006. Data came from a compilation of multiple administrative data sources containing information on all DI and adult SSI disability recipients with at least one month in current pay status from 1996 onward, created for the Ticket to Work (TTW) evaluation. The study found that less than 1 percent of all recipients, or about 70,000 each year, experienced their first month of benefit suspension or termination for work in each year from 2002 through 2006. However, the cumulative effect was much more substantial because many recipients remained in NSTW for a sustained period. Slightly more than 400,000 recipients or former recipients had at least one NSTW month in 2006. TTW participants were more likely to have a first STW than nonparticipants, but most of those who had an STW were not TTW participants, reflecting low use of TTW.",,"Disability insurance Supplemental security income (SSI)",Disability,,"United States",2011,http://www.ssa.gov/policy/docs/ssb/v71n3/v71n3p83.html,"Disability Employment Policy Review Protocol" "The Social Security Administration’s Youth Transition Demonstration Projects: Interim report on the City University of New York’s project","Fraker, T., Black, A., Broadus, J., Mamun, A., Manno, M., Martinez, J., McRoberts, R., Rangarajan, A., & Reed, D. (2011). The Social Security Administration’s Youth Transition Demonstration Projects: Interim report on the City University of New York’s project. Princeton, NJ: Mathematica Policy Research.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Education and skills gains-Mod/high-No impacts Education and skills gains Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: This study’s objective was to measure 12-month impacts of the City University of New York (CUNY) Youth Transition Demonstration Project (YTDP) in the Bronx, one of six project sites of the larger Social Security Administration (SSA)-sponsored YTD projects that used a randomized evaluation.  CUNY YTDP provided services to help youth with severe disabilities improve their employment outcomes and become more economically self-sufficient. Data were collected from a baseline survey and 12-month follow-up survey, the Ticket Research File (TRF), and the Master Earnings File (MEF). The authors estimated program impacts on measures of paid employment, educational attainment, and Social Security disability benefit receipt. The study found that CUNY YTDP had positive and statistically significant impacts on employment during the 12-month follow-up period. The study found no statistically significant impacts on earnings, educational attainment, total income, or Social Security disability benefit receipt. The quality of causal evidence presented in this report is high because it is based on a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to CUNY YTDP, and not to other factors.","the Youth Transition Demonstration Projects, The City University of New York","Disability insurance Supplemental security income (SSI) Youth programs","Youth, Disability",,"United States",2011,http://www.ssa.gov/disabilityresearch/documents/CUNY%20Final%20Interim%20Report…,"Disability Employment Policy Review Protocol" "Working Well—the Texas Demonstration to Maintain Independence and Employment: 18-month outcomes","Bohman, T.M., Wallisch, L., Christensen, K., Stoner, D., Pittman, A., Reed, B., & Ostermeyer, B. (2011). Working Well—the Texas Demonstration to Maintain Independence and Employment: 18-month outcomes. Journal of Vocational Rehabilitation, 34, 97–106.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The report’s objective was to examine the impacts of the Demonstration to Maintain Independence and Employment (DMIE) in the Texas site. The DMIE was designed to prevent or delay people with disabilities from leaving the workforce and applying for Social Security Disability Insurance (SSDI) and Supplemental Security Income (SSI) benefits. The study was a randomized controlled trial examining DMIE’s impacts on employment, earnings, Social Security disability benefit receipt, and health status and access. Impacts were evaluated 18 months after sample members’ enrollment. The study found no statistically significant impacts on employment or earnings. However, there was evidence of modest reductions in SSDI and SSI receipt among treatment group members, as well as improvements in health care access, utilization, and satisfaction with health care. The quality of the causal evidence presented in this report is high because it was a well-implemented randomized controlled trial. This means we can be confident that the estimated impacts are attributable to Texas’s DMIE, and not other factors.","Demonstration to Maintain Independence and Employment (DMIE) in Texas","Health Disability insurance Supplemental security income (SSI) Vocational rehabilitation",Disability,,"United States",2011,,"Disability Employment Policy Review Protocol" "Mental Health Treatment Study: Final Report","Frey, W., Drake, R., Bond, G., Miller, A., Goldman, H., Salkever, D., & Holsenbeck, S. (2011). Mental Health Treatment Study: Final Report. Baltimore, MD: Westat.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Health and safety-Low-Favorable impacts Health and safety Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Mental Health Treatment Study (MHTS), which provided supported employment services to Social Security Disability Insurance (SSDI) recipients with psychiatric disabilities. The study was a randomized controlled trial with 2,238 participants. The analysis used data from nine surveys administered over the two-year intervention period. The study found that MHTS had positive impacts on earnings measured 12 and 24 months after random assignment and on health outcomes 24 months after random assignment. There were no statistically significant impacts on disability benefits receipt. The quality of the evidence presented in this study is moderate for earnings and SSDI benefit receipt outcomes. This means we are somewhat confident that the estimated effects are attributable to the MHTS, but other factors might also have contributed. For the health outcomes, the quality of evidence presented in this study is low. This means we are not confident that the estimated effects are attributable to MHTS; other factors are likely to have contributed.","the Mental Health Treatment Study (MHTS)","Health Disability insurance Job search assistance and supportive services Vocational rehabilitation",Disability,,"United States",2011,http://socialsecurity.gov/disabilityresearch/documents/MHTS_Final_Report_508.pdf,"Disability Employment Policy Review Protocol" "The Impact of Changing Financial Work Incentives on the Earnings of Social Security Disability Insurance (SSDI) Beneficiaries","Weathers, R., & Hemmeter, J. (2011). The impact of changing financial work incentives on the earnings of Social Security Disability Insurance (SSDI) beneficiaries. Journal of Policy Analysis and Management, 30(4), 708-728.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-Unfavorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Benefit Offset Pilot Demonstration (BOPD), which provided a more-generous work incentive for Social Security Disability Insurance (SSDI) recipients, on recipients’ employment status, earnings, and reliance on benefits.  The analysis used data from the Master Earnings File (MEF) and Master Beneficiary Record (MBR). The authors reported unadjusted and regression-adjusted program impacts. The study found that the BOPD had no earnings impacts but increased the probability of earning above the annualized SGA amount one and two years after baseline. The intervention also increased the average SSDI benefit payment to participants. The quality of the evidence presented in this study is high because it is based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the BOPD, and not to other factors.","the Benefit Offset Pilot Demonstration","Disability insurance Other wages and benefits Supplemental security income (SSI)",Disability,,"United States",2011,,"Disability Employment Policy Review Protocol" "Longitudinal Statistics on Work Activity and Use of Employment Supports for New Social Security Disability Insurance Beneficiaries","Liu, Su, & Stapleton, David C. (2011). Longitudinal Statistics on Work Activity and Use of Employment Supports for New Social Security Disability Insurance Beneficiaries. Social Security Bulletin, 71(3).","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: This study used administrative data files constructed for the Ticket to Work (TTW) evaluation. These files contained extensive information on the more than 20 million Disability Insurance or Supplemental Security Income recipients who received a benefit in at least one month from January 1996 through December 2007. They included data on benefits, earnings, and enrollment in vocational rehabilitation services for 100 percent of the Disability Insurance population, with a few exceptions, over this time period. For the first (1996) cohort, the study documented the different pathways that led recipients to benefit termination. It presented longitudinal statistics on employment, earnings, and use of work incentives, and showed variation in work incentive statistics by state. It then compared selected statistics for more recent cohorts, and considered policy implications of all findings, including implications for TTW and other employment initiatives. These longitudinal statistics painted a somewhat more optimistic picture of the efforts of recipients to find work compared with the Social Security Administration’s then-published cross-sectional statistics. The authors also concluded that changing the Disability Insurance program to help recipients increase earnings might not produce program savings even if the changes increased exits from Disability Insurance, because the program might have provided additional support to those who would exit anyway.",,"Disability insurance Supplemental security income (SSI) Supported employment or other employment supports",Disability,,"United States",2011,,"Disability Employment Policy Review Protocol" "Labor market rigidities and the employment behavior of older workers.","Blau, D., & Shvydko, T. (2011). Labor market rigidities and the employment behavior of older workers. Industrial and Labor Relations Review, 64(3), 464-484.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of flexibility in hours of work on the likelihood that older workers separate from an employer. The study used a statistical model to compare the job exit behavior of older and younger workers in firms with different shares of women younger than age 30. The analysis used monthly data on workers ages 45 to 69 in the Survey of Income and Program Participation from 1990 to 2001 matched to employers in the Longitudinal Employment and Household Dynamics data. The study found that workers in their sixties who work for employers with a higher share of women younger than age 30 are less likely to experience job separations compared with workers in their late 40s to mid-50s. The quality of causal evidence presented in this report is low because the groups being compared might not be similar before leaving their employer. This means we are not confident that the estimated effects are attributable to employment flexibility, other factors are likely to have contributed.","Employment flexibility","Other employer services","Adult, Older worker",,"United States",2011,https://www.jstor.org/stable/41149475?seq=1#page_scan_tab_contents,"Employment and Training Review Protocol" "The Accelerated Benefits Demonstration and Evaluation project: Impacts on health and employment at twelve months","Michalopoulos, C., Wittenburg, D., Israel, D., Schore, J., Warren, A., Zutshi, A., Freedman, S., & Schwartz, L. (2011). The Accelerated Benefits Demonstration and Evaluation project: Impacts on health and employment at twelve months, volume 1. New York: MDRC.","Disability Employment Policy","Study Type: Implementation Analysis",,,"Summary: This report presented an interim implementation and impact analysis on the Accelerated Benefits Demonstration (ABD), an effort to provide immediate health insurance and employment and benefits counseling to new, uninsured Social Security Disability Insurance (SSDI) recipients during the 24-month Medicare eligibility waiting period. This profile focused on the implementation analysis. The study examined implementation of ABD in 53 qualifying U.S. metropolitan areas, focusing on service delivery and use, and challenges and solutions to implementation. The authors conducted qualitative analysis of interviews with program staff, discussions from regular team meetings, and a document review, along with quantitative analysis of health plan claims and service use data from the AB Plus management information system. Overall, the study found that almost all program group members used the AB health plan. Most members of the AB Plus group, which had access to additional programming, completed intake and a substantial proportion used services. Under the AB Plus plan, the behavioral motivational coaching and employment and benefits counseling were largely implemented as designed, but the intake process and medical case management were refined over time. Because of limitations in the study’s discussion of its research methods, it is unclear whether findings are potentially applicable to other projects that provide employment-related services to people with disabilities.","Accelerated Benefits Demonstration","Disability insurance Health insurance",Disability,,"United States",2011,,"Disability Employment Policy Review Protocol" "Mental Health Treatment Study: Final report. Report submitted to the Social Security Administration.","Frey, W., Drake, R., Bond, G., Miller, A., Goldman, H., Salkever, D., & Holsenbeck, S. (2011) Mental Health Treatment Study: Final report. Report submitted to the Social Security Administration. Rockville, MD: Westat.","Disability Employment Policy","Study Type: Implementation Analysis",,,"Summary: The study’s objective was to examine the implementation and impact of the Mental Health Treatment Study, which provided individual placement and support (IPS, an evidence-based model of supported employment services) and systematic medication management to Social Security Disability Insurance (SSDI) recipients with psychiatric disabilities. This profile focuses on the implementation study; see CLEAR’s profile of the impact study here. The implementation study focused on fidelity to the program model, consistency in service delivery, where services occurred, and the relationship between fidelity and employment rates. The authors collected data from regular telephone calls with program staff, site visits, participants’ medical records, follow-up interviews, and service use data. To measure fidelity, the study used a 15-point IPS fidelity scale; each scale item reflected a specific element in the IPS practice. Overall, the study found that 77 percent of sites achieved high fidelity in the first year of implementation and 86 percent of sites achieved high fidelity in the second and third years. More than 90 percent of participants engaged in some type of supported employment service in the first reporting period and almost 90 percent did so in the second reporting period. Study findings related to implementation challenges and solutions are potentially applicable to other current or future projects that provide employment-related services to people with psychiatric disabilities.","the Mental Health Treatment Study (MHTS)","Disability insurance Health",Disability,,"United States",2011,http://www.ssa.gov/disabilityresearch/documents/MHTS_Final_Report_508.pdf,"Disability Employment Policy Review Protocol" "Employment of Individuals in the Social Security Disability Programs","O’Leary, Paul, Livermore, Gina A., & Stapleton, David C. (2011). Employment of Individuals in the Social Security Disability Programs. Social Security Bulletin, 71(3).","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: This article introduced an issue of the Social Security Bulletin that featured articles drawn from the 2010 Ticket to Work (TTW) evaluation report and provided more expansive information than that report. As background, this article described both work incentive programs offered to Social Security disability recipients. It used longitudinal and cross-sectional data to provide Supplemental Security Income and Social Security Disability Income program statistics. It described the variation in employment outcomes across states and over time, the occurrence and duration of employment of disability recipients, and factors affecting recipients’ ability to sustain high earnings.",,"Disability insurance Supplemental security income (SSI) Supported employment or other employment supports",Disability,,"United States",2011,http://www.ssa.gov/policy/docs/ssb/v71n3/v71n3p1.html,"Disability Employment Policy Review Protocol" "The Social Security Administration’s Youth Transition Demonstration projects: Interim report on Colorado Youth WINS","Fraker, T., Baird, P., Black, A., Mamun, A., Manno, M., Martinez, J., Rangarajan, A., & Reed, D. (2011). The Social Security Administration’s Youth Transition Demonstration projects: Interim report on Colorado Youth WINS. Princeton, NJ: Mathematica Policy Research.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Education and skills gains-Mod/high-No impacts Education and skills gains Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: This study’s objective was to measure 12-month impacts of the Colorado Youth Work Incentive Network of Supports (WINS) project, sponsored by the Social Security Administration (SSA), one of six project sites of the larger Youth Transition Demonstration (YTD) projects that used a randomized evaluation. Youth WINS provided services to help youth with disabilities improve their education and employment outcomes and become more economically self-sufficient and less reliant on disability benefits. Data were collected from a baseline survey and 12-month follow-up survey, the Ticket Research File (TRF), and the Master Earnings File (MEF). The authors estimated program impacts on measures of paid employment, educational attainment, and Social Security disability benefit receipt. The study found that Youth WINS did not achieve any statistically significant impacts on the outcomes examined during the 12-month follow-up period. The quality of causal evidence in this study is high because it was a well-conducted randomized controlled trial. This means we are confident that the estimated effects are attributable to Colorado Youth WINS and not to other factors.","the Youth Transition Demonstration Projects, Colorado Youth WINS Program","Disability insurance Supplemental security income (SSI) Youth programs","Youth, Disability",,"United States",2011,https://www.socialsecurity.gov/disabilityresearch/documents/CO%20Final%20Interi…,"Disability Employment Policy Review Protocol" "Impact of early intervention programs for working adults with potentially disabling conditions: evidence from the national DMIE evaluation","Gimm, G., Ireys, H., Gillman, B., & Croake, S. (2011). Impact of early intervention programs for working adults with potentially disabling conditions: evidence from the national DMIE evaluation. Journal of Vocational Rehabilitation, 34, 71–81.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-No impacts Employment Earnings and wages-Mod/high-No impacts Earnings and wages Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: This study’s objective was to examine short-term (that is, 6- to 12-month) impacts of the Demonstration to Maintain Independence and Employment (DMIE). DMIE was implemented in Hawaii, Kansas, Minnesota, and Texas with the aim of preventing or delaying people with disabilities from leaving the workforce and applying for Social Security Disability Insurance (SSDI) and Supplemental Security Income (SSI) benefits. The study was a randomized controlled trial examining DMIE’s impact on employment, hours worked, and benefits applications. Study data sources included the Ticket Research File (TRF), 831 File, and Uniform Data Set (UDS). Because DMIE recruitment methods, participant populations, and services offered varied substantially across states, the authors reported impacts separately for each state and for Minnesota and Texas pooled together. With few exceptions, DMIE did not achieve statistically significant impacts on employment, hours worked, or disability benefit applications. The quality of causal evidence is high for most outcomes, which means that we are confident that the estimated impacts are attributable solely to the DMIE. However, for some outcomes including employment in Kansas and Hawaii, the quality of the causal evidence is moderate, which means that we have confidence that the estimated effects are attributable at least in part to the DMIE, though other factors might also have contributed.","Demonstration to Maintain Independence and Employment (DMIE)","Health Disability insurance Supplemental security income (SSI) Vocational rehabilitation",Disability,,"United States",2011,,"Disability Employment Policy Review Protocol" "The Social Security Administration’s Youth Transition Demonstration Projects: Interim report on the City University of New York’s Project","Fraker, T., Black, A., Broadus, J., Mamun, A., Manno, M., Martinez, J., McRoberts, R., Rangarajan, A., & Reed, D. (2011). The Social Security Administration’s Youth Transition Demonstration Projects: Interim report on the City University of New York’s Project. Report submitted to the Social Security Administration. Washington, DC: Mathematica Policy Research.","Disability Employment Policy","Study Type: Implementation Analysis",,,"Summary: This report presents an interim implementation and impact analysis on the City University of New York (CUNY) Youth Transition Demonstration Project (YTDP). The program sought to maximize economic self-sufficiency and independence for youth disability insurance beneficiaries by improving their employment and educational opportunities. The program targeted youth ages 14 through 18 who received Supplemental Security Income (SSI) and resided in Bronx County. The study examined implementation of YTDP at two CUNY campuses, focusing on major aspects of service delivery, including the background, local context, and service environment of YTDP. It also provided information on beneficiaries’ characteristics and satisfaction with the program. The study used qualitative analysis of staff and beneficiary interviews, including data collected from site visits; and descriptive quantitative analysis of beneficiaries’ baseline and follow-up survey data and service utilization data from a management information system. The study found that youth beneficiaries had access to all of the services in the conceptual framework. Many began receiving individualized services before participating in structured workshops. However, education-related and person-centered services were among the less-intensive service offerings. Study findings related to implementation challenges and solutions are potentially applicable to other current or future projects that provide employment-related services to youth with disabilities.","the Youth Transition Demonstration Projects, The City University of New York","Supplemental security income (SSI) Youth programs Vocational rehabilitation","Youth, Disability",,"United States",2011,http://www.mdrc.org/sites/default/files/full_579.pdf,"Disability Employment Policy Review Protocol" "Employment Among Social Security Disability Program Beneficiaries, 1996–2007","Mamun, Arif, O’Leary, Paul, Wittenburg, David C., & Gregory, Jesse. (2011). Employment Among Social Security Disability Program Beneficiaries, 1996–2007. Social Security Bulletin, 71(3).","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: This article described the variation in employment rates of Social Security Disability Insurance (DI) and Supplemental Security Income recipients over time and across states using a consistent measure of earnings from administrative data. It also examined the extent to which observable demographic and disability characteristics of recipients could explain the variation in employment rates. One purpose of the analysis was to assess then-current policies and provide benchmarks for ongoing demonstration projects and future return-to-work initiatives. The study characterized more than 10 million working-age adult disability recipients. Authors found that the overall employment rate—defined for the study as annual earnings over $1,000—was 12 percent in 2007. Substantial variation existed within the population. DI recipients and those younger than 40 were much more likely to work relative to other Social Security recipients. Additionally, substantial regional variation existed across states; employment rates ranged from 7 percent (West Virginia) to 23 percent (North Dakota). The analysis also found that the employment rates among recipients were sensitive to the business cycle and persistent over time.",,"Disability insurance Supplemental security income (SSI)",Disability,,"United States",2011,http://www.ssa.gov/policy/docs/ssb/v71n3/v71n3p11.html,"Disability Employment Policy Review Protocol" "The Accelerated Benefits Demonstration and Evaluation Project: Impacts on health and employment at twelve months","Michalopoulos, C., Wittenburg, D., Israel, D., Schore, J., Warren, A., Zutshi, A., Freedman, S., & Schwartz, L. (2011). The Accelerated Benefits Demonstration and Evaluation Project: Impacts on health and employment at twelve months. New York: MDRC.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-No impacts Employment Health and safety-Mod/high-Favorable impacts Health and safety Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: This is the 12-month survey impact report of the Accelerated Benefits Demonstration (ABD), an effort to provide immediate health insurance and employment and benefits counseling to new, uninsured Social Security Disability Insurance (SSDI) recipients during the 24 month Medicare eligibility waiting period.  About 2,000 volunteers were randomly assigned as part of the demonstration; this report focuses on approximately 1,500 of them. Study data sources included Social Security Administration (SSA) administrative records, a baseline telephone survey, a follow-up 12-month survey, health claims data, and a case management information system. ABD health insurance increased health care utilization, reduced unmet medical care needs, and improved self-reported health. However, ABD employment supports did not increase employment in the first 12 months of follow-up. The quality of the causal evidence presented in this report is high because the study is a well-implemented randomized controlled trial. This means we can be confident that the outcome differences between research groups are attributable to ABD, and not other factors.","Accelerated Benefits Demonstration","Disability insurance Health insurance Supplemental security income (SSI) Job search assistance and supportive services",Disability,,"United States",2011,http://www.mdrc.org/sites/default/files/full_528.pdf,"Disability Employment Policy Review Protocol" "Supporting work effort of SSDI beneficiaries: Implementation of Benefit Offset Pilot Demonstration.","Chambless, C., Julnes, G., McCormick, S., & Reither, A. (2011). Supporting work effort of SSDI beneficiaries: Implementation of Benefit Offset Pilot Demonstration. Journal of Disability Policy Studies, 22(3), 179-188.","Disability Employment Policy","Study Type: Implementation Analysis",,,"Summary: This report presented an implementation and impact analysis of the Utah Benefits Offset Pilot Demonstration Project (BOPD). The study examined pilot procedures and potential challenges for national implementation of the Benefit Offset National Demonstration (BOND), which intended to reduce barriers confronting SSDI recipients wishing to increase their earnings by offering a benefit offset. The study focused on how to effectively implement and administer the benefit offset and whether work incentives counseling and other employment supports would encourage beneficiaries to take advantage of the offset program. The authors used administrative data about recruitment and service use, focus groups, and surveys. The study found that recruitment for the demonstration was challenging because of perceived threats to benefits status from participating. Effective communication through multiple modes was crucial to successful recruitment. In addition, staff found the start and end dates of benefits changes difficult to communicate to participants, and so developed tools, including time lines, to do so. Due to limitations in the study’s discussions of its research methods, it is unclear whether findings are potentially applicable to other projects for SSDI beneficiaries.","the Utah Benefits Offset Pilot Demonstration Project","Disability insurance Vocational rehabilitation",Disability,,"United States",2011,,"Disability Employment Policy Review Protocol" "Microenterprise options for people with intellectual and developmental disabilities: An outcome evaluation.","Conroy, J., Ferris, C., & Irvine, R. (2010). Microenterprise options for people with intellectual and developmental disabilities: An outcome evaluation. Journal of Policy and Practice in Intellectual Disabilities, 7(4), 269-277.","Entrepreneurship and Self-Employment","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Mixed impacts Earnings and wages Education and skills gains-Low-No impacts Education and skills gains Employment-Low-Mixed impacts Employment","Summary: The study’s objective was to examine the impact of a microenterprise intervention from Network180, an agency serving people with intellectual and developmental disabilities, on employment, earnings, and education of 27 people with disabilities. The study defined microenterprise as a very small business, employing 10 or fewer people, with start-up costs less than $500. As part of the intervention, vocational staff at Network180 provided information about microenterprises to people already receiving services at Network180. Staff supported those interested in microenterprises with tasks such as small business loans and talking to community stakeholders. The authors used a pre-post design, collecting survey data measuring hours worked and earnings from several types of employment, as well as the number of hours spent on educational activities, before and after participation in the intervention. Data were collected at one point in time; respondents were asked to estimate pre-intervention data from memory. The authors summed the reported outcomes for all 27 participants and performed statistical tests on the totals rather than the means of each outcome. The study found that hours spent per week engaged in self-employment, as well as earnings from self-employment, were significantly higher after the intervention than before it. In contrast, earnings and weekly hours spent in sheltered or workshop employment decreased significantly after the intervention, compared with before it. There were no significant differences before or after the intervention on hours spent on educational activities.","Network180 microenterprise intervention","Other training and education",Disability,"Small business","United States",2010,,"Employment and Training Review Protocol" "Retiree health insurance and disengagement from a career job.","Robinson, C., & Clark, R. (2010). Retiree health insurance and disengagement from a career job. Journal of Labor Research, 31(3), 247-262.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-No impacts Employment","Summary: The study examined the effect of availability of retiree health insurance (RHI) on a person’s decision to leave a career job (a measure of retirement). Using data from the Health and Retirement Study (HRS), the authors used a nonexperimental approach to estimate the likelihood of retirement for those who worked at firms with RHI compared with those who worked at firms without RHI. The study found that workers at firms that offer RHI are more likely to retire than those at firms that do not offer RHI. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we would be somewhat confident that any estimated effects would be attributable to the availability at RHI, but other factors might also have contributed.","Retiree Health Insurance","Other health and safety Older workers' programs","Adult, Older worker",,"United States",2010,https://link.springer.com/article/10.1007/s12122-010-9091-4,"Employment and Training Review Protocol" "Testing a SSDI Benefit Offset: Evaluations of the Wisconsin SSDI Employment Pilot","Delin, B., Hartman, E., Sell, C., & Brown-Reither, A. (2010). Testing a SSDI Benefit Offset: Evaluations of the Wisconsin SSDI Employment Pilot. Menomonie, WI: University of Wisconsin-Stout.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment Public benefits receipt-Mod/high-No impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of Wisconsin’s Benefit Offset Pilot Demonstration (BOPD), which provided a more-generous work incentive for Social Security Disability Insurance (SSDI) recipients, on recipients’ employment status, earnings, and reliance on benefits. The study was a randomized controlled trial; eligible volunteers were randomly assigned to either a treatment group, which was eligible for the more-generous work incentive, or a control group that was not. Data sources included state and federal administrative data on Wisconsin SSDI recipients who were enrolled in BOPD. The study found no statistically significant differences between treatment and control group members on employment status, earnings, or reliance on benefits in the eight quarters of follow-up. The quality of the causal evidence presented in this study is high for results through the fifth quarter of follow-up, but moderate for subsequent periods because of high attrition in those periods. This means we would be confident that estimated impacts through the fifth quarter of follow-up were attributable to the BOPD and not other factors. However, the study found no such statistically significant impacts.","the Benefit Offset Pilot Demonstration","Disability insurance Other wages and benefits Supplemental security income (SSI)",Disability,,"United States",2010,http://www.ssa.gov/disabilityresearch/documents/WI%20SSDI-EP%20EVAL%20Final%207…,"Disability Employment Policy Review Protocol" "Do disability laws impair firm performance?","Bird, R., & Knopf, J. (2010). Do disability laws impair firm performance? American Business Law Journal, 47(1), 145-190.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Unfavorable impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The study’s objective was to examine the effect of state disability laws—those related to antidiscrimination and reasonable accommodation for employees with disabilities—on commercial banks’ number of full-time equivalent employees and their average salary. The authors estimated the impact of antidiscrimination and reasonable accommodation laws using a differences-in-differences regression model with state- and year-fixed effects. Data were obtained from the Federal Reserve Bank of Chicago’s Commercial Bank Database and from Global Insight. The study found that neither antidiscrimination nor reasonable accommodation laws had a statistically significant effect on bank employment levels during the year the law went into effect or during the subsequent three years. Antidiscrimination laws led to a statistically significant 1.3 percent decline in bank employees’ average salary in the third year after enactment, but not in any other time period. The quality of causal evidence presented in this report is low. This means we are not confident that the estimated effects are attributable to state disability laws. Other factors are likely to have contributed.","State Disability Laws","Americans with Disabilities Act (ADA)",Disability,"Finance and insurance","United States",2010,,"Employer Compliance Review Protocol" "Veterans Health Administration transitional work experience vs. job placement in veterans with co-morbid substance use and non-psychotic psychiatric disorders","Penk, W., Drebing, C. E., Rosenheck, R, A., Krebs, C., Van Ormer, A., & Mueller, L. (2010). Veterans Health Administration transitional work experience vs. job placement in veterans with co-morbid substance use and non-psychotic psychiatric disorders. Psychiatric Rehabilitation Journal, 33(4), 297-307.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Veterans Health Administration (VHA) Transitional Work Experience (TWE) program on employment and income for veterans with substance abuse and non-psychotic psychiatric disorders, compared with job placement (JP) services only. The study was a randomized controlled trial carried out at one VHA medical center site over four years. Eligible veterans were randomly assigned to either the treatment group, which could participate in the TWE program, or to the control group, which could not participate in TWE but could receive JP services. The authors used data from participant surveys to measure impacts. The study found that members of the treatment group worked significantly more hours in paid employment (including employment sponsored by the TWE program itself) and significantly more total weeks in paid employment, compared with the control group. The study also found that the treatment group earned significantly higher total income for the year (including noncompetitive TWE employment income) than the control group. The quality of causal evidence presented in this report is low because the authors did not provide enough information to calculate attrition and did not include sufficient controls in their analysis to establish that treatment and control groups were similar on observable characteristics at baseline for the analytic sample. This means we are not confident that the estimated effects are attributable to TWE. Other factors are likely to have contributed.","the Transitional Work Experience (TWE) Program","Vocational rehabilitation Veterans' reemployment","Disability, Veteran or military",,"United States",2010,,"Disability Employment Policy Review Protocol" "Framing Social Security Reform: Behavioral responses to changes in the full retirement age","Behaghel, L., & Blau, D. M. (2010) Framing Social Security Reform: Behavioral responses to changes in the full retirement age. (IZA Discussion Paper No. 5310). Bonn, Germany: IZA.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The study examined the impact of changes to the Full Retirement Age (FRA) on labor force exit, Old Age and Survivor’s Insurance (OASI) claims, and retirement. The study uses a statistical model and the data from the Health and Retirement Study (HRS) to compare outcomes of people in birth cohorts who were affected by the change in FRA with those of a comparison group of people who were not. The study found that the change in the FRA was associated with significant increases in the likelihood of claiming OASI and exiting the labor force at the new, later full retirement age. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the change in FRA, but other factors might also have contributed.","changes to the Full Retirement Age (FRA)","Older workers' programs Other employment and reemployment","Older worker",,"United States",2010,https://www.aeaweb.org/articles?id=10.1257/pol.4.4.41,"Employment and Training Review Protocol" "Can Social Security explain trends in labor force participation of older men in the United States?","Blau, D. M., & Goodstein, R. M. (2010). Can Social Security explain trends in labor force participation of older men in the United States? Journal of Human Resources, 45(2), 328-363.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The study examined the impact of changes in Social Security Administration (SSA) retirement rules on men’s labor force participation rates in the 1960s–1980s and 1990s–2000s. The study used regression analyses to predicted labor force participation rates using actual and counterfactual SSA retirement rules. These analyses use data from the Current Population Survey (CPS) and the Survey of Income and Program Participation (SIPP) for the period from 1962 to 2005 merged with data from SSA on taxable earnings. The study found that changes in the delayed retirement credit and full retirement age in 1983 could explain one-quarter to one-half of the increase in labor force participation in the early 2000s. The quality of causal evidence presented in this report is moderate, because it is a well-implemented nonexperimental study. This means we are somewhat confident that the estimated effects are attributable to SSA reforms, but other factors might also have contributed.","Social Security Administration Reforms","Federal retirement benefits Older workers' programs","Adult, Older worker, Male",,"United States",2010,http://jhr.uwpress.org/content/45/2/328.abstract,"Employment and Training Review Protocol" "Baltimore County Juvenile Drug Court outcome and cost evaluation","Mackin, J., Lucas, L., Lambarth, C., Herrera, T., Waller, M., Carey, S., & Finigan, M. (2010). Baltimore County Juvenile Drug Court outcome and cost evaluation. Portland, OR: NPC Research.","Opportunities for Youth","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence",,"Summary: The study examined the impact of participation in the Baltimore County Juvenile Drug Court on drug use and recidivism. The authors used a nonexperimental design, matching youth who participated in the juvenile drug court with a comparison group of similar youth who were eligible to participate in juvenile drug court, but instead participated in the traditional juvenile justice system. The authors used administrative data to compare the mean number of juvenile rearrests over a two-year follow-up period. The study found that drug court participants had significantly fewer juvenile rearrests, both overall and specifically for drug charges, than comparison youth. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the Baltimore County Juvenile Drug Court, but other factors might also have contributed.","the Baltimore County Juvenile Drug Court","Substance abuse recovery Youth programs","Youth, Disability, Disconnected youth",,"United States",2010,http://www.ndcrc.org/sites/default/files/baltimore_co_juv_dc_outcome-cost_0110…,"Opportunities for Youth Review Protocol" "Elderly immigrants’ labor supply response to supplemental security income.","Kaushal, N. (2010). Elderly immigrants’ labor supply response to supplemental security income. Journal of Policy Analysis and Management, 29(1), 137-162.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study objective is to examine the impact of the Personal Responsibility and Work Opportunity Reconciliation Act (PRWORA) of 1996 on employment outcomes of foreign-born people and noncitizens ages 60 to 74 The study used a statistical model and the data from the Current Population Survey’s monthly outgoing rotation group and the March Current Population Survey from 1994 to 2005 to estimate the impact. The study found that the PRWORA is associated with increased employment and decreased retirement for foreign-born men compared with U.S.-born men, but it found no statistically significant association with the employment for foreign-born women. The quality of the causal evidence presented in this report is low because the study is a nonexperimental analysis that does not demonstrate that the groups were similar before the policy change. This means we are not confident that the estimated effects are attributable to PRWORA; other factors are likely to have contributed.","Personal Responsibility and Work Opportunity Reconciliation Act of 1996","Federal retirement benefits Foreign and temporary workers","Adult, Older worker, Immigrant",,"United States",2010,https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4222576/,"Employment and Training Review Protocol" "Youth Transition Demonstration Project, City University of New York, Bronx, NY, Final Report.","The City University of New York. (2010). Youth Transition Demonstration Project, City University of New York, Bronx, NY, Final Report. New York: City University of New York.","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: This report described the Youth Transition Demonstration project implemented by the City University of New York. The project enrolled 400 youth ages 15 to 18 in the Bronx who had disabilities and were receiving Social Security Administration (SSA) benefits. The main components of the project were (1) a Saturday college program for youth and their parents, (2) provision of counseling on SSA benefits, (3) person-centered life and employment planning, (4) summer and after-school jobs, and (5) referrals to other services. The report described participants’ receipt of SSA benefits, employment and education outcomes, participants’ use of benefit advisement, and agency partnerships formed to implement the project.",,"Disability insurance Supplemental security income (SSI) Youth programs","Youth, Disability",,"United States",2010,http://www.google.com/url?sa=t&rct=j&q=&esrc=s&frm=1&source=web&cd=1&cad=rja&ua…,"Disability Employment Policy Review Protocol" "The effects of changes in state SSI supplements on preretirement labor supply","Neumark, D., & Powers, E. T. (2005). The effects of changes in state SSI supplements on preretirement labor supply. Public Finance Review, 33(1), 3-35.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study examined the impact of a theoretical increase in Supplemental Security Income (SSI) benefits on the preretirement employment outcomes for likely SSI participants ages 60 to 64. Using data from the annual Current Population Survey from 1979 to 2001 and state-level SSI receipt data, the authors used regression methods in a nonexperimental analysis of likely SSI participants to compare the outcomes of workers ages 62 to 64 with those of workers ages 60 to 61. The study found that an increase in monthly SSI benefits was associated with a statistically significant decrease in the employment rate and number of hours worked for likely SSI recipients ages 62 to 64 compared with those ages 60 to 61. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to changes in SSI benefits; other factors are likely to have contributed.","Supplemental Security Income (SSI) benefits","Older workers' programs Other employment and reemployment","Adult, Older worker",,"United States",2010,https://journals.sagepub.com/doi/pdf/10.1177/1091142104270655,"Employment and Training Review Protocol" "The influences on bridge employment decisions.","Pengcharoen, C., & Shultz, K. S. (2010). The influences on bridge employment decisions. International Journal of Manpower, 31(3), 322-336. doi:10.1108/01437721011050602","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Unfavorable impacts Employment","Summary: The study examined the impact of work schedule flexibility on retirement outcomes among older workers, where work schedule flexibility was measured as the ability to reduce hours from one’s regular work schedule. The study used a statistical model (multinomial logit regression) and the longitudinal data from the Health and Retirement Study (HRS) from 1992 and 2002 to examine the relationship between reporting work schedule flexibility or inflexibility during the baseline survey and reporting complete retirement, partial retirement, or continued employment at the follow-up survey 10 years later among older workers. The study found that individuals who reported work schedule inflexibility in the 1992 were more likely to report completely retired than partially retired in 2002, but when comparing the likelihood of reporting continued employment to complete or partial retirement, there was no difference between older workers reported work schedule flexibility and those who reported inflexibility in 1992. The quality of causal evidence presented in this study is low because the authors did not demonstrate that the participants reporting work schedule flexibility were similar to the participants reporting work schedule inflexibility in 1992. This means we are not confident that the estimated effects are attributable to work schedule flexibility; other factors are likely to have contributed.",,"Other wages and benefits","Adult, Older worker",,"United States",2010,https://www.researchgate.net/publication/46545640_The_influences_on_bridge_empl…,"Employment and Training Review Protocol" "Employment and Earnings Growth Among Transition-Age Supplemental Security Income Program Participants","Berry, Hugh G., & Caplan, Leslie J. (2010). Employment and Earnings Growth Among Transition-Age Supplemental Security Income Program Participants. Journal of Disability Policy Studies, 21(152). Originally published online October 7, 2010.","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: The purpose of this study was to examine individual demographic, disability, and vocational rehabilitation (VR) service factors related to (1) employment status and (2) earnings growth for Supplemental Security Income (SSI) recipients who have participated in the VR program.  The VR program offered eligible people with disabilities services such as assessment, counseling and guidance, restoration, training, job development, and job placement to prepare for and obtain employment. The study merged administrative data from the Ticket Research File maintained by the Social Security Administration with data from the Case Service Report (RSA-911) database maintained by the U.S. Department of Education. Findings showed that SSI participants with mental retardation exhibited the highest odds of employment among other disability groups two years after exiting the VR program. College or university training and job placement services decreased the odds of employment, whereas supported employment demonstrated increased odds. For SSI participants with sustained employment, African American VR consumers showed higher earnings compared with other race groups. Among selected VR services, only college or university training was positively associated with earnings growth over time.","the Vocational Rehabilitation (VOC) Programs","Disability insurance Supplemental security income (SSI) Vocational rehabilitation",Disability,,"United States",2010,,"Disability Employment Policy Review Protocol" "Interim report on the Demonstration to Maintain Independence and Employment","Gimm, G., Denny-Brown, N., Gilman, B., Ireys, H.T., & Anderson, T. (2009). Interim report on the Demonstration to Maintain Independence and Employment. Washington, DC: Mathematica Policy Research.","Disability Employment Policy","Study Type: Implementation Analysis",,,"Summary: This report summarized the results of the first round of the evaluation of the Demonstration to Maintain Independence and Employment (DMIE), under which the Centers for Medicare & Medicaid Services (CMS) offered funding to four states and the District of Columbia to design, implement, and test health care coverage and employment support programs for workers with potentially disabling conditions. This CLEAR profile focuses on the process study component of the evaluation. Other components of the evaluation included an overview of beneficiaries’ characteristics and an impact analysis. This study sought to gain insight into successes, challenges, and lessons related to program outreach and recruitment—drawing relevant information on all five sites from interviews, program documents, state-level evaluation reports, and enrollment data. Key findings indicated that most state DMIE programs faced challenges in recruitment—given delays in designing program processes and obtaining approvals, low interest from eligible beneficiaries, and poor access to data needed for outreach and screening—but eventually met enrollment targets. The authors also found that state DMIE programs that were designed around existing health programs were most successful in implementing streamlined recruitment, strategically supplementing available health benefits, and conducting swift program roll-out through existing provider networks.","Demonstration to Maintain Independence and Employment (DMIE)",,Disability,,"United States",2009,http://www.mathematica-mpr.com/~/media/publications/PDFs/disability/dmie-es.pdf,"Disability Employment Policy Review Protocol" "Benefit Offset Pilot Demonstration: Connecticut final report","State of Connecticut (2009). Benefit Offset Pilot Demonstration: Connecticut final report.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: This study’s objective was to examine 24-month impacts for Connecticut’s Benefit Offset Pilot Demonstration (BOPD), which provided a more-generous work incentive for Social Security Disability Insurance (SSDI) recipients, on recipients’ employment status, earnings, and reliance on benefits. Participants were randomly assigned to a treatment group, which was eligible for the more generous work incentive, or a control group that was not. The authors examined impacts on employment and earnings using state unemployment insurance (UI) wage records. The study found that, although BOPD achieved no statistically significant impacts on being employed, it did generate some positive impacts on earnings at the first year after random assignment. The quality of the causal evidence presented in this report is high for the year two impacts. This means we are confident that those estimated effects are attributable to the BOPD. However, the quality of the causal evidence for the year one impacts is moderate. This means we have confidence that the effects are attributable at least in part to the BOPD, but other factors might also have contributed.","the Benefit Offset Pilot Demonstration","Disability insurance Supplemental security income (SSI)",Disability,,"United States",2009,http://www.google.com/url?sa=t&rct=j&q=&esrc=s&frm=1&source=web&cd=1&cad=rja&ua…,"Disability Employment Policy Review Protocol" "New evidence on the labor supply effects of the Social Security earnings test.","Friedberg, L., & Webb, A. (2009). New evidence on the labor supply effects of the Social Security earnings test. Tax Policy and the Economy, 23(1), 1-36.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study examined the impact of changes to the Social Security earnings test in 1996 and 2000 on employment outcomes. The authors used a nonexperimental design and the data from the Current Population Survey (CPS) and the Health and Retirement Study (HRS) to compare outcomes before and after the changes in earning test rules for those between the ages of 62 and 74 who faced different earnings test thresholds at different ages and years. The study found that upcoming anticipated earnings test between ages 62 to 69 was associated with a significantly lower likelihood of having a job last week. A higher present value of upcoming anticipated earnings threshold between ages 62 to 69 was associated with a significantly higher likelihood of having a job last week. The quality of causal evidence presented in this study is low because the study is a nonexperimental analysis that did not demonstrate that the groups being compared were similar and did not account for possible differences in the analysis. This means we are not confident that the estimated effects are attributable to the changes in the earnings test decision. Other factors are likely to have contributed.","Social Security Earnings Test","Older workers' programs Other employment and reemployment","Adult, Older worker",,"United States",2009,,"Employment and Training Review Protocol" "SSDI '1 for 2:' Benefit Offset Pilot Demonstration Vermont Pilot Final Report","Porter, A., Smith, J., Payette, A., Tremblay, T., & Burt, P. (2009). SSDI '1 for 2:' Benefit Offset Pilot Demonstration Vermont Pilot Final Report. Waterbury, VT: Vermont Division of Vocational Rehabilitation.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: This study’s objective was to examine 24-month impacts for Vermont’s Benefit Offset Pilot Demonstration (BOPD), which provided a more generous work incentive for Social Security Disability Insurance (SSDI) recipients, on recipients’ employment status and earnings. Participants were randomly assigned to a treatment group, which was eligible for the more generous work incentive, or a control group that was not. The authors examined impacts on employment and earnings using state unemployment insurance (UI) wage records. The study found that the BOPD in Vermont had statistically significant, positive impacts on treatment group members’ employment and earnings in the three quarters after random assignment. However, the effects generally did not persist over the full two-year follow-up period. The quality of the causal evidence presented in this report is high because it was a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the BOPD, and not to other factors.","Benefit Offset Pilot Demonstration","Disability insurance Supplemental security income (SSI) Other employment and reemployment",Disability,,"United States",2009,http://www.ssa.gov/disabilityresearch/documents/Vt1for2FinalReport091223.pdf,"Disability Employment Policy Review Protocol" "MS Model Youth Transition Innovation; Youth Transition Process Demonstration Grant Final Summary","Doyle, Rebecca, Horton, Patty, Ladner, Lisa, & Mississippi Department of Rehabilitation Services (2009). MS Model Youth Transition Innovation; Youth Transition Process Demonstration Grant Final Summary.","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: The Mississippi Model Youth Transition Innovation (MYTI) project assisted young people with severe disabilities to become involved in the working community through targeted, school-to-work transition interventions. It exposed students and their families to the concept that all students were employable, then provided employment and benefits information, preparation, and support services tailored to four age ranges of (10–13, 14–18, 19–21, and 22–25 years of age). MYTI served 210 youths ages 10 to 25with significant disabilities, such as mental retardation, developmental disabilities, deafness, blindness, severe emotional disturbances, or multiple disabilities. There was no comparison group. Services included work experience, employment and job planning and support, One-Stop Career Center assistance, and individualized development accounts. Descriptive analyses suggested potential lessons from the project, such as the importance of helping students formulate a vision of work at a young age, and of helping students and their families understand whether and how work affects Social Security benefits.",,"Disability insurance Supplemental security income (SSI) Vocational rehabilitation Supported employment or other employment supports","Youth, Disability",,"United States",2009,http://www.google.com/url?sa=t&rct=j&q=&esrc=s&frm=1&source=web&cd=1&cad=rja&ua…,"Disability Employment Policy Review Protocol" "Utah SSDI '1 for 2:' Benefit Offset Pilot Demonstration Final Report","Chambless, C., Julnes, G., McCormick, S., & Brown-Reither, A. (2009). Utah SSDI '1 for 2:' Benefit Offset Pilot Demonstration Final Report. Salt Lake City, UT: University of Utah Center for Public Policy & Administration.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-No impacts Employment","Summary: This study’s objective was to examine 24-month impacts for Utah’s Benefit Offset Pilot Demonstration (BOPD), which provided a more-generous work incentive for Social Security Disability Insurance (SSDI) recipients, on recipients’ employment status and earnings. Participants were randomly assigned to a treatment group, which was eligible for the more generous work incentive, or a control group that was not. The authors examined impacts on employment and earnings using state unemployment insurance (UI) wage records. The study found that the BOPD in Utah did not have a statistically significant impact on employment or earnings. It did significantly increase the proportion of participants with earnings above the substantial gainful activity (SGA) amount by the end of the second year of follow-up. The quality of the causal evidence presented in this report is high because it was a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the BOPD, and not to other factors.","Benefit Offset Pilot Demonstration","Disability insurance Supplemental security income (SSI) Other employment and reemployment",Disability,,"United States",2009,http://www.ssa.gov/disabilityresearch/documents/Final-UBOPD-Master_5-13-10.doc,"Disability Employment Policy Review Protocol" "The repeal of the retirement earnings test and the labor supply of older men.","Engelhardt, G. V., & Kumar, A. (2009). The repeal of the retirement earnings test and the labor supply of older men. Journal of Pension Economics & Finance, 8(4), 429-450.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study examined the impact of the repeal of the earnings test under the Senior Citizens Freedom to Work Act of 2000 on the labor supply and earnings of older men ages 62 to 72. The authors used a nonexperimental approach and data from the Health and Retirement Study to compare labor force participation, annual hours of work, retirement behavior, and earnings of men who were and were not subject to the repeal of the earnings test. The study found that the policy change was associated with a significant increase in older men’s average annual hours of work. The policy change was also associated with a change in the distribution of real earnings in that a smaller proportion of older men had earnings at or below the earnings test threshold. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Senior Citizens Freedom to Work Act of 2000; other factors are likely to have contributed.","Senior Citizens Freedom to Work Act of 2000","Older workers' programs Other disparities or discrimination in employment and earnings","Adult, Older worker, Male",,"United States",2009,,"Employment and Training Review Protocol" "Work Activity and Use of Em-ployment Supports Under the Original Ticket to Work Regulations: Characteristics, Employment, and Sources of Support Among Working-Age SSI and DI Beneficiaries","Livermore, Gina, Stapleton, David, & Roche, Allison. (2009). Work Activity and Use of Em-ployment Supports Under the Original Ticket to Work Regulations: Characteristics, Employment, and Sources of Support Among Working-Age SSI and DI Beneficiaries. Washington, DC: Mathematica Policy Research.","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: This report presented a profile of all working-age (ages 18 to 64) Supplemental Security Income (SSI) and Disability Income (DI) recipients, using data from the 2004, 2005, and 2006 rounds of the National Beneficiary Survey. Findings indicated that many SSI and DI recipients were working and engaging in work preparation activities, or saw themselves working in the future. But their jobs did not pay well in general, or offer much in the way of benefits. Although many recipients were working, there was a high prevalence of characteristics, circumstances, and experiences making employment difficult. Few were aware of work incentive provisions then available in SSI and DI, and many relied on means-tested public programs for which earnings could jeopardize eligibility. In addition to activity limitations and poor health associated with their disabling health conditions, many recipients had limited education and experienced obstacles to employment, such as a lack of reliable transportation and inaccessible workplaces. Findings indicated that only changing economic incentives inherent in the disability programs would be insufficient to bring about a successful return to work for many recipients; other supports would be needed as well.",,"Disability insurance Supplemental security income (SSI) Supported employment or other employment supports",Disability,,"United States",2009,http://www.ssa.gov/disabilityresearch/documents/TTW5_2_BeneChar.pdf,"Disability Employment Policy Review Protocol" "An empirical study of the effects of Social Security reforms on benefit claiming behavior and receipt using public-use administrative microdata.","Benítez-Silva, H., & Yin, N. (2009). An empirical study of the effects of Social Security reforms on benefit claiming behavior and receipt using public-use administrative microdata. Social Security Bulletin, 69(3), 77-95.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Public benefits receipt-Low-Favorable impacts Public benefit receipt","Summary: The study examined the impact of three policy changes to the Social Security program that went into effect in 2000 on average monthly benefits and the proportion of new claimants by age. The study was a nonexperimental analysis that examined outcomes for older workers by age and year using data from the 2004 Old Age, Survivors, and Disability Insurance program public-use microdata files. The study found that the changes were associated with lower average monthly benefits for individuals ages 66 to 69 after the year 2000 relative to individuals of the same ages in 1994. The quality of the causal evidence presented in this report is low because the authors did not demonstrate that the groups were similar before the intervention. This means we are not confident that the estimated effects are attributable to the intervention program; other factors are likely to have contributed.","Policy Changes to the Social Security Program","Federal retirement benefits Older workers' programs","Adult, Older worker",,"United States",2009,https://papers.ssrn.com/sol3/papers.cfm?abstract_id=1480653,"Employment and Training Review Protocol" "How did the elimination of the US earnings test above the normal retirement age affect labour supply expectations?","Michaud, P., & Van Soest, A. (2008). How did the elimination of the US earnings test above the normal retirement age affect labour supply expectations? Fiscal Studies, 29(2), 197-231. doi:10.1111/j.1475-5890.2008.00073.x","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The authors used a nonexperimental approach and the data from Health and Retirement Study data from 1996 to 2002 and Social Security earnings history to estimate the impact. The study examined the impact of repealing the earnings test from Social Security recipients between full retirement age and age 70 on older workers’ subjective probability of retirement. The authors used a nonexperimental approach and the data from Health and Retirement Study data from 1996 to 2002 and Social Security earnings history to estimate the impact. The study found that after the repeal of the earnings test, the subjective probability of working of full-time past age 65 for older male workers who were likely to have most of their projected Social Security benefits reduced under the earnings test has increased their expected probability of working relative to those who were not likely to be affected. •The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design.This means we are somewhat confident that the estimated effects are attributable to the repeal of the earnings test, but other factors might also have contributed.","Social Security Earnings Test","Federal retirement benefits Older workers' programs","Adult, Older worker, Male",,"United States",2008,,"Employment and Training Review Protocol" "Workforce program performance indicators for the Commonwealth of Virginia. (Upjohn Institute Technical Report No. 08-024). [DBVI]","Hollenbeck, K., & Huang, W-J. (2008). Workforce program performance indicators for the Commonwealth of Virginia. (Upjohn Institute Technical Report No. 08-024). Kalamazoo, MI: W.E. Upjohn Institute for Employment Research. [DBVI]",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Vocational Rehabilitation program administered by the Department for Blind and Vision Impaired (DBVI) on participants’ employment and credential completion. The study used administrative records to compare the outcomes of low-income adults who took part in the DBVI program with outcomes of a nonexperimental matched group of adults who did not take part in the program. The study found that DBVI participants had higher employment and credential completion rates compared with those of people who did not participate in the program. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups compared were similar before program participation. This means we are not confident that the estimated effects are attributable to DBVI; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Vocational Rehabilitation (VOC) Programs","Supported employment or other employment supports Vocational rehabilitation","Disability, Low income",,"United States",2008,http://research.upjohn.org/cgi/viewcontent.cgi?article=1027&context=up_technica…,"Review Protocol" "Evaluation of customized employment in building the capacity of the workforce development system","Elinson, L., Frey, W. D., Li, T., Palan, M. A., & Horne, R. L. (2008). Evaluation of customized employment in building the capacity of the workforce development system. Journal of Vocational Rehabilitation, 28(3), 141-158.","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Unfavorable impacts Earnings and wages Employment-Low-Unfavorable impacts Employment","Summary: The study’s objective was to examine the impact of customized employment services for disabled adults on earnings and employment. Using administrative data, the authors compared employment and earnings outcomes of people who participated in a customized employment intervention with outcomes of people who participated in a Working for Freedom, Opportunity, and Real Choice through Community Employment (WorkForce) intervention. The study found that those in the customized employment intervention were more likely to be employed for at least 12 months and to earn at least $8.15 per hour after participating in the intervention compared with the WorkForce group. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the WorkForce intervention; other factors are likely to have contributed.","the customized employment services","Job search assistance and supportive services Workforce Investment Act (WIA)/Workforce Innovation and Opportunity Act (WIOA)",Disability,,"United States",2008,https://content.iospress.com/articles/journal-of-vocational-rehabilitation/jvr0…,"Employment and Training Review Protocol" "Workforce program performance indicators for the Commonwealth of Virginia. (Upjohn Institute Technical Report No. 08-024). [DRS]","Hollenbeck, K., & Huang, W-J. (2008). Workforce program performance indicators for the Commonwealth of Virginia. (Upjohn Institute Technical Report No. 08-024). Kalamazoo, MI: W.E. Upjohn Institute for Employment Research. [DRS]",,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Education and skills gains-Low-Favorable impacts Education and skills gains Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Vocational Rehabilitation program administered by Department of Rehabilitative Services (DRS) on participants’ employment and credential completion. The study used administrative records to compare the outcomes of low-income adults who took part in the DRS program with outcomes of a nonexperimental matched group of adults who did not take part in the program. The study found that DRS participants had higher employment and credential completion rates compared with those of people who did not participate in the program. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups compared were similar before program participation. This means we are not confident that the estimated effects are attributable to DRS; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies","the Vocational Rehabilitation (VOC) Programs","Job search assistance and supportive services Vocational rehabilitation","Disability, Low-skilled, Low income",,"United States",2008,http://research.upjohn.org/cgi/viewcontent.cgi?article=1027&context=up_technica…,"Review Protocol" "The outcomes of policies designed to eliminate discrimination","Choe, C. (2008). The outcomes of policies designed to eliminate discrimination (Doctoral dissertation). University of Arizona.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Unfavorable impacts Earnings and wages Employment-Low-Unfavorable impacts Employment","Summary: The study’s objective was to examine the impact of the Americans with Disabilities Act (ADA) of 1990 on the employment and wages of men with disabilities relative to men without disabilities. The study used data from the Survey of Income and Program Participation (SIPP) from 1984, 1990, 1996, and 2001. The analysis attempted to determine how much of the difference in wages between men with and without disabilities was explained by background characteristics and how much was not; the portion that was not was interpreted as the effect of discrimination. The study found that neither the employment nor wages of men with disabilities improved relative to men without disabilities following passage of the ADA. Instead, employment and wage differentials both increased. However, the unexplained portion of the wage gap narrowed significantly after the ADA, consistent with a decrease in discrimination, among other explanations. The quality of causal evidence presented in this report is low because the author did not establish the comparability of men with and without disabilities before passage of the ADA. This means we are not confident that the estimated effects are attributable to the ADA. Other factors are likely to have contributed.","the Americans with Disabilities Act of 1990","Americans with Disabilities Act (ADA)","Disability, Male",,"United States",2008,,"Employer Compliance Review Protocol" "The effect of the social security earnings test on male labor supply: New evidence from survey and administrative data.","Haider, S. J., & Loughran, D. S. (2008). The effect of the social security earnings test on male labor supply: New evidence from survey and administrative data. Journal of Human Resources, 43(1), 57-87.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Mixed impacts Earnings and wages Employer benefits receipt-Low-Favorable impacts Employer benefits receipt","Summary: The study’s objective is to examine the impact of 1983 and 2000 policy changes that removed the Social Security earnings test for certain age groups on the earnings and employment outcomes of affected men The study is a nonexperimental analysis that examines the correlations between the 1983 and 2000 policy changes and earnings and employment status. The study compares the outcomes of men affected by the policy changes with the outcomes of men of similar ages not affected by the policy changes. The study finds that the 1983 policy change is associated with few changes to the observed outcomes and that the 2000 policy change is associated with higher earnings and hours worked per week for affected men. The quality of causal evidence presented in this report is low because the study does not demonstrate that men affected by the policy changes are similar to the men not affected by the policy change, nor does it control for possible differences. This means we are not confident that the estimated effects are attributable to the 1983 and 2000 policy changes; other factors are likely to have contributed.","Social Security Earnings Test","Federal retirement benefits Older workers' programs","Adult, Older worker, Male",,"United States",2008,http://jhr.uwpress.org/content/43/1/57.refs,"Employment and Training Review Protocol" "Effectiveness of supported employment for individuals with schizophrenia: Results of a multi-site, randomized trial","Cook, J., Blyler, C., Burke-Miller, J., McFarlane, W., Leff, H., Mueser, K., Gold, P., Goldberg, R., Shafer, M., Onken, S., Donegan, K., Carey, M., Razzano, L., Grey, D., Pickett-Schenk, S., & Kaufmann, C. (2008). Effectiveness of supported employment for individuals with schizophrenia: Results of a multi-site, randomized trial. Clinical Schizophrenia & Related Psychoses, 37-46.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to estimate the 24-month employment effects of supported employment interventions on people with severe mental illness, focusing on those with schizophrenia. Supported employment interventions use a combination of employment and health services and supports to improve employment and other outcomes. The authors analyzed data from seven sites, each of which implemented a distinct supported employment intervention using a randomized controlled trial. At each site, researchers interviewed participants in person twice yearly and collected weekly employment data. The study found that the programs were effective at improving 24-month employment outcomes for people with severe mental illness. Relative to treatment group members with different severe mental illnesses, people with a diagnosis of schizophrenia who received supported employment services were more likely to be employed after receiving those services. The quality of causal evidence provided in this study is moderate. This means we are somewhat confident that the estimated effects are attributable to the supported employment interventions, but other factors might also have contributed.","Supported Employment Programs","Health Job search assistance and supportive services Supported employment or other employment supports",Disability,,"United States",2008,,"Disability Employment Policy Review Protocol" "Rehabilitation of traumatic brain injury in active duty military personnel and veterans: Defense and Veterans Brain Injury Center randomized controlled trial of two rehabilitation approaches","Vanderploeg, R., Schwab, K., Walker, W., Fraser, J., Sigford, B., Date, E., . . . Warden, D. (2008). Rehabilitation of traumatic brain injury in active duty military personnel and veterans: Defense and Veterans Brain Injury Center randomized controlled trial of two rehabilitation approaches. Archives of Physical Medicine and Rehabilitation, 89(12), 2227-2237.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-No impacts Employment Education and skills gains-Mod/high-No impacts Education and skills gains","Summary: The study’s objective was to examine the impact of two treatments—cognitive-didactic rehabilitation and functional-experiential rehabilitation—on return to work/school and functional independence among veterans and active military with traumatic brain injury (TBI). The study used a randomized controlled trial design in which 366 active duty military service members or veterans with moderate-to-severe TBI were randomly assigned to receive either cognitive-didactic rehabilitation, which focuses on addressing cognitive deficits, or functional-experiential rehabilitation, which emphasizes performance of real-life tasks. Primary outcomes were measured using in-person evaluations or structured telephone interviews. The study found no significant differences in return to work or school or functional independence between the two types of rehabilitation. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects would be attributable to the difference between the cognitive-didactic and functional-experiential treatments and not to other factors. However, the study did not find statistically significant effects between the two treatments.","Cognitive-Didactic and Functional-experiential rehabilitation","Vocational rehabilitation Veterans' reemployment","Disability, Veteran or military",,"United States",2008,,"Disability Employment Policy Review Protocol" "State age protection laws and the Age Discrimination in Employment Act.","Lahey, J. State age protection laws and the Age Discrimination in Employment Act. (2008). The Journal of Law and Economics, 51(3), 433-460.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Low-No impacts Earnings and wages Employment-Low-Unfavorable impacts Employment","Summary: The study examined the impact of enforcement of age discrimination laws on the employment and earnings of older male workers The author used a nonexperimental regression model and data from the Current Population Survey to estimate the impact. The study found that males older than 50 in states with age discrimination laws were 0.2 percentage points less likely to be hired compared with those in states without their own age discrimination laws. The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the state laws on age discrimination, but other factors might also have contributed.","Age Discrimination Employment Act (ADEA)","Older workers' programs Other disparities or discrimination in employment and earnings","Adult, Older worker, Male",,"United States",2008,https://www.jstor.org/stable/10.1086/589670?seq=1#page_scan_tab_contents,"Employment and Training Review Protocol" "Supported employment for middle-aged and older people with schizophrenia.","Twamley, E., Narvaez, J., Becker, D., Bartels, S., & Jeste, D. (2008). Supported employment for middle-aged and older people with schizophrenia. American Journal of Psychiatric Rehabilitation, 11(1), 76-89.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study examined the impact of Individual Placement and Support (IPS) on competitive employment for older people with schizophrenia The study was a randomized controlled trial (RCT) and used weekly work logs cross-referenced with pay stubs to measure employment outcomes over a 12-month period. The study found that IPS increased competitive employment and earnings compared with conventional services. The quality of causal evidence presented in this report is low because the RCT has a confounding factor. This means we are not confident that the estimated effects are attributable to the IPS program; other factors are likely to have contributed.","Individual Placement and Support and Vocational Rehabilitation Program","Health Individuals facing barriers to employment Job search assistance and supportive services","Adult, Older worker, Disability",,"United States",2008,https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2638571/,"Employment and Training Review Protocol" "Improving employment outcomes of individuals with disabilities through short-term postsecondary training","Flannery, K. B., Yovanoff, P., Benz, M. R., & Kato, M. M. (2008). Improving employment outcomes of individuals with disabilities through short-term postsecondary training. Career Development for Exceptional Individuals, 31(1), 26-36.","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of an occupational skills training program on employment and earnings outcomes. The study used statistical methods to compare the outcomes of people who successfully completed the occupational skills training program with the outcomes of a comparison group of people who dropped out of the program during the same period. The authors used data from the Oregon State Employment Division, the Oregon Office of Vocational Rehabilitation Services, and a database housed at the occupational skills training site. The study found that participants who successfully completed the occupational skills training program had a higher employment rate, worked more hours, and had higher earnings than those who dropped out of the program. The quality of causal evidence provided in this study is low because the authors did not ensure that the groups being compared were similar before the intervention.","the occupational skills training program","Work based and other occupational training",Disability,,"United States",2008,https://doi.org/10.1177%2F0885728807313779,"Employment and Training Review Protocol" "Initial impacts of the Ticket to Work program on Social Security disability beneficiary service enrollment, earnings, and bene","Wittenburg, D., Fraker, T., Stapleton, D., Thornton, C., Gregory, J., & Mamun, A. (2007). Initial impacts of the Ticket to Work program on Social Security disability beneficiary service enrollment, earnings, and benefits. Journal of Vocational Rehabilitation, 27, 129–140.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages","Summary: The study’s objective was to determine the effectiveness of Ticket to Work (TTW), a program designed to enhance the employment services available to Supplemental Security Income (SSI) and Social Security Disability Insurance (SSDI) recipients. The authors analyzed the outcomes of a nationwide sample of 4.7 million SSI and SSDI recipients ages 18 to 57 who would have been eligible for TTW in 2001. The authors used administrative records through 2004 from the Social Security Administration (SSA) and Rehabilitation Services Administration (RSA). The study found that enrollment in employment services increased 0.1 to 0.4 percent in states where TTW was in effect. However, the authors found no evidence of increased earnings as a result of TTW. The quality of the causal evidence presented in this study is moderate, the highest possible rating for nonexperimental designs. This means we have some confidence that the observed effects represent the impact of TTW, although other factors might also have contributed.","Ticket to Work","Disability insurance Supplemental security income (SSI) Vocational rehabilitation",Disability,,"United States",2007,,"Disability Employment Policy Review Protocol" "Compensation of veterans with psychiatric or substance abuse disorders and employment and earnings","Greenberg, G. A., & Rosenheck, R. A. (2007). Compensation of veterans with psychiatric or substance abuse disorders and employment and earnings. Military Medicine, 172(2), 162-168.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Unfavorable impacts Employment","Summary: The study’s objective was to examine the impact of the Veterans Affairs (VA) Compensation Program on employment for veterans with service-connected disabilities. This study compared employment outcomes for two groups of veterans: (1) disabled veterans receiving VA compensation and (2) nondisabled veterans not receiving disability compensation. To do this, the study team combined data from two national surveys: the Survey of Disabled Veterans and the National Survey of Veterans. Veterans receiving benefits of more than $800 per month from the VA Compensation Program were significantly less likely to be employed than were nondisabled veterans. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the VA Compensation Program; other factors likely contributed to the findings.","the VA Compensation Program","Disability insurance Veterans' reemployment","Disability, Veteran or military",,"United States",2007,https://academic.oup.com/milmed/article/172/2/162/4578021,"Employment and Training Review Protocol" "Labor market shocks and retirement: Do government programs matter?","Coile, C., & Levine, P. (2007). Labor market shocks and retirement: Do government programs matter? Journal of Public Economics, 91(10), 1902-1919.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-No impacts Employment Public benefits receipt-Low-No impacts Public benefit receipt","Summary: The study examined the impact of the generosity of unemployment insurance (UI) benefits on retirement decisions. The study used a statistical model and data from the March Current Population Survey for 1980–2004 to estimate impacts. The study found no relationship between the generosity of UI benefits and the likelihood of retirement or receipt of UI. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before changes in the generosity of UI benefits were observed. This means we are not confident that the estimated effects are attributable to changes in the generosity of UI benefits; other factors are likely to have contributed.","Unemployment Insurance (UI)","Unemployment Insurance","Adult, Older worker, Unemployed",,"United States",2007,http://academics.wellesley.edu/Economics/Coile/PDF%20files/coile-levine%20JPubE…,"Employment and Training Review Protocol" "Long-Term Employment Trajectories Among Participants With Severe Mental Illness in Supported Employment","Becker, Deborah, Whitley, Rob, Bailey, Edward, & Drake, Robert. (2007). Long-Term Employment Trajectories Among Participants With Severe Mental Illness in Supported Employment. Psychiatric Services, 58, 922-928.","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: This exploratory study reinterviewed 38 participants in two supported employment studies 8 to 12 years later to examine their long-term employment trajectories. Both groups were adults with psychiatric disabilities who had participated in one of the earlier studies of individual placement and support services. Quantitative and qualitative analyses of data from the semistructured surveys were conducted, using a grounded theory approach. The study found positive employment trajectories; all 38 participants worked at least one job during the follow-up period, a great majority in competitive jobs, and 71 percent worked for more than half of the follow-up years. A great majority also continued to receive benefits at the time of the follow-up: 34 (89 percent) were receiving Social Security, 10 (26 percent) received Supplemental Security Insurance, and 28 (74 percent) received Social Security Disability Income. Three themes emerged from the qualitative analysis: (1) the persistent and pervasive nature of participants’ psychiatric problems, the importance of successful management of symptoms, and the deployment of appropriate coping skills in finding and maintaining work; (2) a strong preference by participants for part-time work because of the lesser demands and the ability to maintain Social Security and health care entitlements; and (3) the importance expressed by participants of ongoing individual placement and support services.",,"Disability insurance Supplemental security income (SSI) Supported employment or other employment supports",Disability,,"United States",2007,,"Disability Employment Policy Review Protocol" "Can SSDI and SSI beneficiaries with mental illness benefit from evidence-based supported employment?","Bond, G., Xie, H., & Drake, R. (2007). Can SSDI and SSI beneficiaries with mental illness benefit from evidence-based supported employment? Psychiatric Services, 58(11), 1412-1420.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to determine whether supported employment programs improved employment outcomes for Social Security Disability Insurance (SSDI) and Supplemental Security Income (SSI) recipients with psychiatric disabilities. Supported employment interventions use a combination of employment and health services and supports to improve employment and other outcomes. This study aggregated data from randomized controlled trials in four sites: New Hampshire, Connecticut, Illinois, and Washington, D.C. Study data sources included baseline interviews and 18-month follow-up data from each site. The study found that, across all recipient types, the programs increased the probability of employment, the number of weeks worked, and the number of weeks worked at a single job by a statistically significant margin. The quality of causal evidence provided in this study is low. This means that we cannot be confident that the estimated effects are attributable to the support employment interventions; other factors are likely to have contributed.","Supported Employment Programs","Disability insurance Supplemental security income (SSI) Supported employment or other employment supports",Disability,,"United States",2007,,"Disability Employment Policy Review Protocol" "The Employment Retention and Advancement project: Results from the Personal Roads to Individual Development and Employment (PRIDE) program in New York City","Bloom, D., Miller, C., and Azurdia, G. (2007). The Employment Retention and Advancement project: Results from the Personal Roads to Individual Development and Employment (PRIDE) program in New York City. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Unfavorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Personal Roads to Individual Development and Employment (PRIDE) welfare-to-work program in New York City on the employment, earnings, and public benefits receipt of low-income single parents with physical or mental health problems that limited their ability to work. The study was a randomized controlled trial that used data from administrative records for the two years following assignment and a survey conducted with a random subset of the sample to assess outcomes one year after assignment. The study found that treatment group participants were significantly more likely than control group participants to have had a job and had higher average earnings. The treatment group was significantly less likely to receive cash assistance and received lower amounts of cash assistance benefits than the control group. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to PRIDE and not to other factors.","Personal Roads to Individual Development and Employment (PRIDE)","Other employment and reemployment","Disability, Low income, Parent",,"United States, Urban",2007,http://www.acf.hhs.gov/sites/default/files/opre/era_pride.pdf,"Employment and Training Review Protocol" "A tax on work for the elderly: Medicare as a secondary payer.","Goda, G. S., Shoven, J. B., & Slavov, S. N. (2007). A tax on work for the elderly: Medicare as a secondary payer. (NBER Working Paper No. 13383). Cambridge, MA: National Bureau of Economic Research.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of Medicare as a Secondary Payer (MSP) on older workers’ labor force participation and full-time employment The study used a nonexperimental regression design. The authors used data from the 1980 to 2006 March Supplement of the Current Population Survey. The study found that labor force participation for older males increased following the enforcement of the MSP policy, and that older males and females in the labor force were more likely to be employed full time after the policy was enforced. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention, and confounding factors could have impacted older workers differentially during the time periods examined. This means we are not confident that the estimated effects are attributable to MSP; other factors are likely to have contributed.","Medicare as a Secondary Payer","Federal retirement benefits Older workers' programs","Adult, Older worker",,"United States",2007,https://www.nber.org/papers/w13383,"Employment and Training Review Protocol" "Evaluation of LA’s HOPE: Ending chronic homelessness through employment and housing—Final report.","Burt, M. (2007). Evaluation of LA’s HOPE: Ending chronic homelessness through employment and housing—Final report. Washington, DC: U.S. Department of Housing and Urban Development and U.S. Department of Labor.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence",,"Summary: The study’s objective was to examine the impact of Los Angeles’ Homeless Opportunity Providing Employment (HOPE) program on employment, housing, and income. The study used a quasi-experimental design in which the authors compared participants in the HOPE program with participants in other programs that provided many of the same services but not its specialized housing and employment resources. The authors presented direct comparisons, as well as comparisons that adjusted for the groups’ differences in age, race, mental health diagnoses, and recent experience of homelessness and incarceration. This review was conducted in collaboration with the Employment Strategies for Low-Income Adults Evidence Review (ESER). Because ESER did not report findings for studies that received a low causal evidence rating, the CLEAR profile does not report the findings either. The quality of causal evidence presented in this report is low because the author did not account for differences between members of the program and comparisons groups or show that they were similar when they joined the study. This means we are not confident that the estimated effects are attributable to Los Angeles’ HOPE program; other factors are likely to have contributed.","Los Angeles’ Homeless Opportunity Providing Employment (HOPE)","Other employment and reemployment","Low income, Homeless, Disability",,"United States",2007,http://www.urban.org/sites/default/files/alfresco/publication-pdfs/411631-Evalu…,"Employment and Training Review Protocol" "Final evaluation report of the SSI Work Incentives Demonstration Project","Kregel, J. (2006). Final evaluation report of the SSI Work Incentives Demonstration Project. Richmond, VA: State Partnership Systems Change Initiative Project Office, Virginia Commonwealth University.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-No impacts Employment","Summary: The study’s objective was to measure employment and earnings impacts for the four State Partnership Initiative (SPI) sites that implemented the Supplemental Security Income (SSI) Work Incentives Demonstration Project, also known as the SSI Waiver Demonstration Project. The author compared the outcomes of SSI Waiver Demonstration Project participants with those of nonparticipants using data from SPI project offices and Unemployment Insurance (UI) administrative records. The study found that during the intervention delivery period, SSI Waiver Demonstration Project participants’ earnings increased relative to (1) people at the same sites who chose not to participate in the demonstration and (2) people at other SPI sites that did not implement the demonstration. The quality of the causal evidence presented in this report is low because the study was a nonexperimental analysis that did not include adequate controls for underlying differences between the groups being compared. This means we are not confident that the estimated effects are attributable to the SSI Waiver Demonstration Project. Other factors are likely to have contributed.","the SSI Work Incentives Demonstration Project","Supplemental security income (SSI)",Disability,,"United States",2006,http://www.google.com/url?sa=t&rct=j&q=&esrc=s&frm=1&source=web&cd=1&cad=rja&ua…,"Disability Employment Policy Review Protocol" "New evidence on earnings and benefit claims following the changes in the retirement earnings test in 2000.","Song, J. G., & Manchester, J. (2006). New evidence on earnings and benefit claims following the changes in the retirement earnings test in 2000. (ORES Working Paper 107). Washington, DC: Social Security Administration, Office of Policy, Office of Research, Evaluation, and Statistics. Also available in Journal of Public Economics, 91(3–4), 669–700 (2007).","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Low-No impacts Employment Public benefits receipt-Mod/high-Unfavorable impacts Public benefit receipt","Summary: The study examined the impact of the Senior Citizens Freedom to Work Act of 2000 on employment, earnings, and public benefit receipt outcomes of workers ages 65 to 69. The study was a nonexperimental analysis and used Social Security Administrative data to estimate the impacts. The study found that the Senior Citizens Freedom to Work Act of 2000 was associated with significant increases in the rate of Social Security claims for both sets of individuals affected by the law. The study found no statistically significant relationship between the Senior Citizens Freedom to Work Act of 2000 and earnings. The quality of casual evidence presented in this report for Social Security claims and earnings outcomes is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the Senior Citizens Freedom to Work Act of 2000, but other factors might also have contributed. The quality of causal evidence presented in this report on employment is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to the Senior Citizens Freedom to Work Act of 2000; other factors are likely to have contributed.","Senior Citizens Freedom to Work Act of 2000","Older workers' programs Other disparities or discrimination in employment and earnings","Adult, Older worker",,"United States",2006,,"Employment and Training Review Protocol" "Effect of benefits counseling services on employment outcomes for people with psychiatric disabilities","Tremblay, T., Smith, J., Xie, H., & Drake, R. (2006). Effect of benefits counseling services on employment outcomes for people with psychiatric disabilities. Psychiatric Services, 57(6), 816-821.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages","Summary: The studies’ objective was to measure the earnings impacts of the Vermont Work Incentive Initiative (VWII), which provided customized benefits counseling to Social Security disability benefit recipients who were receiving vocational rehabilitation (VR) services. Services offered by the VWII participants varied, but could consist of benefits screening, explanations of work incentives, and case management. The studies used earnings data collected from the Vermont Department of Employment and Training. The treatment groups received VWII services and possibly other VR services, whereas the comparison groups received VR services excluding benefits counseling services. The quasi-experimental evaluation employed matched comparison groups and measured impacts using a mixed-effects linear model. VWII was correlated with significant increases in mean earnings for the treatment group—averaging about $1,250 per year among participants with psychiatric disabilities and about $760 to $900 per year among all participants. These studies receive a low causal evidence rating because they did not adequately demonstrate baseline equivalence between the treatment and comparison groups or control in the analysis for key factors. A low causal evidence rating means that we are not confident that the estimated effects are attributable to the VWII and other factors likely played a role.","the Vermont Work Incentive Initiative","Disability insurance Supplemental security income (SSI) Vocational rehabilitation",Disability,,"United States",2006,,"Disability Employment Policy Review Protocol" "Net impact and benefit-cost estimates of the workforce development system in Washington State. Upjohn Institute technical report no. TR06-020. [Dept. of Services for the Blind]","Hollenbeck, K., & Huang, W. (2006). Net impact and benefit-cost estimates of the workforce development system in Washington State. Upjohn Institute technical report no. TR06-020. Kalamazoo, MI: W. E. Upjohn Institute for Employment Research. [Dept. of Services for the Blind]","Apprenticeship and Work-Based Training","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of the Department of Services for the Blind (DSB) program on the employment rate and earnings of low-income adults who are blind. The authors used a nonexperimental method to compare the short-term (3 quarters after program exit) and long-term (9 to 12 quarters after program exit) employment and earnings between those who took part in the DSB program relative to those who were eligible but did not receive these services. The study found that, compared with those who did not receive these services, DSB program participants had significantly higher employment and earnings. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups compared were similar before program participation. This means we are not confident that the estimated effects are attributable to the DSB program; other factors are likely to have contributed. This study also examined the effectiveness of other workforce development programs. Please click here to find CLEAR profiles of those studies.","the Department of Services for the Blind (DSB) Program","Unemployment Insurance Vocational rehabilitation",Disability,,"United States",2006,http://research.upjohn.org/cgi/viewcontent.cgi?article=1023&context=up_technica…,"Employment and Training Review Protocol" "State Partnership Initiative: Selection of comparison groups for the evaluation and selected impact estimates: Final report","Peikes, D., Orzol, S., Moreno, L., & Paxton, N. (2005). State Partnership Initiative: Selection of comparison groups for the evaluation and selected impact estimates: Final report. Princeton, NJ: Mathematica Policy Research.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Unfavorable impacts Earnings and wages Employment-Mod/high-Unfavorable impacts Employment","Summary: The study’s objective was to measure short-term impacts for the three State Partnership Initiative (SPI) sites whose effectiveness was evaluated using a randomized controlled trial. SPI was meant to increase employment and earnings for Supplemental Security Income (SSI) and Social Security Disability Insurance (SSDI) beneficiaries through the provision of direct services. The study’s data were collected from Social Security Administration (SSA) administrative data and the Summary Earnings Record (SER). The authors estimated program impacts on employment and earnings. The study found that SPI had negative and statistically significant impacts on employment and earnings, contrary to the initiative’s intent. The quality of causal evidence presented in this report is high because it is based on a well-conducted randomized controlled trial. This means we are confident that the effects estimated in the study are attributable solely to the SPI, and not to other factors.","the State Partnership Initiative","Supplemental security income (SSI) Disability insurance",Disability,,"United States",2005,http://www.mathematica-mpr.com/~/media/publications/PDFs/SPIselectimpact.pdf,"Disability Employment Policy Review Protocol" "Results of a multisite randomized trial of supported employment interventions for individuals with severe mental illness","Cook, J., Leff, H., Blyler, C., Gold, P., Goldberg, R., Mueser, K., Toprac, M., McFarlane, W., Shafer, M., Blankertz, L., Dudek, K., Razzano, L., Grey, D., & Burke-Miller, J. (2005). Results of a multisite randomized trial of supported employment interventions for individuals with severe mental illness. Archives of General Psychiatry, 62, 505-512.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to estimate the 24-month employment effects of supported employment on people with severe mental illness. Supported employment interventions use a combination of employment and health services and supports to improve employment and other outcomes.  The authors analyzed data from seven sites, each of which implemented a distinct supported employment intervention using a randomized controlled trial. At each site, researchers interviewed participants in person twice yearly and collected weekly employment data. The supported employment interventions had a significant and positive impact on employment, working for 40 or more hours in a single month, and monthly earnings from paid employment. The quality of causal evidence provided in this study is moderate. This means we are somewhat confident that the estimated effects are attributable to the supported employment interventions, but other factors might also have contributed.","Supported Employment Programs","Health Supported employment or other employment supports Vocational rehabilitation",Disability,,"United States",2005,,"Disability Employment Policy Review Protocol" "Employment outcomes and PTSD symptom severity","Smith, M., Schnurr, P., & Rosenheck, R. (2005). Employment outcomes and PTSD symptom severity. Mental Health Services Research, 7(2), 89-101.","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: The authors assessed the relationship between male Vietnam-era veterans’ scores on the Clinician-Administered Post-Traumatic Stress Disorder (PTSD) Scale (CAPS), a clinically administered scale of PTSD severity, and their employment and earnings. The authors analyzed a data set containing demographic characteristics, PTSD symptom severity, employment status, and earnings for 325 male Vietnam-era veterans ages 18 to 54. The authors used a multinomial logistic regression framework to estimate the marginal effect of PTSD severity on three categories of employment—no employment, part-time employment, and full-time employment—and a Heckman selection model to estimate effects on earnings. The study found that a 10-point increase in the CAPS score was associated with a 5.9 percentage point increase in the probability of unemployment, a 2.1 percentage point decrease in the probability of part-time employment, and a 3.8 percentage point decrease in the probability of full-time work.",,,"Disability, Veteran or military",,"United States",2005,,"Disability Employment Policy Review Protocol" "The effect of the SSI program on labor supply: Improved evidence from Social Security administrative files","Neumark, D., & Powers, E. T. (2005). The effect of the SSI program on labor supply: Improved evidence from Social Security administrative files. Social Security Bulletin, 65(3), 45-60.","Older Workers","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Favorable impacts Employment","Summary: The study examined the relationship between generous state Supplemental Security Income (SSI) benefits and the employment of older worker nearing SSI eligibility age. The authors used a regression model and data from the Survey of Income and Program Participants (SIPP) and Social Security Administration (SSA) to estimate the effect. The study found that older males who were likely SSI participants in generous states worked significantly fewer hours and had lower employment rates compared with those living in less generous states. The authors, using the SSA administrative records, also found that likely older participants (ages 60 to 64) worked significantly fewer hours than younger ones. The quality of causal evidence presented in this report is low because the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to generosity of state SSI benefits; other factors are likely to have contributed.","state Supplemental Security Income (SSI) benefits","Older workers' programs Other employment and reemployment","Adult, Older worker",,"United States",2005,https://www.ssa.gov/policy/docs/ssb/v65n3/v65n3p45.html,"Employment and Training Review Protocol" "Participation in Programs Designed to Improve Employment Outcomes for Persons with Psychiatric Disabilities: Evidence from the New York WORKS Demonstration Project","Ruiz-Quintanilla, Antonio S., Weathers II, Robert R., Melburg, Valerie, Campbell, Kimberly, & Madi, Nawaf. (2005). Participation in Programs Designed to Improve Employment Outcomes for Persons with Psychiatric Disabilities: Evidence from the New York WORKS Demonstration Project. Social Security Bulletin, 66(2), 49–79.","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: This study used a sequential response model of conditional probabilities to examine the impact of characteristics of Supplemental Security Income (SSI) recipients on participation in the New York WORKS project. The analysis showed how individual characteristics were related to responses at each of four stages of the program recruitment process and how they contributed to the overall likelihood of enrollment. New York WORKS targeted people with a primary medical diagnosis of psychiatric illness. Characteristics examined in the study for their relationship to completion of enrollment included demographics, psychiatric diagnosis, and past employment and earnings. The study found that the relationship between the characteristics of SSI recipients and the outcomes at each stage of the recruitment process contributed to the overall likelihood of enrollment.",,"Disability insurance Supplemental security income (SSI)",Disability,,"United States",2005,,"Disability Employment Policy Review Protocol" "A Ten-Year Follow-Up of a Supported Employment Program","Salyers, Michelle P, Becker, DR, Drake RE, Torrey WC, and Wyzick PF (2004). A Ten-Year Follow-Up of a Supported Employment Program. Psychiatric Services, 55(3), 302–308.","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: The objective of this study was to examine the outcomes of supported employment 10 years after an initial demonstration project. Authors interviewed 36 of 62 clients who had participated in 1990 or 1992 in a supported employment program at one of two mental health centers located in rural areas. Although few of the 36 clients made the transition to full-time employment with health benefits, 75 percent of them worked beyond the initial study period and 35 percent worked during at least 5 years of the 10-year follow-up period. Current and recent jobs tended to be competitive (that is, not reserved for people with disabilities), with an average tenure of 32 months. Clients reported that employment led to substantial benefits in diverse areas, such as improvements in self-esteem, hope, relationships, and control of substance abuse.",,"Supported employment or other employment supports",Disability,,"United States",2004,,"Disability Employment Policy Review Protocol" "The effects of the Americans with Disabilities Act: A longitudinal model analysis","Moon, S., Chung, K, & Yang, D. (2003). The effects of the Americans with Disabilities Act: A longitudinal model analysis. Clinical Research and Regulatory Affairs, 20(4), 433-445.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Mixed impacts Employment","Summary: The study’s objective was to examine the impact of the Americans with Disabilities Act (ADA), both the original 1992 legislation and its 1994 extension, on working hours and employment among men with disabilities.  The authors applied a multiple regression model to panel data from the 1989–1995 Survey of Income and Program Participation (SIPP). The study found that working hours and employment decreased on average among all men with disabilities, regardless of their labor force participation, relative to men without disabilities after the ADA was first implemented in 1992. In contrast, relative working hours and employment increased for labor force participants who self-reported a disability after the law’s 1994 extension went into effect. The quality of causal evidence presented in this report is low because the authors did not control for possible disparities in pre-intervention trends in working hours and employment among men with and without disabilities. This means we are not confident that the estimated effects are attributable to the ADA; other factors are likely to have contributed.","the Americans with Disabilities Act of 1990","Americans with Disabilities Act (ADA)","Disability, Male",,"United States",2003,,"Employer Compliance Review Protocol" "Impact of public support payments, intensive psychiatric community care, and program fidelity on employment outcomes for people with severe mental illness","Resnick, S., Neale, M., & Rosenheck, R. (2003). Impact of public support payments, intensive psychiatric community care, and program fidelity on employment outcomes for people with severe mental illness. The Journal of Nervous and Mental Disease, 191(3), 139-144.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to evaluate the one-year impacts of a Department of Veterans Affairs (VA) model of assertive community treatment for veterans with serious mental illnesses known as Intensive Psychiatric Community Care (IPCC). The study was based on a randomized controlled trial. Roughly half of the 528 veterans participating in the study were randomly assigned to receive the IPCC treatment while the other half received standard VA services. The authors analyzed self-reported employment data collected from participants one year after random assignment. The study found that veterans in the IPCC group were three times more likely to be employed one year after random assignment than veterans in the control group. The quality of the causal evidence presented in this report is high because it is based on a well-conducted randomized controlled trial. This means we have confidence that the estimated effects are attributable to the IPCC program, and not other factors.","Intensive Psychiatric Community Care (IPCC)","Veterans' reemployment Vocational rehabilitation","Disability, Veteran or military",,"United States",2003,,"Disability Employment Policy Review Protocol" "Impact of public support payments, intensive psychiatric community care, and program fidelity on employment outcomes for people with severe mental illness","Resnick, S., Neale, M., & Rosenheck, R. (2003). Impact of public support payments, intensive psychiatric community care, and program fidelity on employment outcomes for people with severe mental illness. The Journal of Nervous and Mental Disease, 191(3), 139-144.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-Unfavorable impacts Employment","Summary: The study evaluated the one-year impacts of a U.S. Department of Veterans Affairs (VA) model of assertive community treatment for veterans with serious mental illnesses known as Intensive Psychiatric Community Care (IPCC) on employment. The study conducted a randomized controlled trial (RCT); those randomly assigned to the treatment group were eligible to receive the IPCC services, whereas those randomly assigned to the control group could not access IPCC services but could use other available health- and workforce-related services from the VA. The authors analyzed outcomes based on self-reported employment data collected from participants one year after random assignment. The study found that 7 percent of veterans in the IPCC group were employed one year after random assignment compared to 11 percent of veterans in the control group. The authors did not report the statistical significance of this difference. The quality of the causal evidence presented in this report is high because it was based on a well-conducted RCT. This means we have confidence that the estimated effects are attributable to the IPCC program and not other factors.","Intensive Psychiatric Community Care (IPCC)","Health Job search assistance and supportive services Veterans' reemployment Basic skills","Disability, Veteran or military",,"United States",2003,https://journals.lww.com/jonmd/Abstract/2003/03000/IMPACT_OF_PUBLIC_SUPPORT_PAY…,"Employment and Training Review Protocol" "Consequences of employment protection? The case of the Americans with Disabilities Act.","Acemoglu, D., & Angrist, J. (2001). Consequences of employment protection? The case of the Americans with Disabilities Act. Journal of Political Economy, 109(5), 915-957.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-No impacts Earnings and wages Employment-Mod/high-Unfavorable impacts Employment","Summary: The study’s objective was to examine the consequences of the Americans with Disabilities Act (ADA) on the employment and wages of people with disabilities. The main analysis estimated regression models of weeks worked and weekly earnings as a function of self-reported work disability status, allowing effects to differ each year and controlling for factors relating to demographics, region, and time. Data came from the 1988–1997 March Current Population Survey. The study found that a year after the ADA came into effect (1993), the employment of men and women ages 21 to 39 with disabilities declined and this change could not be explained by potential changes in how individuals reported disability status or by increases in Supplemental Security Income (SSI) or Old-Age, Survivors, and Disability Income (OASDI). The quality of causal evidence presented in this report is moderate because it was based on a well-implemented nonexperimental design. This means we are somewhat confident that the estimated effects are attributable to the ADA, but other factors might also have contributed.","the Americans with Disabilities Act of 1990","Americans with Disabilities Act (ADA)",Disability,,"United States",2001,,"Employer Compliance Review Protocol" "Changes in wage discrimination against people with disabilities.","DeLeire, T. (2000). Changes in wage discrimination against people with disabilities: 1984–93. The Journal of Human Resources, 37(1), 144-158.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Unfavorable impacts Earnings and wages","Summary: The study’s objective was to estimate changes in wage discrimination against people with disabilities before and after the Americans with Disabilities Act of 1990 (ADA).  The author used data from the 1984, 1992, and 1993 panels of the Survey of Income and Program Participation to compare earnings for people who reported functional and work limitations, people who reported only functional limitations, and people who reported no limitations. The percentage of the gap between the first two groups that was not explained by control variables and self-reported health status was attributed to discrimination, and that percentage was compared between 1984 and 1993 to estimate the effect of the ADA. The study found earnings gaps between people with no disabilities and those with work limitations and/or functional limitations in each year, and the share of the gap explained by discrimination rose slightly after passage of the ADA. The quality of causal evidence provided in this study is low. This means that we are not confident that the estimated effects were attributable to the passage of the ADA; other factors are likely to have contributed.","the Americans with Disabilities Act of 1990","Americans with Disabilities Act (ADA)",Disability,,"United States",2000,,"Employer Compliance Review Protocol" "The unintended consequences of the Americans with Disabilities Act","DeLeire, T. (2000). The unintended consequences of the Americans with Disabilities Act. Regulation 23(1), 21–24.","Employer Compliance","Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Employment-Low-Unfavorable impacts Employment","Summary: The study’s objective was to examine the effect of the Americans with Disabilities Act (ADA) on the employment rate for men with disabilities. Using data from the Survey of Income and Program Participation from 1985 to 1995, the author compared the change in employment for men with disabilities ages 18 to 65 pre- and post-ADA with the change in employment for men without disabilities over the same period. The study found that the employment rate for men with disabilities was 8 percentage points lower relative to men without disabilities after ADA, with particularly large differences for those with mental disabilities or low education levels. The quality of causal evidence provided in this study is low. This means that we are not confident that the estimated effects are attributable to the ADA; other factors are likely to have contributed.","the Americans with Disabilities Act of 1990","Americans with Disabilities Act (ADA)","Disability, Male",,"United States",2000,,"Employer Compliance Review Protocol" "Cognitive rehabilitation for traumatic brain injury: A randomized trial","Salazar, A., Warden, D., Schwab, K., Spector, J., Braverman, S., Walter, J., . . . Ellenbogen, R. (2000). Cognitive rehabilitation for traumatic brain injury: A randomized trial. Journal of American Medical Association, 283(23), 3075-3081.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-No impacts Employment","Summary: The study’s objective was to examine the impact of in-hospital and home rehabilitation programs on the employment and health status of active duty military members with severe traumatic brain injuries (TBIs). The study was a randomized controlled trial conducted at the Walter Reed Army Medical Center, where 120 active duty military members with TBI were randomly assigned to receive either in-hospital rehabilitation or home rehabilitation. Researchers collected outcome data 8 weeks and 6, 12, and 24 months after randomization. Although the study authors originally hypothesized that in-hospital rehabilitation would increase the rates of patients who were able to return to work or able to return to active duty, the study found no statistically significant difference between the two groups on these outcomes. The quality of the causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any differences in outcomes would be attributable to the more effective program; however, there were no statistically significant differences between the programs.","the In-hospital and Home Rehabilitation Programs Studied","Vocational rehabilitation","Disability, Veteran or military",,"United States",2000,,"Disability Employment Policy Review Protocol" "Impacts of the Project NetWork Demonstration: Final Report","Kornfeld R.., Wood M. L., Orr L. L., & Long D. A. (1999). Impacts of the Project NetWork Demonstration: Final Report. Cambridge, MA: Abt Associates, Inc.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Health and safety-Mod/high-No impacts Health and safety Public benefits receipt-Low-No impacts Public benefit receipt","Summary: This study’s objective was to report impacts for Project NetWork. Created by the Social Security Administration (SSA), Project NetWork tested specific approaches to improving employment among Social Security Disability Insurance (SSDI) recipients and Supplemental Security Income (SSI) applicants and recipients, with a particular focus on case and referral management systems.  The study used multiple data sources, including the Master Earnings File (MEF), Master Beneficiary Record (MBR), Supplemental Security Record (SSR), and survey data collected 25 to 36 months after enrollment. The study found that Project NetWork increased earnings one and two years after enrollment, but these effects did not persist in the third follow-up year. The program led to a slight increase in the average number of months employed, but no changes in participants’ Social Security disability benefit receipt, health, or well-being. The quality of causal evidence presented in this study is considered high for the annual earnings, proportion of months receiving SSI/SSDI benefits, and average monthly SSI/SSDI benefits outcomes measured through administrative data because they are based on a well-implemented randomized controlled trial with low attrition. However, the quality of causal evidence is moderate for annual earnings, hours and months worked, and mental and physical health outcomes due to high attrition for these domains.","Project NetWork","Health Disability insurance Supplemental security income (SSI) Vocational rehabilitation Health Disability insurance Supplemental security income (SSI) Vocational rehabilitation",Disability,,"United States",1999,http://www.abtassociates.com/reports/19994080203411.pdf,"Disability Employment Policy Review Protocol" "Case management at work for SSA disability beneficiaries: process results of the Project NetWork","Leiter, V., & Wood, M.L. (1997). Case management at work for SSA disability beneficiaries: process results of the Project NetWork. Social Security Bulletin, 60 (1), 29–57.","Disability Employment Policy","Study Type: Implementation Analysis",,,"Summary: This article summarized the results of a process evaluation of Project NetWork, a demonstration launched by the Social Security Administration (SSA) to test various strategies for providing vocational rehabilitation (VR) services to its disability insurance beneficiaries as well as blind and disabled applicants for and recipients of Supplemental Security Income benefits. The study, which was part of an evaluation that also included impact and cost analyses, assessed the feasibility of providing VR services to SSA beneficiaries with severe disabilities. It drew on interviews with program staff, management information system data, and a variety of program documents to examine the roll-out and implementation of four models of service delivery, each implemented at two sites. The authors determined that it was feasible to recruit people with severe disabilities for a rehabilitation program and provide the range of required services. Models with varying institutional arrangements were equally successful in attracting the interest of this population and arranging for the services they needed to meet their vocational goals.","Project NetWork","Disability insurance Supplemental security income (SSI) Vocational rehabilitation",Disability,,"United States",1997,http://www.ssa.gov/policy/docs/ssb/v60n1/v60n1p29.pdf,"Disability Employment Policy Review Protocol" "An exploratory cost-benefit analysis of natural support strategies in the employment of people with severe disabilities","Zivolich, S., Shueman, S.A., & Weiner, J.S. (1997). An exploratory cost-benefit analysis of natural support strategies in the employment of people with severe disabilities. Journal of Vocational Rehabilitation, 8, 211–221.","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: Natural support programs use existing job-site routines, people, and methods, rather than job coaches, to assist workers with severe disabilities. This exploratory cost-benefit analysis used data from the first 59 of 110 people employed through a grant program using natural supports to estimate costs and benefits to participants, taxpayers, and society. Benefits were estimated from relevant combinations of earnings, taxes, Supplemental Security Income benefits (transfers) and administrative costs, and savings from a most likely alternative program, rather than from impact estimates derived from experimental evaluation. Under this approach, results suggested substantive benefits to participants, taxpayers, and society for a natural support approach, and the superiority of this approach over the traditional sheltered workshop (job coaching) model.",,"Disability insurance Supplemental security income (SSI) Supported employment or other employment supports",Disability,,"United States",1997,,"Disability Employment Policy Review Protocol" "Effective employment services for persons with mental retardation","Decker, Paul T., and Thornton, Craig. (1996). Effective employment services for persons with mental retardation. Journal of Vocational Rehabilitation 7, 29-40.","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: This study combined data from an impact evaluation and an associated process study of the Transitional Employment Intervention (TEI) to identify effective supported employment services for people with mental retardation. TEI randomly assigned eligible Supplemental Security Income recipients to a treatment or control group at eight training agencies serving 13 communities in seven states. All eight agencies implemented the basic demonstration model successfully, although their methods of providing basic services differed, as did their results. Overall, average earnings were substantially higher for people who were enrolled in the demonstration. However, agency-specific estimates varied from large and statistically significant to small and not statistically significant. By comparing the implementing agencies across multiple characteristics identified in the process study, this study found that the most successful programs tailored their services to the needs of each participant, developed jobs in a wide array of occupations, and kept people in the program for a longer period than the other agencies. The implementing agencies persisted in placing participants who lost a job into second, third, or fourth jobs. The study also found cost implications of the successful strategies. Average costs for the three high-impact agencies were approximately $7,000 per enrolled participant, and approximately $6,000 per participant for the three low-impact agencies.",,"Disability insurance Supplemental security income (SSI) Supported employment or other employment supports",Disability,,"United States",1996,,"Disability Employment Policy Review Protocol" "The long-term effects of transitional employment services","Decker, P., & Thornton, C. (1995). The long-term effects of transitional employment services. Social Security Bulletin, 58(4), 71–81.","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment","Summary: The study’s objective was to determine the long-term effects of an intervention designed to improve employment and earnings outcomes among Supplemental Security Income (SSI) recipients with intellectual disabilities. The study was a component of the Transitional Employment Training Demonstration (TETD). The authors examined data from the Supplemental Security Record (SSR) maintained by the Social Security Administration (SSA) and demographic information from intake data collection forms. They estimated impacts on employment, earnings, total income, amount of SSI benefits received, and probability of receiving Social Security Disability Insurance (SSDI) benefits for the six years following enrollment. The study found statistically significant, positive impacts on employment, earnings, and total income over the follow-up period. There were also modest declines in the amount of SSI benefits received. The quality of causal evidence presented in this study is high because it is a well-conducted randomized controlled trial. This means that we are confident that the estimated effects in this study are attributable to the intervention, and not to other factors.","Transitional Employment Training Demonstration","Disability insurance Other training and education Supplemental security income (SSI) Vocational rehabilitation",Disability,,"United States",1995,http://www.ssa.gov/policy/docs/ssb/v58n4/v58n4p71.pdf,"Disability Employment Policy Review Protocol" "Pay and participation in work activity: Clinical benefits for clients with schizophrenia","Bell, M.D., & Milstein, R.M. (1993). Pay and participation in work activity: Clinical benefits for clients with schizophrenia. Psychosocial Rehabilitation Journal, 17(2), 173-176.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: Low Causal Evidence","Earnings and wages-Low-Favorable impacts Earnings and wages Employment-Low-Favorable impacts Employment","Summary: The study’s objective was to examine the impact of a paid supported work program for veterans diagnosed with schizophrenia or schizoaffective disorder on their employment, earnings, wages, and health outcomes. The authors used a randomized controlled trial to compare outcomes of veterans assigned to the paid supported work condition with those assigned to the unpaid work condition using data collected through interviews at baseline and five months later. The authors found that the paid group had higher employment and earnings and fewer depressive symptoms five months after random assignment compared with the unpaid group. The quality of causal evidence presented in this report is low because it was based on a randomized controlled trial in which the analytic sample sizes are unknown, and the authors did not ensure that the groups being compared were similar before the intervention. This means we are not confident that the estimated effects are attributable to paid supported work; other factors are likely to have contributed to the findings.","the Paid Supported Work Program","Health Veterans' reemployment","Disability, Veteran or military",,"United States",1993,https://psycnet.apa.org/doi/10.1037/h0095590,"Employment and Training Review Protocol" "Disability beneficiaries who work and their experience under program work incentives","Muller, L. Scott. (1992). Disability beneficiaries who work and their experience under program work incentives. Social Security Bulletin, 55(2), 2–42.","Disability Employment Policy","Study Type: Descriptive Analysis",,,"Summary: This study used data from the New Beneficiary Survey and claims folders to describe the experiences of recipients’ experiences under Social Security Disability Insurance (DI) work incentive provisions. The analysis found that relatively few DI recipients worked while in benefit status, and considerably smaller numbers had benefit terminations. About 10 percent of people initially entitled to benefits from mid-1980 to mid-1981 were found to have worked while in benefit status over the approximately 10-year period under study. The vast majority (84 percent) of those who worked were granted a trial work period (TWP). Nearly 75 percent of those granted a TWP successfully completed nine months of trial work, yet fewer than half of those who completed the TWP were eventually terminated from the program for substantial gainful activity (SGA). Overall, fewer than 3 percent of this cohort of initial entitlements had SGA terminations and, among this small number, nearly one-third had returned to the rolls by 1990. Recipients most likely to make a work attempt were young and had high levels of education.",,"Disability insurance Supplemental security income (SSI) Other employment and reemployment",Disability,,"United States",1992,http://www.ssa.gov/policy/docs/ssb/v55n2/v55n2p2.pdf,"Disability Employment Policy Review Protocol" "Schizophrenic symptoms, work adjustment, and behavioral family therapy","Glynn, S. M., Randolph, E. T., Eth, S., Paz, G. G., Leong, G. B., Shaner, A. L., & Vort, W. V. (1992). Schizophrenic symptoms, work adjustment, and behavioral family therapy. Rehabilitation Psychology, 37(4), 323-338.",Veterans,"Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Employment-Mod/high-No impacts Employment","Summary: This study examined the impact of behavioral family therapy on male veterans’ employment. The study conducted a randomized controlled trial using data from self-reported responses to the Social Adjustment Scale, Version I. The study showed that behavioral family therapy did not have statistically significant effects on employment. The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that any estimated effects are attributable to behavioral family therapy and not to other factors. However, the study did not show any statistically significant effects.","Behavioral Family Therapy","Health Veterans' reemployment","Disability, Veteran or military",,"United States",1992,,"Employment and Training Review Protocol" "Transitional employment training for SSI recipients with intellectual disabilities.","Prero, A.J., & Thornton, C. (1991). Transitional employment training for SSI recipients with intellectual disabilities. Social Security Bulletin, 54(11), 2-25.","Disability Employment Policy","Study Type: Implementation Analysis",,,"Summary: This article summarized the findings of a process evaluation of the Transitional Employment Training Demonstration, which aimed to transition Supplemental Security Income (SSI) recipients with intellectual disabilities to permanent employment. To achieve this goal, the demonstration provided participants with short-term training for potentially permanent jobs in which they would conduct tasks for their employers and interact with nondisabled colleagues. The study developed findings on recruitment, training, placement, and the provision of other services by collecting data from all eight program sites. It drew on several qualitative sources, such as program staff interviews, observations of service provision, and program documents, as well as a few quantitative sources, including program, survey, and SSI administrative data. The study found that it was feasible to successfully place a wide variety of SSI recipients with intellectual disabilities in mainstream jobs using transitional employment services. However, the programs faced several challenges in program design and implementation. Recruitment and job placement could be difficult, given opinions among caregivers and employers that people with intellectual disabilities cannot perform well in competitive jobs. Job placement was hampered further by the lack of suitable transportation options.","Transitional Employment Training Demonstration","Supplemental security income (SSI) Basic skills Job search assistance and supportive services",Disability,,"United States",1991,http://www.ssa.gov/policy/docs/ssb/v54n11/v54n11p2.pdf,"Disability Employment Policy Review Protocol" "Impacts of transitional employment for mentally retarded young adults: Results of the STETS demonstration","Kerachsky, S., Thornton, C., Bloomenthal, A., Maynard, R. & Stephens, S. (1985). Impacts of transitional employment for mentally retarded young adults: Results of the STETS demonstration. New York: Manpower Demonstration Research Corporation.","Low-Income Adults","Study Type: Causal Impact Analysis","Causal Evidence Rating: High Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages Employment-Mod/high-Favorable impacts Employment Public benefits receipt-Mod/high-Favorable impacts Public benefit receipt","Summary: The study’s objective was to examine the impact of the Structured Training and Employment Transitional Services (STETS) program on employment rates, earnings, and Social Security Disability Income (SSDI) and Supplemental Security Income (SSI) receipt. The STETS program included a suite of work-readiness training, transitional jobs, and postplacement support services for young adults with intellectual disabilities. The study was a randomized controlled trial that randomly assigned young adults to the treatment group, which could participate in the STETS program, or to the control group, which could not. The study drew on data from in-person interviews conducted 6, 15, and 22 months after the start of the program. The study found that young adults in the treatment group were employed at significantly higher rates and, on average, earned more than the control group 15 and 22 months after the program began. The study also found that 15 months after random assignment, the young adults in the treatment group were significantly less likely than those in the control group to receive SSI or SSDI benefits. The quality of causal evidence presented in this report is high because it is based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the STETS program, and not to other factors.","Structured Training and Employment Transitional Services","Job search assistance and supportive services Other employment and reemployment","Disability, Low income",,"United States",1985,http://www.mdrc.org/sites/default/files/impacts_of_transitional_employment_fr.p…,"Employment and Training Review Protocol" "Evaluating the Vocational Rehabilitation Program using longitudinal data: Evidence for a quasi-experimental research design","Dean, D., Dolan, R., & Schmidt, R. (1999). Evaluating the Vocational Rehabilitation Program using longitudinal data: Evidence for a quasi-experimental research design. Evaluation Review, 23(2), 162–189","Disability Employment Policy","Study Type: Causal Impact Analysis","Causal Evidence Rating: Moderate Causal Evidence","Earnings and wages-Mod/high-Favorable impacts Earnings and wages","Summary: The study’s objective was to determine the impact of participation in Vocational Rehabilitation (VR), a state and federal program, on earnings for people with disabilities. VR provides services and supports to people with disabilities to help them achieve their employment goals. The authors analyzed linked Rehabilitation Services Administration (RSA) and Social Security Administration (SSA) data for about 29,000 people whose VR cases were closed in 1980. The linked data contained annual earnings histories, service expenditures, and disability and demographic information. By the eighth year after first receiving VR services, women in six of seven disability categories and men in four of seven disability categories earned significantly more than their counterparts who had not received VR services. The quality of the causal evidence presented in this study is moderate. This means we have some confidence that the observed effects represent the impact of VR, although other factors might also have contributed.","the Vocational Rehabilitation (VOC) Programs","Disability insurance Supplemental security income (SSI) Vocational rehabilitation",Disability,,"United States",,,"Disability Employment Policy Review Protocol"