Skip to main content
UNITED STATES DEPARTMENT OF LABOR

Key

Intervention Evidence Ratings

There are four RESEA intervention causal evidence ratings, which are indicators of intervention effectiveness:

  • High intervention evidence rating

    High

    • At least 2 credible* impact studies each have found…
    • Favorable impacts on employment and UI duration…
    • With a strong degree of statistical significance (p<.05)
  • Moderate intervention evidence rating

    Moderate

    • At least 1 credible* impact study has found…
    • Favorable impacts on employment and (either that same study or another study has found) favorable impacts on UI duration…
    • With a modest degree of statistical significance (p<.10)
  • Potentially promising intervention evidence rating

    Potentially Promising

    • At least 1 impact study (not necessarily credible)…
    • Found favorable impacts on employment or UI duration…
    • With a modest degree of statistical significance (p<.10)
  • No Rating

    No Rating

    • No impact studies of the intervention exist (yet), or
    • Impact studies exist, but none show statistically significant favorable impacts on the specified outcomes (…more research is needed)

* “Credible” impact studies are those that received High or Moderate study causal evidence ratings, which describe the strength of the methods used by the study and how well the study was carried out. These study ratings reflect CLEAR’s level of confidence in the study’s estimates of impacts.

Study Characteristics

These icons indicate important details about a study, such as its type, evidence, and outcome findings:

STUDY TYPE:

  • Causal Analysis (No Rating) Icon

    Causal Impact Analysis

    Uses quantitative methods to assess the effectiveness of a program, policy, or intervention.

  • Descriptive Analysis Icon

    Descriptive Analysis

    Describes a program, policy, or intervention using qualitative or quantitative methods.

  • Implementation Analysis Icon

    Implementation Analysis

    Examines the implementation of a program, policy, or intervention.

CAUSAL EVIDENCE RATING:

  • High Causal Evidence Icon

    High Causal Evidence

    Strong evidence the effects are caused by the examined intervention.

  • Moderate Causal Evidence Icon

    Moderate Causal Evidence

    Evidence that the effects are caused to some degree by the examined intervention.

  • Low Causal Evidence Icon

    Low Causal Evidence

    Little evidence that the effects are caused by the examined intervention.

Outcome Findings

OUTCOME FINDINGS FOR HIGH EVIDENCE STUDY RATING:

  • The study found at least one favorable impact in the outcome domain, and no unfavorable impacts.

    Favorable

    The study found at least one favorable impact in the outcome domain, and no unfavorable impacts.

  • The study found some favorable and some unfavorable impacts in the outcome domain.

    Mixed

    The study found some favorable and some unfavorable impacts in the outcome domain.

  • The study found no statistically significant impacts in the outcome domain.

    None

    The study found no statistically significant impacts in the outcome domain.

  • Not applicable because no outcomes were examined in the outcome domain.

    Not applicable

    Not applicable because no outcomes were examined in the outcome domain.

OUTCOME FINDINGS FOR LOW EVIDENCE STUDY RATING:

  • Plus Sign Icon representing a Favorable Rating

    Favorable - low evidence

    The study found at least one favorable impact in the outcome domain, and no unfavorable impacts. The study received a low causal evidence ratings so these findings should be interpreted with caution.

  • Mixed Results Rating Icon

    Mixed - low evidence

    The study found some favorable and some unfavorable impacts in the outcome domain. The study received a low causal evidence ratings so these findings should be interpreted with caution.

  • slash icon

    None - low evidence

    The study found no statistically significant impacts in the outcome domain. The study received a low causal evidence ratings so these findings should be interpreted with caution.

  • Unfavorable - low evidence

    Unfavorable - low evidence

    The study found at least one unfavorable impact in the outcome domain, and no favorable impacts. The study received a low causal evidence ratings so these findings should be interpreted with caution.