Digging Deeper into What Works: What Services Improve Labor Market Outcomes, and for Whom?

Digging Deeper into What Works: What Services Improve Labor Market Outcomes, and for Whom?

Pathways to Work Evidence Clearinghouse, Synthesis Report, OPRE Report # 2022-161
Published: Jul 29, 2022
Publisher: Washington, DC: Office of Planning, Research, and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services
Download
Associated Project

Pathways to Work Evidence Clearinghouse

Time frame: 2018-2023

Prepared for:

U.S. Department of Health and Human Services, Administration for Children and Families, Office of Planning, Research, and Evaluation

Clients
OPRE Logo
Authors

Leah Shiferaw

Dan Thal

Key Findings
  • Twelve of the 127 interventions examined for this analysis have more than a 90 percent probability of improving labor market outcomes for participants.
  • Interventions focused on work and work-based learning have the highest probability of improving outcomes relative to interventions focused on delivering other services.
    • Interventions focused on work and work-based learning have a 72 percent probability of improving labor market outcomes overall (including earnings, employment, education and training, and public benefit receipt), and a 92 percent probability of improving employment outcomes specifically.
    • Interventions focused on work and work-based learning were most effective when combined with employment services; these interventions have an 80 percent probability of improving outcomes when offered in combination with work and work-based learning.
  • No single primary service is particularly likely to improve outcomes by a substantial amount (by at least $1,000 in annual earnings).
    • Though interventions focused on work and work-based learning have the highest probability of improving outcomes by any amount, they are among the least likely to improve outcomes by a substantial amount relative to interventions focused on delivering other services (a 21 percent probability of improving outcomes by an amount equivalent to $1,000 or more).
    • Interventions focused on subsidized and transitional jobs are the most likely to improve outcomes by an amount equivalent to $1,000 or more (a 32 percent probability).
  • The likelihood that an intervention offering a particular primary service improves outcomes differs depending on the characteristics of the population being studied. However, interventions focused on work and work-based learning, employment retention services, and case management and other supports typically have the highest probabilities of improving outcomes in interventions serving primarily people from racial or ethnic minority groups, women, and people with disabilities.

Service providers, policymakers, and researchers need to know how likely specific interventions are to improve employment and related outcomes if implemented in a particular setting with clients. In practice, most employment interventions offer a combination of services that are designed to improve labor market outcomes (e.g., employment, earnings, education and training, and public benefit receipt). The sheer volume of research on these interventions, combined with the diversity of intervention characteristics, study participants, and findings, can make it challenging to identify what works.

The Pathways to Work Evidence Clearinghouse is dedicated to gathering information from research and making evidence more useful to decision makers. As part of these efforts, the Pathways Clearinghouse has undertaken a series of research syntheses to explore what we can learn by looking across all the data the Pathways Clearinghouse has collected. This report, one in that series, uses Bayesian meta-analysis—an analytic approach that synthesizes relationships across multiple studies—to provide new evidence on the likelihood that specific interventions will improve labor market outcomes and which combinations of services are most likely to be effective for different groups of people.

Policymakers, practitioners, and researchers can use this report to identify the interventions, and the combination of services provided by those interventions, that are most likely to improve labor market outcomes for different groups of people.

How do you apply evidence?

Take our quick four-question survey to help us curate evidence and insights that serve you.

Take our survey