Cohort bias in predictive risk assessments of future criminal justice system involvement.

Risk assessment instruments (RAIs) are widely used to aid high-stakes decision-making in criminal justice settings and other areas such as health care and child welfare. These tools, whether using machine learning or simpler algorithms, typically assume a time-invariant relationship between predictors and outcome. Because societies are themselves changing and not just individuals, this assumption may be violated in many behavioral settings, generating what we call cohort bias. Analyzing criminal histories in a cohort-sequential longitudinal study of children, we demonstrate that regardless of model type or predictor sets, a tool trained to predict the likelihood of arrest between the ages of 17 and 24 y on older birth cohorts systematically overpredicts the likelihood of arrest for younger birth cohorts over the period 1995 to 2020. Cohort bias is found for both relative and absolute risks, and it persists for all racial groups and within groups at highest risk for arrest. The results imply that cohort bias is an underappreciated mechanism generating inequality in contacts with the criminal legal system that is distinct from racial bias. Cohort bias is a challenge not only for predictive instruments with respect to crime and justice, but also for RAIs more broadly.

Social change and cohort differences in group-based arrest trajectories over the last quarter-century.

This article draws on official criminal histories for multiple birth cohorts spanning a 17-y difference in birth year to study how social change can alter our understanding of influential theories and policies about criminal offender groups. Arrest histories are linked to comprehensive longitudinal measurement on over 1,000 individuals originally from Chicago. Using group-based trajectory modeling, we investigated the magnitude and type of cohort differences in trajectories of arrest over the period 1995 to 2020. Our results show that trajectory group membership varies strongly by birth cohort. Membership in the nonoffender group is nearly 15 percentage points higher for cohorts born in the mid-1990s as compared to those born in the 1980s; conversely, older cohorts are more likely to be members of adolescent-limited and chronic-offender groups. Large cohort differences in trajectory group membership persist after controlling for a wide-ranging set of demographic characteristics and early-life risk factors that vary by cohort and that prior research has identified as important influences on crime. Not only does the effect of social change on cohort differentiation persist, but its magnitude is comparable to-indeed larger than-differences in trajectory group membership associated with varying levels of self-control or by whether individuals grew up in high-poverty households. These results suggest that changes in the broader social environment shared by members of the same birth cohort are as powerful in shaping their trajectory group membership as classic predictors identified in prior research, a finding that carries implications for crime-control policies that rely on prediction.