Measuring Non-Expert Comprehension of Machine Learning Fairness Metrics

of Sample Census Study-1 Study-2 Ethnicity AI or AN 0.7 0.7 0.9 Asian or NH or PI 5.7 1.4 2.3 Black or AA 12.3 10.2 15.8 Hispanic or Latinx 18.1 12.2 7.7 Other 2.6 2.7 1.4 White 60.6 72.8 71.9 Education [...] HS or equivalent 27.7 29.9 24.9 Some post-secondary 30.8 30.6 24.9 Bachelor’s and above 29.4 33.3 42.7 3.2. Study-2 Study-2 follows a very similar structure to Study-1 with a few changes. First, we decided [...] receive job offers. 3.2.2. RECRUITMENT AND PARTICIPANTS We again used the Cint service to recruit participants. Com- pensation for participation was handled in the same manner as described in §3.1.2. Because …