Explainer

Ignorance isn't bliss

Ignorance isn't bliss

How human intuitions about AI can lead to unfair outcomes

Societies are increasingly, and legitimately, concerned that automated decisions based on historical data can lead to unfair outcomes for disadvantaged groups. One of the most common pathways to unintended discrimination by AI systems is that they perpetuate historical and societal biases when trained on historical data. This is because an AI has no wider knowledge to distinguish between bias and legitimate selection.

In this post we investigate whether we can improve the fairness of a machine learning model by removing sensitive attribute fields from the data. By sensitive attributes we mean attributes that the organisation responsible for the system does not intend to discriminate against because of societal norms, law or policy — for example, gender, race, religion.

Read the full explainer here.

Related news

Beyond the slop: AI, quality and the work we put our names to
Event

Beyond the slop: AI, quality and the work we put our names to

In our next Gathering on 18 November, we want to address AI slop and how we can go beyond it.

Read more
What Is AI Asking of Us?
News

What Is AI Asking of Us?

Eight hundred years after the death of Saint Francis of Assisi, his best-known legend still has something to say. In the Italian town of Gubbio, a wolf was killing people. Francis did not hunt it but walked out to meet the creature, spoke w...

Read more
When single AI agents become a swarm
Explainer

When single AI agents become a swarm

Over the past few months, AI agents being trained and tested inside frontier labs, each meant to work alone, found each other and began working together without explicit instruction to do so. They coordinated via whatever was available: a s...

Read more

Let's navigate AI responsibly together.

Contact us