New EU project to reduce discrimination through AI


Nov 17, 2022

MAMMOth calls
the new EU project
and actually faces
a mammoth task.

AI opens up many possibilities. At the same time, it can force discriminatory decision-making – for example, in education, job application processes or advertising. The MAMMOth project aims to change that.

 

CSH scientist Fariba Karimi and her team are developing fairness measurements that take into account not just one attribute, such as skin color, but several overlapping attributes like gender, age and race.

MAMMOth = Multi-Attribute, Multimodal Bias Mitigation in AI Systems

Businesses, politics and many other sectors are increasingly relying on artificial intelligence and making far-reaching decisions for individuals and society based on that. “On the one hand, this opens up enormous opportunities for different sectors such as education, banking or healthcare, as well as on a personal level, for example, in job applications or ad targeting. On the other hand, artificial intelligence (AI) in particular runs the risk of further enforcing discrimination against minorities and marginalized groups in the population – based on so-called protected attributes such as gender, race and age,” explains Fariba Karimi, senior scientist at Computational Social Science at CSH Vienna.

 

By doing so, AI systems reinforce already existing biases and also contribute to the development of new, unknown types of discrimination – so-called black-box biases – instead of using their potential to compensate for inequalities.

 

Capturing discrimination through multiple attributes

 

Over the course of the three-year project, Karimi and her team will develop fairness measurements that go beyond single protected attributes such as gender or skin color. “For example, we want our fairness measurements to work not only for women, but also for women who are immigrants or from disadvantaged ethnic groups,” she says. Her focus is on precisely this multi-criteria fairness in network data – when, for example, inequalities result from people occupying different positions in the context of an underlying network.

 

Minorities should not become invisible in algorithms

 

Discrimination is not a new problem. But the fact that AI technology continues to reinforce discrimination has led to the rise of fairness-aware machine learning (ML) as part of responsible AI. This aims to develop machine learning models that, on the one hand, perform well in terms of prediction, but on the other hand, do not discriminate with respect to protected attributes such as gender or race. „Much effort has been made, but so far the proposed methods have limited impact and do not reflect the complexity and requirements of real-world applications,“ Karimi states.

 

Twelve institutes pull together

 

The new EU project, MAMMOth, aims to change that: In it, experts from twelve different institutions are developing an innovative, fairness-aware, AI data-driven foundation that provides the necessary tools to mitigate discrimination and multi-discrimination and ensure accountability of AI systems. “Through designing and implementing multi-criteria fairness measures and mitigations we want to ensure that minorities do not face any visibility issues in algorithms and treated fairly in sectors that rely on machines in decision-making processes. More fair algorithms means better representation and diversity in society which also means more inclusive and just societies“, Karimi said.

 

To this end, the project will actively target numerous communities of vulnerable and/or underrepresented groups in AI research from the outset. The so-called co-creation approach will ensure that the real needs and hardships of users are at the heart of the research agenda and guide the project’s activities. The solutions developed will then be demonstrated in pilot projects in three relevant areas (finance/loan applications, identity verification systems and academic evaluation).

 

Here you can find more information: http://mammoth-ai.eu/

 

Read more about Fariba’s research on gender inequalities in research here.


Publication

M. Pangallo, A. Aleta, et al.

The unequal effects of the health-economy tradeoff during the COVID-19 pandemic

Nature Human Behaviour (2023) DOI: 10.1038/s41562-023-01747-x

Publication

A. Nerpel, A. Käsbohrer, C. Walzer, A. Desvars-Larrive

Data on SARS-CoV-2 events in animals: Mind the gap!

One Health 17 (2023) 100653 DOI: 10.1016/j.onehlt.2023.100653

Publication

P. Klimek, A. Aykac, S. Thurner

Forensic analysis of the Turkey 2023 presidential election reveals extreme vote swings in remote areas

PLoS ONE 18(11) (2023) e0293239

Press

Wissenschaft kritisiert fehlenden Datenzugang


ORF, Dec 4, 2023

Unkategorisiert

Dec 6, 2023

From Leafy Woods to Data Forests

Spotlight

Nov 30, 2023

From Inequality to Instability

Press

Forscher sagt: „2024 wird das System in den USA möglicherweise zusammenbrechen“


Die Presse, Nov 14, 2023

Research News

Dec 6, 2023

A better way of measuring homophily

Press

Why reports that Western civilisation will soon collapse are premature


New Scientist, Dec 5, 2023

Research News

Dec 6, 2023

A better way of measuring homophily

Unkategorisiert

Dec 6, 2023

From Leafy Woods to Data Forests

Spotlight

Nov 30, 2023

From Inequality to Instability

Research News

Nov 28, 2023

Proposals for an Efficient and Effective Corporate Sustainability Due Diligence in Europe

Research News

Nov 27, 2023

India's Rice Export Restrictions Echo in West Asia and Africa

Research News

Nov 23, 2023

Study Identifies Numerous Connections in Cybercrime Cases

Press

Nov 17, 2023

Invitation to media chat by Supply Chain Intelligence Institute Austria (ASCII)

Research News

Nov 15, 2023

Data Gap in SARS-CoV-2 Cases in Animals

News

Nov 14, 2023

FTX Collapse: New Method for Assessing the Solvency of Cryptocurrency Exchanges

People

Nov 10, 2023

Double Honors for CSH Researchers

News

Nov 13, 2023

New scientific methods for analyzing criminal careers

Press

Why reports that Western civilisation will soon collapse are premature


New Scientist, Dec 5, 2023

Press

Best ideas books of 2023


The Guardian, Dec 5, 2023

Press

Wissenschaft kritisiert fehlenden Datenzugang


ORF, Dec 4, 2023

Press

Forscher sagt: „2024 wird das System in den USA möglicherweise zusammenbrechen“


Die Presse, Nov 14, 2023

Press

Klima und Geschichte


Die Presse, Nov 4, 2023

Press

Daten mit Gewicht: Analysen von Lieferketten zeigen auch Steuerlücken


Die Presse, Oct 20, 2023

Press

Krypto-Forscher über DeFi: “Würde von De-facto-Centralized-Finance sprechen”


brutkasten, Oct 27, 2023

Press

Scientists say Western sanctions against China ‘toothless’ without better supply chain data


South China Morning Post, Oct 20, 2023

Press

Climate change has toppled some civilizations but not others. Why?


Grist, Oct 16, 2023

Press

Chinas E-Autos kommen, und Europa darf nicht naiv sein


Der Standard, Oct 9, 2023

Publication

P. Klimek, A. Aykac, S. Thurner

Forensic analysis of the Turkey 2023 presidential election reveals extreme vote swings in remote areas

PLoS ONE 18(11) (2023) e0293239

Publication

M. Pangallo, A. Aleta, et al.

The unequal effects of the health-economy tradeoff during the COVID-19 pandemic

Nature Human Behaviour (2023) DOI: 10.1038/s41562-023-01747-x

Publication

A. Nerpel, A. Käsbohrer, C. Walzer, A. Desvars-Larrive

Data on SARS-CoV-2 events in animals: Mind the gap!

One Health 17 (2023) 100653 DOI: 10.1016/j.onehlt.2023.100653

Publication

G. Heiler, T. Pham, J. Korbel, J. Wachs, S. Thurner

A large-scale empirical investigation of specialization in criminal career

Scientific Reports 13 (2023) 17160

Publication

A. Pichler, C. Diem, et al.

Building an alliance to map global supply networks: New firm-level data can inform policy-making

Science 382(6668) (2023) 270-272.

Publication

R. Prieto-Curiel, G. M. Capedelli, A. Hope

Reducing cartel recruitment is the only way to lower violence in Mexico

Science 381(6664) (2023) 1312-1316

Publication

B. Méro, A. Borsos, et al.

A High-Resolution, Data-Driven Agent-Based Model of the Housing Market

Journal of Economic Dynamics and Control (2023) 104738

Publication

S. Juhász, G. Pintér, et al.

Amenity complexity and urban locations of socio-economic mixing

EPJ Data Science 12 (2023) 34

Publication

R. Hanel, S. Thurner

Equivalence of information production and generalised entropies in complex processes

PLOS ONE 18(9) (2023) e0290695

Publication

K. Frenken, F. Neffke, A. van Dam

Capabilities, institutions and regional economic development: a proposed synthesis

Cambridge Journal of Regions, Economy and Society (2023) rsad021

Publication

G. Orlandi, D. Hoyer, et al.

Structural-demographic analysis of the Qing Dynasty (1644–1912) collapse in China

PLoS ONE 18(8) (2023) e0289748

Publication

N. Kushwaha, E.D. Lee

Discovering the mesoscale for chains of conflict

PNAS Nexus 2(7) (2023) pgad228