New EU project to reduce discrimination through AI


Nov 17, 2022

MAMMOth calls
the new EU project
and actually faces
a mammoth task.

AI opens up many possibilities. At the same time, it can force discriminatory decision-making – for example, in education, job application processes or advertising. The MAMMOth project aims to change that.

 

CSH scientist Fariba Karimi and her team are developing fairness measurements that take into account not just one attribute, such as skin color, but several overlapping attributes like gender, age and race.

MAMMOth = Multi-Attribute, Multimodal Bias Mitigation in AI Systems

Businesses, politics and many other sectors are increasingly relying on artificial intelligence and making far-reaching decisions for individuals and society based on that. “On the one hand, this opens up enormous opportunities for different sectors such as education, banking or healthcare, as well as on a personal level, for example, in job applications or ad targeting. On the other hand, artificial intelligence (AI) in particular runs the risk of further enforcing discrimination against minorities and marginalized groups in the population – based on so-called protected attributes such as gender, race and age,” explains Fariba Karimi, senior scientist at Computational Social Science at CSH Vienna.

 

By doing so, AI systems reinforce already existing biases and also contribute to the development of new, unknown types of discrimination – so-called black-box biases – instead of using their potential to compensate for inequalities.

 

Capturing discrimination through multiple attributes

 

Over the course of the three-year project, Karimi and her team will develop fairness measurements that go beyond single protected attributes such as gender or skin color. “For example, we want our fairness measurements to work not only for women, but also for women who are immigrants or from disadvantaged ethnic groups,” she says. Her focus is on precisely this multi-criteria fairness in network data – when, for example, inequalities result from people occupying different positions in the context of an underlying network.

 

Minorities should not become invisible in algorithms

 

Discrimination is not a new problem. But the fact that AI technology continues to reinforce discrimination has led to the rise of fairness-aware machine learning (ML) as part of responsible AI. This aims to develop machine learning models that, on the one hand, perform well in terms of prediction, but on the other hand, do not discriminate with respect to protected attributes such as gender or race. „Much effort has been made, but so far the proposed methods have limited impact and do not reflect the complexity and requirements of real-world applications,“ Karimi states.

 

Twelve institutes pull together

 

The new EU project, MAMMOth, aims to change that: In it, experts from twelve different institutions are developing an innovative, fairness-aware, AI data-driven foundation that provides the necessary tools to mitigate discrimination and multi-discrimination and ensure accountability of AI systems. “Through designing and implementing multi-criteria fairness measures and mitigations we want to ensure that minorities do not face any visibility issues in algorithms and treated fairly in sectors that rely on machines in decision-making processes. More fair algorithms means better representation and diversity in society which also means more inclusive and just societies“, Karimi said.

 

To this end, the project will actively target numerous communities of vulnerable and/or underrepresented groups in AI research from the outset. The so-called co-creation approach will ensure that the real needs and hardships of users are at the heart of the research agenda and guide the project’s activities. The solutions developed will then be demonstrated in pilot projects in three relevant areas (finance/loan applications, identity verification systems and academic evaluation).

 

Here you can find more information: http://mammoth-ai.eu/

 

Read more about Fariba’s research on gender inequalities in research here.


Press

Stablecoin Destabilization - why should we care?


Forbes, Apr 27, 2023

Publication

A. Nerpel, et al.

SARS-ANI: a global open access dataset of reported SARS-CoV-2 events in animals

Scientific Data 9 (438) (2022)

Event

CSH Vernissage: Wolfgang Zeindl


Jun 01, 2023 | 18:0021:00

Event

CSH Talk by Thomas Choi "Supply Networks: Dyads, Triads, Tetrads, and Beyond"


Jun 06, 2023 | 15:0016:00

Complexity Science Hub Vienna

Press

Treibjagd im Darknet: Neue Technologien für Cyber-Ermittler


Salzburger Nachrichten, May 16, 2023

Press

Kritik an EU-Chatkontrolle


Ö1 | Digital.leben, May 11, 2023

Publication

C. Deischinger, E. Dervic, S. Nopp, M. Kaleta, P. Klimek, A. Kautzky-Willer

Diabetes mellitus is associated with a higher relative risk for venous thromboembolism in females than in males

Diabetes Res Clin Pract. (2022) 36471550

Publication

V.D.P. Servedio, M. R. Ferreira, N. Reisz, R. Costas, S. Thurner

Scale-free growth in regional scientific capacity building explains long-term scientific dominance

Chaos, Solitons & Fractals 167 (2023) 113020

People

May 12, 2023

Peter Turchin introduces his new book

News

May 25, 2023

Quotas alone will not solve the problem

Spotlight

May 17, 2023

Complexity Research for Digital Humanism

Event

CSH Talk by Guy Arie Amichay "Modeling Firefly Swarms as Coupled Oscillators"


Jun 02, 2023 | 15:0016:00

Complexity Science Hub Vienna

News

May 25, 2023

Quotas alone will not solve the problem

Spotlight

May 17, 2023

Complexity Research for Digital Humanism

People

May 12, 2023

Peter Turchin introduces his new book

Research News

May 2, 2023

Scientists create high-resolution poverty maps using big data

News

Apr 26, 2023

BEYOND COLLECTIVE STUPIDITY

Spotlight

Apr 21, 2023

How does a region become a center for innovation?

Spotlight

Apr 14, 2023

Are cars our kings?

Research News

Apr 4, 2023

Researchers create new classification of chess openings

Press

Kritik an EU-Chatkontrolle


Ö1 | Digital.leben, May 11, 2023

Press

Treibjagd im Darknet: Neue Technologien für Cyber-Ermittler


Salzburger Nachrichten, May 16, 2023

Press

„Die Älteren halten zu Erdogan, die jüngere Generation hat andere Sorgen“


Cicero, May 9, 2023

Press

Stablecoin Destabilization - why should we care?


Forbes, Apr 27, 2023

Press

„Wir sind nicht so einfach zu manipulieren“ [feat. Hannah Metzler]


Kurier, Apr 29, 2023

Press

Die manchmal fatale Lust, alles selbst zu recherchieren [feat. Mirta Galesic & Henrik Olsson]


Die Presse, Apr 14, 2023

Press

La scienza ha creato una nuova classificazione delle aperture degli scacchi [ital | feat. Vito Servedio & Giordano De Marzo]


WIRED, Apr 10, 2023

Press

Studie: Daten-Verknüpfung ermöglicht Ländern zielgerichtete Maßnahmen [feat. Peter Klimek]


Salzburger Nachrichten, Apr 12, 2023

Press

La contingencia y la movilidad eléctrica [span. | feat. Rafael Prieto-curiel]


Heraldo de México, Mar 28, 2023

Press

Ursachen für den Antibiotika-Mangel [feat. Peter Klimek]


ORF (ZIB 1), Mar 27, 2023

Publication

R. Prieto-Curiel, J. E. Patino, B. Anderson

Scaling of the morphology of African cities

PNAS 120 (9) (2023) e2214254120

Publication

A. Di Natale, D. Garcia

LEXpander: applying colexification networks to automated lexicon expansion

Behaviour Research Methods (2023)

Publication

V.D.P. Servedio, M. R. Ferreira, N. Reisz, R. Costas, S. Thurner

Scale-free growth in regional scientific capacity building explains long-term scientific dominance

Chaos, Solitons & Fractals 167 (2023) 113020

Publication

C. Deischinger, E. Dervic, S. Nopp, M. Kaleta, P. Klimek, A. Kautzky-Willer

Diabetes mellitus is associated with a higher relative risk for venous thromboembolism in females than in males

Diabetes Res Clin Pract. (2022) 36471550

Publication

A. Nerpel, et al.

SARS-ANI: a global open access dataset of reported SARS-CoV-2 events in animals

Scientific Data 9 (438) (2022)

Publication

E. D. Lee, X. Chen, B. C. Daniels

Discovering sparse control strategies in neural activity

PLoS Computational Biology (May 27) (2022)

Publication

H. Kong, S. Martin-Gutierrez, F. Karimi

Influence of the first-mover advantage on the gender disparities in physics citations

Communications Physics 5 (243) (2022)

Publication

T.M. Pham, J. Korbel, R. Hanel, S. Thurner

Empirical social triad statistics can be explained with dyadic homophylic interactions

PNAS 119 (2022) e2121103119

Publication

G. De Marzo, V.D.P. Servedio

Quantifying the complexity and similarity of chess openings using online chess community data

Scientific Reports 13 (2023) 5327

Publication

D. R. Lo Sardo, S. Thurner, et al.

Systematic population-wide ecological analysis of regional variability in disease prevalence

Heliyon 9(4) (2023) e15377

Publication

J. Wachs

Digital traces of brain drain: developers during the Russian invasion of Ukraine

EPJ Data Science 12 (2023) 14

Publication

D. Diodato, R. Hausmann, F. Neffke

The impact of return migration on employment and wages in Mexican cities

Journal of Urban Economics 135 (2023) 103557

Event

CSH Talk by Thomas Choi "Supply Networks: Dyads, Triads, Tetrads, and Beyond"


Jun 06, 2023 | 15:0016:00

Complexity Science Hub Vienna

Event

CSH Workshop: "Firm-level supply network data for policy making"


Jun 05, 2023 | 8:00Jun 06, 2023 | 17:00

Complexity Science Hub Vienna

Event

CSH Talk by Guy Arie Amichay "Modeling Firefly Swarms as Coupled Oscillators"


Jun 02, 2023 | 15:0016:00

Complexity Science Hub Vienna

Event

CSH Vernissage: Wolfgang Zeindl


Jun 01, 2023 | 18:0021:00

Event

CSH Talk by François Lafond "Firm-level production networks: what do we (really) know?"


Jun 07, 2023 | 15:0016:00

Complexity Science Hub Vienna

Event

CSH Talk by Andreas Moxnes: "Growing Together and Apart: Scale Economies and Specialization"


May 31, 2023 | 15:0016:00

Complexity Science Hub Vienna