What role does gender play for online platform reviews?


Jan 28, 2022

As how helpful product reviews are perceived often depends on the gender of the reviewer, suggests new study

 

What makes an online customer product review helpful? Certainly numerous factors, but for some products at least, when an author’s username suggests they are a woman, the reviews are perceived as more helpful, according to a paper co-authored by Johannes Wachs.

 

That’s the case for products in the Movies or Beauty categories. Conversely, reviews of tech products are perceived as more helpful when written by users whose names suggest they are men.

 

In their study, the scientists analyzed more than 80 million English language customer reviews on the e-commerce platform Amazon across 15 different categories – including Books, Electronics, Clothing, and Movies – to see how users rate the helpfulness of the reviews depending on the gendered signals and behavior of their authors.

 

Overall, across all categories, the team didn’t find any general trend that signals of the gender identity or gendered behavior of the author – which could be inferred from the username or identified by a machine learning algorithm – had an effect on the success of a review.

 

Category-specific effects

 

On the other hand, the study, published in the journal Frontiers in Big Data, identified strong category-specific effects. Reviews by customers whose usernames implied they were women were perceived as more helpful in categories like Toys, Movies and Beauty, while reviews written by customers who indicated they were likely men received more positive scores in categories including Electronics, Kindle, and Computer.

 

The results also show that gender anonymous reviewers who, according to the machine learning model developed by the team, “performed” as women received better evaluations than users who indicated they were likely women in categories like Electronics or Cellphones. Similar effects were observed for anonymous authors “performing” as men compared with reviewers who implied they were men in categories including Books or Kindle.

 

On the Internet everybody knows you’re a dog

 

According to Johannes, the results suggest that in the online world people aren’t so anonymous anymore. He mentions one of the most famous cartoons from the early years of the Internet age that was published in The New Yorker magazine in 1993. The cartoon, by Peter Steiner, depicts two dogs: one, sitting at a computer, says to the other “On the Internet, nobody knows you’re a dog.”

 

“Almost 30 years later, the idea that you can be whoever you want to be online doesn’t seem to hold true anymore,” says Johannes. “Your words and emojis, and even your chosen username, seem to influence how others react to you – at least on product reviews on Amazon. Even the very weak gender signals we can send seem to make a difference on how people react to a seemingly simple statement as an Amazon review,” he points out.

 

Linguistic differences

 

In order to infer the gender of the reviewers, the team first used a name-to-gender prediction tool and was able to identify the gender of 42 percent of users in the sample, the ones who were signaling a likely gender with their username. Next, in order to understand and interpret reviews written by users who hid their gender, consciously or not, the researchers trained and tested a machine learning algorithm designed to identify the linguistic differences between reviews written by a man and a woman, taking into account factors such as style and word choice. The model was able to correctly classify the gender suggested by an author’s username with a success rate of at least 70 percent.

 

Commenting on the category-specific effects found in the study, Sandipar Sikdar, the main author of the paper, says that “one potential mechanism for this effect is that users judging reviews apply gender stereotypes – for example, that men are more knowledgeable about electronics while women are better informed about beauty products – to rate reviewers when they can infer gender from names. As these ratings influence the ranking and visibility of reviews to shoppers, this can amplify stereotypes.” Sandipar Sikdar is a PostDoc at RWTH Aachen University, in Germany.

 

 

The study The effects of gender signals and performance in online product reviews by Sandipan Sikdar, Rachneet Sachdeva, Johannes Wachs, Florian Lemmerich, and CSH External Faculty member Markus Strohmaier appeared in Frontiers in Big Data Vol 4 (2022).


Publication

A. Nerpel, et al.

SARS-ANI: a global open access dataset of reported SARS-CoV-2 events in animals

Scientific Data 9 (438) (2022)

Event

CSH Talk by Guy Arie Amichay "Modeling Firefly Swarms as Coupled Oscillators"


Jun 02, 2023 | 15:0016:00

Complexity Science Hub Vienna

Spotlight

May 17, 2023

Complexity Research for Digital Humanism

News

May 25, 2023

Quotas alone will not solve the problem

Event

CSH Talk by Thomas Choi "Supply Networks: Dyads, Triads, Tetrads, and Beyond"


Jun 06, 2023 | 15:0016:00

Complexity Science Hub Vienna

Publication

C. Deischinger, E. Dervic, S. Nopp, M. Kaleta, P. Klimek, A. Kautzky-Willer

Diabetes mellitus is associated with a higher relative risk for venous thromboembolism in females than in males

Diabetes Res Clin Pract. (2022) 36471550

Press

Kritik an EU-Chatkontrolle


Ö1 | Digital.leben, May 11, 2023

Press

Treibjagd im Darknet: Neue Technologien für Cyber-Ermittler


Salzburger Nachrichten, May 16, 2023

Press

Stablecoin Destabilization - why should we care?


Forbes, Apr 27, 2023

People

May 12, 2023

Peter Turchin introduces his new book

Publication

V.D.P. Servedio, M. R. Ferreira, N. Reisz, R. Costas, S. Thurner

Scale-free growth in regional scientific capacity building explains long-term scientific dominance

Chaos, Solitons & Fractals 167 (2023) 113020

Event

CSH Vernissage: Wolfgang Zeindl


Jun 01, 2023 | 18:0021:00

News

May 25, 2023

Quotas alone will not solve the problem

Spotlight

May 17, 2023

Complexity Research for Digital Humanism

People

May 12, 2023

Peter Turchin introduces his new book

Research News

May 2, 2023

Scientists create high-resolution poverty maps using big data

News

Apr 26, 2023

BEYOND COLLECTIVE STUPIDITY

Spotlight

Apr 21, 2023

How does a region become a center for innovation?

Spotlight

Apr 14, 2023

Are cars our kings?

Research News

Apr 4, 2023

Researchers create new classification of chess openings

Press

Kritik an EU-Chatkontrolle


Ö1 | Digital.leben, May 11, 2023

Press

Treibjagd im Darknet: Neue Technologien für Cyber-Ermittler


Salzburger Nachrichten, May 16, 2023

Press

„Die Älteren halten zu Erdogan, die jüngere Generation hat andere Sorgen“


Cicero, May 9, 2023

Press

Stablecoin Destabilization - why should we care?


Forbes, Apr 27, 2023

Press

„Wir sind nicht so einfach zu manipulieren“ [feat. Hannah Metzler]


Kurier, Apr 29, 2023

Press

Die manchmal fatale Lust, alles selbst zu recherchieren [feat. Mirta Galesic & Henrik Olsson]


Die Presse, Apr 14, 2023

Press

La scienza ha creato una nuova classificazione delle aperture degli scacchi [ital | feat. Vito Servedio & Giordano De Marzo]


WIRED, Apr 10, 2023

Press

Studie: Daten-Verknüpfung ermöglicht Ländern zielgerichtete Maßnahmen [feat. Peter Klimek]


Salzburger Nachrichten, Apr 12, 2023

Press

La contingencia y la movilidad eléctrica [span. | feat. Rafael Prieto-curiel]


Heraldo de México, Mar 28, 2023

Press

Ursachen für den Antibiotika-Mangel [feat. Peter Klimek]


ORF (ZIB 1), Mar 27, 2023

Publication

R. Prieto-Curiel, J. E. Patino, B. Anderson

Scaling of the morphology of African cities

PNAS 120 (9) (2023) e2214254120

Publication

A. Di Natale, D. Garcia

LEXpander: applying colexification networks to automated lexicon expansion

Behaviour Research Methods (2023)

Publication

V.D.P. Servedio, M. R. Ferreira, N. Reisz, R. Costas, S. Thurner

Scale-free growth in regional scientific capacity building explains long-term scientific dominance

Chaos, Solitons & Fractals 167 (2023) 113020

Publication

C. Deischinger, E. Dervic, S. Nopp, M. Kaleta, P. Klimek, A. Kautzky-Willer

Diabetes mellitus is associated with a higher relative risk for venous thromboembolism in females than in males

Diabetes Res Clin Pract. (2022) 36471550

Publication

A. Nerpel, et al.

SARS-ANI: a global open access dataset of reported SARS-CoV-2 events in animals

Scientific Data 9 (438) (2022)

Publication

E. D. Lee, X. Chen, B. C. Daniels

Discovering sparse control strategies in neural activity

PLoS Computational Biology (May 27) (2022)

Publication

H. Kong, S. Martin-Gutierrez, F. Karimi

Influence of the first-mover advantage on the gender disparities in physics citations

Communications Physics 5 (243) (2022)

Publication

T.M. Pham, J. Korbel, R. Hanel, S. Thurner

Empirical social triad statistics can be explained with dyadic homophylic interactions

PNAS 119 (2022) e2121103119

Publication

G. De Marzo, V.D.P. Servedio

Quantifying the complexity and similarity of chess openings using online chess community data

Scientific Reports 13 (2023) 5327

Publication

D. R. Lo Sardo, S. Thurner, et al.

Systematic population-wide ecological analysis of regional variability in disease prevalence

Heliyon 9(4) (2023) e15377

Publication

J. Wachs

Digital traces of brain drain: developers during the Russian invasion of Ukraine

EPJ Data Science 12 (2023) 14

Publication

D. Diodato, R. Hausmann, F. Neffke

The impact of return migration on employment and wages in Mexican cities

Journal of Urban Economics 135 (2023) 103557

Event

CSH Talk by Thomas Choi "Supply Networks: Dyads, Triads, Tetrads, and Beyond"


Jun 06, 2023 | 15:0016:00

Complexity Science Hub Vienna

Event

CSH Workshop: "Firm-level supply network data for policy making"


Jun 05, 2023 | 8:00Jun 06, 2023 | 17:00

Complexity Science Hub Vienna

Event

CSH Talk by Guy Arie Amichay "Modeling Firefly Swarms as Coupled Oscillators"


Jun 02, 2023 | 15:0016:00

Complexity Science Hub Vienna

Event

CSH Vernissage: Wolfgang Zeindl


Jun 01, 2023 | 18:0021:00

Event

CSH Talk by François Lafond "Firm-level production networks: what do we (really) know?"


Jun 07, 2023 | 15:0016:00

Complexity Science Hub Vienna

Event

CSH Talk by Andreas Moxnes: "Growing Together and Apart: Scale Economies and Specialization"


May 31, 2023 | 15:0016:00

Complexity Science Hub Vienna