What role does gender play for online platform reviews?


Jan 28, 2022

As how helpful product reviews are perceived often depends on the gender of the reviewer, suggests new study

 

What makes an online customer product review helpful? Certainly numerous factors, but for some products at least, when an author’s username suggests they are a woman, the reviews are perceived as more helpful, according to a paper co-authored by Johannes Wachs.

 

That’s the case for products in the Movies or Beauty categories. Conversely, reviews of tech products are perceived as more helpful when written by users whose names suggest they are men.

 

In their study, the scientists analyzed more than 80 million English language customer reviews on the e-commerce platform Amazon across 15 different categories – including Books, Electronics, Clothing, and Movies – to see how users rate the helpfulness of the reviews depending on the gendered signals and behavior of their authors.

 

Overall, across all categories, the team didn’t find any general trend that signals of the gender identity or gendered behavior of the author – which could be inferred from the username or identified by a machine learning algorithm – had an effect on the success of a review.

 

Category-specific effects

 

On the other hand, the study, published in the journal Frontiers in Big Data, identified strong category-specific effects. Reviews by customers whose usernames implied they were women were perceived as more helpful in categories like Toys, Movies and Beauty, while reviews written by customers who indicated they were likely men received more positive scores in categories including Electronics, Kindle, and Computer.

 

The results also show that gender anonymous reviewers who, according to the machine learning model developed by the team, “performed” as women received better evaluations than users who indicated they were likely women in categories like Electronics or Cellphones. Similar effects were observed for anonymous authors “performing” as men compared with reviewers who implied they were men in categories including Books or Kindle.

 

On the Internet everybody knows you’re a dog

 

According to Johannes, the results suggest that in the online world people aren’t so anonymous anymore. He mentions one of the most famous cartoons from the early years of the Internet age that was published in The New Yorker magazine in 1993. The cartoon, by Peter Steiner, depicts two dogs: one, sitting at a computer, says to the other “On the Internet, nobody knows you’re a dog.”

 

“Almost 30 years later, the idea that you can be whoever you want to be online doesn’t seem to hold true anymore,” says Johannes. “Your words and emojis, and even your chosen username, seem to influence how others react to you – at least on product reviews on Amazon. Even the very weak gender signals we can send seem to make a difference on how people react to a seemingly simple statement as an Amazon review,” he points out.

 

Linguistic differences

 

In order to infer the gender of the reviewers, the team first used a name-to-gender prediction tool and was able to identify the gender of 42 percent of users in the sample, the ones who were signaling a likely gender with their username. Next, in order to understand and interpret reviews written by users who hid their gender, consciously or not, the researchers trained and tested a machine learning algorithm designed to identify the linguistic differences between reviews written by a man and a woman, taking into account factors such as style and word choice. The model was able to correctly classify the gender suggested by an author’s username with a success rate of at least 70 percent.

 

Commenting on the category-specific effects found in the study, Sandipar Sikdar, the main author of the paper, says that “one potential mechanism for this effect is that users judging reviews apply gender stereotypes – for example, that men are more knowledgeable about electronics while women are better informed about beauty products – to rate reviewers when they can infer gender from names. As these ratings influence the ranking and visibility of reviews to shoppers, this can amplify stereotypes.” Sandipar Sikdar is a PostDoc at RWTH Aachen University, in Germany.

 

 

The study The effects of gender signals and performance in online product reviews by Sandipan Sikdar, Rachneet Sachdeva, Johannes Wachs, Florian Lemmerich, and CSH External Faculty member Markus Strohmaier appeared in Frontiers in Big Data Vol 4 (2022).


Event

CSH Talk by Elma Dervic: "Unravelling cradle-to-grave disease trajectories from multilayer comorbidity networks"


Dec 16, 2022 | 15:3016:00

Complexity Science Hub Vienna

Research News

Dec 6, 2022

Complexity Science meets Digital Humanism

People

Nov 30, 2022

Bridging the gap between academia and industry

Event

CSH Talk by Zlata Tabachová: "Supply chain shock propagation and financial systemic risk"


Dec 02, 2022 | 15:0016:00

Complexity Science Hub Vienna

Publication

H. Kong, S. Martin-Gutierrez, F. Karimi

Influence of the first-mover advantage on the gender disparities in physics citations

Communications Physics 5 (243) (2022)

Publication

W. Schueller, J. Wachs, V. D. P. Servedio, S. Thurner, V. Loreto

Evolving collaboration, dependencies, and use in the Rust Open Source Software ecosystem

Scientific Data 9 (2022) 703

Press

A charada do desequilibrio de genero na ciencia [Portuguese] [feat.Fariba Karimi]


Pesquisa Fapesp, Nov 17, 2022

Event

CSH Talk by visiting scientist Meike Zehlike: "Fairness Criteria in Machine Learning and Law"


Dec 16, 2022 | 15:0015:30

Complexity Science Hub Vienna

Press

MAMMOth: KI-Tendenz zur Diskriminierung durchbrechen [feat.Fariba Karimi]


Brutkasten, Nov 22, 2022

Press

Was crime as bad as it was portrayed [feat.Rafael Prieto-Curiel]


abcNEWS, Nov 18, 2022

Publication

N. Pontika, T. Klebel, A. Correia, H. Metzler, P. Knoth, T. Ross-Hellauer

Indicators of research quality, quantity, openness and responsibility in institutional review, promotion and tenure policies across seven countries

Quantitative Science Studies 1-49

Spotlight

Dec 2, 2022

Avoiding supply chain bottlenecks with Big Data

Event

CSH Talk by Elma Dervic: "Unravelling cradle-to-grave disease trajectories from multilayer comorbidity networks"


Dec 16, 2022 | 15:3016:00

Complexity Science Hub Vienna

Research News

Dec 6, 2022

Complexity Science meets Digital Humanism

People

Nov 30, 2022

Bridging the gap between academia and industry

Event

CSH Talk by Zlata Tabachová: "Supply chain shock propagation and financial systemic risk"


Dec 02, 2022 | 15:0016:00

Complexity Science Hub Vienna

Publication

H. Kong, S. Martin-Gutierrez, F. Karimi

Influence of the first-mover advantage on the gender disparities in physics citations

Communications Physics 5 (243) (2022)

Publication

W. Schueller, J. Wachs, V. D. P. Servedio, S. Thurner, V. Loreto

Evolving collaboration, dependencies, and use in the Rust Open Source Software ecosystem

Scientific Data 9 (2022) 703

Press

A charada do desequilibrio de genero na ciencia [Portuguese] [feat.Fariba Karimi]


Pesquisa Fapesp, Nov 17, 2022

Event

CSH Talk by visiting scientist Meike Zehlike: "Fairness Criteria in Machine Learning and Law"


Dec 16, 2022 | 15:0015:30

Complexity Science Hub Vienna

Press

MAMMOth: KI-Tendenz zur Diskriminierung durchbrechen [feat.Fariba Karimi]


Brutkasten, Nov 22, 2022

Press

Was crime as bad as it was portrayed [feat.Rafael Prieto-Curiel]


abcNEWS, Nov 18, 2022

Publication

N. Pontika, T. Klebel, A. Correia, H. Metzler, P. Knoth, T. Ross-Hellauer

Indicators of research quality, quantity, openness and responsibility in institutional review, promotion and tenure policies across seven countries

Quantitative Science Studies 1-49

Spotlight

Dec 2, 2022

Avoiding supply chain bottlenecks with Big Data

People

Nov 30, 2022

Bridging the gap between academia and industry

Research News

Dec 6, 2022

Complexity Science meets Digital Humanism

Spotlight

Dec 2, 2022

Avoiding supply chain bottlenecks with Big Data

Research News

Nov 28, 2022

New evidence for possible domino effects in cryptoassets

Spotlight

Nov 28, 2022

BUSTS AFTER BOOMS, BUT WHY?

Research News

Nov 17, 2022

New EU project to reduce discrimination through AI

Research News

Oct 13, 2022

Yes we can -- STEM is also for women

Research News

Oct 13, 2022

Predicting the economic downturn during the pandemic

Press

MAMMOth: KI-Tendenz zur Diskriminierung durchbrechen [feat.Fariba Karimi]


Brutkasten, Nov 22, 2022

Press

Was crime as bad as it was portrayed [feat.Rafael Prieto-Curiel]


abcNEWS, Nov 18, 2022

Press

A charada do desequilibrio de genero na ciencia [Portuguese] [feat.Fariba Karimi]


Pesquisa Fapesp, Nov 17, 2022

Press

COVID : Les animaux peuvent-ils attraper le virus? [French] [feat.Amélie Desvars-Larrive]


News24, Nov 17, 2022

Press

Departure of Tech Workers Weighs on Russian Economy [feat.Johannes Wachs]


The Wall Street Journal, Nov 14, 2022

Press

Männer profitieren stärker vom Pionier-Vorteil als Frauen [feat.Fariba Karimi]


Spektrum Online, Oct 26, 2022

Press

Can your phone tell if a bridge is in good shape?


Scienmag, Nov 3, 2022

Press

Which Animals Catch COVID? This Database Has Dozens of Species and Counting [feat.Amélie Desvars-Larrive]


Scientific American, Oct 19, 2022

Press

Hinweise auf subtile Bevorzugung von Arbeiten von Männern in Physik [feat.Fariba Karimi]


APA Science, Oct 14, 2022

Press

Female representation in physics: Can we fix it?[feat.Fariba Karimi]


Cosmos Magazine , Oct 17, 2022

Press

Hundreds of Russia's top software developers may have left the country [feat.Johannes Wachs]


New Scientist , Oct 19, 2022

Publication

W. Schueller, J. Wachs, V. D. P. Servedio, S. Thurner, V. Loreto

Evolving collaboration, dependencies, and use in the Rust Open Source Software ecosystem

Scientific Data 9 (2022) 703

Publication

N. Pontika, T. Klebel, A. Correia, H. Metzler, P. Knoth, T. Ross-Hellauer

Indicators of research quality, quantity, openness and responsibility in institutional review, promotion and tenure policies across seven countries

Quantitative Science Studies 1-49

Publication

H. Kong, S. Martin-Gutierrez, F. Karimi

Influence of the first-mover advantage on the gender disparities in physics citations

Communications Physics 5 (243) (2022)

Publication

A. Pichler, M. Pangallo, M. del Rio-Chanona, F. Lafond, D. Farmer

Forecasting the propagation of pandemic shocks with a dynamic input-output model

Journal of Economic Dynamics and Control (2022) 104527

Publication

J. Lasser, S. Taofeek Aroyehun, et al.

Social media sharing of low quality news sources by political elites

PNAS Nexus (2022) pgac186

Publication

R. Prieto Curiel, A. Schumann, I. Heo, P. Heinrigs

Detecting cities with high intermediacy in the African urban network

Computers, Environment and Urban Systems 98 (2022) 101869

Publication

T. Reisch, G. Heiler, C. Diem, P. Klimek, S. Thurner

Monitoring supply networks from mobile phone data for estimating the systemic risk of an economy

Scientific Reports 12 (13347) (2022)

Publication

G. De Marzo, F. Pandolfelli, V.D.P. Servedio

Modeling innovation in the cryptocurrency ecosystem

Scientific Reports 12 (12942) (2022)

Publication

A. Nerpel, et al.

SARS-ANI: a global open access dataset of reported SARS-CoV-2 events in animals

Scientific Data 9 (438) (2022)

Publication

M. Kaleta, J. Lasser, E. Dervic, et al.

Stress-testing the resilience of the Austrian healthcare system using agent-based simulation

Nature Communications 13 (4259) (2022)

Publication

F. Amman, et al.

Viral variant-resolved wastewater surveillance of SARS-CoV-2 at national scale

Nature Biotechnology (2022)

Publication

J. V. Camp, A. Desvars-Larrive, N. Nowotny, C. Walzer

Monitoring urban zoonotic virus activity: Are city rats a promising surveillance tool for emerging viruses?

Viruses 14 (7) (2022) 1516

Event

CSH Talk by Zlata Tabachová: "Supply chain shock propagation and financial systemic risk"


Dec 02, 2022 | 15:0016:00

Complexity Science Hub Vienna

Event

CSH Workshop: "Innovation and obsolescence in the space of the possible"


Dec 12, 2022Dec 14, 2022

Complexity Science Hub Vienna

Event

CSH Talk by visiting scientist Meike Zehlike: "Fairness Criteria in Machine Learning and Law"


Dec 16, 2022 | 15:0015:30

Complexity Science Hub Vienna

Event

CSH Talk by Elma Dervic: "Unravelling cradle-to-grave disease trajectories from multilayer comorbidity networks"


Dec 16, 2022 | 15:3016:00

Complexity Science Hub Vienna