What role does gender play for online platform reviews?


Jan 28, 2022

As how helpful product reviews are perceived often depends on the gender of the reviewer, suggests new study

 

What makes an online customer product review helpful? Certainly numerous factors, but for some products at least, when an author’s username suggests they are a woman, the reviews are perceived as more helpful, according to a paper co-authored by Johannes Wachs.

 

That’s the case for products in the Movies or Beauty categories. Conversely, reviews of tech products are perceived as more helpful when written by users whose names suggest they are men.

 

In their study, the scientists analyzed more than 80 million English language customer reviews on the e-commerce platform Amazon across 15 different categories – including Books, Electronics, Clothing, and Movies – to see how users rate the helpfulness of the reviews depending on the gendered signals and behavior of their authors.

 

Overall, across all categories, the team didn’t find any general trend that signals of the gender identity or gendered behavior of the author – which could be inferred from the username or identified by a machine learning algorithm – had an effect on the success of a review.

 

Category-specific effects

 

On the other hand, the study, published in the journal Frontiers in Big Data, identified strong category-specific effects. Reviews by customers whose usernames implied they were women were perceived as more helpful in categories like Toys, Movies and Beauty, while reviews written by customers who indicated they were likely men received more positive scores in categories including Electronics, Kindle, and Computer.

 

The results also show that gender anonymous reviewers who, according to the machine learning model developed by the team, “performed” as women received better evaluations than users who indicated they were likely women in categories like Electronics or Cellphones. Similar effects were observed for anonymous authors “performing” as men compared with reviewers who implied they were men in categories including Books or Kindle.

 

On the Internet everybody knows you’re a dog

 

According to Johannes, the results suggest that in the online world people aren’t so anonymous anymore. He mentions one of the most famous cartoons from the early years of the Internet age that was published in The New Yorker magazine in 1993. The cartoon, by Peter Steiner, depicts two dogs: one, sitting at a computer, says to the other “On the Internet, nobody knows you’re a dog.”

 

“Almost 30 years later, the idea that you can be whoever you want to be online doesn’t seem to hold true anymore,” says Johannes. “Your words and emojis, and even your chosen username, seem to influence how others react to you – at least on product reviews on Amazon. Even the very weak gender signals we can send seem to make a difference on how people react to a seemingly simple statement as an Amazon review,” he points out.

 

Linguistic differences

 

In order to infer the gender of the reviewers, the team first used a name-to-gender prediction tool and was able to identify the gender of 42 percent of users in the sample, the ones who were signaling a likely gender with their username. Next, in order to understand and interpret reviews written by users who hid their gender, consciously or not, the researchers trained and tested a machine learning algorithm designed to identify the linguistic differences between reviews written by a man and a woman, taking into account factors such as style and word choice. The model was able to correctly classify the gender suggested by an author’s username with a success rate of at least 70 percent.

 

Commenting on the category-specific effects found in the study, Sandipar Sikdar, the main author of the paper, says that “one potential mechanism for this effect is that users judging reviews apply gender stereotypes – for example, that men are more knowledgeable about electronics while women are better informed about beauty products – to rate reviewers when they can infer gender from names. As these ratings influence the ranking and visibility of reviews to shoppers, this can amplify stereotypes.” Sandipar Sikdar is a PostDoc at RWTH Aachen University, in Germany.

 

 

The study The effects of gender signals and performance in online product reviews by Sandipan Sikdar, Rachneet Sachdeva, Johannes Wachs, Florian Lemmerich, and CSH External Faculty member Markus Strohmaier appeared in Frontiers in Big Data Vol 4 (2022).


Publication

M. Pangallo, A. Aleta, et al.

The unequal effects of the health-economy tradeoff during the COVID-19 pandemic

Nature Human Behaviour (2023) DOI: 10.1038/s41562-023-01747-x

Press

Forscher sagt: „2024 wird das System in den USA möglicherweise zusammenbrechen“


Die Presse, Nov 14, 2023

Spotlight

Nov 30, 2023

From Inequality to Instability

Unkategorisiert

Dec 6, 2023

From Leafy Woods to Data Forests

Press

Wissenschaft kritisiert fehlenden Datenzugang


ORF, Dec 4, 2023

Publication

A. Nerpel, A. Käsbohrer, C. Walzer, A. Desvars-Larrive

Data on SARS-CoV-2 events in animals: Mind the gap!

One Health 17 (2023) 100653 DOI: 10.1016/j.onehlt.2023.100653

Press

Why reports that Western civilisation will soon collapse are premature


New Scientist, Dec 5, 2023

Publication

P. Klimek, A. Aykac, S. Thurner

Forensic analysis of the Turkey 2023 presidential election reveals extreme vote swings in remote areas

PLoS ONE 18(11) (2023) e0293239

Research News

Dec 6, 2023

A better way of measuring homophily

Research News

Dec 6, 2023

A better way of measuring homophily

Unkategorisiert

Dec 6, 2023

From Leafy Woods to Data Forests

Spotlight

Nov 30, 2023

From Inequality to Instability

Research News

Nov 28, 2023

Proposals for an Efficient and Effective Corporate Sustainability Due Diligence in Europe

Research News

Nov 27, 2023

India's Rice Export Restrictions Echo in West Asia and Africa

Research News

Nov 23, 2023

Study Identifies Numerous Connections in Cybercrime Cases

Press

Nov 17, 2023

Invitation to media chat by Supply Chain Intelligence Institute Austria (ASCII)

Research News

Nov 15, 2023

Data Gap in SARS-CoV-2 Cases in Animals

News

Nov 14, 2023

FTX Collapse: New Method for Assessing the Solvency of Cryptocurrency Exchanges

People

Nov 10, 2023

Double Honors for CSH Researchers

News

Nov 13, 2023

New scientific methods for analyzing criminal careers

Press

Why reports that Western civilisation will soon collapse are premature


New Scientist, Dec 5, 2023

Press

Best ideas books of 2023


The Guardian, Dec 5, 2023

Press

Wissenschaft kritisiert fehlenden Datenzugang


ORF, Dec 4, 2023

Press

Forscher sagt: „2024 wird das System in den USA möglicherweise zusammenbrechen“


Die Presse, Nov 14, 2023

Press

Klima und Geschichte


Die Presse, Nov 4, 2023

Press

Daten mit Gewicht: Analysen von Lieferketten zeigen auch Steuerlücken


Die Presse, Oct 20, 2023

Press

Krypto-Forscher über DeFi: “Würde von De-facto-Centralized-Finance sprechen”


brutkasten, Oct 27, 2023

Press

Scientists say Western sanctions against China ‘toothless’ without better supply chain data


South China Morning Post, Oct 20, 2023

Press

Climate change has toppled some civilizations but not others. Why?


Grist, Oct 16, 2023

Press

Chinas E-Autos kommen, und Europa darf nicht naiv sein


Der Standard, Oct 9, 2023

Publication

P. Klimek, A. Aykac, S. Thurner

Forensic analysis of the Turkey 2023 presidential election reveals extreme vote swings in remote areas

PLoS ONE 18(11) (2023) e0293239

Publication

M. Pangallo, A. Aleta, et al.

The unequal effects of the health-economy tradeoff during the COVID-19 pandemic

Nature Human Behaviour (2023) DOI: 10.1038/s41562-023-01747-x

Publication

A. Nerpel, A. Käsbohrer, C. Walzer, A. Desvars-Larrive

Data on SARS-CoV-2 events in animals: Mind the gap!

One Health 17 (2023) 100653 DOI: 10.1016/j.onehlt.2023.100653

Publication

G. Heiler, T. Pham, J. Korbel, J. Wachs, S. Thurner

A large-scale empirical investigation of specialization in criminal career

Scientific Reports 13 (2023) 17160

Publication

A. Pichler, C. Diem, et al.

Building an alliance to map global supply networks: New firm-level data can inform policy-making

Science 382(6668) (2023) 270-272.

Publication

R. Prieto-Curiel, G. M. Capedelli, A. Hope

Reducing cartel recruitment is the only way to lower violence in Mexico

Science 381(6664) (2023) 1312-1316

Publication

B. Méro, A. Borsos, et al.

A High-Resolution, Data-Driven Agent-Based Model of the Housing Market

Journal of Economic Dynamics and Control (2023) 104738

Publication

S. Juhász, G. Pintér, et al.

Amenity complexity and urban locations of socio-economic mixing

EPJ Data Science 12 (2023) 34

Publication

R. Hanel, S. Thurner

Equivalence of information production and generalised entropies in complex processes

PLOS ONE 18(9) (2023) e0290695

Publication

K. Frenken, F. Neffke, A. van Dam

Capabilities, institutions and regional economic development: a proposed synthesis

Cambridge Journal of Regions, Economy and Society (2023) rsad021

Publication

G. Orlandi, D. Hoyer, et al.

Structural-demographic analysis of the Qing Dynasty (1644–1912) collapse in China

PLoS ONE 18(8) (2023) e0289748

Publication

N. Kushwaha, E.D. Lee

Discovering the mesoscale for chains of conflict

PNAS Nexus 2(7) (2023) pgad228