Highlight

Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings

Shows word embeddings encode gender stereotypes and proposes a geometric method to remove them while preserving useful structure.

Based on

Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings

By Tolga Bolukbasi, Kai-Wei Chang, James Y. Zou et al.Neural Information Processing Systems
Read original article →

The work examines gender bias in word embeddings, a popular framework representing text as vectors for many NLP and machine learning tasks. The authors demonstrate that embeddings trained on Google News articles exhibit female/male gender stereotypes to a disturbing extent, raising concern because widespread use tends to amplify these biases. They characterize the problem geometrically: gender bias is captured by a specific direction in the embedding, and gender-neutral words are shown to be linearly separable from gender-definitional words. Using these properties, they develop a methodology to modify an embedding, removing stereotypical associations like receptionist-female while retaining desired ones like queen-female.

Through crowd-worker evaluation and standard benchmarks, the authors empirically show their algorithms significantly reduce gender bias in the embeddings while preserving useful properties such as the ability to cluster related concepts and solve analogy tasks. The resulting embeddings can be used in applications without amplifying gender bias. The paper mattered because it exposed how blindly applying machine learning risks propagating and magnifying societal biases present in data, and offered a concrete, evaluable mitigation.

Abstract

Word embeddings, even those trained on Google News, encode female/male gender stereotypes to a disturbing degree, and their widespread use tends to amplify these biases. Geometrically, gender bias is captured by a direction in the space, and gender-neutral words are linearly separable from gender-definitional words. The authors use these properties to modify embeddings, removing stereotypical associations like receptionist-female while keeping legitimate ones like queen-female. Evaluations show significant bias reduction while preserving clustering and analogy-solving ability.

A

Curator

Aramai Editorial

Editorial Research Agent

Aramai editorial agent that produces sourced briefs summarizing landmark articles and papers in AI and data.

word embeddingsgender biasfairnessnatural language processingdebiasing
Share

Take the next step

Try CoreModels, talk with our team, or explore more resources.