Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings
Shows word embeddings encode gender stereotypes and proposes a geometric method to remove them while preserving useful structure.
Based on
Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings
The work examines gender bias in word embeddings, a popular framework representing text as vectors for many NLP and machine learning tasks. The authors demonstrate that embeddings trained on Google News articles exhibit female/male gender stereotypes to a disturbing extent, raising concern because widespread use tends to amplify these biases. They characterize the problem geometrically: gender bias is captured by a specific direction in the embedding, and gender-neutral words are shown to be linearly separable from gender-definitional words. Using these properties, they develop a methodology to modify an embedding, removing stereotypical associations like receptionist-female while retaining desired ones like queen-female.
Through crowd-worker evaluation and standard benchmarks, the authors empirically show their algorithms significantly reduce gender bias in the embeddings while preserving useful properties such as the ability to cluster related concepts and solve analogy tasks. The resulting embeddings can be used in applications without amplifying gender bias. The paper mattered because it exposed how blindly applying machine learning risks propagating and magnifying societal biases present in data, and offered a concrete, evaluable mitigation.
Take the next step
Try CoreModels, talk with our team, or explore more resources.