---
title: "Man is to Computer Programmer as Woman is — Bolukbasi 2016"
description: "Word embeddings trained on large text collections absorb gender stereotypes."
authors: ["Tolga Bolukbasi", "Kai-Wei Chang", "James Zou", "Venkatesh Saligrama", "Adam Kalai"]
year: 2016
venue: "arXiv:1607.06520"
source: "https://arxiv.org/abs/1607.06520"
doi: "10.48550/arxiv.1607.06520"
arxiv: "1607.06520"
licence: "arXiv — non-exclusive licence to distribute"
licence_url: "http://arxiv.org/licenses/nonexclusive-distrib/1.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/bolukbasi-2016-man-computer-programmer-woman-homemaker/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/bolukbasi-2016-man-computer-programmer-woman-homemaker/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2016](https://md.research.elamur.ai/free/en/papers/2016/page/2/) / Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings

# Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings

**Authors:** Tolga Bolukbasi, [Kai-Wei Chang](https://md.research.elamur.ai/free/en/authors/kai-wei-chang/), [James Zou](https://md.research.elamur.ai/free/en/authors/james-zou/), Venkatesh Saligrama, [Adam Kalai](https://md.research.elamur.ai/free/en/authors/adam-kalai/) · **Year:** 2016 · **Venue:** arXiv:1607.06520 · **Licence:** [arXiv — non-exclusive licence to distribute](http://arxiv.org/licenses/nonexclusive-distrib/1.0/)

**Links:** [Publisher's page](https://arxiv.org/abs/1607.06520) · [PDF](https://arxiv.org/pdf/1607.06520) · [DOI 10.48550/arxiv.1607.06520](https://doi.org/10.48550/arxiv.1607.06520) · [arXiv 1607.06520](https://arxiv.org/abs/1607.06520) · [OpenAlex](https://openalex.org/W2483215953)

**Citations:** 1245 citations (openalex-snapshot · 2026-10-14) · [792](#cited-by) in our library, of the 140673 papers whose bibliographies we read

## Summary
Word embeddings trained on large text collections absorb gender stereotypes. Many search, ranking and other NLP systems reuse them as input features, so these biases can be amplified downstream. The authors study w2vNEWS, the public word2vec model trained on Google News. Its analogy arithmetic produces stereotyped answers, for example pairing woman with homemaker where man is paired with computer programmer. They show that gender is mostly captured by a single direction, which can be estimated from definitional pairs such as she–he. They also find that gender-specific words can be separated linearly from gender-neutral ones. Using these properties, they define two measures: direct bias, where a neutral word leans toward one gender, and indirect bias, where similarity between neutral words is driven by gender. They then propose two algorithms. Hard debiasing ("neutralize and equalize") removes the gender component from neutral words. Soft debiasing trades some bias reduction for keeping the original distances. Ratings from Amazon Mechanical Turk workers confirm that the detected biases match common stereotypes. Hard debiasing cuts stereotyped analogies substantially without hurting standard benchmark performance.

## Key points
- **Main embedding:** w2vNEWS is a word2vec model trained on Google News, with about 3 million English words and phrases in 300 dimensions. Other public embeddings trained with different algorithms show similar biases.
- **Occupations on the she–he direction:** the most "female" ones include homemaker, nurse and receptionist. The most "male" ones include maestro, skipper and protege.
- **Crowd evaluation:** 10 crowd workers rated each generated analogy. Hard debiasing reduced stereotyped analogies from about 19% to about 6%. The number of gender-appropriate analogies (e.g. queen–king, sister–brother) stayed about the same. Soft debiasing removed less bias.
- **Indirect bias:** the softball–football axis is used as an example. Before debiasing, receptionist and waitress sat near the softball end and businessman near the football end. Afterwards these were replaced by sport-related terms such as infielder and midfielder.
- **Limitations:** the same embedding also contains racial stereotypes. The authors leave languages with grammatical gender, such as Ukrainian, as an open question. In those languages most nouns carry a gender marker, so this matters for Ukrainian NLP.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

Fields: [Other](https://md.research.elamur.ai/free/en/shelves/other/)

## Cited by

Cited by

792 papers of our library cite it (of the 140673 whose bibliographies we read); 88 of them have a page here, 704 not yet.

- [Knowledge Graph Based Synthetic Corpus Generation for Knowledge-Enhanced Language Model Pre-training](https://md.research.elamur.ai/free/en/papers/agarwal-2021-knowledge-graph-based-synthetic-corpus/)
- [JW300: A Wide-Coverage Parallel Corpus for Low-Resource Languages](https://md.research.elamur.ai/free/en/papers/agic-2019-jw300-wide-coverage-parallel-corpus/)
- [The Arabic Parallel Gender Corpus 2.0: Extensions and Analyses](https://md.research.elamur.ai/free/en/papers/alhafni-2022-arabic-parallel-gender-corpus-2/)
- [The User-Aware Arabic Gender Rewriter](https://md.research.elamur.ai/free/en/papers/alhafni-2023-user-aware-arabic-gender-rewriter/)
- [Refusal in Language Models Is Mediated by a Single Direction](https://md.research.elamur.ai/free/en/papers/arditi-2024-refusal-language-models-mediated-single/)
- [Evaluating the Underlying Gender Bias in Contextualized Word Embeddings](https://md.research.elamur.ai/free/en/papers/basta-2019-evaluating-underlying-gender-bias-contextualized/)
- [Don't Take the Premise for Granted: Mitigating Artifacts in Natural Language Inference](https://md.research.elamur.ai/free/en/papers/belinkov-2019-don-t-take-premise-granted/)
- [Language (Technology) is Power: A Critical Survey of “Bias” in NLP](https://md.research.elamur.ai/free/en/papers/blodgett-2020-language-technology-is-power-critical/)
- [Interpreting Pretrained Contextualized Representations via Reductions to Static Embeddings](https://md.research.elamur.ai/free/en/papers/bommasani-2020-interpreting-pretrained-contextualized-representations-reductions/)
- [Identifying and Reducing Gender Bias in Word-Level Language Models](https://md.research.elamur.ai/free/en/papers/bordia-2019-identifying-reducing-gender-bias-word/)
- [Sparks of Artificial General Intelligence: Early experiments with GPT-4](https://md.research.elamur.ai/free/en/papers/bubeck-2023-sparks-artificial-general-intelligence-early/)
- [Toward Gender-Inclusive Coreference Resolution](https://md.research.elamur.ai/free/en/papers/cao-2020-gender-inclusive-coreference-resolution/)
- [Toward Gender-Inclusive Coreference Resolution: An Analysis of Gender and Bias Throughout the Machine Learning Lifecycle*](https://md.research.elamur.ai/free/en/papers/cao-2021-gender-inclusive-coreference-resolution-analysis/)
- [German's Next Language Model](https://md.research.elamur.ai/free/en/papers/chan-2020-german-s-next-language-model/)
- [Marked Personas: Using Natural Language Prompts to Measure Stereotypes in Language Models](https://md.research.elamur.ai/free/en/papers/cheng-2023-marked-personas-natural-language-prompts/)
- [Racial Bias in Hate Speech and Abusive Language Detection Datasets](https://md.research.elamur.ai/free/en/papers/davidson-2019-racial-bias-hate-speech-abusive/)
- [RobBERT: a Dutch RoBERTa-based Language Model](https://md.research.elamur.ai/free/en/papers/delobelle-2020-robbert-dutch-roberta-based-language/)
- [Harms of Gender Exclusivity and Challenges in Non-Binary Representation in Language Technologies](https://md.research.elamur.ai/free/en/papers/dev-2021-harms-gender-exclusivity-challenges-non/)
- [Queens are Powerful too: Mitigating Gender Bias in Dialogue Generation](https://md.research.elamur.ai/free/en/papers/dinan-2020-queens-are-powerful-too-mitigating/)
- [GLaM: Efficient Scaling of Language Models with Mixture-of-Experts](https://md.research.elamur.ai/free/en/papers/du-2021-glam-efficient-scaling-language-models/)
- [Adversarial Removal of Demographic Attributes from Text Data](https://md.research.elamur.ai/free/en/papers/elazar-2018-adversarial-removal-demographic-attributes-text/)
- [From Pretraining Data to Language Models to Downstream Tasks: Tracking the Trails of Political Biases Leading to Unfair NLP Models](https://md.research.elamur.ai/free/en/papers/feng-2023-pretraining-data-language-models-downstream/)
- [Bridging the Gap: A Survey on Integrating (Human) Feedback for Natural Language Generation](https://md.research.elamur.ai/free/en/papers/fernandes-2023-bridging-gap-survey-integrating-human/)
- [Bias and Fairness in Large Language Models: A Survey](https://md.research.elamur.ai/free/en/papers/gallegos-2023-bias-fairness-large-language-models/)
- [Lipstick on a Pig: Debiasing Methods Cover up Systematic Gender Biases in Word Embeddings But do not Remove Them](https://md.research.elamur.ai/free/en/papers/gonen-2019-lipstick-pig-debiasing-methods-cover/)
- [Auto-Debias: Debiasing Masked Language Models with Automated Biased Prompts](https://md.research.elamur.ai/free/en/papers/guo-2022-auto-debias-debiasing-masked-language/)
- [Evaluating Large Language Models: A Comprehensive Survey](https://md.research.elamur.ai/free/en/papers/guo-2023-evaluating-large-language-models-comprehensive/)
- [Unlearn Dataset Bias in Natural Language Inference by Fitting the Residual](https://md.research.elamur.ai/free/en/papers/he-2019-unlearn-dataset-bias-natural-language/)
- [Challenges and Strategies in Cross-Cultural NLP](https://md.research.elamur.ai/free/en/papers/hershcovich-2022-challenges-strategies-cross-cultural-nlp/)
- [Social Biases in NLP Models as Barriers for Persons with Disabilities](https://md.research.elamur.ai/free/en/papers/hutchinson-2020-social-biases-nlp-models-as/)
- [Debiasing Pre-trained Contextualised Embeddings](https://md.research.elamur.ai/free/en/papers/kaneko-2021-debiasing-pre-trained-contextualised-embeddings/)
- [Contextualizing Hate Speech Classifiers with Post-hoc Explanation](https://md.research.elamur.ai/free/en/papers/kennedy-2020-contextualizing-hate-speech-classifiers-post/)
- [Examining Gender and Race Bias in Two Hundred Sentiment Analysis Systems](https://md.research.elamur.ai/free/en/papers/kiritchenko-2018-examining-gender-race-bias-two/)
- [GeDi: Generative Discriminator Guided Sequence Generation](https://md.research.elamur.ai/free/en/papers/krause-2021-gedi-generative-discriminator-guided-sequence/)
- [Measuring Bias in Contextualized Word Representations](https://md.research.elamur.ai/free/en/papers/kurita-2019-measuring-bias-contextualized-word-representations/)
- [Sustainable Modular Debiasing of Language Models](https://md.research.elamur.ai/free/en/papers/lauscher-2021-sustainable-modular-debiasing-language-models/)
- [UNQOVERing Stereotyping Biases via Underspecified Questions](https://md.research.elamur.ai/free/en/papers/li-2020-unqovering-stereotyping-biases-underspecified-questions/)
- [Towards Debiasing Sentence Representations](https://md.research.elamur.ai/free/en/papers/liang-2020-debiasing-sentence-representations/)
- [Towards Understanding and Mitigating Social Biases in Language Models](https://md.research.elamur.ai/free/en/papers/liang-2021-towards-understanding-mitigating-social-biases/)
- [Trustworthy LLMs: a Survey and Guideline for Evaluating Large Language Models' Alignment](https://md.research.elamur.ai/free/en/papers/liu-2023-trustworthy-llms-survey-guideline-evaluating/)
- [Gender Bias in Neural Natural Language Processing](https://md.research.elamur.ai/free/en/papers/lu-2018-gender-bias-neural-natural-language/)
- [Gender Disambiguation in Machine Translation: Diagnostic Evaluation in Decoder-Only Architectures](https://md.research.elamur.ai/free/en/papers/manna-2026-gender-disambiguation-machine-translation-diagnostic/)
- [Black is to Criminal as Caucasian is to Police: Detecting and Removing Multiclass Bias in Word Embeddings](https://md.research.elamur.ai/free/en/papers/manzini-2019-black-is-criminal-as-caucasian/)
- [On Measuring Social Biases in Sentence Encoders](https://md.research.elamur.ai/free/en/papers/may-2019-measuring-social-biases-sentence-encoders/)
- [An Empirical Survey of the Effectiveness of Debiasing Techniques for Pre-trained Language Models](https://md.research.elamur.ai/free/en/papers/meade-2022-empirical-survey-effectiveness-debiasing-techniques/)
- [A Survey on Bias and Fairness in Machine Learning](https://md.research.elamur.ai/free/en/papers/mehrabi-2019-survey-bias-fairness-machine-learning/)
- [SemEval-2018 Task 1: Affect in Tweets](https://md.research.elamur.ai/free/en/papers/mohammad-2018-semeval-2018-task-1-affect/)
- [Towards Reliable AI Fairness: Challenges in Steering Features within Bias-Implicated Neurons](https://md.research.elamur.ai/free/en/papers/munoz-2026-reliable-ai-fairness-challenges-steering/)
- [StereoSet: Measuring stereotypical bias in pretrained language models](https://md.research.elamur.ai/free/en/papers/nadeem-2021-stereoset-measuring-stereotypical-bias-pretrained/)
- [A framework for analyzing concept representations in neural models](https://md.research.elamur.ai/free/en/papers/naowarat-2026-framework-analyzing-concept-representations-neural/)
- [Text and Code Embeddings by Contrastive Pre-Training](https://md.research.elamur.ai/free/en/papers/neelakantan-2022-text-code-embeddings-contrastive-pre/)
- [Rating-based property axes: Agentivity and split intransitivity](https://md.research.elamur.ai/free/en/papers/neu-2026-rating-based-property-axes-agentivity/)
- [HONEST: Measuring Hurtful Sentence Completion in Language Models](https://md.research.elamur.ai/free/en/papers/nozza-2021-honest-measuring-hurtful-sentence-completion/)
- [Investigating How LLMs Propagate Female Stereotypes: Comparing What Models Say via Prompts with What They Represent in Their Embeddings](https://md.research.elamur.ai/free/en/papers/nunez-2026-investigating-how-llms-propagate-female/)
- [GPT-4 Technical Report](https://md.research.elamur.ai/free/en/papers/openai-2023-gpt-4-technical-report/)
- [Reducing Gender Bias in Abusive Language Detection](https://md.research.elamur.ai/free/en/papers/park-2018-reducing-gender-bias-abusive-language/)
- [Red Teaming Language Models with Language Models](https://md.research.elamur.ai/free/en/papers/perez-2022-red-teaming-language-models-language/)
- [Learning Transferable Visual Models From Natural Language Supervision](https://md.research.elamur.ai/free/en/papers/radford-2021-learning-transferable-visual-models-natural/)
- [Null It Out: Guarding Protected Attributes by Iterative Nullspace Projection](https://md.research.elamur.ai/free/en/papers/ravfogel-2020-null-it-out-guarding-protected/)
- [Gender Bias in Coreference Resolution](https://md.research.elamur.ai/free/en/papers/rudinger-2018-gender-bias-coreference-resolution/)
- [Reducing Gender Bias in Neural Machine Translation as a Domain Adaptation Problem](https://md.research.elamur.ai/free/en/papers/saunders-2020-reducing-gender-bias-neural-machine/)
- [Self-Diagnosis and Self-Debiasing: A Proposal for Reducing Corpus-Based Bias in NLP](https://md.research.elamur.ai/free/en/papers/schick-2021-self-diagnosis-self-debiasing-proposal/)
- [Predictive Biases in Natural Language Processing Models: A Conceptual Framework and Overview](https://md.research.elamur.ai/free/en/papers/shah-2019-predictive-biases-natural-language-processing/)
- [On Second Thought, Let's Not Think Step by Step! Bias and Toxicity in Zero-Shot Reasoning](https://md.research.elamur.ai/free/en/papers/shaikh-2023-second-thought-let-s-not/)
- [The Woman Worked as a Babysitter: On Biases in Language Generation](https://md.research.elamur.ai/free/en/papers/sheng-2019-woman-worked-as-babysitter-biases/)
- [Towards Controllable Biases in Language Generation](https://md.research.elamur.ai/free/en/papers/sheng-2020-controllable-biases-language-generation/)
- [“I'm sorry to hear that”: Finding New Biases in Language Models with a Holistic Descriptor Dataset](https://md.research.elamur.ai/free/en/papers/smith-2022-i-m-sorry-hear-that/)
- [Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model](https://md.research.elamur.ai/free/en/papers/smith-2022-using-deepspeed-megatron-train-megatron/)
- [Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models](https://md.research.elamur.ai/free/en/papers/srivastava-2022-imitation-game-quantifying-extrapolating-capabilities/)
- [Uncertainty Quantification for Evaluating Gender Bias in Machine Translation](https://md.research.elamur.ai/free/en/papers/staliunaite-2026-uncertainty-quantification-evaluating-gender-bias/)
- [Evaluating Gender Bias in Machine Translation](https://md.research.elamur.ai/free/en/papers/stanovsky-2019-evaluating-gender-bias-machine-translation/)
- [Mitigating Gender Bias in Natural Language Processing: Literature Review](https://md.research.elamur.ai/free/en/papers/sun-2019-mitigating-gender-bias-natural-language/)
- [Intrinsic Bias Metrics Do Not Correlate with Application Bias](https://md.research.elamur.ai/free/en/papers/tarrant-2021-intrinsic-bias-metrics-do-not/)
- [How Far Can Bias Go? Tracing Bias from Pre-Training Data to Alignment](https://md.research.elamur.ai/free/en/papers/thaler-2026-how-far-can-bias-go/)
- [LaMDA: Language Models for Dialog Applications](https://md.research.elamur.ai/free/en/papers/thoppilan-2022-lamda-language-models-dialog-applications/)
- [The Moral Foundations Reddit Corpus](https://md.research.elamur.ai/free/en/papers/trager-2026-moral-foundations-reddit-corpus/)
- [DecodingTrust: A Comprehensive Assessment of Trustworthiness in GPT Models](https://md.research.elamur.ai/free/en/papers/wang-2023-decodingtrust-comprehensive-assessment-trustworthiness-gpt/)
- [Mind the GAP: A Balanced Corpus of Gendered Ambiguous Pronouns](https://md.research.elamur.ai/free/en/papers/webster-2018-mind-gap-balanced-corpus-gendered/)
- [Measuring and Reducing Gendered Correlations in Pre-trained Models](https://md.research.elamur.ai/free/en/papers/webster-2020-measuring-reducing-gendered-correlations-pre/)
- [The Rise and Potential of Large Language Model Based Agents: A Survey](https://md.research.elamur.ai/free/en/papers/xi-2023-rise-potential-large-language/)
- [Men Also Like Shopping: Reducing Gender Bias Amplification using Corpus-level Constraints](https://md.research.elamur.ai/free/en/papers/zhao-2017-men-also-like-shopping-reducing/)
- [Gender Bias in Coreference Resolution: Evaluation and Debiasing Methods](https://md.research.elamur.ai/free/en/papers/zhao-2018-gender-bias-coreference-resolution-evaluation/)
- [Learning Gender-Neutral Word Embeddings](https://md.research.elamur.ai/free/en/papers/zhao-2018-learning-gender-neutral-word-embeddings/)
- [Gender Bias in Contextualized Word Embeddings](https://md.research.elamur.ai/free/en/papers/zhao-2019-gender-bias-contextualized-word-embeddings/)
- [CANVAS: A Multimodal Dataset of Chinese Textbook Images for Bias and Representation Analysis](https://md.research.elamur.ai/free/en/papers/zhu-2026-canvas-multimodal-dataset-chinese-textbook/)
- [VALUE: Understanding Dialect Disparity in NLU](https://md.research.elamur.ai/free/en/papers/ziems-2022-value-understanding-dialect-disparity-nlu/)
- [Counterfactual Data Augmentation for Mitigating Gender Stereotypes in Languages with Rich Morphology](https://md.research.elamur.ai/free/en/papers/zmigrod-2019-counterfactual-data-augmentation-mitigating-gender/)
- [Representation Engineering: A Top-Down Approach to AI Transparency](https://md.research.elamur.ai/free/en/papers/zou-2023-representation-engineering-top-down-approach/)

## Cite

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@misc{bolukbasi2016man,
  title = {{Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings}},
  author = {Bolukbasi, Tolga and Chang, Kai-Wei and Zou, James and Saligrama, Venkatesh and Kalai, Adam},
  year = {2016},
  doi = {10.48550/arxiv.1607.06520},
  eprint = {1607.06520},
  archivePrefix = {arXiv},
  url = {https://doi.org/10.48550/arxiv.1607.06520}
}
```

- [← previous Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answering](https://md.research.elamur.ai/free/en/papers/goyal-2016-making-v-vqa-matter-elevating/)
- [next → Many Languages, One Parser](https://md.research.elamur.ai/free/en/papers/ammar-2016-many-languages-one-parser/)
- [↑ back to papers of 2016](https://md.research.elamur.ai/free/en/papers/2016/page/2/)

## References

41 references, 2 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. J. Angwin, J. Larson, S. Mattu, and L. Kirchner. Machine bias: There’s software used across the country to predict future criminals. and it’s biased against blacks., 2016. [find](https://scholar.google.com/scholar?q=J%2E+Angwin%2C+J%2E+Larson%2C+S%2E+Mattu%2C+and+L%2E+Kirchner%2E+Machine+bias%3A+There%E2%80%99s+software+used+across+the+country+to+predict+future+criminals%2E+and+it%E2%80%99s+biased+against+blacks%2E%2C+2016%2E)
2. C. Aschwanden. The finkbeiner test: What matters in stories about women scientists? DoubleXScience, 2013. [find](https://scholar.google.com/scholar?q=C%2E+Aschwanden%2E+The+finkbeiner+test%3A+What+matters+in+stories+about+women+scientists%3F+DoubleXScience%2C+2013%2E)
3. S. Barocas and A. D. Selbst. Big data’s disparate impact. Available at SSRN 2477899, 2014. [find](https://scholar.google.com/scholar?q=S%2E+Barocas+and+A%2E+D%2E+Selbst%2E+Big+data%E2%80%99s+disparate+impact%2E+Available+at+SSRN+2477899%2C+2014%2E)
4. E. Beigman and B. B. Klebanov. Learning with annotation noise. In ACL, 2009. [find](https://scholar.google.com/scholar?q=E%2E+Beigman+and+B%2E+B%2E+Klebanov%2E+Learning+with+annotation+noise%2E+In+ACL%2C+2009%2E)
5. A. J. Cuddy, E. B. Wolf, P. Glick, S. Crotty, J. Chong, and M. I. Norton. Men as cultural ideals: Cultural values moderate gender stereotype content. Journal of personality and social psychology, 109(4):622, 2015. [find](https://scholar.google.com/scholar?q=A%2E+J%2E+Cuddy%2C+E%2E+B%2E+Wolf%2C+P%2E+Glick%2C+S%2E+Crotty%2C+J%2E+Chong%2C+and+M%2E+I%2E+Norton%2E+Men+as+cultural+ideals%3A+Cultural+values+moderate+gender+stereotype+content%2E+Journal+of+personality+and+social+psychology%2C+109%28)
6. A. Datta, M. C. Tschantz, and A. Datta. Automated experiments on ad privacy settings. Proceedings on Privacy Enhancing Technologies, 2015. [find](https://scholar.google.com/scholar?q=A%2E+Datta%2C+M%2E+C%2E+Tschantz%2C+and+A%2E+Datta%2E+Automated+experiments+on+ad+privacy+settings%2E+Proceedings+on+Privacy+Enhancing+Technologies%2C+2015%2E)
7. C. Dwork, M. Hardt, T. Pitassi, O. Reingold, and R. Zemel. Fairness through awareness. In Innovations in Theoretical Computer Science Conference, 2012. [find](https://scholar.google.com/scholar?q=C%2E+Dwork%2C+M%2E+Hardt%2C+T%2E+Pitassi%2C+O%2E+Reingold%2C+and+R%2E+Zemel%2E+Fairness+through+awareness%2E+In+Innovations+in+Theoretical+Computer+Science+Conference%2C+2012%2E)
8. J. Eisenstein, B. O’Connor, N. A. Smith, and E. P. Xing. Diffusion of lexical change in social media. PLoS ONE, pages 1–13, 2014. [find](https://scholar.google.com/scholar?q=J%2E+Eisenstein%2C+B%2E+O%E2%80%99Connor%2C+N%2E+A%2E+Smith%2C+and+E%2E+P%2E+Xing%2E+Diffusion+of+lexical+change+in+social+media%2E+PLoS+ONE%2C+pages+1%E2%80%9313%2C+2014%2E)
9. M. Faruqui, J. Dodge, S. K. Jauhar, C. Dyer, E. Hovy, and N. A. Smith. Retrofitting word vectors to semantic lexicons. In NAACL, 2015. [find](https://scholar.google.com/scholar?q=M%2E+Faruqui%2C+J%2E+Dodge%2C+S%2E+K%2E+Jauhar%2C+C%2E+Dyer%2C+E%2E+Hovy%2C+and+N%2E+A%2E+Smith%2E+Retrofitting+word+vectors+to+semantic+lexicons%2E+In+NAACL%2C+2015%2E)
10. M. Feldman, S. A. Friedler, J. Moeller, C. Scheidegger, and S. Venkatasubramanian. Certifying and removing disparate impact. In KDD, 2015. [find](https://scholar.google.com/scholar?q=M%2E+Feldman%2C+S%2E+A%2E+Friedler%2C+J%2E+Moeller%2C+C%2E+Scheidegger%2C+and+S%2E+Venkatasubramanian%2E+Certifying+and+removing+disparate+impact%2E+In+KDD%2C+2015%2E)
11. C. Fellbaum, editor. Wordnet: An Electronic Lexical Database. The MIT Press, Cambridge, MA, 1998. [find](https://scholar.google.com/scholar?q=C%2E+Fellbaum%2C+editor%2E+Wordnet%3A+An+Electronic+Lexical+Database%2E+The+MIT+Press%2C+Cambridge%2C+MA%2C+1998%2E)
12. L. Finkelstein, E. Gabrilovich, Y. Matias, E. Rivlin, Z. Solan, G. Wolfman, and E. Ruppin. Placing search in context: The concept revisited. In WWW. ACM, 2001. [find](https://scholar.google.com/scholar?q=L%2E+Finkelstein%2C+E%2E+Gabrilovich%2C+Y%2E+Matias%2C+E%2E+Rivlin%2C+Z%2E+Solan%2C+G%2E+Wolfman%2C+and+E%2E+Ruppin%2E+Placing+search+in+context%3A+The+concept+revisited%2E+In+WWW%2E+ACM%2C+2001%2E)
13. P. Glick and S. T. Fiske. The ambivalent sexism inventory: Differentiating hostile and benevolent sexism. Journal of personality and social psychology, 70(3):491, 1996. [find](https://scholar.google.com/scholar?q=P%2E+Glick+and+S%2E+T%2E+Fiske%2E+The+ambivalent+sexism+inventory%3A+Differentiating+hostile+and+benevolent+sexism%2E+Journal+of+personality+and+social+psychology%2C+70%283%29%3A491%2C+1996%2E)
14. J. Gordon and B. Van Durme. Reporting bias and knowledge extraction. Automated Knowledge Base Construction (AKBC), 2013. [find](https://scholar.google.com/scholar?q=J%2E+Gordon+and+B%2E+Van+Durme%2E+Reporting+bias+and+knowledge+extraction%2E+Automated+Knowledge+Base+Construction+%28AKBC%29%2C+2013%2E)
15. A. G. Greenwald, D. E. McGhee, and J. L. Schwartz. Measuring individual differences in implicit cognition: the implicit association test. Journal of personality and social psychology, 74(6):1464, 1998. [find](https://scholar.google.com/scholar?q=A%2E+G%2E+Greenwald%2C+D%2E+E%2E+McGhee%2C+and+J%2E+L%2E+Schwartz%2E+Measuring+individual+differences+in+implicit+cognition%3A+the+implicit+association+test%2E+Journal+of+personality+and+social+psychology%2C+74%286%29%3A1464%2C+1998)
16. C. Hansen, M. Tosik, G. Goossen, C. Li, L. Bayeva, F. Berbain, and M. Rotaru. How to get the best word vectors for resume parsing. In SNN Adaptive Intelligence / Symposium: Machine Learning 2015, Nijmegen. [find](https://scholar.google.com/scholar?q=C%2E+Hansen%2C+M%2E+Tosik%2C+G%2E+Goossen%2C+C%2E+Li%2C+L%2E+Bayeva%2C+F%2E+Berbain%2C+and+M%2E+Rotaru%2E+How+to+get+the+best+word+vectors+for+resume+parsing%2E+In+SNN+Adaptive+Intelligence+%2F+Symposium%3A+Machine+Learning+2015%2C+Nijm)
17. J. Holmes and M. Meyerhoff. The handbook of language and gender, volume 25. John Wiley & Sons, 2008. [find](https://scholar.google.com/scholar?q=J%2E+Holmes+and+M%2E+Meyerhoff%2E+The+handbook+of+language+and+gender%2C+volume+25%2E+John+Wiley+%26+Sons%2C+2008%2E)
18. O. İrsoy and C. Cardie. Deep recursive neural networks for compositionality in language. In NIPS. 2014. [find](https://scholar.google.com/scholar?q=O%2E+%C4%B0rsoy+and+C%2E+Cardie%2E+Deep+recursive+neural+networks+for+compositionality+in+language%2E+In+NIPS%2E+2014%2E)
19. R. Jakobson, L. R. Waugh, and M. Monville-Burston. On language. Harvard Univ Pr, 1990. [find](https://scholar.google.com/scholar?q=R%2E+Jakobson%2C+L%2E+R%2E+Waugh%2C+and+M%2E+Monville%2DBurston%2E+On+language%2E+Harvard+Univ+Pr%2C+1990%2E)
20. J. T. Jost and A. C. Kay. Exposure to benevolent sexism and complementary gender stereotypes: consequences for specific and diffuse forms of system justification. Journal of personality and social psychology, 88(3):498, 2005. [find](https://scholar.google.com/scholar?q=J%2E+T%2E+Jost+and+A%2E+C%2E+Kay%2E+Exposure+to+benevolent+sexism+and+complementary+gender+stereotypes%3A+consequences+for+specific+and+diffuse+forms+of+system+justification%2E+Journal+of+personality+and+social+psy)
21. M. Kay, C. Matuszek, and S. A. Munson. Unequal representation and gender stereotypes in image search results for occupations. In Human Factors in Computing Systems. ACM, 2015. [find](https://scholar.google.com/scholar?q=M%2E+Kay%2C+C%2E+Matuszek%2C+and+S%2E+A%2E+Munson%2E+Unequal+representation+and+gender+stereotypes+in+image+search+results+for+occupations%2E+In+Human+Factors+in+Computing+Systems%2E+ACM%2C+2015%2E)
22. T. Lei, H. Joshi, R. Barzilay, T. Jaakkola, A. M. Katerina Tymoshenko, and L. Marquez. Semi-supervised question retrieval with gated convolutions. In NAACL. 2016. [find](https://scholar.google.com/scholar?q=T%2E+Lei%2C+H%2E+Joshi%2C+R%2E+Barzilay%2C+T%2E+Jaakkola%2C+A%2E+M%2E+Katerina+Tymoshenko%2C+and+L%2E+Marquez%2E+Semi%2Dsupervised+question+retrieval+with+gated+convolutions%2E+In+NAACL%2E+2016%2E)
23. O. Levy and Y. Goldberg. Linguistic regularities in sparse and explicit word representations. In CoNLL, 2014. [find](https://scholar.google.com/scholar?q=O%2E+Levy+and+Y%2E+Goldberg%2E+Linguistic+regularities+in+sparse+and+explicit+word+representations%2E+In+CoNLL%2C+2014%2E) [our card](https://md.research.elamur.ai/free/en/papers/levy-2014-linguistic-regularities-sparse-explicit-word/)
24. T. Mikolov, K. Chen, G. Corrado, and J. Dean. Efficient estimation of word representations in vector space. In ICLR, 2013. [find](https://scholar.google.com/scholar?q=T%2E+Mikolov%2C+K%2E+Chen%2C+G%2E+Corrado%2C+and+J%2E+Dean%2E+Efficient+estimation+of+word+representations+in+vector+space%2E+In+ICLR%2C+2013%2E)
25. T. Mikolov, I. Sutskever, K. Chen, G. S. Corrado, and J. Dean. Distributed representations of words and phrases and their compositionality. In NIPS. [find](https://scholar.google.com/scholar?q=T%2E+Mikolov%2C+I%2E+Sutskever%2C+K%2E+Chen%2C+G%2E+S%2E+Corrado%2C+and+J%2E+Dean%2E+Distributed+representations+of+words+and+phrases+and+their+compositionality%2E+In+NIPS%2E)
26. T. Mikolov, W.-t. Yih, and G. Zweig. Linguistic regularities in continuous space word representations. In HLT-NAACL, pages 746–751, 2013. [find](https://scholar.google.com/scholar?q=T%2E+Mikolov%2C+W%2E%2Dt%2E+Yih%2C+and+G%2E+Zweig%2E+Linguistic+regularities+in+continuous+space+word+representations%2E+In+HLT%2DNAACL%2C+pages+746%E2%80%93751%2C+2013%2E) [our card](https://md.research.elamur.ai/free/en/papers/mikolov-2013-linguistic-regularities-continuous-space-word/)
27. E. Nalisnick, B. Mitra, N. Craswell, and R. Caruana. Improving document ranking with dual word embeddings. In www, April 2016. [find](https://scholar.google.com/scholar?q=E%2E+Nalisnick%2C+B%2E+Mitra%2C+N%2E+Craswell%2C+and+R%2E+Caruana%2E+Improving+document+ranking+with+dual+word+embeddings%2E+In+www%2C+April+2016%2E)
28. B. A. Nosek, M. Banaji, and A. G. Greenwald. Harvesting implicit group attitudes and beliefs from a demonstration web site. Group Dynamics: Theory, Research, and Practice, 6(1):101, 2002. [find](https://scholar.google.com/scholar?q=B%2E+A%2E+Nosek%2C+M%2E+Banaji%2C+and+A%2E+G%2E+Greenwald%2E+Harvesting+implicit+group+attitudes+and+beliefs+from+a+demonstration+web+site%2E+Group+Dynamics%3A+Theory%2C+Research%2C+and+Practice%2C+6%281%29%3A101%2C+2002%2E)
29. D. Pedreshi, S. Ruggieri, and F. Turini. Discrimination-aware data mining. In Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining, pages 560–568. ACM, 2008. [find](https://scholar.google.com/scholar?q=D%2E+Pedreshi%2C+S%2E+Ruggieri%2C+and+F%2E+Turini%2E+Discrimination%2Daware+data+mining%2E+In+Proceedings+of+the+14th+ACM+SIGKDD+international+conference+on+Knowledge+discovery+and+data+mining%2C+pages+560%E2%80%93568%2E+ACM%2C+20)
30. J. Pennington, R. Socher, and C. D. Manning. Glove: Global vectors for word representation. In EMNLP, 2014. [find](https://scholar.google.com/scholar?q=J%2E+Pennington%2C+R%2E+Socher%2C+and+C%2E+D%2E+Manning%2E+Glove%3A+Global+vectors+for+word+representation%2E+In+EMNLP%2C+2014%2E)
31. K. Ross and C. Carter. Women and news: A long and winding road. Media, Culture & Society, 33(8):1148–1165, 2011. [find](https://scholar.google.com/scholar?q=K%2E+Ross+and+C%2E+Carter%2E+Women+and+news%3A+A+long+and+winding+road%2E+Media%2C+Culture+%26+Society%2C+33%288%29%3A1148%E2%80%931165%2C+2011%2E)
32. H. Rubenstein and J. B. Goodenough. Contextual correlates of synonymy. Communications of the ACM, 8(10):627–633, 1965. [find](https://scholar.google.com/scholar?q=H%2E+Rubenstein+and+J%2E+B%2E+Goodenough%2E+Contextual+correlates+of+synonymy%2E+Communications+of+the+ACM%2C+8%2810%29%3A627%E2%80%93633%2C+1965%2E)
33. E. Sapir. Selected writings of Edward Sapir in language, culture and personality, volume 342. Univ of California Press, 1985. [find](https://scholar.google.com/scholar?q=E%2E+Sapir%2E+Selected+writings+of+Edward+Sapir+in+language%2C+culture+and+personality%2C+volume+342%2E+Univ+of+California+Press%2C+1985%2E)
34. B. Schmidt. Rejecting the gender binary: a vector-space operation. [http://bookworm.benschmidt.org/posts/2015-10-30-rejecting-the-gender-binary.html](http://bookworm.benschmidt.org/posts/2015-10-30-rejecting-the-gender-binary.html), 2015. [↗](http://bookworm.benschmidt.org/posts/2015-10-30-rejecting-the-gender-binary.html)
35. J. P. Stanley. Paradigmatic woman: The prostitute. Papers in language variation, pages 303–321, 1977. [find](https://scholar.google.com/scholar?q=J%2E+P%2E+Stanley%2E+Paradigmatic+woman%3A+The+prostitute%2E+Papers+in+language+variation%2C+pages+303%E2%80%93321%2C+1977%2E)
36. L. Sweeney. Discrimination in online ad delivery. Queue, 11(3):10, 2013. [find](https://scholar.google.com/scholar?q=L%2E+Sweeney%2E+Discrimination+in+online+ad+delivery%2E+Queue%2C+11%283%29%3A10%2C+2013%2E)
37. A. Torralba and A. Efros. Unbiased look at dataset bias. In CVPR, 2012. [find](https://scholar.google.com/scholar?q=A%2E+Torralba+and+A%2E+Efros%2E+Unbiased+look+at+dataset+bias%2E+In+CVPR%2C+2012%2E)
38. P. D. Turney. Domain and function: A dual-space model of semantic relations and compositions. Journal of Artificial Intelligence Research, pages 533–585, 2012. [find](https://scholar.google.com/scholar?q=P%2E+D%2E+Turney%2E+Domain+and+function%3A+A+dual%2Dspace+model+of+semantic+relations+and+compositions%2E+Journal+of+Artificial+Intelligence+Research%2C+pages+533%E2%80%93585%2C+2012%2E)
39. C. Wagner, D. Garcia, M. Jadidi, and M. Strohmaier. It’s a man’s wikipedia? assessing gender inequality in an online encyclopedia. In Ninth International AAAI Conference on Web and Social Media, 2015. [find](https://scholar.google.com/scholar?q=C%2E+Wagner%2C+D%2E+Garcia%2C+M%2E+Jadidi%2C+and+M%2E+Strohmaier%2E+It%E2%80%99s+a+man%E2%80%99s+wikipedia%3F+assessing+gender+inequality+in+an+online+encyclopedia%2E+In+Ninth+International+AAAI+Conference+on+Web+and+Social+Media%2C+2015%2E)
40. D. Yogatama, M. Faruqui, C. Dyer, and N. A. Smith. Learning word representations with hierarchical sparse coding. In ICML, 2015. [find](https://scholar.google.com/scholar?q=D%2E+Yogatama%2C+M%2E+Faruqui%2C+C%2E+Dyer%2C+and+N%2E+A%2E+Smith%2E+Learning+word+representations+with+hierarchical+sparse+coding%2E+In+ICML%2C+2015%2E)
41. I. Zliobaite. A survey on measuring indirect discrimination in machine learning. arXiv preprint arXiv:1511.00148, 2015. — [arXiv:1511.00148](https://arxiv.org/abs/1511.00148) [find](https://scholar.google.com/scholar?q=I%2E+Zliobaite%2E+A+survey+on+measuring+indirect+discrimination+in+machine+learning%2E+arXiv+preprint+arXiv%3A1511%2E00148%2C+2015%2E+%E2%80%94+%5BarXiv%3A1511%2E00148%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F1511%2E00148%29)