It all
started when I was preparing a PowerPoint presentation on ‘Gender Sensitivity’
I asked ChatGPT to give me a picture where one partner was cooking and the other
was making a chair. The first picture that ChatGPT gave me was of a man
finishing the chair and the woman cooking. I asked it to change the roles, make
the man cook and the woman do the chair. He helped me with the picture but
something else changed too. The lady became tomboyish, had short hair, wore
trousers. I asked the app to make the lady wear Indian clothes and hairdo but
my problem was not resolved. Her hair still remained short and she looked
masculine. I was confused and bitter…why did such a simple set of instructions
appear so difficult to such a technologically driven application?
I planned a
few questions and asked directly :
IS AI GENDER-BIASED?
And the answer☹(ctrl+c/ctrl+v)directly from chatGPT
It
can be — but not because AI is inherently sexist or
has a personal agenda.
The bias comes from three main sources:
1. Training
Data Bias –
AI learns patterns from huge datasets, many of which are scraped from the
internet, books, media, and other human-made sources. If those sources have
gender stereotypes (e.g., associating men more with leadership and women with
caregiving), the AI can unintentionally replicate them.
2. Algorithmic
Design –
Even if data is balanced, the way algorithms weigh, classify, or predict can
magnify small biases. For example, a hiring AI might favor male candidates
because the historical company data showed more men in senior roles.
3. Human
Feedback Loops
– AI models often improve through user feedback. If that feedback carries bias
(consciously or unconsciously), the system can reinforce it — a bit like a
rumor growing stronger the more people repeat it. In short: AI reflects our
world back at us, warts and all. That’s why researchers now spend a lot of
effort on debiasing
techniques, ethical guidelines, and more representative
datasets — but no system is 100% bias-free yet.
ME: Can you show me specific references where
AI is gender-biased
Here are specific,
documented examples and references showing how AI systems can exhibit gender
bias — backed by research, real-world cases, and academic studies:
1. Bias in Hiring Algorithms
Amazon’s AI
Recruiting Tool
- Amazon’s automated hiring system learned
from past resumes, which were mostly from male applicants and engineers.
The AI began penalizing resumes from women, especially those
including all-female educational histories or women-specific terms,
leading to gender bias in candidate scoring. It was eventually abandoned
because of this bias. Digital Adoption
LinkedIn
Job Recommendation Systems
- Research has shown LinkedIn’s AI
algorithm tended to favor male candidates over equally qualified
women in job recommendations, reflecting systemic bias in job search
ranking tools. Crescendo.ai
Resume
Ranking Bias by LLMs
- A study on state-of-the-art language
models found AI tools favored male-associated names far more often than
female-associated names when ranking resumes, demonstrating bias in
gendered hiring relevance. washington.edu
2. Gender Bias in Image Generation and Representation
Stereotyped
AI Images
- Image generation models like Midjourney
and DALL·E often portray occupations in gender-traditional ways —
e.g., accountants and professionals as men, and caregiving professions as
women — reinforcing stereotypes. TUM
Generative
AI Bias Against Women
·
Academic
research on generative AI tools (Midjourney, Stable Diffusion, DALL·E 2) found gender
bias in isual depictions: women were portrayed with stereotypical
expressions (e.g., smiling more) and biased age/facial features compared to
men, suggesting gendered portrayals. arXiv
3. Language and Translation Bias
Machine
Translation Defaults to Male
- Research on gender bias in machine
translation (e.g., Google Translate) shows the system often defaults to male
pronouns or male occupations (like “engineer”) when a translation
could be gender-neutral, reflecting and amplifying societal bias in
training data. arXiv
4. Facial Recognition Performance Differences
·
Facial
Recognition Systems (Gender Shades)
The Gender Shades study found commercial facial recognition tools (e.g.,
Amazon Rekognition, IBM, Microsoft) performed better on male faces than
female faces — with especially high error rates for dark-skinned women,
highlighting intersectional gender and race bias in AI. Wikipedia
5. Structural and Systemic Bias in AI
Bias
Reflected Across AI Systems
- Gender bias isn’t limited to one
application; AI models trained on societal data tend to mirror existing
gender inequalities (e.g., associating “nurse” with women and “doctor”
with men), which can widen gender gaps if unchecked. Consilium
UN Women on
AI Reinforcing Gender Inequality
- According to UN Women, AI systems — from
hiring to healthcare to governance — can amplify pre-existing gender
biases, further disadvantaging women if not proactively corrected. UN Women
Underrepresentation in AI Development
Participation
Gap
- Studies highlight that women are
significantly underrepresented in AI development and at AI
conferences, which contributes to biased systems because fewer female
perspectives shape the design and testing of models. UNESCO
Why This Happens
- Bias in Training Data: AI learns from text, images, and decisions that reflect
historical gender inequality, so it reproduces those patterns. The Gradient
- Lack of Diverse Development Teams: Fewer women in AI roles means less scrutiny of gender issues
during development. Premier Science
- Algorithm Design Limits: Even with balanced data, how AI measures relevance or similarity
can still implicitly favor male-associated patterns. The Gradient
- Systematic reviews on AI gender bias, summarizing detection and mitigation. M-Chair
- Machine Translation Gender Bias (Prates
et al.), experimental evidence of gender
defaults in translation outputs. arXiv
So, if you are still
wondering and saying aloud ‘REALLY??’
Yes! It is ‘Really’
gender-biased. We may have come far but for gender equality in the truest sense
we still have a far way to go.
For real progress to happen,
change should take place at the base, that is at the basics. Because of the years
of patriarchal domination in the different fields, subordination is so embedded
in the system that it is difficult to remove its traces even from a system
generated app.
However, things are
changing, we are now comfortable seeing our mothers read and fathers wash dishes. Looking at it the other way, men need not always be the bread-earner, women
can be. Our eyes are still not set to it, but it has to be. Empowerment of
women will come only when we learn to respect her opinion, choice and thinking.
Negligence, domination and subordination
have pushed women so far in the background that to be equal she needs that
small advantage – in the form of supportive hands – liberal, progressive man,
government and the society.