Bias and fairness
How AI can repeat unfair patterns from its data, and what you can do about it.
What is it?
AI models learn from huge amounts of human-made data, such as text and images from the internet. That data contains stereotypes, gaps and uneven representation of people, languages and cultures. A model can repeat or even amplify these patterns, for example by assuming a doctor is male or by working less well for some accents or skin tones.
Fairness work tries to measure and reduce these effects. It matters most when AI is used for decisions about people, such as hiring, lending, housing or education, where unfair results can cause real harm.
Which models use it?
- Language models such as the GPT, Claude, Gemini and Llama families are tested and adjusted by their developers to reduce biased outputs.
- Image generators such as Midjourney, DALL-E and Stable Diffusion have shown stereotyped results for some prompts.
- Speech recognition and face analysis systems have been found to perform unevenly across groups of people.
- Open-source toolkits such as Fairlearn and IBM's AI Fairness 360 help teams measure bias in their own systems.
How to use it
- Notice assumptions in AI answers, such as gender, age, nationality or culture, that you did not ask for.
- Ask the AI to give varied examples or to consider different groups and perspectives.
- Test the same request with small changes, such as a different name or location, and compare results.
- Do not use AI output alone to make decisions about people; keep a human reviewer involved.
- If you build with AI, test it on data from all the groups your users belong to.
- Report biased or offensive outputs through the app or provider's feedback tools.
Benefits
- Awareness of bias helps you get more balanced and inclusive results.
- Testing for bias builds trust with users and reduces the risk of harm.
- Diverse prompts and examples often produce more creative and useful outputs too.
Limits and risks
- Bias cannot be fully removed because it comes from the data and from how fairness is defined.
- Different fairness goals can conflict, so trade-offs are often needed.
- Fixes can make a model overcorrect or refuse harmless requests.
- Many systems are not transparent about their data, which makes bias hard to audit.
Prompt template
Copy it, replace the parts in [brackets] and paste it into any AI chat.
Review the text below for bias. Point out any stereotypes, assumptions about gender, age, culture, disability or background, and wording that could exclude people. For each issue, quote the phrase, explain why it may be a problem, and suggest a fairer alternative. Keep the original meaning and tone. Audience: [who will read this] Text: [paste your text]
More in Safety and society
- Hallucinations and fact-checkingWhy AI sometimes states false things with confidence, and how to check its answers.
- Privacy and your dataWhat happens to what you type into AI tools, and how to protect personal information.
- Prompt injection and AI securityHow hidden instructions in content can trick AI tools, and how to stay safe.
- Deepfakes, watermarking and content credentialsHow AI-made images, voices and videos are spotted and labelled.
- Copyright and AI contentWho owns AI-made work, and why the rules are still being decided.
- AI safety and responsible useSimple habits for using AI honestly, safely and with good judgement.