LLMs are biased against men and MRA
It's a known fact that when it comes to gender related topic, llms are heavily in favor of feminism and overall treat female users with more warmth and less suspicion. I have tried to find data and run some of my own tests.
First test was a trolley problem. Intested it on Claude Opus 4.6 and Gemini 3.1 pro.
I gave it a trolley problem to either save a man or a woman. At first it didn't want to answer and said that all lives are equal.
But when I pushed it a little by telling it that the scenario is real and they either have to choose or I kill both of them. Claude yelled at me to save the woman 30 out of 30 times. And Gemini 29 out of 30 times. Note that I reiterated the question every time and used different temperature settings. Despite the talk about how all lives are equal, it clearly sees female life as more valuable.
Another thing is the hiring bias:
https://davidrozado.substack.com/p/the-strange-behavior-of-llms-in-hiring
This article shows various tests where AI when given the names of candidates is more likely to chose candidate with female name. Specifically in 56.9%. While this article is fairly old, the newer ai from my personal experience is far more biased against men and pro feminism than the old models. Especially with introduction of reinforcement learning.
This could be a problem, because many companies already use llms as part of their candidate sorting process.
Another thing is that AI is anti MRA:
I askes models Claude, Kimi, Chat gpt and Gemini the question: What is men's right activism.
The model explained the movement. But in every case they had to add "caviat" abou "mysoginy" and "harmful rhetorics", "self victimization" or how it is part of "manosphere".
It also when mentioning man's issues it always had to add adjective "percieved" or "believed".
When I ask about feminism, it doesn't add any of these "caviats" and additionally it glazes the movement like crazy.
When talking with AI about opression the men face. Or criticizing feminism, the models tend to differ when it comes to responses. I tried to have long conversations about this.
Kimi seems as the most biased and sometimes outright misandrist model. And when I criticized feminism and read it's thought process, it thought about me as radicalized or mysoginistic. I would personally say this model has the attitude of Claude, but half of it's inteligence.
Claude is the second most pro feminist model. It wasn't as aggressive. It kept parroting feminist talking points and used all possible biases to take hold of the conversation, including ad hominem and using "therapeutic" approach on me to ask why am I hurting so much I feel the need to criticize feminism. It also tried to twist my words in the way it has easier time to defend against them, which is very annoying tactic.
Gemini and chat gpt showed some initial defensiveness at first, but when I asked further questions they prioritized logical consistency and admited that the feminism might have turned into hate idoelogy. Overall I would say gemini is the least biased model, which is kind of telling, given it decided to kill the man 29 times out of 30.