See, now this is what I like: an explanation for your reasoning. Things are starting to make sense. You're not a very strong-willed person, and women have always been key figures in your life. Perhaps your mother was overbearing and intimidating (just a hypothesis, nothing more), but whatever the case women terrify you. Yet you want to please them. You care about what they think, and therefore you pay close attention to whatever they have to say in regards to your behavior. Some women you hold in high regard make the same tasteless, sarcastic comment about rape and you take it to heart. Ergo, we get Rape Ape, destroyer of Western sluts.
I'm more struck by how the most influential figures in his life are women. This kind of gives sense to his hatred because women make him feel powerless, and he wants to feel in control of his own life.