They also refuse to use the term waifu apparently. I think what I’m gathering is waifu = engrish = casually racist since it’s making fun of ESL accents. Also, I think a lot of them would find the origin of the word to be problematic since it’s from an Azumanga Daioh character creeping on one of the high schoolers.
You're right, my post was made kind of quickly so I couldn't explain more in depth but they indeed refuse in general to use the word "waifu/waifuism" or even anything associated with it, there are multiple reasons for this and for most it's a mix of multiple, what I've seen would be the following:
1. Slightly racist, as you already said.
2. 4chan origins, the fact that waifuism pretty much started on 4chan is commonly known and for them the site is the internet Boogeyman where all the incels, nazis, school shooters etc (I don't believe this just in case, it's from their POV) therefore that's enough to want to distance themselves from it.
3. Waifuism is right leaning, this goes hand in hand with the origins being from 4chan, I've seen some people sort of tie waifuism with the political right, I would say it's mostly due to the next point.
4. Rules, most waifu communities ""enforce"" (extremely loosely) what you would expect on a normal functional relationship to some degree, the main part being monogamy, this goes against many on the ficto/yume/selfship.
Meanwhile these groups follow a more "love is love" kind of values, so anything and everything is accepted (polygamy, constantly changing partners etc).
To conclude, while making the topic political is a bit dumb (in my opinion) they kind of distance themselves due to doing that.
Here's the TLDR, waifu communities lean more towards traditional/right values while ficto/yume/selfship communities lean towards more progressive/left or let's say LGBT values (as many are part of this community or extremely supportive).