He definitely does seem to have something against men of color, what with all his comments over the years about "saggy pants thugs" and "mocha men" and his tall tales of random Hispanic hit men hired by Taylor Swift stalking him around town in black Jettas and threatening his life. He's lashed out at women who rejected him with comments along those lines many times. He also invariably goes nuts if there's a Hispanic/Black/mixed man in an Instagram shot with one of his current obsessions. At one point he did so even after it was pointed out the man in the shot was the woman's father, with a comment that went something like "He shouldn't touch you that way!" because Russhole always has to be creepy as shit.
It's a weird sort of racism, because you're right, he seems perfectly fine with women of color--well, fine with them in the sense that he treats them just like he treats white women. As in, he believes they are all mindless vending machines and if you put in cheap flowers and trite flattery, they're supposed to immediately provide sex in return, and if they don't it's DISCRIMUNASHUN. But he seriously seems threatened by men of color. It's only white guys that he calls "studs" and tries to suck up to. Not sure why that is.