Yeah, I suppose. But what really bothers me (and quite a few other people, I imagine) is that after all these years, long after he's forgotten Kacey and Liquids' names, the Game Place regulars, Mary and the galpals are still very much branded on his mind. Being obsessed over by a washed up transvestite who hasn't even seen you for years can't possibly be a pleasant experience.
And perhaps it's because, on some level, he knows they weren't trolls, and that his dealings with them are the best proof out there that his life wouldn't be substantially better without the trolls, or all these websites about him. Which would require him to acknowledge that he is at least partially responsible for the sorry state of his life, and everyone knows how he feels about responsibility.
Since he can't resolve what happened between him and them in a way favourable to him, he's resigned to telling himself they were trolls, as in his mind, that puts all the blame on their shoulders, not his. Of course, I'm sure Borb played into it by explaining it away as a massive conspiracy against their special snowflake. Not to mention, I'm pretty sure I read somewhere that conspiracy theories in general are seductive to autistic people.