This was something that was brewing in my head the more I learned about him. All of his stories about Past Phil paint him as The Big Dick on Campus when he was in high school (lifted weights, women wanted him, and didn't he supposedly play football?) and some kind of bizarre chimera of Frat Boy and Academic Overachiever in college (the "drank and smoked weed then puked and shat" story). And it's not unheard of for Phil to try and rewrite history.
I think Phil is a noodly-armed faggot dork who is desperate to portray himself as anyone who he perceived as more successful/popular than him growing up. It's also likely that they're the same people who pushed him around, since we know how much he likes to wield the tiny bit of power that he has.
Note 1: I'm discounting one story he's told from his high school years: the "muh depressed, muh psychopharmocological cocktail" one. Reason being is the context under which it was brought up, that being while Phil was pity-trawling. Is it possible that he was telling the truth? Yes. Was it very convenient given that he was hard on the begging (and, as I recall, shielding himself from criticism)? Also yes.
Note 2: liking video games or Dragonball doesn't make you a geek anymore, Phil. You have the most plebian tastes of anyone who's ever picked up a controller. If you wanna be a Chad Bro (or at least act like one because being one...well, that ship has sailed) then you can do that and still stream CoD. You pick up an Altelier title and 100% it at some point, we'll talk about renewing your nerd card.
You're still a faggot, though.