They could both think they're right. I didn't watch Coles interview but he apparently thinks he got kicked off when Ben came in and told him to pack it up because they found his replacement. Cole actually did up and pack up on the spot after this, when before he was just kind of waiting around not doing shit. Sam might not have been aware of this interaction at all, since I think he was doing other stuff in the house at the time, so when Cole came downstairs they assume it was voluntary. Basically everyone is retarded. I wonder if Cole actually would want to come back but based on what he's said after the show he wants to be done with everything relating to this.