I'm inclined to agree, but that wasn't the cause of Sam's rage towards Jimmy, imo Sam just correctly sees Jimmy as a punk who likes to throw hands against women but who pussies out when a man confronts him. He offered Jimmy a second chance after he headbutted Taylor and in return Jimmy attacked Brit over a toy phone. Tonight was all about revenge, sweet lasting revenge, and to expose Jimmy as the punk he is, to both the other fish and to his shrinking fanbase.
I think the scenario you talk about is more relevant to Cole and Jon, Sam genuinely took a liking to them and they both shit on him in return.