People get into these messy situations by not admitting the guy is acting like an asshole. Forget all his words and look at his actions.

Actually, forget the guy. Is this the type of behavior you are proud of? Do you really want to be that kind of girl? He is being unfaithful, and you're allowing and encouraging it. I would stop this entire situation. There's nothing confusing about it. He's a cheater...this is how they operate.