This relationship does not sound healthy. If you keep letting things slide like this, then you will turn into a doormat....it is up to you. Will he become crazy angry if you bring this up even though you are not yelling or being crazy yourself?