shouldn't it be his right to walk away?

I definitely believe that a woman should CONSIDER the man's feelings, but the man isn't going to be the one affected the same emotionally and physically. And there are always TWO people involved in making a baby.