I think he enjoys the sex without a real relationship. If you're ok with that then fine but don't shut yourself off to others.