It's not a red flag if you're okay with it. And it's not a red flag if he told you this from the start. Your guy seems pretty clear about what he wants and doesn't want. You just need to decide for yourself if you're okay living that way or not.