It's too late to call CPS now, you didn't have enough of a backbone and let her leave. But I would make it clear that you're going to do so next time.