You can do better. there's a lot of things that send red flags, at least they seem like red flags to me. They might not be important to you though.
first of all, I hate to sound old fashioned or whatever, but the guy is 25, almost 10 years younger than you. Probably a lot more immature than you realize. That doesn't seem to be an issue, so take it as you will. But 25 year old divorced guy? really? he probably just want to get laid as much as possible right now. I'm assuming, so...

You're right, at your age, you should know that you are worth way more than that. You shouldn't be #2. Do you really want to be competing with 20 year olds for a guy's attention. Who's to say he won't find someone else he likes more. Find someone more mature who will treat you as the number one girl in his life, not as the "back-up" he goes back to when he gets dumped