I would just wear the dress without the jeans, but if you like the jeans look, go for it.