Even I prefer a female doctor under most circumstances. They tend to be more open to any variety of conversations... and I can only imagine how a male gyn might think of you more like a collection of parts than a young woman who should be humping her cute ass as much as possible.
ooops, sorry, I get carried away.
Don't put up with it. You can get a second opinion without giving up on doctor #1, even if he turns out to be wrong. One mistake doesn't say anything about everything else he knows.