Eventually, the people you're around often will become accustomed to it or at least keep their comments to themselves.
Yes, this is true. Oddly enough, we don't have any problems with his family, I suppose because he's been submissive his whole life so they're just used to him (and his mother is DOMINANT; she runs the family and nobody questions her, nobody would dare).

My family's beginning to get used to him; they've figured out that if they want to ask a question to him specifically (and not to us), that if they say his name first I'll be quiet and he will answer. That's not something we planned, it just comes out like that.

I was, as Oz said, venting about my frustration with the general public. I appreciate everyone sharing their experiences as well; sometimes it's comforting to know you're not the only one who has to face things.