This is hard advice to follow, I know, but try to relax, and don't assume the worst. Someone gazing in your direction might be simply curious, or even lost in their own thoughts. It's been said here many times that most people are so wrapped up in their own thing that they won't even notice you. And if they do, the odds are they don't care.
One thing that you yourself can do is use your experience living in the world as a woman to be sure your spouse is dressed in a way that blends with the other females at whatever venue or area you are going to. No sense in drawing extra attention to yourselves with an inappropriate outfit.