Just because I can't enter your house with a bag over my head is no reason why I shouldn't be allowed to wear one.
But I agree you have the right to deny me entry
... and I think you can extend that principle as far as it will go.
I'm not saying you can't wear a bag over your head. Just not in my house. Or in my bank. Or in my store. Or in airports, or train stations, or other areas where large groups of people are crammed together by necessity.
"A casual stroll through the lunatic asylum shows that faith does not prove anything." - Friedrich Nietzsche