If there is a problem with coercion, deal with it. Yet again we see the punishment of all to try and deal with the few for administrative convenience and forced collectivism. It is plainly wrongheaded, vindictive and a reaction of fear that will be counter-productive.
That said, a person is free to wear what they want, but must accept that others are free to respond (non-violently) to that wearing. If you set up a barrier, display overt separateness, then others might decide do the same in response, such as refuse to serve or refuse to interact. That is as much a free choice as is wearing a niqab or burqa. Should an employee of a company take unilateral action against the wishes of the proprietor, e.g. a barman not serving* when the Landlord has no issue, then that is a matter of contract law, not criminal law.
The only exception would be in situations where the State enforces a monopoly service under law and in such situations commonsensical arrangements should be put in place to enable access thereof.
* I know, I know.