It’s always fine to make an accurate reference to a person’s sex.
It’s never fine to throw a tantrum in response to a person making an accurate reference to a person’s sex.
It’s always wrong for public authority to abridge anyone’s right to free speech.