By the way, when I said "harmless, I meant harmless to non-Muslims.
The problem with this type of argument is that it relies on a sort of double standard. For instance my neighbor could do all sorts of things to his wife and family which would be perfectly "harmless" to me but I don't think that affects his wife and children's legal rights one bit!