If you create something distinguishable, remarkable, or something worth talking about, you’ll most certainly be confronted with criticism.
Some people won’t like it, some people will hate it, some people will be annoyed by it, some people will feel the need to express their discomfort with it and some people will say that you’ve gone too far, that you should make it more comprehensible, that you should tone it down.
If you do so, critiques will be silenced. They’ll have nothing to say about it any longer. And a chance to annoy somebody will diminish. But the problem is that the chance to delight somebody will diminish as well.
In position like this, I’d much rather annoy a few and delight a few than annoy nobody and delight nobody. How about you?