Well, sometimes a single complaint can create disproportional responses, but that is a 'bug' of most societal management systems - when dealing with nonlinear systems like humans (or worse, societies) there is always the risk of minor actions causing major reactions, both positive and negative. You can get famous for repeating some random old quote, or excommunicated for dressing slightly differently than the norm (or not different enough etc.).
The important thing is that while such bans/reactions can happen, they generally happen very rarely - on average, a minor action/annoyance/etc. will result in minor reactions.