Obvious as it may sound, people with authoritarian beliefs hiding behind free speech actually consider it as a weakness akin empathy. It allows losers like them to amplify their reach despite not being in power. They abandon their “free speech absolutist” postures the moment they think they are in power.
It depends on the source of the consequences.
Social consequences? Completely fine, even desirable.
Legal consequences? This is where trouble starts and freedom of speech is no longer given.