Yes. Freedom of speech is essential as it enables the search for the truth. But as a society, we will fail if we aren't actually searching for the truth. The freedom is essential but not sufficient.
But society has to have some common values - for example, is it child abuse to transition your child, or to refuse to do so? Or do parents just own their children for any purpose? A decision has to be made on this kind of question, you can't have it all ways.