You're right. From my experience, saying anathema to a Christian will make him, at worst, condescendingly preach that you'll be going to hell and he'll pray for you to see the light.
Saying something like "I don't believe in vaccines" to a liberal, however...