If enough people have cash balances in bitcoin, it will be difficult to persecute bitcoiners.
Sure, they could require you to pay your taxes, but in order to get ahold of BTC that's rightfully yours, they'll have to use literal violence, not implied violence.
That's why the more the merrier. It's easier to be violent towards a minority than a majority.