Well, you definitely have trust issues, perhaps for good reason but, nonetheless.
It's a process, all the expulsions took years to build up to and were generally gradual affairs that were true grassroots, bottom up affairs.
Often with rulers punishing their own people for anti-jewish behavior beforehand.