The ancient Chinese proverb pretty much sums up the situation of anyone held to a belief by fear of the alternative. It is true of many religions, including Atheism, which, as practiced by some, but not all, can be a religion. But, it is not true of all religious people or all atheists.
We need to learn to stop fearing what we don’t believe. Relax. It has no power over us and may even contain meaning. Let what you ride be a peaceful mount – and let it be sturdy.