We often fear the worst case. We fear getting rejected, settling for a job we don't want, or being poor.
But why not let these fears help you?
Consider, for one week, to live as if you were extremely poor. Wear only a white T-shirt and jeans, eat cheap food such as rice and beans, use the cheapest bathroom appliances you can find, and walk or carpool instead of driving. In general, minimize costs wherever you can.
If you follow through, I think a few interesting things will happen. I think you'll realize dressing well, eating fancy foods, or driving a nice vehicle may not be so important for your well-being. I predict you'll gain more confidence to pursue what you desire, even if it doesn't follow the beaten path, because you'll realize the worst case isn't so bad.