The hard version of this is never strangers disagreeing. It is a parent who keeps asking when you will get a proper job, or a friend who goes slightly quiet whenever you describe what you are building.
Some of that is disapproval. Much more of it is just a different life, with different fears inside it, and no way for anyone to see out from behind their own eyes.
Accepting it does not require pretending you do not mind. You can want a person's blessing, not get it, and go anyway. Those are three separate things, and the third one does not wait on the second.