I don't comment often and I just happened to click on this video of yours today...sometime God does put things in your path, even your own talk about this.
We have thought of this so many times ourselves but in our own version (not tons of land for farming which I'd love but @winstonalden would hate;) ) but these type of decisions.
For my two cents to you and completely not asked, my advice is land...LAND LAND LAND you cannot make or build more land...Buy Land. Go to where the land is and get as much as you can afford.
I'm not sure if you are familiar with modular housing but it's factory made housing sort of a step up from mobile homes adn you can design off basic shapes. They are made quicker in a factory and delivered and assembled not as expensive as traditional stick build onsite housing. You could start with a good base shape on your 40 acres and plan openings and doorways to be future connections as you can afford to add another house to that and keep growing it, meanwhile you have LAND to spread out and increase your garden and animals and your homestead.
For what it's worth from the words of a complete stranger who has nothing to gain or lose by your decisions, I just felt compelled to type this to you. The best of luck to your family and follow your hearts. :)
Completely agree @donnadavisart Land.....that's payed for.
Thank you for your input. I sincerely appreciate it.