We live on our smallholding - if you can find a place with an existing dwelling then choose that above somewhere without. Getting PP seems such a stressful business, and all that living in a caravan for years first
I love being able to pop out to check the ewes, collect the eggs or to pick a few veggies without having to drive or cycle to the land and spend the whole day there to make it worthwhile. Living on the place is so much better for security too. Also, when you live on your land it's somehow much more of an integral part of your home. Many, many moons ago we used to have allotments and travelling the 5 miles each way was always the downside.
Our house here was semi-derelict when we bought it (some might say it still is

) but the land and everything else was more important. We have taken a while to renovate it as we started with the land first, whereas most people would do up the house first. It depends on which is the most important to you, but don't be put off by the state of the house as it can always be renovated, whereas the land is much more difficult to modify.