I used to be like that but have calmed down a bit since we 'downsized' We realised that we actually did have too much to do and, neither of us being in the best of health, we cut back on the variety of stock we keep. We got rid of the ducks altogether, reduced our sheep breeds to one (although another seemed to sneak in there), we keep sheep numbers right down and we are strict with ourselves over that. We didn't get more pigs, or goats as we would love to do, and I haven't set up my fleece flock again.
We stopped making hay for some of our neighbours, as that was far more stressful than just doing our own, and was way too much work for no return (and they usually managed to be somewhere else at baling/carting/stacking time)
We grassed over a good half of the veg garden and work the rest with machinery where we can. We improved our fencing so stock and dogs can't get out, so no need to worry there. We did have a seep hose for watering the polytunnel but it silted up so we're back to watering with a hose, and that does take up a lot of time. I am learning that I don't have to preserve every single veg and piece of fruit, and I now work out how much we will use, add a bit on for the boys and their families, and once those are made I make no more. Some fruit is wasted, but in fact the birds and hens have a happy feast, and I don't have to chuck out so much unused stuff after a couple of years spoiling in the freezer.
So have a good think about where you could reduce your workload, because being stressed by your smallholding is not what it's all about. Are there areas where you overproduce? Would your stock be less of a problem with reduced numbers? We had found that we made no more from our animals having a smaller flock, once time and feed were taken into consideration, but they were so much healthier with a lower stocking density.
Nowadays, we still have far more to do than we have time for, but it's so much better than sitting in front of the telly bored out of our trees
and nothing like as much as we used to push ourselves to do back before we took the decision to downsize.
We did get our front garden poshified, to give me somewhere to sit and relax, but of course there's always weeding to be done, planting out, cutting back etc. I've learnt to say 'sod it' and go back to the job when I feel more up to it.