I know nothing about apricots but if it were an apple or plum I'd say you're not pruning the new growth enough if the branches are getting too long and weak to bear the amount of fruit set. In which case given it's a stone fruit, wait til summer pruning and take half the length of the new growth on enough of the branches to give the overall tree a balanced shape and remove (pinch) out some of the excess fruit to let the rest grow safely and probably bigger as a result.
As I say, I'm no expert on the trees I do have and apricots are not in my repertoire at all, so look for more local expertise, but that'd be my concern. I have a plum tree that I let carry too much last year and a 3" branch cracked right up in the old wood which is really sad to see. It is still budding profusely all the way down from there, hundreds of fruit potentially on that section, but I will have to take it off in the summer and lose all those fruit, and it might still have got damp in by then. A real shame but I just pruned it too lightly trying to keep as much fruit as possible and not confident enough to really get in there.