I noticed there's lots on council verges on roads little and large, but apparently the rules are a bit more relaxed these days because ragwort is a host plant for many species of wildlife. We have just come back from our son's house in a town, and his wife is actively encouraging ragwort - there are loads of bees, hoverflies and so on enjoying the flowers, and no agricultural land nearby to infest, so no probs.
Like you, we pull out any ragwort which appears on our land and yes, this year there has been much more growing. I think it is probably to do with the very dry summer.