Backyard chicken forum had a thread about a hen who'd been poisoned by eating ragwort
Since it causes liver damage and we've all got livers, I would have thought it was poisonous to most living things, ducks included (cinnabar caterpillars not, obviously).
I pull the horrid stuff up too, but you should wear gloves and then burn it