Yes, they are poisonous, if eaten by animals, or I suppose humans! They release poisonous toxins. But as I see it, once rotted down on the compost heap, they will be ok. Animals and humans do not eat direct from the compost, do they? So, by the time the rhubarb compost is used, it will be fine. I have no problem with doing it that way anyway.