Yes, any bread, biscuits, fruit, including bananas and their skin, and even orange peel is desired by some of my goats .....urgh, it must taste horrible. Not all my goats like green veg though, some turn their noses up at broccoli, but all will eat carrots, and some eat potato peelings. Only thing I can think of not to give is the big green rhubarb tops, and potato tops, as in the big green tops before you dig them up. Onions not liked, but mine will happily eat Celery.
Goats are browsers, not grazers, and would happily do without grass if they had free access to trees for the leaves and branches, and things like bramble and fruit bushes. I have watched my goats over the years, and know thats their preference.
I always have a little tub of sheep nuts in the food barrel. Its really useful if the goats escape. A shake of that, and they think of food, and come running. An empty feed sack works good too. You need to have a few cunning plans up your sleeve, as goats are very brainy!!