Mine get hay most of the time, but just now I have the large haylage bales open for the sheep, (and this year it was so dry that it is actually like hay inside the bales!), so goats get it too.
Last year I was very short on hay (and the haylage wasn't good enough quality) and also fed horsehage in the morning - the goats loved it.
Silage is said to taint the milk, and if you only have a few goats both haylage and silage are spoiled before you get through the (large) bales.
Over the summer (well from May to October) my goats get mainly freshly cut grass from the various overgrown patches in our and neighbours garden, and no hay at all for the adults (as I didn't have any...) Worked well, just have to be careful with bottle fed kids. They still got hay (secret stash...).