That depends on whether or not your goats have access to grazing or not!
Our goats eat less hay in the summer, but not until at least mid May up here might be earlier in England. If your goats aren't milking or producing anything, and they are getting grass or a lot of greens then yes you can reduce their food. I would still give them some, because it keeps them friendly!
Beth