Well if you want to milk your goats you will need somewhere covered (ideally) to milk them and having to trudge through a field to get there (and back with full milk buckets) may not be that funny on a rainy/stormy/snowy autumn/winter morning.
I also would have thought that being able to stand up in your milking parlour would be necessary, and most calf hutches are not that tall?
I think people use them successfully as field shelters for youngstock over the summer, but not for accommodation for milkers, especially over winter.
You should be able to get a garden shed type building, strengthen the floor (with heavy boards) and sides(with OSB boards), add some extra ventilation above head height and hey presto goat shed...