I suppose if you ate an intact billy goat, that would taste "goaty". Those I have eaten have been castrated billy goats, and definitely did not taste funny. If milk and cream is cooled correctly, it should not taste goaty, but yes, it does have a stronger taste than cows milk, until you get used to it.
There is a farmers market not far from us, and a lady has a goat meat stall, selling chops etc. She will also buy excess billy kids from people, and rears them free range until around 9months I think, so its a nice life for them. I am sure she has 150 goats, including breeding goats, so not sure what she does with all the milk!!