We've tried a few goat cheeses here and found the taste varies from OK to absolutely terrible. One we were given stank so badly when opened that it went straight outside, in a sealed bag, to the bin- that brand was supposed to be a great delicacy! We were told that if a Billy was anywhere near, his scent would get into the milk and be intensified in the cheese making process. Whether that's true I don't know.
Try Brebis, which is ewe's milk cheese. We've tried a dozen or so in the search for a replacement for English Cheddar and they vary from amazing to a hint of bitterness. Speciality of the Pyrenees. Now they sell English Cheddar in the supermarket- very expensive and not a patch on Brebis.