Rammy meat perhaps? Did you castrate your lambs if they were male? Were they rigs maybe?
I have never found mutton to be distasteful, more intense perhaps, like lamb but more so if that make sense?
Rammy meat is a taste all of its own however (I kind of like it but I am very odd
) and is the most likely to cause comment out of all the types sheep meat in my experience.