I've always had a mix of both and never had any trouble beyond some displaying to the girls which is quite funny when they're scrawny teens! If you're killing for Christmas it's unlikely to be a problem. Kept longer, the males do square up to each other a bit in the spring.
Stags have a higher ratio of bone to meat so although heavier and bigger, are not necessarily meatier.