Personally I'd never resort to violence unless in self defence - its completely pointless and most the time will not solve any problem only breed more contempt and further your original problems.
Its hard I admit not to go over the top though in these situations as its very frustrating, I know.
I have a neighbour who comes here for holidays, he bought part of the farm when it was split as the ex owner slowly went bankrupt. I have had a few run-ins with him verbally - normally when its the evening and I'm having a beer

I tend to be very noisy - partly why I moved to the middle of nowhere (I've always had noise complaints and council bans of owning electrical amplification equipment). The last was a complaint here was about having a radio on while building my patio at 5pm, only a tin pot roberts radio too - he stated that he was here for the quiet and didnt want my noise invading his space. After a big argument I decided to move the radio, turn it down, and start cleaning the sheds out with the mini digger till 10 at night.
I told him that I lived here and worked every day and found that the radio helped to pass the time and the comedy show on radio two was something I enjoyed listening too and laughing out loud at, if he didnt like it - goto an oldies holiday camp!!
We have a campsite on our back fields and one day a punter told my misses not to ride the quad to feed the horses at 8pm cos of the noise - yes they had a kid that was trying to sleep - but wtf it is advertised as a campsite and working farm, did he really expect there to be no work going on past the 5.30 he normally quits at?
I had a call from the council in my last terrace house before we got here about the noise of the toilet flushing!! When the police came round I told them that I loved staying up all night flushing the toilet to keep him awake - I dont think he understood satire, but did apologise for having to answer such a ludicrous claim.
My advice is carry on as normal and ignore him, I know its hard, but as long as you dont go and break his legs, eventually the law will be on your side when he finally oversteps the mark and then you can go after him.
Baz