Spoke to insurance, they said without proof he has no claim. Apparfently I did the right thing calling them because it could have gone against me, cheers for the advice earlier on that one.
I said I might pop round tonight and she said probably no need, she has all she needs to defend me, she didn't advise not to but said if he was aggressive in the car and then a bit spikey to me on the phone to leave it to the insurers just incase it gets complicated with him kicking off.
So, I'm going to leave it to the insurers. He will have to stump up his excess in order to get the repair done and then it gets assessed as to who is liable for the bill so that alone might put him off.
The only thing she said I could do is wander past his drive (on the pavement) and take a pic of the front of his car just to show no significant damage.
Cheers guys, hopefully this won't go against us. Purely because of the way he intimidated my wife on the road I hope he gets nothing out of it.