Just replace it - No idea why it does it when it's running but it's obviously not working right.
I fitted an adjustable flash rate relay which was cheap cos I waited 4 weeks for it to arrive from China but there are some in the UK, just a bit dearer. You might have to make up a couple of wires with spade end connectors as mine didn't fit directly onto my Fazer 1000.