That would certainly cause a vibey drive!
You need a rubber in that me son, and the sooner the better!
And while your going to take it off, that will give you a perfect excuse to put a new rubber in the other end.
Or am even better idea is upgrade your shock for a nice new one, simpler job and makes you smile more lol