You can get those replacement blanked off spigots in most large DIY stores. B&Q, Wickes, etc.
There's virtually no water pressure involved so the rubber glove and jubilee clip trick should work.