I stick the chain in some panniers. To be fair, I was contemplating sticking it over my shoulder, but it weighs a fecking tonne! Long term I'm gonna get a second chain to leave at work, as the weight of the chain on one side of the bike is quite noticeable.
I do have a mate whose been biking for years who does go round with chain over shoulder mind...