More a preventative thing than actually answering the question, but I put a sheet of kitchen roll in there and replace it after a couple of weeks use.
I used on on the kids when they were small.Dont know what its like on helmets or grown ups..Maybe remove the linings and give them a run through the washing machine?Most likely due to heat at the moment though.