If there's no signs of wear and the steering feels good leave them. It's not the most enjoyable job to do. Getting the lower race out is difficult because the part you hit against is very narrow.