The noise is likely to be the starter relay dropping out when the battery is presented with the large electrical load of the starter motor. If the battery is OK, then the problem may be loose or corroded connections between the battery. Check everything is clean and tight.