Did you fit a resistor with in line with the LEDs? You might need to limit the current in the LED to a safer value. With LEDs a[size=1em] small change in voltage can produce a big change in current, that's probably what's slightly energizing the neutral lamp.[/size]
Treat everything in life the way a dog would- if you can't eat it or foc it, forget it.