I'd ensure there is an on/off switch. The dimmer not reducing the brightness to zero is a good indication that the lights are on.
If the dimmest setting is too bright, get a better dimmer.
Placing a resistor across a LED is an option for a single low current device, not for a mains operated...