There are some important differences between batteries and a 4.5V power supply.
Firstly, the voltage on the batteries will change from maybe 4.8V when new down to a little over 3V when the batteries are to flat to produce any noticable light from the LEDs.
The 4.5V power supply, if...