The March, 2005 datasheet of the LE00 low-dropout regulator is pretty new and says the ICs should have a bypass capacitor with an ESR from 0.1 to 10 ohms. Every schematic shown has a polarized output bypass capacitor.
Ceramic caps have an ESR much lower, and are not polarized.
Try a ceramic...