Hi Trigger,
The power source (battery) doesn't produce any noise. The noise comes from inside a noisy opamp, U1, and is amplified by its high gain.
If you divide R1 (10K) into two 5K resistors with their junction decoupled to ground, you will decrease the output of the microphone, because its...