Without the zobel network, the amplifier might oscillate and blow your tweeter. It will be noisy if it is oscillating, and maybe is getting hot.
If the noise is a high frequency hiss, and it reduces when the volume control is turned down, then the noise comes from the source that feeds the amp...