Most likely the noise is cause by having the TV volume turned so low. If you solve that problem, I think your noise will go away, at least some of it. Since there is a gain control on your amp, you could simply use a two resistor divider to reduce the TV output by, say a factor of 10. I.e...