I had similar problem, but mine was with fluctuation of the panel all over. My solution was to power up the pannel on bipolar, i.e. +-5V with midpoint. I suppose your panels allow you to connect them this way, or hopefully they do. The good thing is that you only need few miliampers to power up...