If a small capacitance affects the output, it looks as if the amp is oscillating at high frequency. Have you by-passed the power supply properly?
You should try a Zobel network (Wkipedia) across the output, perhaps a 100n capacitor in series with 10 ohm to correct the phase of the load and...