Radio Shack have a bridge rectifier, 25A 50V #276-1185 $3.49, which should do. Remember that this will dissipate quite a bit of heat so will need boltng to a heat sink if used at full current.
While you are at the shop, get a capacitor to replace the dodgy one as others have said.
Have...