As above, most of it is the difference between peak and peak-to-peak. Some of it might be noise.
If the scope has a vertical channel bandwidth limit function, set it to its lowest corner frequency.
Get a 0.1 uF, 250 Vac, X, X2, or Y rated capacitor and connect it directly across the...