Well, it's not quite perfect, but soldering it did lower the drop, so now it's going from 3.93 with just the 10μf cap on the input, and the 100μf on the output, down to 3.76V when I put the 20Ω resistor on there.
That still seems kind of high, it should be closer to 3.8.