What is the magnitude of said voltage and with what kind of voltmeter are you measuring it?
Even when off, mosfets, like any real switch, will have a bit of leakage. The S12303 datasheet speaks of as much as 100nA, which would produce a reading of 1V in a standard 10Megohm input impedance...