The charging requires just 2 lines in the usb; during Data transfer 4, and the phone acts as a slave. But using as an OTG adapter requires more contacts to be linked - the phone needs to be "informed" that it needs to perform as a Host.
The fact that physically moving the connector does...