You need to know how much current the motors draw. Then you need a power supply that can provide more than 4 times that. It is that simple. If the power supply voltage is dropping from 12V to 6V, then it is not capable of providing the current needed by the motors.
Actually, with motors, it...