Yes, he gave you backwards instructions. To have the pin low normally, then high when you press the button, you will want to connect the pin to ground via a resistor. Then with a switch connected from the input to VCC, you will have high only when pressing the switch. If the pin is floating, you...