If it is a small enough stepper, you can run it directly from the parallel port. There are a few different types and how you connect it will depend upon this.
You did not mention what you know about programming, which operating system you will use or which language you prefer to program in, so I will spell out the basics.
A stepper just uses a binary like code which pulses the coils in a sequence. You have the choice here of full step and half step.
The simplest form is to use a 4 wire stepper in full step mode and send:
0000
delay
1000
delay
0000
delay
0100
delay
0000
delay
0010
delay
0000
delay
0001
delay
(All of this is required for one step)
then repeat.
To go in the other direction, reverse the sequence. Notice that the parallel port will continue to send the data until it is cleared. This is the reason to send zeros after each step. One delay sets the "on" time and the other delay sets the "off" time.
The parallel port uses pins 2 through 7 as an 8 bit word to send data out. You can use the basic command "outport" to send a binary number to this port. LPT1 is Hex378. You will have to send the code to this port. A computer will not guess which port you are using.
Start with a delay of "wait 500" and work up or down from there. Running the stepper too fast will actually cause it to skip steps and seem like it is going slower.
After some testing, you can add features in your program which can change the delay timing or the direction on the fly.
Hope this is helpful to get you a start.
MP