If you turn a heating element off, it continues to heat as it cools down.
PID control is to maintain steady control, without overshoot.
IOW as the temp approaches the set point it anticipate over shoot and starts to turn off before the set point, and then on/off at increasingly smaller...