Often yes, but it doesn't have to be.
You could ground the Positive side, or ground the power supply mid-way between Pos and Neg to divide the voltage between the two with respect to ground. For example you could read 12v between Pos and Neg, so you've got -6v on Neg and +6 on Pos with respect...