That module is unregulated and really only suitable for a constant voltage. If using the car battery out of the car, then it’ll be ok. On the other hand, in the car, the voltage could be as much as 14.6V.
I’d be inclined to open the speaker and maybe connect your 12VDC adapter directly if...