This looks like one of those very muddy pools that innocent questions lead us into, but I'll risk dipping my toe in!
"It seems that there is no way to completely ignore current, as changing voltage will change current and thus vibrate the speaker coil. " - Absolutely! You have it spot on...