Depends on the main audio driver really - some are bridged outputs and some single-ended - but, yes, that's the basic principle.
The red wire would go to the tip, the black to the sleeve (of the jack plug) - you might have to short the two 'tip' connects to get a mono signal.
If you could post...