You can find class D amps, there is a very common one that is 3W and runs off 5V on Ebay, it costs only a couple of bucks.
As for speakers, I don't know. MadisoundSpeakerStore.com is a good source for raw drivers and info on building speakers. I went there and tried to search for efficient...