I have never seen AA Li-Ion cells because they are not supposed to be able to fit into the battery holder for AA alkaline, Ni-Cad or Ni-MH cells. They are usually a larger 18650 size (18mm diameter by 650mm long).
The "power adapter" has an expensive switch (that will usually be in the wrong...