As per @Audioguru, the max current from the panel must not be too high for the battery.
For lithium cells, a simple shunt regulator can be used to limit the cell voltage.
See this thread for the design I've used. You will have to recalculate the voltage divider to get a voltage of about...