That will be fine with respect to the voltage delivered to the strip, however if these batteries are charged in series, you need to keep the load on each battery as close as possible to the same.
If the LED strips are identical and use resistors to limit current, you can connect pairs of these...