I am not sure of complete schematic , battery and power load , so I can only guess.
There are a few subtle behaviors of relays, comparators and batteries you need to understand regarding hysteresis. A complete schematic would help.
Batteries have memory. So when weak and unloaded, the voltage...