@23.5v open circuit, should be ok.
Consider the solar panel as a bucket of water and your battery as an empty receptacle, difference in level (voltage) will allow current to run.
Have you done a short circuit current test??
I can imagine it won't be much.
You will need some type of blocking...