A LED can also be used as a light sensor. Light falling on an LED generates a voltage. The color of the lens (poorly) filters in that color. So an orange LED selects predominately the orange light.
I don't know if they will be sensitive enough for you though. A CdS cell (photo resistor) or...