C3 and C6 are supply bypass capacitors. They keep the supply from bouncing around which might cause low frequency oscillation (motorboating put, put, put ...) because of the internal resistance of a battery that causes poor voltage regulation.
All battery powered circuits should have a supply...