Kind of. It's definitely true that without the output capacitor, a buck converter won't work properly.
I would describe it more as an energy converter, using an inductor. During the time that the switch (transistor, MOSFET, whatever) is ON, current flows from the input, through the switch...