Quite frankly ceramic caps >0.5uF are news to me. I had no idea that they even existed. Technology is rapidly passing me by.:(
That said I see no reason why you couldn't use them, including for the additional DC blocking cap on the input.
BTW, you do realize that unlike the LM358 the OPA134...