It's a way of admitting a mistake, and apologizing for that mistake, without actually apologizing. It's like saying...
A beautiful cedar palace does not make a great king!