Indeed, you're quite right, it's just that the public sector has no concept of controlling costs. The rise of Lido and Aldi shows that prices can be reduced if competition is allowed.
Rail privatisation is another issue though, I have understood how this was supposed to improve things. As now-gone MP David Price used to say 'How can you have competition when one train can't overtake another?'