I agree with your sentiments completely.
If Pardew were to be sacked I would think he had been hard done by and I would wish him all the best (unless he went to Pompey!). I know, however, that in the long-term Liebherr and Cortese are far more important than Pardew is to Saints.
People are justfiably scared of changing managers because we have a recent history (with the notable exception of Crouch's superb appointment of Pearson, and Pards himself) of appointing awful candidates. I am confident any replacement would be a good replacement.
By the way, I also don't think Pards will be sacked (although I wouldn't rule out some sort of mutually agreed departure to West Ham).