'We' (the ordinary man in the street) didn't directly cause the crisis but as a society we all indirectly benefitted from the artificial banking boom in some shape or form. For example, my modest pension fund.
Whilst 'banker bashing' is a natural and understandable human instinct in the circumstances we now face, the unpalatable truth is that 'we' (the ordinary man in the street) need the banking/financial system to recover as quickly as possible to get us out of the very mess that the unregulated system got us into in the first place.
If all the remaining bankers are forced out to other territories through swingeing punishments then where does that leave, for example, my modest pension fund?
I suppose I could join the clamour for retribution and wave goodbye to my retirement so that I can be a burdon on the state in later life...