While the 3 players in question are not perhaps good enough to continue 'wearing the shirt', I think that the term 'not fit to wear the shirt' implies an attitudinal, even moral failure on their parts. That would be both unfair and untrue, they have tried their bests but their respective bests have not been good enough.