It's a bit of a myth that he's "too young for a CB". He's 24. He's about the right age to be maturing in that position.
I was chatting to a member of his immediate family a couple of months ago, they said, as much as he loves Saints, he's going to hand in a transfer request at the end of the season if he's not assured of first team football.