Because it's a symptom of greater discrimination and inequality within Muslim society. The majority of Muslims are peace loving, friendly and hospitable who treat others equally but there is a group who do treat women as second class, who force them to marry people they don't know against their will and who don't think domestic abuse by husbands is wrong. Yes segregation isn't the same as those abhorrent views but it's a smaller part of a larger problem imo.