There's about 8 times as many white people (98454) as there are muslims (12,147) in huddersfield, while there are around 260 times as many people not from the americas/europe/australia (8,249,196 possibly all or mostly brown) as are (31,729 possibly all or mostly white)
not sure if that matter of scale makes a difference and of course I'm making an assumption about skin colour.
Another possible difference would be that muslim is not a skin colour or gang affiliation.