I think you haven't grasped that in that scenario we'd have 36 and Swansea would be two points behind on 34.
So they could still beat Stoke on the last day and finish above us, goal difference or not, if we lose to City.
Of course 36 could well be enough anyway but Huddersfield still have 3 matches to play.