They have never had a referendum to stay or leave.
I'm glad you've picked Norway as one of your model countries as they are pretty much the direct opposite of the things you want - higher immigration than us, part of the Schengen area, pay into the EU and swallow EU legislation with no say at all.
I was surprised as you to see that Norway aren't building a brand new hospital every single day like we'll be able to do when we get our £350m a day back to spend on whatever our heart desires.