Talk me out of it?

We've just visited , from Far North Queensland. Spent a few weeks seeing north, east and south. The wife and I fell in love, particularly Launnie (is that how we shorten it!).

On the assumption the wife could get a transfer out of her Government position (had a quick look, there are a few she's directly suitable for), we could take leave without pay for a year, possibly two, and move down. Continue to work, but do more exploring of that amazing island!

Rent out our place, rent there.

So, to the crux of the post,... What's wrong with that plan? The cold and windy didn't scare us (much). We both like rugging up, fires, cozy blankets.

Standing aside the financial craziness of a 1 to 2 year Seachange (or maybe permanent if we settle in), what other points should we be considering? What are the downsides of living down there? Why are people leaving (if they are).

We are both ~50yo

Thanks brainstrust!