The 'City in a Garden' island has become a haven for billionaires worldwide but it hasn't always been that way ...