Thank you for all your helps.
We have been back to Nz yesterday.
We brought both the old and the new passports. It took more time than usual at the airport but everything went well.
In NZ, the immigration lady said she we will be allowed to enter "one-time" with the new passport but need to contact INZ as soon as possible to complete the transfer process.
Thank you so much for all the information.