If you really want to scare yourself this site has all recorded/reported earthquakes in NZ with a location scatter map -
http://www.geonet.org.nz/recent_quakes.html
I lived in Te Anau for eight years (on the fault line) and we got one noticable quake a year that did little more than knock groceries off supermarket shelves.
The last time there was a fatal earthquake in NZ was 1968 I think, near Reefton on the West Coast of the SI. Only three or four people died, but then again the population is pretty small over there. More than 250 people died when a quake hit Napier/Hastings in 1931 - but on the bright side, it did mean that Napier had to be almost totally rebuilt which is why it now has such a complete art-deco feel.
So many NZ cities are on coastal planes or around inlets so the risk of tsunami is always there. The best you can do is be prepared, or move to a more stable country.
As Trigirl said, most NZers are pretty laid back about the earthquake risk - very much a case of "if it happens, it happens"