We present azimuthally anisotropic Rayleigh group velocity models from 8 - 35 s both offshore and onshore of the South Island of New Zealand. We use MOANA (Marine Observations of Anisotropy Near Aotearoa) broadband ocean seismic data in combination with on land data from the New Zealand National Seismography Network (NZNSN) to investigate the seismic structure of the flanks of the Australian-Pacific plate boundary. At 8 s, we observe low offshore group velocities best explained by the influence of the water layer and thick water-laden sediments. At long periods (20-30 s), group velocities are lower on the South Island relative to its offshore flanks, due to thickened crust beneath the island, with the lowest velocities primarily beneath the Southern Alps. Group velocity azimuthal anisotropy fast directions near the Alpine Fault align with the direction of relative plate motion between the Australian and Pacific plates. In the southern portion of the island, fast directions rotate anticlockwise, likely in response to a decrease in dextral shearing away from the plate boundary. Azimuthal anisotropy fast directions align with absolute plate motion offshore on the Pacific plate. Based on the depth sensitivity of our observations, we suggest diffuse deformation occurs throughout the crust. Our observations match trends in previous Pn anisotropy and SKS shear wave splitting observations, and therefore suggest a consistent pattern of distributed deformation throughout the lithosphere.