Marlon Samuels and Kirk Edwards hit half-centuries as the West Indies reached 158 for four in reply to New Zealand's 441 on day two of the second Test in Wellington.
BJ Watling had earlier made 65 as New Zealand went from their overnight score of 307 for six to be bowled out with Tino Best taking four for 110.
Edwards then hit 55 and Samuels is unbeaten on 50 as the West Indies began their reply but with key players Darren Bravo and Shivnarine Chanderpaul already out, just as in Dunedin, they have plenty of work ahead of them.
The West Indies began the day well enough and managed to take the final four New Zealand wickets for 134 runs with Watling making 65 in 125 balls.
Best finished things off by removing Ish Sodhi (27) and Neil Wagner (0) in consecutive deliveries before Watling finally fell when he was bowled by Shannon Gabriel.
West Indies struggled early on as Kieron Powell was trapped in front by Tim Southee for 21 and Bravo was caught by Peter Fulton off Corey Anderson for four.
Edwards, who made 55 in 74 balls, added 37 with Samuels for the third wicket to take his side past the 100-mark and when he was caught by Hamish Rutherford as Anderson struck again, New Zealand were back on top, and even more so when Chanderpaul (11) was caught at point by Anderson off Trent Boult.
Samuels looked in good touch, striking nine fours, in just 57 balls with Narsingh Deonarine unbeaten alongside him on 11 at stumps.
© Cricket World 2013