Winger Mateo Carreras scored a touchdown after taking advantage of a defensive mistake before the end of the first half to cut Felipe Contepomi’s Argentina side’s lead to five points.
Pumas took the lead for the first time just two minutes into the second half, when Franco Molina powered through the lineout to score his first Test try.
Wing Mark Telea restored the All Blacks’ five-point lead but fly-half Carreras’ penalty cut the Pumas’ lead to two.
Iconic striker Crevi, who has played 109 times for his country, cut in and slotted home, with Carreras slotting home to put the visitors five points ahead.
The three-time world champions tried to fight back but made too many mistakes and Carreras’ late penalty put Argentina out of sight.
The two teams meet again in Auckland on August 17.