A Malaysian military attache extradited to New Zealand to face an attempted rape charge was remanded in custody following a brief court appearance on Saturday.

Muhammad Rizalman Ismail, who stood silently in the dock as Malaysian High Commission staff watched from the public gallery, will reappear in court on Tuesday.

Rizalman was flown from Kuala Lumpur to New Zealand under police escort on Friday and spent the night in custody in Auckland before being put on a flight to Wellington on Saturday for his court appearance.

He had fled home to Malaysia in May after invoking diplomatic immunity when accused of stalking and attempting to rape 21-year-old Tania Billingsley at her home in the same Wellington suburb where Malaysia's High Commission is located.

Rizalman, who was a defence staff assistant at the High Commission, faces a jail term of up to 10 years if found guilty.