Air New Zealand Matariki Experience

This project was highly ambitious and challenging, applying emerging technologies to tell an important cultural story. The team worked with cultural storyteller, Joe Harawira to recreate him as a full scale digital character. As a performance storyteller, Joe uses his whole body to convey this stories and we recreated this digitally using a combination of facial motion capture and photogrammetry with careful curation of his gestures to replicate the authenticity in his storytelling. Joe’s cultural identity was authentically conveyed through the recreation of his facial Tā moko and pounamu which together embody his culture, status and history.

By putting on a Magic Leap headset, customers were transported onto a waka rererangi (canoe in the sky) to fly through the guardians realms and the sky to learn about Matariki all without leaving the room. We blended the real and digital world through the use of digital replicas, film and narration by our lead storyteller. We introduced the Matariki star constellation by asking users to hold out their hand and throw the stars into the sky. We recreated a 7m carved Waka and window made by carvers at New Zealand Māori Arts and Crafts as full scale 3D replicas.

This project enabled Māori to tell their stories, traditionally passed down through carvings and song, using a new digital medium. Matariki is a cultural celebration which is new for many New Zealanders and it was important to educate everyone on its true meaning. This touring exhibition, used innovative technology to connect with a broader audience enabling Māori to tell their stories, traditionally passed down through carvings and song, using a new digital medium. We trained Māori 3D design students to work with us in order to pass on our knowledge, ensuring skills transfer and growth in this technology sector.

The team developed a meaningful relationship with Joe (storyteller), drawing on his knowledge and guidance to ensure all aspects of the project were relevant and meaningful. Joe conveyed his trust in our abilities to accurately represent him digitally, seeing this project as a unique opportunity to connect with a wider audience through a new and innovative medium. We introduced the Matariki star constellation as a floating 3D element by asking users to hold out their hand and throw the stars up into the sky. This was to connect to the story of Matariki, the shortened name for Ngā mata o te ariki Tāwhirimātea, which means the eyes of the god. We recreated a 7m carved timber Waka and window made by traditional Māori carvers at New Zealand Māori Arts and Crafts as full scale 3D replicas. The intricate carvings were carefully scanned and rebuilt to mimic their colour, tone, texture and form. The use of mixed reality and digital replicas in this cultural context was a first for New Zealand.