|Felix Gaedtke,Gayatri Parameswaran,Gyani Maiya Kusunda,Hima Kusunda,Lil Bahadur Kusunda
Visit the project
Kusunda celebrates the efforts of its co-creators, a tight knit indigenous community in Nepal that is working hard to revitalize their mother tongue against all odds.
NowHere Media, Producer, to Docubase
Kusunda is a docufiction voice driven virtual reality experience that’s co-created together with the Kusunda community in Nepal. This installation invites audiences to speak an endangered indigenous language. Kusunda shaman Lil Bahadur has forgotten his indigenous mother tongue. His granddaughter, Hima, wants to revive it.
Kusunda was created with Unity, Blender and Tilt Brush. The protagonists were filmed volumetrically using the Microsoft Kinect Azure with DepthKit with one sensor and a DLSR to capture the volumetric video. The surrounding environment was captured using photogrammetry. Memories of the protagonist were recreated with 3D animations and using Tilt Brush. All the animations were captured using motion capture with an OptiTrack system. A neural network trained for speech recognition enabled voice based interactions which carve the user’s path through the narrative, unlocking storyworlds and memories related to specific words.
Additionally, the producers created a non-interactive 360 version of the piece, to distribute on cardboards in the community.