menu
 

Menura | Step Up Your Sound Game Jam

게임 오디오

This article was written following the second annual Step Up Your Sound Game Jam, an Android mobile game jam where teams developed one-of-a-kind gaming experiences using Dolby Atmos with Wwise. This is a 5-part series; in this second blog, the Nekologic team dives into their game Menura.

A journey in birdsong

“The island is as intriguing as I imagined, there are so many birds here to find and catalog! Their calls are stranger than anything I've ever heard. There is much to explore!

It will be morning soon, and I cannot imagine the glory of the dawn chorus!”

In Menura (from Menura novaehollandiae or “Superb Lyrebird”), you play an ornithologist sent to a mysterious island to catalog the bird species that live there. Based on the childhood fascination with birdsong of one of our team members, we imagined a forest in which players could casually wander, surrounded by birdsong and the sounds of nature.

We are Nekologic, a game studio based in Kyoto, Japan, and it’s our pleasure to introduce the secret inner workings of our game, developed with Dolby Atmos and Wwise, for the Step Up Your Sound Jam 2023 with Playcrafting.

image7

Beginning the adventure

Evoking a feeling

We started with a feeling that we wanted to evoke: a blend of relaxation, exploration and discovery. We felt we could use Dolby Atmos to create an immersive soundscape that could be experienced even without visuals. The bird theme naturally suggested a forest setting, but to retain a feeling of wonder–and to maintain an emphasis on the sonic aspect of the game–we decided to use an abstract visual language, describing the scene with color and movement. To emphasize the feeling of the natural world, we wanted everything to be organically generated, so the player could constantly discover new bird species, and the bird songs for each species would be recognizable yet never repetitive. The final piece of the puzzle was the passing of time, which would allow us to vary which birds appeared–and how they behaved–at different times of day.

image4

Dawn in the forest

Gameplay design

We decided early on that a first-person perspective would allow the player the best chance to experience the feeling of moving through and looking around the forest. Each bird would be placed in 3D space–hiding in trees and bushes–and the spatial audio provided by Dolby Atmos would allow the player to pinpoint where the birds were hiding. Some of the trees are relatively tall, and since Dolby Atmos is particularly good at rendering the difference between sounds overhead and on the ground, this is a perfect scenario for a full 3D experience with a good depth of the mix. When the player is close enough, he or she would be able to tap on the screen to take a picture of the bird to place in their ornithologist’s notebook, along with a recording of the bird’s unique call.

There were a few technical challenges in executing this idea:

  • How to use Dolby Atmos and Wwise to generate the birdsong
  • Where the birds would be and when they would sing
  • A system for the bird’s appearance in the logbook
  • A relaxing and intriguing environment, varied in terrain and vegetation
  • Controlling the randomness of all of the above

image2

Generative Birdsong with Dolby Atmos and Wwise

Our idea was to create an infinite variety of distinct bird voices that not only imitated the sound of real-world birds but also went beyond, towards the supernatural. Each bird species has its own vocabulary of song elements consisting of notes, swoops, chirps, trills, warbles and other features. Individuals of that species then recombine these elements spontaneously when singing based on environmental factors.

The song elements are modeled as sequences of instructions passed into Wwise as gradually changing Real Time Parameter Controls (RTPCs) with different interpolation shapes and durations. Since real-world bird songs contain an incredible amount of detail in fast-paced modulations and timbral variations, we knew that we needed to model the majority of these modulations directly within Wwise to avoid overloading the Unity update loop. After some experiments with Wwise’s built-in synthesizer plugins–using simple sine oscillators and nested modulator signals of different shapes (see figure below)--we decided to use actual audio fragments of songs of different birds, each only a few milliseconds long, to provide a more realistic variety of timbres. We play these samples using looped Wwise sound sources equipped with LFO modulators, whose parameters (e.g. shapes, frequencies, depths, etc) are in turn controlled by RTPCs.

image5

An early simple hand-drawn modulation curve for a finch-like sounding bird  |  Hear more at games.dolby.com

We then randomly generated RTPC ramps for each species based on constraints such as characteristic ranges for pitch, modulation frequency and depth, element durations, singing variety, and recombinations. Due to Dolby Atmos’s rendering clarity–especially of overhead sounds–this produced a satisfying soundscape where a large number of different bird species were distinguishable. In the current build, the settings of the constraints are still kept relatively tame. But for the next iteration, our model will generate much longer, wilder, and more complex songs. 

Subscribe

NekoLogic

NekoLogic

NekoLogic is a studio that focuses on the intersection of the digital and the real worlds. We focus on AR, IoT, Game-assisted learning and other interactive mediums.

www.neko-logic.com/

 @nekologicJP

댓글

댓글 달기

이메일 주소는 공개되지 않습니다.

다른 글

Wwise Wworld Wwide Online Expo (와이즈 월드 와이드 온라인 엑스포) 요약해보기

Audiokinetic의 20주년 기념과 딱 맞게 2020년이 시작되었습니다. 오늘, 크로스 플랫폼 오디오 솔루션인 Wwise는 여러분의 성원에 힘입어 상호작용 및 게임 오디오에서...

30.9.2020 - 작성자: Audiokinetic

UI 설계 관점에서 UI 오디오 접근하기 - 제 1부

어떤 게임에서는 사용자 인터페이스가 플레이어의 전체 경험에 궁극적으로 영향을 거의 미치지 않습니다. 수많은 모바일 게임과 같이 어떤 게임에서는 거의 전체 게임플레이 동안 UI를...

14.10.2020 - 작성자: 조셉 마척(JOSEPH MARCHUK)

텔 미 와이(Tell Me Why) | 오디오 다이어리 제 3부: 사운드 디자인

텔 미 와이(Tell Me Why)의 오디오 팀에게는 독특하면서도 인상 깊은 서사적 시퀀스를 향상시킬 수 있는 기회가 많았습니다. 저희 시네마틱 및 크리에이티브 디렉터는 영상에 꼭...

19.7.2022 - 작성자: 매튜 피오렌티니 (Mathieu Fiorentini)

인디 개발자를 위한 무료 Wwise - 사운드 제한이 없는 전체 플랫폼 사용 권한. 이 라이선스를 내놓은 이유와 사용 방법.

안녕하세요!지난 4월 공유된 영상에 대해 더 자세한 정보를 전해드리기 위해 온 라이선스 담당자입니다. 예상치 못했던 깜짝 소식이었지만, 2022년 4월 1일에 저희는 에셋 제한이...

12.12.2022 - 작성자: 마이크 드러멜스미스 (Mike Drummelsmith)

노 스트레이트 로드(No Straight Roads)의 음악적 게임 세계 설계하기

안녕하세요, 게임 오디오 여러분들! 저희가 Wwise와 Unreal Engine을 사용해서 '노 스트레이트 로드(No Straight Roads, NSR)'의 극도의 스타일링을...

29.3.2023 - 작성자: Imba Interactive (임바 인터랙티브)

Strata, Wwise, Unreal을 결합해 몰입형 게임 환경 만들기

이 블로그에서는 Wwise가 통합된 Unreal Engine 5 프로젝트의 멀티트랙 컬렉션 중 하나를 사용하여 Strata를 이용한 상호작용 디자인 과정을 살펴보겠습니다.이...

16.5.2023 - 작성자: 체이스 스틸(Chase Steele)

다른 글

Wwise Wworld Wwide Online Expo (와이즈 월드 와이드 온라인 엑스포) 요약해보기

Audiokinetic의 20주년 기념과 딱 맞게 2020년이 시작되었습니다. 오늘, 크로스 플랫폼 오디오 솔루션인 Wwise는 여러분의 성원에 힘입어 상호작용 및 게임 오디오에서...

UI 설계 관점에서 UI 오디오 접근하기 - 제 1부

어떤 게임에서는 사용자 인터페이스가 플레이어의 전체 경험에 궁극적으로 영향을 거의 미치지 않습니다. 수많은 모바일 게임과 같이 어떤 게임에서는 거의 전체 게임플레이 동안 UI를...

텔 미 와이(Tell Me Why) | 오디오 다이어리 제 3부: 사운드 디자인

텔 미 와이(Tell Me Why)의 오디오 팀에게는 독특하면서도 인상 깊은 서사적 시퀀스를 향상시킬 수 있는 기회가 많았습니다. 저희 시네마틱 및 크리에이티브 디렉터는 영상에 꼭...