menu
 

Menura | Step Up Your Sound Game Jam

게임 오디오

This article was written following the second annual Step Up Your Sound Game Jam, an Android mobile game jam where teams developed one-of-a-kind gaming experiences using Dolby Atmos with Wwise. This is a 5-part series; in this second blog, the Nekologic team dives into their game Menura.

A journey in birdsong

“The island is as intriguing as I imagined, there are so many birds here to find and catalog! Their calls are stranger than anything I've ever heard. There is much to explore!

It will be morning soon, and I cannot imagine the glory of the dawn chorus!”

In Menura (from Menura novaehollandiae or “Superb Lyrebird”), you play an ornithologist sent to a mysterious island to catalog the bird species that live there. Based on the childhood fascination with birdsong of one of our team members, we imagined a forest in which players could casually wander, surrounded by birdsong and the sounds of nature.

We are Nekologic, a game studio based in Kyoto, Japan, and it’s our pleasure to introduce the secret inner workings of our game, developed with Dolby Atmos and Wwise, for the Step Up Your Sound Jam 2023 with Playcrafting.

image7

Beginning the adventure

Evoking a feeling

We started with a feeling that we wanted to evoke: a blend of relaxation, exploration and discovery. We felt we could use Dolby Atmos to create an immersive soundscape that could be experienced even without visuals. The bird theme naturally suggested a forest setting, but to retain a feeling of wonder–and to maintain an emphasis on the sonic aspect of the game–we decided to use an abstract visual language, describing the scene with color and movement. To emphasize the feeling of the natural world, we wanted everything to be organically generated, so the player could constantly discover new bird species, and the bird songs for each species would be recognizable yet never repetitive. The final piece of the puzzle was the passing of time, which would allow us to vary which birds appeared–and how they behaved–at different times of day.

image4

Dawn in the forest

Gameplay design

We decided early on that a first-person perspective would allow the player the best chance to experience the feeling of moving through and looking around the forest. Each bird would be placed in 3D space–hiding in trees and bushes–and the spatial audio provided by Dolby Atmos would allow the player to pinpoint where the birds were hiding. Some of the trees are relatively tall, and since Dolby Atmos is particularly good at rendering the difference between sounds overhead and on the ground, this is a perfect scenario for a full 3D experience with a good depth of the mix. When the player is close enough, he or she would be able to tap on the screen to take a picture of the bird to place in their ornithologist’s notebook, along with a recording of the bird’s unique call.

There were a few technical challenges in executing this idea:

  • How to use Dolby Atmos and Wwise to generate the birdsong
  • Where the birds would be and when they would sing
  • A system for the bird’s appearance in the logbook
  • A relaxing and intriguing environment, varied in terrain and vegetation
  • Controlling the randomness of all of the above

image2

Generative Birdsong with Dolby Atmos and Wwise

Our idea was to create an infinite variety of distinct bird voices that not only imitated the sound of real-world birds but also went beyond, towards the supernatural. Each bird species has its own vocabulary of song elements consisting of notes, swoops, chirps, trills, warbles and other features. Individuals of that species then recombine these elements spontaneously when singing based on environmental factors.

The song elements are modeled as sequences of instructions passed into Wwise as gradually changing Real Time Parameter Controls (RTPCs) with different interpolation shapes and durations. Since real-world bird songs contain an incredible amount of detail in fast-paced modulations and timbral variations, we knew that we needed to model the majority of these modulations directly within Wwise to avoid overloading the Unity update loop. After some experiments with Wwise’s built-in synthesizer plugins–using simple sine oscillators and nested modulator signals of different shapes (see figure below)--we decided to use actual audio fragments of songs of different birds, each only a few milliseconds long, to provide a more realistic variety of timbres. We play these samples using looped Wwise sound sources equipped with LFO modulators, whose parameters (e.g. shapes, frequencies, depths, etc) are in turn controlled by RTPCs.

image5

An early simple hand-drawn modulation curve for a finch-like sounding bird  |  Hear more at games.dolby.com

We then randomly generated RTPC ramps for each species based on constraints such as characteristic ranges for pitch, modulation frequency and depth, element durations, singing variety, and recombinations. Due to Dolby Atmos’s rendering clarity–especially of overhead sounds–this produced a satisfying soundscape where a large number of different bird species were distinguishable. In the current build, the settings of the constraints are still kept relatively tame. But for the next iteration, our model will generate much longer, wilder, and more complex songs. 

Subscribe

NekoLogic

NekoLogic

NekoLogic is a studio that focuses on the intersection of the digital and the real worlds. We focus on AR, IoT, Game-assisted learning and other interactive mediums.

www.neko-logic.com/

 @nekologicJP

댓글

댓글 달기

이메일 주소는 공개되지 않습니다.

다른 글

머더러스 퍼수츠(Murderous Pursuits)의 대사와 대화 설계 - 제 2부

안녕하세요, 머더러스 퍼수츠의 대화와 대사 시스템의 제 2부로 다시 돌아온 제이미입니다. 제 1부를 아직 보지 않으셨다면 여기를 클릭하여 읽어주세요! 제 1부에서는 게임에서의...

20.5.2020 - 작성자: 제이미 크로스(JAIME CROSS)

Wwise+GME 게임 음성 솔루션: 다양한 음성 플레이 대방출, 생생한 몰입감 선사

AppAnnie2021 모바일 게임 리포트는 강력한 소셜 인터랙션 속성을 가진 배틀 그라운드, 슈팅 및 온라인 MOBA가 플레이어들의 사랑을 많이 받았으며 게임 시간 증가를...

13.1.2022 - 작성자: Tencent Cloud

‘잇 테이크 투(It Takes Two)’ 사운드 비하인드 스토리 | Hazelight 오디오 팀과의 Q&A

Hazelight Studios(헤이즈라이트 스튜디오)에서 제작한 잇 테이크 투(It Takes Two)는 분할 스크린 액션 어드벤처 플랫폼 협동 게임입니다. 이 게임은 엄청나게...

5.4.2022 - 작성자: Hazelight (헤이즐라이트)

노 스트레이트 로드(No Straight Roads)의 음악적 게임 세계 설계하기

안녕하세요, 게임 오디오 여러분들! 저희가 Wwise와 Unreal Engine을 사용해서 '노 스트레이트 로드(No Straight Roads, NSR)'의 극도의 스타일링을...

29.3.2023 - 작성자: Imba Interactive (임바 인터랙티브)

BPM: 불렛 퍼 미닛(Bullets Per Minute)에서 음악과 게임플레이 동기화하기

어떤 리듬의 FPS를 만들지 결정하기 BPM: 불렛 퍼 미닛(Bullets Per Minute)은 박자에 맞춰 총을 쏘고, 재장전하고, 점프하고, 피하는 리듬 액션 FPS...

11.12.2024 - 작성자: Awe Interactive (어 인터랙티브)

우주의 침묵 속 사운드 | 하드스페이스: 쉽브레이커의 시스템

하드스페이스: 쉽브레이커(Hardspace: Shipbreaker)는 최근 Playstation 5, Xbox Series S/X 및 PC에서 출시된 1인칭 무중력 우주선 해체...

6.1.2025 - 작성자: 벤 맥컬러프 (Ben McCullough)

다른 글

머더러스 퍼수츠(Murderous Pursuits)의 대사와 대화 설계 - 제 2부

안녕하세요, 머더러스 퍼수츠의 대화와 대사 시스템의 제 2부로 다시 돌아온 제이미입니다. 제 1부를 아직 보지 않으셨다면 여기를 클릭하여 읽어주세요! 제 1부에서는 게임에서의...

Wwise+GME 게임 음성 솔루션: 다양한 음성 플레이 대방출, 생생한 몰입감 선사

AppAnnie2021 모바일 게임 리포트는 강력한 소셜 인터랙션 속성을 가진 배틀 그라운드, 슈팅 및 온라인 MOBA가 플레이어들의 사랑을 많이 받았으며 게임 시간 증가를...

‘잇 테이크 투(It Takes Two)’ 사운드 비하인드 스토리 | Hazelight 오디오 팀과의 Q&A

Hazelight Studios(헤이즈라이트 스튜디오)에서 제작한 잇 테이크 투(It Takes Two)는 분할 스크린 액션 어드벤처 플랫폼 협동 게임입니다. 이 게임은 엄청나게...