menu
 

Integrating Spatial Audio in Unity

게임 오디오 / 사운드 디자인 / 공간 음향

Live integration in the Unity Sample - the Wwise Adventure Game, coming soon!

Two years have passed since we first set foot in the fertile lands of Allegro Kingdom. Back then, numerous aspiring sound enthusiasts jumped to the rescue and fought to cleanse the lands from the evil essence! Now it’s time to venture back into the terrifying dungeons, to once again put a stop to the infestation.

WwiseAdventureGame

My name is Mads. I’m one of the two developers who worked on the Wwise Adventure Game (WAG), and today I have the pleasure to talk about our plans at Audiokinetic towards integrating Spatial Audio into the Unity sample, the Wwise Adventure Game. I’m also really excited to share that we plan on doing this with you, by demoing it via multiple 'Wwise Up On Air | Hands-On' live stream sessions to come. But before venturing into the deep pockets of Spatial Audio, let's refresh our memory a bit and talk about the Wwise Adventure Game.

Subscribe

What is the Wwise Adventure Game (WAG)?
An open source Unity project using Wwise, downloadable from the Wwise Launcher.

WwiseAdventureGame2

Want to learn about setting up the hooks in Unity, or looking for inspiration on granularly loading area Soundbanks? Access any object, script, animation, image or other resource. Take a quick look here.

How it all started! 

For me, it started back as a Sound and Music Computing student at AAU in Copenhagen, Denmark. Together with Jacob Lynggaard Olsen, we were about to take on our final year of our masters, but we were ever so ready to get out of school and into working with game audio. Luckily for us, when presenting one of our student games at a conference, we met Thomas Bärtschi. He seemed quite interested in our audio experimental student game.

WwiseAdventureGame3

Seizing the opportunity, we showed off our best work along with various video tutorials we'd made and mentioned that we were looking for an internship. Some time after, we got on a skype call with Simon Ashby and Benoit Santerre from Audiokinetic. This time, we came better prepared with a presentation on how we could make a new game tailored for the Wwise Unity Integration and on the 1st of May 2016 we got the wonderful message from Simon, that Audiokinetic had greenlit our internship, hereby approving production of the Wwise Adventure Game.  Well aware that we were officially to start in september, we jumped into preparing whatever we could beforehand.

WwiseAdventureGame4

Look close and you might see some similarities to how WAG looks like today!

A 'Wwise Unity Integration' sample 

Beyond making a resourceful Unity project, we knew it had to be centered around the Wwise Unity Integration. That said, the complete suite of the integration is quite comprehensive and we didn't want to overwhelm the beginner. We decided to break things down to the most common and fundamental audio integration methods - like posting Events, Setting Game Syncs, Reverb Zones and Callbacks. In order to keep things simple, we did not include Spatial Audio in the initial integration, but made preparations for its inclusion in the future.

Audio integration is often based on the contents of your Wwise project, so how do we make sure we include the most relevant audio design methods? Fortunately, Damian Kastbauer had already created a diverse and solid Wwise project with a variety of audio design methods called, the Wwise Project Adventure, and it became the basis for our audio integration, along with its name.

Side-note for programmers

While WAG was developed specifically for sound designers, we also had a side goal to make every script and system open source and commonly reusable. Because, what programmer doesn't reuse their own code, or gets inspired by someone else's code? We wanted everyone to be able to jump in, look at the code we used for callbacks, copy the parts that they would need and be able to simply paste/modify within their own Unity projects.

Four months later the game design was done, but it had grown into its own product and besides the music, there were still many audio files with temporary beeps and boinks! We became completely speechless when Damian and Audiokinetic mentioned getting Bay Area Sound on board  for a rundown of most sound effects, and boy did that take the game to new heights! 

The Wwise Adventure Game was published just before GDC 2018, alongside the Wwise-251: Performance Optimization & Mobile Considerations certification, and followed by the Wwise-301: Wwise Unity Integration certification half a year later. The Wwise Adventure Game became the sample accompanying the Wwise-301 learning material, helping users learn how to use a variety of components (such as AkAmbient, AkState, AkBank) along with making custom scripts.

Naturally while creating authentic circumstances for using the Wwise Unity Integration components, we needed various systems that could either support the game experience, or accomodate audio integration. To mention a few of these systems, we built...


  • Additive Scene Loading
  • AI & State Machines
  • Camera Movement
  • Collectables
  • Combat Targeting
  • Developer / Editor Tools
  • Dialogue
  • Game Speed Handling
  • Image Effects
  • Input
  • Inventory
  • Level of Detail
  • Localization
  • Menu
  • Navigation
  • Player Attack
  • Player Interaction
  • Questing
  • Skybox
  • Spellcasting
  • Teleportation
  • Time of day
  • Various Mobile Substitute scripts

If you see anything that interests you, all of these systems are included in the Wwise Adventure Game in their full extent, allowing you to open any of them up to get inspired or experiment with.

Getting started with the Wwise Adventure Game

The game features all sorts of classic features like magic, various types of weapons, quests, collectable coins and various types of enemies. Once the game is downloaded from the Wwise Launcher, you can choose to play it directly, open it in Unity and play it there, or even export it to your Android or iOS device for a mobile experience. Controls will switch automatically from keyboard + mouse to touch controls based on the platform you prefer, and you can either jump and forth into your questline, teleport, or make yourself invisible and focus on the important part -> Audio ;)

Today, the Wwise Adventure Game is a free and open source Unity sample that can be downloaded directly from the Wwise Launcher. It's a requirement for the courses, but it's also frequently being used for game audio demos. I've even used it quite often in the One Minute Wwise series since it's an actual game allowing you to consider how the "added feature" works in context within a particular project.

That said, the Wwise Adventure Game wouldn't have become such a powerful resource without the support and contributions from the Audiokinetic team, Damian, Bay Area Sound and other collaborators throughout this journey. 

You are now up to speed with how the Wwise Adventure Game came to be, but if you want to read more about it, you can check out the release blog or our student blog post. Now, let's fast forward to 2020 and talk about the new addition to the game - Spatial Audio!

Integrating Spatial Audio with you!

In light of the new Spatial Audio updates with Wwise 2019.2, we wanted to get Spatial Audio into the Wwise Adventure Game as well.  An old friend, Damian Kastbauer jumped to the rescue and offered that we demonstrate the integeration live on Audiokinetic's Twitch show Wwise Up on Air | Hands On!

WwiseAdventureGame5

The Wwise Up on Air | Hands On is a series of live streams where the true Wwizard - Damian Kastbauer, invites a friend and demonstrates hands-on how something works in Wwise. It's a strong learning resource allowing its audience to learn by actually doing something rather than reading about it, and it's just a lot of fun. 

We plan on demonstrating a step-by-step integration of Spatial Audio in Unity, while engaging with viewers at every step. We may even ask you what object to add reflections to, or what sounds to test out the spatial audio with. You will be able to ask questions along the way or even request certain demonstrations. 

You may be thinking that this sounds advanced, and I won't lie, it's something you will need to wrap your head around - but we will do this together, and not only will we have Damian's teaching expertise leading the way, we also plan on starting off with baby steps anyone can follow, and learn incrementally. Let's talk about some of the things we will be covering during this live stream.

Live integration of Spatial Audio in Unity

We'll be looking at some excellent examples where spatial audio had been integrated. We'll discuss why it could be relevant to include spatial audio in your games, and what considerations you may have to take into account beforehand. From there, we'll get practical!

We'll grab Wwise and the Wwise Adventure Game and slowly take one piece at a time until we've completed our first steps with spatial audio. Now, Wwise Reflect is based on reflections onto the in-game geometry, so naturally we'll discuss how to use shapes as reflective surfaces and to what degree it will contribute to the acoustic impression. Once we've added Spatial Audio to the first room, we'll start gluing it up with portals and occlusion. We'll discuss both the sound design and technical properties of being able to listen to sounds from next door and how it can contribute to a more immersive experience. As icing on the cake, we'll look at concepts like diffraction and how to color your rooms with textures and room tones.

Maybe this sounds complex, maybe it doesn't, nevertheless we want you to be a close part of this process so you can let us know. Our plan is to stream at least 2 live sessions. From there we'll see how much content we can squeeze in and what kind of feedback we'll receive. 

Subscribe

Joining Damian Kastbauer on this journey from the Audiokinetic team is Thalie Keklikian, Software Developer, Benoit Santerre, Wwise Integrations Lead, and I, Mads Maretty Sønderup, Integrations Educator and Content Creator. We will alternate in assisting with the hands on integration while answering your questions. If you have already completed the Wwise-301 certification, these sessions will be the last piece of the 'Wwise Unity Integration' puzzle, where we take a look at some of the following components.

AkEmitterObstructionOcclusion

AkRoom-2

AkRoomAwareObject-3

unnamed-4

AkRoomPortalObstruction-5

AkSpatialAudioDebugDraw-6

AkSpatialAudioListener-7

unnamed-8

This is a great opportunity to get yourself up-to-speed with using these components, understanding when not to use them, and to ask those Spatial Audio integration questions that have been burning inside of you. 

Changes in Wwise Adventure Game

Following the live stream sessions, the Wwise Adventure Game will be updated, and no place seems more ideal to add Spatial Audio, than the dark Dungeon below the Allegro Kingdom!

WwiseAdventureGame6

The Audio menu will receive multiple new settings. Not only will you be able to experience the dungeon with Spatial Audio, you'll also get a variety of Early Reflection settings, including hotkeys and a placeable emitter (Radio).

WwiseAdventureGame7

I have so much more to tell you, but let's keep some of that suspense to the live stream sessions! Until then, here's a quick teaser.

Community driven every step of the way

While this is just the tip of the iceberg for both the Spatial Audio live streams and the Wwise Adventure Game, this is a collective project with you - the community. Maybe there's a scenario in the Wwise Adventure Game you'd like us to try out? Perhaps you'd like Damian to feature something or someone in particular on the Wwise Up on Air, or Wwise Up on Air | Hands-On show? Let us know! Reach out to us at openears@audiokinetic.com.

Mads Maretty Sønderup

Specialist, Training & Education Content

Audiokinetic

Mads Maretty Sønderup

Specialist, Training & Education Content

Audiokinetic

Wwise educator, experimentalist, and evangelist. Lead trainer at Audiokinetic. Mads wrote the Wwise-251 & Wwise-301 courses, was one of the main developers of the Wwise Adventure Game, and the creator of the One Minute Wwise series.

 @madsmaretty

댓글

댓글 달기

이메일 주소는 공개되지 않습니다.

다른 글

Wwise Wworld Wwide Online Expo (와이즈 월드 와이드 온라인 엑스포) 요약해보기

Audiokinetic의 20주년 기념과 딱 맞게 2020년이 시작되었습니다. 오늘, 크로스 플랫폼 오디오 솔루션인 Wwise는 여러분의 성원에 힘입어 상호작용 및 게임 오디오에서...

30.9.2020 - 작성자: Audiokinetic

동적 음악 설계에 관하여 - 제 1부: 설계 분류하기

설계 계기 저는 2015년에 오디오 게임 엔지니어로서 처음 일을 하게 되면서 그 당시 저의 아트 디렉터를 통해 Wwise를 접하게 되었습니다. 그전에 저는 게임 음악을 작곡하는...

7.10.2020 - 작성자: 천종 호우 (Chenzhong Hou)

Impacter와 Unreal - 게임 물리를 사용하여 Impacter 플러그인 제어하기

소개 Impacter(임팩터)는 Wwise를 위한 새로운 타격음 모델링 플러그인입니다. 플러그인 소개는 이 글을 통해 확인해주세요. 이 글에서는 Impacter를 사용하여...

3.6.2021 - 작성자: 션 소라한 (Sean Soraghan)

Wwise에서 Audio Object를 저작하고 프로파일링하는 간단한 9 단계

Wwise에서 새롭게 제공되는 오브젝트 기반 오디오 파이프라인을 둘러보고 싶지만 어디서부터 시작해야 할지 모르시는 분들 계시나요? 그렇다면 Windows용 Wwise에서 Audio...

21.7.2021 - 작성자: 데미안 캐스트바우어 (Damian Kastbauer)

텔 미 와이(Tell Me Why) | 오디오 다이어리 제 3부: 사운드 디자인

텔 미 와이(Tell Me Why)의 오디오 팀에게는 독특하면서도 인상 깊은 서사적 시퀀스를 향상시킬 수 있는 기회가 많았습니다. 저희 시네마틱 및 크리에이티브 디렉터는 영상에 꼭...

19.7.2022 - 작성자: 매튜 피오렌티니 (Mathieu Fiorentini)

Wwise를 사용한 반복 재생 기반 자동차 엔진음 디자인 | 제 1부

이 시리즈에서는 Wwise Authoring과 오디오 및 자동차 전문 지식을 알맞게 사용해서 간단한 반복 재생 기반 자동차 엔진 사운드를 디자인하는 방법을 살펴보려고 합니다! ...

18.4.2023 - 작성자: 아르토 코이비스토 (Arto Koivisto)

다른 글

Wwise Wworld Wwide Online Expo (와이즈 월드 와이드 온라인 엑스포) 요약해보기

Audiokinetic의 20주년 기념과 딱 맞게 2020년이 시작되었습니다. 오늘, 크로스 플랫폼 오디오 솔루션인 Wwise는 여러분의 성원에 힘입어 상호작용 및 게임 오디오에서...

동적 음악 설계에 관하여 - 제 1부: 설계 분류하기

설계 계기 저는 2015년에 오디오 게임 엔지니어로서 처음 일을 하게 되면서 그 당시 저의 아트 디렉터를 통해 Wwise를 접하게 되었습니다. 그전에 저는 게임 음악을 작곡하는...

Impacter와 Unreal - 게임 물리를 사용하여 Impacter 플러그인 제어하기

소개 Impacter(임팩터)는 Wwise를 위한 새로운 타격음 모델링 플러그인입니다. 플러그인 소개는 이 글을 통해 확인해주세요. 이 글에서는 Impacter를 사용하여...