Building a Career in Sound Today: Film, Games and Shades of Gray

상호작용 오디오 / 사운드 디자인

On one side there’s sound for films- linear, on the other there’s sound for video games- interactive. In the middle, there is this gray area where immersive XR soundscapes can be created using both linear and interactive sound design approaches. Coming from the linear world, learning interactive audio has been a journey (and still is) but the ability to combine both to explore new ways of storytelling is extremely rewarding and makes me more passionate about my work every day. My name is David Grinbaum and I’m the Head of Post Production at Chapter Four, a NYC-based full service production company specializing in immersive and interactive content. I began my journey in the linear world before venturing into interactive audio.

ch43

From traditional film and television to 360 video production

A few years ago, I had the opportunity to learn game audio but I was resisting the idea at first. My goal was always to work on big blockbuster movies, so there was only one thing I wanted to do: post production sound for film and television. In 2015, José Frías, one of my friends and now business partners, told me that he had been working on a few 360 video productions with ambisonics and thought it would be interesting if we could work with those recordings in post production. After a bit of research, I found Two Big Ears (now Facebook360), and started exploring spatial audio. After talking to two other friends, Sarah Gibble-Laska and Karim Douaidy, we all decided to form Chapter Four and focus our work on spatial audio. We could tell that sound was the secret ingredient to providing viewers with truly immersive experiences: we had found our holy grail! The transition from standard film and television to 360 videos was fairly straight forward. It was still linear, and spatializing audio felt similar to working in surround, just more rewarding!  On our first year, we got to work on some really cool pieces, including The Circle of Life in 360, the opening number from The Lion King on Broadway, and The White Helmets 360, a documentary by Vice and Samsung taking place in Syria.

 ch41-1

Discovering the world of game audio

Soon after, I was fortunate enough to meet the Dolby Atmos VR team and became a beta tester of their Dolby Atmos for VR suite. Thanks to them, I went to my first GDC in 2017 and discovered the world of video games and game audio. It was overwhelming! I met a few people from Audiokinetic as well as folks from Vibe Avenue who were kind and patient enough to walk me through the basic steps of what game audio was, and coming from the linear world, I found it fascinating. Instead of attaching an event to a timeline, I can attach sound and physical properties to an object to dictate how it is going to behave in a virtual world. Mind blown.

Back in NY, I started learning Wwise by going through the Wwise 101 certification. At GDC18, I went back to the Audiokinetic booth and saw that VR was more and more present. Late to the game (pun intended), I finally realized learning game audio was the next step in my career and that I had a lot to catch up on. Luckily, the game audio community is very welcoming, so I knew I would be able to find help if needed. I went back to NY and finished the Wwise 101 certification, and after a few months, I jumped into the Wwise 201 certification, and then finally the Wwise 301 certification.

I love sound. I’m passionate about creating soundscapes and bringing things  to life. I’m constantly amazed by what technology allows us to do and by what people keep creating. Wwise and interactive audio opened a whole new world of possibilities for me. A world of creating sounds for new mediums and experiences, a world of thinking differently about my role as a sound designer, but it certainly required a mind shift and commitment. I think one of my favorite things about interactive audio is how scientific it can be as much as it is creative. This may also be why many sound designers coming from the linear world hesitate to jump into game audio however. Interactive audio can certainly seem overwhelming, but it certainly inspired me with a lot of ideas for storytelling. To me, the discovery of interactive audio was the equivalent of a kid going to Disney World, but for a sound designer.

 ch44

Stepping out of your comfort zone with small victories

For those of you who come from the film industry, I want you to know that transitioning to game audio is not as scary as it looks! Coming from an IT background, I had a slight advantage because object-oriented languages and coding were concepts that I was already familiar with (although not passionate about). That being said, you don’t actually need to know a lot about coding when starting out, as the Wwise integration already comes with pre-made functions that allow you to integrate sound into the game engine of your choice. While the learning curve can be fairly steep because there is pretty much nothing from the DAW world you can use in the interactive world (besides preparing stems), the reward is hugely gratifying! 

For me, this is the beginning of a new adventure. Interactive audio made me even more passionate about sound. Like a kid with new toys! Everytime I finally figure out what’s missing for the object to be able to emit sound, or for the engine to use the RTPC value, or for the soundbank to be recognized (all of which, I’m sure, sounds very easy to some of you), I hear the Zelda music for opening a chest! 

For those of you who come from the linear world, and would like to learn game audio but don’t know where to start, here are a few checkpoints to help you get your feet wet. This is by no means comprehensive, as I'm still discovering new tools and techniques myself:

  • Jump into the Wwise 101 Certification. It will all sound weird at first but after your second run through their lessons, you’ll start understanding the logic behind it. By the end of it, you won’t know exactly how to implement your own sound objects in Unity or Unreal but you’ll have a better grasp of how engines and Wwise communicate.
  • If you don’t know anything about programming, there are tons of free tutorials (and also paid ones) that you can explore to learn the basics of coding. The most useful programming language to start with is C#. Brackeys’ YouTube channel is a fantastic resource for game engine and programming tutorials. I recommend getting a bit familiar with C# and at least one engine (if you’ll be learning with Brackeys, then it’ll be Unity) so that you are able to understand more than just interactive sound.  An audio programmer's role might involve helping game designers with minor bugs so that the back and forth between the audio and game dev teams are reduced. 
  • The Wwise 201 Certification for interactive music is not a mandatory course (at first) but it will eventually become important that you learn about the mechanics of game music. From implementing transitions to generating a random cue so that music is never repetitive, a lot of the tools you learn in this module can be used for other effects.
  • The Wwise 301 Certification is probably the most important after you're done with the Wwise 101 Certification. You can try to figure out on your own how to integrate Wwise into Unity and maybe trigger your first event, but if you want to do it right and learn all the different ways available, this course really does an excellent job at teaching you the good habits. You’ll learn how to use pre-made functions available to you through the Wwise integration, but also learn to write in C#, which will give you a lot more flexibility.

 

Some high level differences between linear and interactive projects that you'll first notice 

If you’re coming from the film industry, you’ve been used to certain specs and timelines. The specs are standardized depending on the distribution medium (number of channels or loudness requirements, etc.) and you usually start working once the picture is locked (note the “usually”). You are not limited by how many sounds can be used (besides creative direction) nor limited in how much DSP you can put on your tracks (provided your computer can handle it). All that matters is that your audio file matches the length of the video, has the correct number of channels and is synced. There is no limit on the size of the file. As a matter of fact, the file size can be calculated in advance since you already know the sample rate, word length and number of channels. 

Things are slightly different in video games and interactive media. You will be dealing with restrictions on how much CPU can be allocated to process sound or how much space is left for the audio assets - your ‘audio budget’. When working in Wwise, you can choose to have some of the DSP happening in real-time (using more CPU) or bake it into audio files (using more storage). Footsteps are a good example of how you could lower the amount of storage it requires: you can use as little as two different footstep files per surface and then randomize how much pitch is applied every time they’re played to get an infinite variety of footsteps, always sounding different to our ears. Another big difference I found is how we think about panning. There are three different panning modes in Wwise: 2D, 3D user-defined and 3D game-defined. Without going into detail, you can either associate a sound event to an object (3D game-defined), or automate sounds in 2D or 3D around the user for visual objects that aren’t actual game objects, or music and narrative that don’t necessarily need to be panned in 3D.

 ch45

Next steps in my journey

There is still so much to learn! Now that I realize how many possibilities there are in interactive sound and game engines in general, I want to explore as much as I can. One of the things I mentioned earlier is interactive storytelling. While this is a concept well known within the video game industry, we could use this form of storytelling without the gaming aspect, giving a choice to the user to explore a specific part of a story and creating their own experience. I’m very curious to see where this takes me in my career as I intend to keep working in the film industry as well as getting more projects in the interactive world (games and immersive media).

David Grinbaum

Co-Founder and Head of Post Production

Chapter Four

David Grinbaum

Co-Founder and Head of Post Production

Chapter Four

David is the co-founder and head of post production of Chapter Four, a NY-based, full service production company. He has been working in the film industry for nearly 10 years and was one of the early adopters of spatial audio in the VR industry. He has been involved in many immersive project, from documentary films all the way to Broadway shows. Some notable projects he worked on are The Lion King’s Circle of Life in 360 and Aladdin’s A Friend Like Me in 360.

https://chapterfour.com/

Instagram

 @chapterfourlive

댓글

댓글 달기

이메일 주소는 공개되지 않습니다.

다른 글

보이스 제어 방법- CPU에 최적화하기(제 1부)

프로젝트 개발 과정 동안 성능 문제가 일어나는 것은 꽤나 흔한 일입니다. 문제의 원인은 다양하지만 대부분의 경우 동시 재생되는 사운드의 수와 직접 관련된 경우가 많죠. 볼륨만...

12.5.2020 - 작성자: 마튜 장 (Mathieu Jean)

라우드니스를 처리하는 최상의 방법, 제 3강: 게임을 위한 측정 가능한 라우드니스 처리

우리는 대부분의 경우 복잡한 사운드를 다룹니다. 게임에서는 각 사운드가 전반적인 출력 라우드니스에 기여합니다. 영화나 텔레비전 제작과 달리 작은 세그먼트의 다이내믹과 주파수 반응을...

27.5.2020 - 작성자: 지에 양 (Jie Yang, 디지몽크)

Wwise를 사용하여 UE 게임에 두 개의 오디오 장치 구현하기

먼저 제 소개를 해드릴게요. 저는 에드 카신스키(Ed Kashinsky)이며 러시아 상트페테르부르크 출신 사운드 디자이너 겸 음악가입니다. 현재 저는 아주 흥미롭고 독특한...

15.9.2020 - 작성자: 에드 카신스키(ED KASHINSKY)

Wwise에서 음악 설계 템플릿을 사용하여 독보적인 사운드 디자인을 만들어내는 방법

Foxface Rabbitfish(폭스페이스 레빗피시)의 작곡가 겸 오디오 디렉터인 가이 휘트모어(Guy Whitmore)는 2019 Wwise 상호작용 음악 심포지움에서 현대...

24.11.2021 - 작성자: 가이 휘트모어 (Guy Whitmore)

눈이 보이지 않는 사람에게 Wwise 가르치기

원거리에 있는 학생들에게 게임 오디오를 가르치는 것은 쉬운 일이 아닙니다. 앞을 보지 못하는 원거리 학생에게 게임 오디오를 가르치는 것은 심지어 더 어렵겠죠. 바로 이 과제가 저희...

15.2.2022 - 작성자: 에릭 버진스(Eric Berzins)

노 스트레이트 로드(No Straight Roads)의 음악적 게임 세계 설계하기

안녕하세요, 게임 오디오 여러분들! 저희가 Wwise와 Unreal Engine을 사용해서 '노 스트레이트 로드(No Straight Roads, NSR)'의 극도의 스타일링을...

29.3.2023 - 작성자: Imba Interactive (임바 인터랙티브)

다른 글

보이스 제어 방법- CPU에 최적화하기(제 1부)

프로젝트 개발 과정 동안 성능 문제가 일어나는 것은 꽤나 흔한 일입니다. 문제의 원인은 다양하지만 대부분의 경우 동시 재생되는 사운드의 수와 직접 관련된 경우가 많죠. 볼륨만...

라우드니스를 처리하는 최상의 방법, 제 3강: 게임을 위한 측정 가능한 라우드니스 처리

우리는 대부분의 경우 복잡한 사운드를 다룹니다. 게임에서는 각 사운드가 전반적인 출력 라우드니스에 기여합니다. 영화나 텔레비전 제작과 달리 작은 세그먼트의 다이내믹과 주파수 반응을...

Wwise를 사용하여 UE 게임에 두 개의 오디오 장치 구현하기

먼저 제 소개를 해드릴게요. 저는 에드 카신스키(Ed Kashinsky)이며 러시아 상트페테르부르크 출신 사운드 디자이너 겸 음악가입니다. 현재 저는 아주 흥미롭고 독특한...