menu
 

Using Wwise as a main instrument for sound design in theatre

상호작용 오디오 / 위치 기반 엔터테인먼트 (LBE)

Over the past few years, I've been lucky enough to take part in several plays as sound designer and musician. By chance, or perhaps by preference, I often find myself playing the music directly on stage, alone as a one-woman band or with other performers. 

Thanks to my training in classical music, I'm well skilled to compose in a linear fashion as heard in opera or melodrama (for example, Igor Stravinsky's A Soldier's Tale). This method of composition, used for hundreds of years in the Western music tradition, certainly has its benefits. Scenes can be shaped with high precision, the musical score and text, whether sung or unsung, woven together, and this altogether can create marvellous works. We spend time in rehearsal to get everything just right, get on stage, and play the composition to perfection in the same way every night. 

This approach works very well in the context of a play that doesn't interact with the audience. In a work that includes improvised moments, on the other hand, a pre-composed soundtrack or one that follows a score is sometimes too rigid. That's where Wwise comes in.

img1

Interpreting music on stage can lead to beautiful theatrical moments (Merci d'être venus, Théâtre Périscope, 2023).

Today I'd like to tell you about my sound design for the play Merci d'être venus ("Thank you for coming") and what led me to choose Wwise as a tool for creating and performing on stage.

Why Use Wwise in Theater?

Merci d'être venus is a play by the company Le Complexe that makes extensive use of the codes of stand-up performance; the main character engages with the crowd several times during the show and can improvise at any given time. When we started designing sound, we wanted the music to be able to adapt to the improvisational nature of the text and the antics of Gabriel Morin, the play's sole actor. We also knew that I would be accompanying Gabriel directly on stage, and that I would be performing all the sound cues directly from my on-stage seat in the set.

For me, performing arts such as theater have always related more to video games than films: actors are a living and sometimes unpredictable material, like the player's character in a game - and music has to react accordingly. Having worked with Wwise in the past, I tried it out in rehearsal and the team loved it.

As well as being able to play cues the traditional way, Wwise naturally offers all the features we associate with video games. It's a very powerful tool for crafting complex soundscapes thanks to the Actor-Mixer Hierarchy; there are also the almost infinite applications of RTPCs (modifying a cue in real time with a low-pass filter, for example), all that without mentioning the interactive music features.

For me, using Wwise in theater allows you to create a lively, unique and complex sound design that adapts organically to the acting of the performers on stage.

Wwise as a stage instrument

At the beginning of my adventure, I wondered whether the Soundcaster was going to be reliable enough to trigger cues throughout the show. The article Using Wwise for Theatre: Adaptive soundscape for Theatre Play Le Léthé by Pierre-Marie Blind had me reassured and gave me the confidence to go ahead with the idea. 

Since I was going to be on stage rather than in the control room, and the director didn't want a computer on stage, I figured I could assign the Soundcaster's Events to keys on a MIDI controller, linked to a computer backstage. I came across a fascinating video by Aaron Brown that convinced me of the infinite possibilities of using MIDI and Wwise.

img2

Once the MIDI controller is connected, it's easy to assign Events to specific keys in a Control Surface Session.

Since I wanted to have the entire show's Events on a single page and several knobs to change the value of the RTPCs, I chose the APC Mini mk2 as a controller.

img3

Left: my APC Mini mk2, annotated and ready to play cues. Right: my music corner in the background.

Actor-Mixer-Hierarchy as a Musical Tool

Naturally, composers have found ways to make written music more flexible over the years. In musicals, for example, safety bars (ex. 1) are a way for the orchestra to wait for characters to arrive at the right moment in the text before moving on to the rest of the score. 

img4

ex. 1 Into the Woods, Stephen Sondheim (1986)

I thought this kind of method would work beautifully in Wwise with the Music Switch Containers and the various States that can be created in the Game parameters. All you need to do is split the music into several States and make sure that the last item in the Playlist is looped (ex. 2). 

img5

ex. 2

We can then move on to another State and carry on with the rest of the track, after taking great care to program adequate transitions. This is all pretty standard in the video game industry, but being able to apply this method to theater with pre-composed musical segments was new to me - and, let's face it, pretty exciting!

img6

Merci d'être venus, Théâtre Périscope, 2023.

At one point in Merci d'être venus, the actor slowly shifts to a musical section and gets the audience involved. I obviously used the States approach described above, and it worked like a charm. However, at the very beginning of this section, the lyrics are scored with bars-free, tempo-less music. I probably could have used the Interactive Music Hierarchy, but it was simpler for me to use the Actor-Mixer-Hierarchy and handle the musical elements as sound design elements.

img7

ex. 3 Score and Wwise Events relation in Merci d'être venu.

As you can see above (ex. 3), I've assigned a looping drone in an Event. When the actor gets to a specific moment in the text, I trigger another Event to play the first organ line over the drone. The next Event plays the second organ line, but also changes the drone note from D to A. The third organ line overlays the drone without a hitch. These Events are accessible at my fingertips on my MIDI controller, and I can trigger them whenever I like!

Now comes the time in the play where I need to bring drums and a tempo, so the next Event starts the Music Switch Container JCS_toune (pardon my vernacular naming) while continuing to play the drone below. The rest of the musical section is set in the Interactive Music Hierarchy.

I very much appreciate the flexibility that the Actor-Mixer-Hierarchy offers for musical cues that don't have a fixed tempo, and use it a few times in Merci d'être venus.

Interactivity at the Heart of the Theatrical Performance

Because Merci d'être venus is a show that tackles some pretty heavy topics head-on, it strongly relies on the interaction with the audience. Intense moments are interrupted with stand-up-like moments, and when the actor decides to keep going with a joke because the audience reacts well, the music has to follow him too.  

I could have simply accompanied the actor on guitar (earlier versions of the show were all acoustic guitar), but for this iteration we wanted to push the design further and have more musical moments, with more instrumentation. Being the only musician, Wwise gave me access to more complex instrumental textures without giving up the soundtrack's interactivity. Furthermore, the possibilities offered by the Control Surface Sessions in triggering Events using a MIDI controller made performing the show surprisingly simple.

Wwise is already a powerful tool for video games, and I was pleasantly surprised by its capability in a theatrical context. I recommend it to any designer who wants to build an interactive design, whether from the control room or directly on stage.

Merci d'être venus will be presented across Québec in 2024 and 2025.

Philomène Gatien

Composer and Orchestrator

Philomène Gatien

Composer and Orchestrator

Philomène Gatien is a composer and orchestrator. She has written the music for several short films and plays (Merci d'être venus, L'expiration). She also works on orchestrations and arrangements, notably for composer Martin Léon and director Philippe Falardeau (My Salinger Year, Le temps des framboises).

philomenegatien.ca

댓글

댓글 달기

이메일 주소는 공개되지 않습니다.

다른 글

상호작용 오디오 비지니스

저희는 Wwise 상호작용 음악 심포지움에서 최고의 분들을 패널에 모셔서 상호작용 오디오에서 작업 그 자체만큼이나 아주 중요한 분야인 비즈니스의 측면에 대해 대화를 나누었습니다....

26.1.2021 - 작성자: Audiokinetic (오디오키네틱)

새로운 Impacter 플러그인 알아보기

개요 Impacter(임팩터)는 기존의 SoundSeed Impact 플러그인을 영감으로 하는 새로운 음원 플러그인입니다. 이 플러그인은 '타격음' 사운드 파일을 저작 도구로...

20.5.2021 - 작성자: 라이언 돈 (RYAN DONE)

위치 기반 엔터테인먼트, 불규칙적 스피커 구성과 Wwise

Wwise는 오디오 채널의 개수와 스피커 배열이 기존의 소비자 채널 구성을 따르는 콘솔과 PC 게임 개발에 사용하는 것으로 잘 알려져 있습니다. 하지만 Wwise가 빛을 발하는...

16.11.2021 - 작성자: 숀 랩티스트 (Shawn Laptiste)

Wwise에서 음악 설계 템플릿을 사용하여 독보적인 사운드 디자인을 만들어내는 방법

Foxface Rabbitfish(폭스페이스 레빗피시)의 작곡가 겸 오디오 디렉터인 가이 휘트모어(Guy Whitmore)는 2019 Wwise 상호작용 음악 심포지움에서 현대...

24.11.2021 - 작성자: 가이 휘트모어 (Guy Whitmore)

Strata, Wwise, Unreal을 결합해 몰입형 게임 환경 만들기

이 블로그에서는 Wwise가 통합된 Unreal Engine 5 프로젝트의 멀티트랙 컬렉션 중 하나를 사용하여 Strata를 이용한 상호작용 디자인 과정을 살펴보겠습니다.이...

16.5.2023 - 작성자: 체이스 스틸(Chase Steele)

상호작용 음악: '여러분이 직접 선택하는 모험' 스타일의 발라드

2018년 크라우드 펀딩 캠페인을 성공적으로 마친 inXile Entertainment(인엑사일 엔터테인먼트)는 '웨이스트 랜드 3(Wasteland 3)' 게임의 본격적인 제작에...

23.5.2023 - 작성자: Alexander Brandon (알렉산더 브랜드)

다른 글

상호작용 오디오 비지니스

저희는 Wwise 상호작용 음악 심포지움에서 최고의 분들을 패널에 모셔서 상호작용 오디오에서 작업 그 자체만큼이나 아주 중요한 분야인 비즈니스의 측면에 대해 대화를 나누었습니다....

새로운 Impacter 플러그인 알아보기

개요 Impacter(임팩터)는 기존의 SoundSeed Impact 플러그인을 영감으로 하는 새로운 음원 플러그인입니다. 이 플러그인은 '타격음' 사운드 파일을 저작 도구로...

위치 기반 엔터테인먼트, 불규칙적 스피커 구성과 Wwise

Wwise는 오디오 채널의 개수와 스피커 배열이 기존의 소비자 채널 구성을 따르는 콘솔과 PC 게임 개발에 사용하는 것으로 잘 알려져 있습니다. 하지만 Wwise가 빛을 발하는...