menu
 

Doin' it Beatnik-style: MIDI + samples in Wwise

상호작용 음악

The first time I looked at the MIDI music system in Wwise, I was struck by how functionally similar it was to the now-obsolete Beatnik engine, a software synthesizer I used many years ago to produce game audio and interactive music. This is a prime example of the adage: "ya live long enough, ya become cool again". 

beatnikBeatnik engine

I had just started to work with the Wwise MIDI system to reduce the size of a mobile game music soundtrack, when the gig disappeared in a sudden flash of dragonfire! Undaunted, I still wanted to try it out, because the MIDI+samples method of producing interactive music provides tools for creative invention and adaptive implementation unavailable to streaming media systems. 

So I wrote "metal(notHeavy)" using the same techniques I would have had it been a Beatnik track. In fact, I wanted to demonstrate a variety of techniques available to composers when controlling sample playback using MIDI data. As the project evolved, a creative theme emerged as well, specifically "all sounds produced by metal": glockenspiel, agogo bell, steel strings (piano, bass), vibes, brass, et al. 

Dowload the "metal(notHeavy)" Wwise Project

Recording Samples 

I started with the piano loop. This is a live recording of my 1926 Steinway baby grand using a PianoMic system by Earthworks. The physics behind this remarkable mic setup seems like voodoo magic to me, but to my ears the results are astonishing. I played to click, and cut the loop in ProTools. 

Then I recorded the glockenspeil (an Orff instrument recently retrieved from an attic in Massachusetts). It only ever had C diatonic keys, plus a couple of F#'s and Bb's; I recorded each metal bar, and would fill in the gaps later to create a chromatic instrument. 

glockenspielCarl Orff (Carmina Burana) was not only a composer of apocalyptic full-orchestra-and-choir pieces, he also developed a pedagogy for teaching music to very young children (kindergarten through 4th grade). The Orff Schulwerk method relied on rhythmic clapping, pentatonic scales, and special mallet instruments, including various sizes of xylophones (wood keys), metallophones (aluminum, aka vibes), and this glockenspiel (steel).

I once took an "african bell" class at UC extension, and learned a variety of patterns: guanguanco, kidi, african 6, agogo, timbale. I recorded multiple takes of these rhythms using a rubber mallet and a Neumann KM184, then cut up four bar phrases in ProTools. Full disclosure, I did apply some quantization to these samples, sliding audio hits around by hand to line up exactly to tempo (100 bpm). 

The rest of the samples were gleaned from various sources over the course of the project: additional recordings, synthesizers, and sample libraries. They are all in blend containers in the "instruments" actor-mixer, formatted as 16/48 WAV (the full-rez 24/96 recordings of the bell patterns are also available to download, for anyone interested). 

Triggering Samples 

A Wwise MIDI music segment works just like a regular one, except you drop in .mid rather than .wav files. Each track is associated with a instrument blend container, which contains a keymap defining note ranges and roots for each sample (again, like Beatnik). 

agogobell cabasa sawbladeAgogo Bell (left) Cabasa (center) Sawblade (right)

There's a few ways the samples are triggered: 

  • The piano loop is triggered once every 20 bars. 
  • The bell patterns are shorter, and are triggered more often. Each MIDI note is assigned to a random container of loops, sorted by catgegory. The MIDI sequence defines which categories play when, but the bell pattern mix will vary on subsequent playbacks. 
  • The glockenspeil is laid out so each steel bar sample is associated with the corresponding MIDI note. Then the ranges of the C, D, and G notes are stretched to cover the C#'s, Eb's, and Ab's of the chromatic scale. 
  • The bass and vibes instruments are similarly laid out, except that I recorded the MIDI first, then looked at the range of notes played, and took samples at regular intervals within that range. This produces smooth tonal transitions between high and low notes. 
  • The cabasa, ride cymbal, and sawblade effect are all one-note hits, associated with containers of variations to prevent annoying sonic repetition. 
  • The brass is an assortment of phrases culled from an old school sample CD. They've been cut into short phrases, and are triggered in different combinations and timings to create melodic riffs. The technique is designed to produce increased sonic bang for your audio budget buck. 

Fun with MIDI 

Putting a song together in this manner results in a dramatic reduction of memory usage. In fact, an .mp3 rendition of the piece is double the size of the Wwise Vorbis bank (2.3Mb). The project demonstrates how small audio chunks can be played and manipulated via MIDI to create large amounts of variable musical content. This is an especially useful technique when producing soundtracks for resource constrained platforms, like mobile and wearable devices. 

metal(notHeavy)_wwiseProjclick on the screenshot to enlarge 

But simple and straightforward it ain't! I could have much more easily and quickly produced the same song (sans variable bell patterns) in ProTools by just laying down tracks and rendering a .wav file. And if you're under a tight deadline (because the programmer needs to integrate the music now now now), then yeah, no problem, here ya go! 

However, this project was produced soley for my own creative edification, and I must admit, I very much enjoyed writing without consideration to what the stakeholders might think, or whether the music fit the game theme. My point is, doing purely personal projects after your job goes up in smoke can be an effective way of channeling the inevitable layoff blues into something privately satisfying (that might even help you find work in the future). 

In any case, halfway through development, while playing with my audio toys and working out the technical implementation, I realized that what I was really doing was just having FUN ... the most important aspect of any creative project! 

MP3 rendition of the song metal(notHeavy)

- pdx

Peter "pdx" Drescher

Sound Designer and Composer

Peter "pdx" Drescher

Sound Designer and Composer

Peter "pdx" Drescher produces audio content, implementation, and code for games and mobile devices. He is a talented sound designer, accomplished musician/composer, published author, experienced programmer, and skilled audio engineer. His ProTools project studio "Twittering Machine" is located in the SF Bay area.

www.twittering.com/

댓글

Ken Felton

August 20, 2019 at 12:00 pm

Hey PDX, Nice overview. Thanks for sharing! Cheers- Ken

Garry Schafer

August 20, 2019 at 01:37 pm

Hey I thought I was the only guy on this planet that remembered and loved Thomas Dolby’s Beatnik — used it on numerous projects in Director and it was exactly like having a little Akai sampler with a General Midi synth; there was nothing else like it for Director, and, when I started getting into Unity, nothing like it for Unity - until now. Great article; thanks for the memories!

댓글 달기

이메일 주소는 공개되지 않습니다.

다른 글

하이브리드 상호작용 음악의 시대가 올 것인가? 제 1부 -상호작용 음악의 R&D 플랫폼으로 Get Even 사용하기

저는 게임 음악을 작곡할 때 어떻게 하면 플레이어에게 의미있게 다가갈 수 있을까 항상 고민합니다. 작곡가는 보통 크리에이티브 디렉터, 오디오 디렉터와 함께 이야기, 감정, 주제,...

22.10.2019 - 작성자: 올리비에 더리비에르 (OLIVIER DERIVIÈRE)

음악 디자인 & "히라에스 프로젝트(Project Hiraeth)": 내가 존재하지 않는 게임을 위해 1년을 보낸 이유

히라에스 프로젝트(Project Hiraeth)는 완전히 어뎁티브하고, 전문적으로 믹싱 되고, 라이브 오케스트라와 함께 녹음된 세계 최초의 비디오 게임 스코어 라이센스입니다....

15.4.2020 - 작성자: Seth Wright

동적 음악 설계에 관하여 - 제 1부: 설계 분류하기

설계 계기 저는 2015년에 오디오 게임 엔지니어로서 처음 일을 하게 되면서 그 당시 저의 아트 디렉터를 통해 Wwise를 접하게 되었습니다. 그전에 저는 게임 음악을 작곡하는...

7.10.2020 - 작성자: 천종 호우 (Chenzhong Hou)

상호작용 오디오 비지니스

저희는 Wwise 상호작용 음악 심포지움에서 최고의 분들을 패널에 모셔서 상호작용 오디오에서 작업 그 자체만큼이나 아주 중요한 분야인 비즈니스의 측면에 대해 대화를 나누었습니다....

26.1.2021 - 작성자: Audiokinetic (오디오키네틱)

Wwise로 현실 세계의 상호작용 음악 만들기

저는 몇 년 전부터 상호작용 오디오를 좀 더 깊게 탐구해보기로 했습니다. 제가 하는 작업과 연관된 프로젝트로 만들되, 지루하지 않게 흥미로우면서도 배울 것이 있는 프로젝트를...

24.8.2021 - 작성자: 리사 슈바르츠발트 (Ressa Schwarzwald)

게임 음악은 단순히 그냥 음악이 아니다: 제 1부

게임 음악이란 무엇일까요? 상호작용 음악이란 무엇일까요? 이 질문에 답하기란 생각만큼 그리 간단하지 않습니다. 올리비에 더리비에르(Olivier Derivière)는 이 글을 통해...

20.10.2021 - 작성자: 올리비에 더리비에르 (OLIVIER DERIVIÈRE)

다른 글

하이브리드 상호작용 음악의 시대가 올 것인가? 제 1부 -상호작용 음악의 R&D 플랫폼으로 Get Even 사용하기

저는 게임 음악을 작곡할 때 어떻게 하면 플레이어에게 의미있게 다가갈 수 있을까 항상 고민합니다. 작곡가는 보통 크리에이티브 디렉터, 오디오 디렉터와 함께 이야기, 감정, 주제,...

음악 디자인 & "히라에스 프로젝트(Project Hiraeth)": 내가 존재하지 않는 게임을 위해 1년을 보낸 이유

히라에스 프로젝트(Project Hiraeth)는 완전히 어뎁티브하고, 전문적으로 믹싱 되고, 라이브 오케스트라와 함께 녹음된 세계 최초의 비디오 게임 스코어 라이센스입니다....

동적 음악 설계에 관하여 - 제 1부: 설계 분류하기

설계 계기 저는 2015년에 오디오 게임 엔지니어로서 처음 일을 하게 되면서 그 당시 저의 아트 디렉터를 통해 Wwise를 접하게 되었습니다. 그전에 저는 게임 음악을 작곡하는...