Combining Strata, Wwise and Unreal for Immersive Game Experiences

Contenu sonore pour les jeux vidéo / Audio interactif / Outils et conseils pour Strata

In this blog, we’ll dive into working with Strata for interactive design, using one of the multitrack collections in an Unreal Engine 5 project with a Wwise integration.

This blog was adapted from a video I made a few months back, and you can view that here.

Exploring Strata

For those yet unfamiliar, Strata is Audiokinetic’s new sound library designed from the ground-up with over 100,000 audio sources, clip edits, tracks and effect parameters in ready-to-edit REAPER multitrack format. At the time of writing, Audiokinetic has released 25 collections in collaboration with BOOM Library. 

Strata-Store-Banner

Subscribe

For this demonstration, we'll be using sounds from Strata’s Robotic collection for a robot character sound design, specifically diving into the Movement ServoStutter and the Propulsion Footstep subprojects. In case you’d like to take a look at the collection’s documentation, you can do so here. There, you’ll find a brief introduction to the collection, its soundprojects, a link to download the accompanying SoundBook, and more collection-specific information.

robotic-1

Strata’s Robotic collection

Let’s first take a look at my finished result and then dive into the design choices I made in REAPER & Wwise that led to it.

Now let’s open up the Robotic collection in REAPER and get started with the robot’s sound design!

Strata Robotic Collection in REAPER

As I mentioned before, I modified two of the collection’s subprojects, Movement ServoStutter and Propulsion Footstep, to arrive at my end result. Here’s how the Movement ServoStutter subproject looks like in REAPER:

img1

Movement ServoStutter subproject in REAPER

I didn't make too many alterations in this subproject. I decided to essentially export the “ConstantHard” layer as is, and I also changed “Slow Medium” by muting the entire first layer, leaving only the pneumatics and piston-like clattering sounds. Finally, I made minimal changes to the “Fast Large” group, knowing that I would be manipulating the pitch and other aspects in Wwise later on.

Now let’s take a look at Propulsion Footstep. I was already familiar with this subproject, having used it in my earlier Strata linear design project. However, I did make some changes, mainly toning down some of the additional metal impact sounds to match up with the robot character in the game.

img2

Propulsion Footstep subproject in REAPER

Using BOOM’s ENRAGE plug-in

I also made use of some ENRAGE effects, such as the flanger, warp effect, timbre, and voice shifting.

Lately, I’ve come to love experimenting with the various effects and features of BOOM’s ENRAGE plug-in that comes included with the Strata subscription. In this case, I used it to make some small aesthetic changes to push the sounds in the direction I wanted. 

img3

BOOM’s ENRAGE plug-in

The character model I created has a rustic, borderline steampunk appearance with a futuristic twist, and I tried to associate the sounds it generates by making some mechanical aspects of its movement sound more techie or futuristic.

Using the ReaWwise REAPER extension

Once I was finished choosing & modifying the sounds I planned on using in my project, I rendered them out and imported them into Wwise using the ReaWwise REAPER extension.

ReaWwise makes the process of importing sounds into Wwise as painless as possible. If you’d like a more in-depth walkthrough of using the extension in conjunction with Strata collections, you can watch this video. Essentially, the extension looks at what’s inside REAPER’s Render to File dialog, and gives me the ability to make choices about how those files should be transferred into Wwise. Here, I’m able to customize my desired Wwise hierarchy, and map REAPER wildcards to appropriate Wwise object types.

The Preview Panel shows me what the object structure will look like in Wwise, which is pretty neat!

img4

The ReaWwise preview panel

Once we’re ready to take our work to Wwise, we just have to hit “Transfer to Wwise”.

Putting It All Together in Wwise & UE5

Heading over to the Wwise Project Explorer, we’ll see that our audio assets along with the Wwise object hierarchy were successfully transferred from REAPER.

img5

The “Constant Hard” Servo Loop

The first element I’d like to take a look at is the “Constant Hard” servo loop. I decided this would be one of the key sounds for the robot character, and the idea was to have it drone on continuously, while every other action the player would make could potentially alter its pitch, tone, volume, etc.

Taking a look at the RTPC window of the “Constant Hard” Blend Container, we can see that there’s a game parameter receiving the movement speed and acceleration data from the animation. The data is then used to drive changes in the voice pitch, voice volume, and low-pass filter parameters.

img6

The game parameter in Unreal that’s tracking the movement speed and acceleration

Let’s hear how that sounds when isolated:

Elements affecting the “Constant Hard” Servo Loop

The Jump Event

Whenever the Jump event occurs, there are noticeable changes to some of the RTPC parameters on the “Constant Hard” servo loop: it sets the voice pitch and voice volume to a particular relative value. The Jump event also triggers a Power Up sound, as well as Slow Medium Foot Buildup.

Here’s what those actions look like in the Event Property Editor:

img7

Jump in the Wwise Event Property Editor

Just as the Jump event sets off noticeable changes to RTPC parameters on the “Constant Hard” servo loop, Jump_Land involves similar changes, but the other way around, driving the pitch in a different direction. Here’s how Jump_Land looks like in the Event Property Editor:

img8

Jump_Land in the Wwise Event Property Editor

It was quite fun playing around with this particular game parameter and using it to drive the servo, and then compounding on it with other events.

Footsteps and mechanical movements

Moving onto the footsteps and mechanical movements of the character, I put together some layers of slow, clunky, and worn sounds. Here’s a video where I isolated these layers for you to hear them. Note that I turn it down quite a bit in the final mix.

These layers set up the beginning of the mechanics of the footstep.

Looking at the Footstep Blend Container, I just made some minor mix adjustments in Wwise after transferring everything over from REAPER (i.e. pitch adjustments). The footstep impact sound is one of the louder sounds in the mix, which is the counterpoint to the “Constant Hard” servo loop. These two elements basically sandwich everything else in between them, and everything operates based on what they’re doing.

If one of the pneumatic layers is playing from Foot_Plant, when the impact hits, it should release the pneumatic layer envelope that controls the volume (and pitch to some extent). This helps blend everything together.

Here's the Foot_Plant Event, which plays the Slow Medium Foot Buildup Sounds, and also posts the Servo_Movement event.

img9

Foot_Plant in the Wwise Event Property Editor

The Punch

The punch (or Fist) events act similarly to our footstep & jump events: they manipulate the RTPCs for the “Constant Hard” servo loop. 

I made use of the two-event system to take care of this particular animation action: There’s FistHit and the FistHit_Finish, the latter of which resets some of the pitch and volume voice parameters for that “Constant Hard” servo loop.

img10

FistHit in the Wwise Event Property Editor

img11v2

FistHit_Finish in the Wwise Event Property Editor

The Jog_Start & Jog_Stop Events

Next we have the Jog_Start & Jog_Stop events, which play the Power Up and Power Down sounds, respectively. The idea is that these sounds can end up playing almost instantly, one after the other. To handle this, each event (Power Up & Power Down) turns the other one off, so they automate each other's RTPC values. 

Conclusion

Overall, Strata has been an excellent resource for my Unreal/Wwise project, and with some minor modifications to the included sounds and effects, it has provided the perfect soundscape for my interactive game design project.

Thanks for reading this blog about using Strata in combination with Wwise and Unreal. Hopefully this illustrates how well-organized the Strata collections are and how seamless it is to integrate them into a non-linear format and easily start tweaking them.

Subscribe

Chase Steele

Founder

Sound Spark LLC

Chase Steele

Founder

Sound Spark LLC

Chase Steele, founder of Sound Spark LLC, is an accomplished audio engineer with a focus on game audio. Since 2013, he has worked on projects like Madden at EA Tiburon and contributed to the Melrose Center at the Orange County Public Library, where he developed a game audio curriculum. Based in Orlando, Florida, Chase's expertise continues to shape the audio industry.

 @SoundSparkChase

Commentaires

Laisser une réponse

Votre adresse électronique ne sera pas publiée.

Plus d'articles

Hitman 2 : Améliorer la réverbération sur les processeurs modernes

La popularisation des processeurs à six et huit cœurs signifie qu'une puissance de traitement...

19.5.2022 - Par Stepan Boev

Système de chat vocal GME de Suspects : Mystery Mansion

Introduction Cet article de blogue traite du système de chat vocal dans le jeu Suspects : Mystery...

25.8.2022 - Par Felippe Lopes

Visualiser les variations issues de la synthèse croisée d'Impacter

Bienvenue à nouveau dans notre série d'articles sur le plugiciel Impacter. Dans les deux articles...

24.11.2022 - Par Ryan Done

SpectralMultiEffect par zerocrossing

SpectralMultiEffect est un plug-in pour Wwise. Il a été créé dans l'intention d'améliorer...

15.12.2022 - Par Javier Arciniegas

Derrière le son de I Am Fish

I Am Fish est une charmante petite aventure dont le gameplay est basé sur la physique, et qui permet...

6.6.2024 - Par Ali Tocher

Faites une plongée sous-marine en multipiste | Nouvelle collection Strata : Submersion

Plongez et explorez les profondeurs englouties avec la toute nouvelle collection Strata, Submersion....

22.8.2024 - Par Spectravelers

Plus d'articles

Hitman 2 : Améliorer la réverbération sur les processeurs modernes

La popularisation des processeurs à six et huit cœurs signifie qu'une puissance de traitement...

Système de chat vocal GME de Suspects : Mystery Mansion

Introduction Cet article de blogue traite du système de chat vocal dans le jeu Suspects : Mystery...

Visualiser les variations issues de la synthèse croisée d'Impacter

Bienvenue à nouveau dans notre série d'articles sur le plugiciel Impacter. Dans les deux articles...