DAW based VR audio content production?

Post general topics related to Nuendo 7 here.
Tronic
New Member
Posts: 19
Joined: Sun Aug 21, 2016 11:32 am
Contact:

DAW based VR audio content production?

Post by Tronic » Sun Aug 21, 2016 12:06 pm

With Nuendo 7 we saw an attempt to tap into game audio, but what about VR?

Ambisonics has been adopted by the big players and is fast becoming the “defacto standard” for VR audio production: Google (ambiX Youtube content), Facebook (recently bought Two Big Ears and Occulus provides its own ambisonic based audio tool-set), Adobe also supports ambisonic audio, and there are many others. But when is Steinberg going to provide Nuendo with appropriate functionality to capitalise here?

Moves to support Nokia’s OZO audio (a €40,000 AV solution) doesn’t help smaller audio content producers who don’t/will not have access to this equipment and Nuendo’s rigid bus architecture continues to be a problem.

In terms of 3D audio, most higher order ambisonic (HOA) VST tools (there are now more available than ever before) are unusable in Nuendo. Higher channel counts per bus are needed, even the recently added 22.2 bus is sub-par at this point.

Is there anything in the pipeline for 7.5? Why is Steinberg behind the curve on all of this? I use Nuendo, and love it, but I'm really feeling felt behind here, if I want to get into DAW based VR audio content production I see no other option than to adopt Reaper (up to 64 channels on a bus) for this type of work, which is a shame.

Anybody got any views on this?

TimoWildenhain
Moderator
Posts: 1022
Joined: Mon Jan 31, 2011 11:51 am
Contact:

Re: DAW based VR audio content production?

Post by TimoWildenhain » Tue Aug 23, 2016 11:32 am

Hello,

may I asked why you feel we are "behind all this"?

First of all, our Nokia OZO VR project should not be mixed up with other types of playgrounds of VR-related formats
and technology. There are only a few, limited tools on the market that allow for "something" like VR production. The entire VR industry is at its beginnings and be sure that we are in contact with ALL the players you listed and a few more most people don't have on their radar. Integrating Ambisonics will not be the biggest deal and you can expect that this will happen in a future Nuendo version.

The challenge is to establish a real workflow, not just supporting a format. All current technologies are far from being convenient and straightforward. That is why we are not releasing one VST plug-in after the other.

Be sure we do our best to develop technology for VR, besides our focus on game audio, TV and film post-production and ADR workflows.

Thanks,
Timo
Timo Wildenhain - Head of Business Unit
Professional Audio Unit
Steinberg Media Technologies GmbH
Hamburg, Germany
Checkout Steinberg on YouTube, Twitter, Facebook and MySpace!

heisenberg9
Junior Member
Posts: 150
Joined: Wed Jul 01, 2015 6:22 pm
Contact:

Re: DAW based VR audio content production?

Post by heisenberg9 » Wed Aug 24, 2016 2:17 am

Great to hear Timo. This stuff, IMO, is going to be huge for those of us who will be pursuing 360 VR Video as part of our business.
Andrew
--
Nuendo 10.1.0
--
Hardware related to issue tracking:
ASUS P9x79, i7-3930K CPU OC to 4.05 khz, 64 GB, combination of SSDs & HDs, Blackmagic Decklink Card with HD-SDI Monitor used in Nuendo, Firewire Card, MOTU Traveler mkIII, GTX 580 2 GB of VRAM with 2 Monitors, NVIDIA Driver 390.41 WHQL running on Windows 7 Pro 64 bit with eLicenser & iLok dongles.

For Issue tracking, the MIDI controllers used:
Mackie MCU+C4, X-Touch Compact, X-Station, nanoKEY2 for key switching & Steinberg TP, CH & AI

For issue tracking, brands or software instruments & effects commonly used:
VEPro 7, Vienna Instruments 2, MIR Pro & Suite; script heavy Kontakt Libraries such as Spitfire, Heavyocity, NI, Soniccouture, Sound Dust, also UVI Falcon & rewired Ableton Live 10, Max 7, Melodyne and Reason 8. EFX often used are by Lexicon PCM Reverbs & Effects, FabFilter, IRCAM Spat, SoundToys, Brainworks, (iZotope RX punted to the sideline), Eventide, Waves plugins, etc.

User avatar
ChrisPolus
Member
Posts: 576
Joined: Sat Jun 13, 2015 9:32 am
Location: Schweiz
Contact:

Re: DAW based VR audio content production?

Post by ChrisPolus » Wed Aug 24, 2016 9:02 am

From what I've seen at gamescom I can only testify that VR is in its early infancy. There are some great concepts out there, but until this gets to the masses, it will take a while. If only because of the prices for VR gear and the inconvenience of setting this up in the living room. The Vive for example, you need to have multiple cables from the computer, you have to mount these room sensors, you need a super gaming PC at home (which is expensive), and you need to tackle the cables in order not to get entangled in them. This is something only few can buy. I cannot remember the last time something this inconvenient, where you had to rebuild your living or gaming room with cable holders and a peripheral for 800$ won the mass market. So we're far from mass market. Trade shows, as eye catcher, or multimedia shows in museums or something yes, sure. But again, not wide spread yet.

Nonetheless, everybody wants to get on the bandwagon. On that note, 3D and VR sound is more a thing of the playback device. The audio engine in the game or VR experience has to properly translate audio sources into 3D sound and space, do HRTF and such things so the sound really feels immersive. Currently all the game engines I tried (Unity, Unreal...) do not sound that great when on headphones, not to speak of VR headsets.

But, you're right, if we are to develop sound for VR experiences, we need means of testing how the sound will feel and export it into a supported format, or read such formats for editing. But just exporting such a file will do not much good, we need testing within Nuendo, how the sound will sound when turning our heads. Not only VR, also better integration in game engines and middleware would be great so we can test sound before we deliver it to the client. Then they have to create a game build, send it to us, we can play it and re-create a game situation to judge the sound. Then we have to go back. It's cumbersome. And here, workflow is crucial. How could such a workflow look like so it makes sense? More than just linking a Nuendo project to WWise and have roundtrip editing. I guess an exporter is quickly written. But giving you the advantage of testing sound while editing would speed up workflow a lot.

I'm intrigued and looking forward to what Steinberg will come up with.
Handmade Win10 x64 Machine, Intel 6 Core CPU, ASUS Prime Board, 16GB RAM, 1080 GTX
MacBook Pro 15" Late 2016 with Touchbar, latest macOS, 16GB RAM
Latest Nuendo version, Logic Pro X, Reaper, UAD Apollo Duo + Twin MK2 via Thunderbolt

Tronic
New Member
Posts: 19
Joined: Sun Aug 21, 2016 11:32 am
Contact:

Re: DAW based VR audio content production?

Post by Tronic » Tue Sep 06, 2016 1:44 pm

TimoWildenhain wrote:The entire VR industry is at its beginnings and be sure that we are in contact with ALL the players you listed and a few more most people don't have on their radar. Integrating Ambisonics will not be the biggest deal and you can expect that this will happen in a future Nuendo version.
Thanks for your reply Timo. Well, the VR sector might be new, but as you know, ambisonics is decades old, if integrating it is not a big deal, Steinberg should really have done it already, it's called foresight, market positioning etc. It doesn't really look good for you guys when someone goes to this Google page and they are basically told "use Reaper."
TimoWildenhain wrote:The challenge is to establish a real workflow, not just supporting a format. All current technologies are far from being convenient and straightforward. That is why we are not releasing one VST plug-in after the other.

Workflow looks pretty straight forward to me, and this is not about "supporting a format," it's about changing Nuendo's rigid bus architecture so that we are free to do the things we want the way we want (rather than how Dolby etc. wants people to do it) - even Pyramix is getting this right, and you wonder why I'm starting to feel left behind sticking with Nuendo?

User avatar
ChrisPolus
Member
Posts: 576
Joined: Sat Jun 13, 2015 9:32 am
Location: Schweiz
Contact:

Re: DAW based VR audio content production?

Post by ChrisPolus » Tue Sep 06, 2016 1:52 pm

Tronic wrote:Workflow looks pretty straight forward to me, and this is not about "supporting a format," it's about changing Nuendo's rigid bus architecture so that we are free to do the things we want the way we want (rather than how Dolby etc. wants people to do it)
Here' I'm totally with you.

By now, I've hit several walls in Nuendo, where I think it's too rigid and too many manual steps, while software should help us automate as much as possible to get our work done. I guess your issues are sort of related. I've filed multiple feature requests and also started a bigger workflow thread for game audio. Most of that can be brought down to this notion of "too rigid" and "too manual", while it should be "dynamic" and "automatic".

Maybe I'm just too boisterous.
Last edited by ChrisPolus on Tue Sep 06, 2016 2:48 pm, edited 1 time in total.
Handmade Win10 x64 Machine, Intel 6 Core CPU, ASUS Prime Board, 16GB RAM, 1080 GTX
MacBook Pro 15" Late 2016 with Touchbar, latest macOS, 16GB RAM
Latest Nuendo version, Logic Pro X, Reaper, UAD Apollo Duo + Twin MK2 via Thunderbolt

Tronic
New Member
Posts: 19
Joined: Sun Aug 21, 2016 11:32 am
Contact:

Re: DAW based VR audio content production?

Post by Tronic » Tue Sep 06, 2016 2:38 pm

It could be a generational thing, the open source software movement has always been about keeping things open-ended, it's antithetical to industrial concerns, but it makes these guys who essentially want a rigid tape+console implementation look like a bunch of dinosaurs, I mean what is it? too many options might fry their heads ; ) what are they going to do when a machine learning based DAW replaces them?

TimoWildenhain
Moderator
Posts: 1022
Joined: Mon Jan 31, 2011 11:51 am
Contact:

Re: DAW based VR audio content production?

Post by TimoWildenhain » Tue Sep 06, 2016 3:37 pm

Hi Chris and Tronic,

thank you for your comments and discussion. Chris, your comment is well put.
Tronic, I also agree that Ambisonics is a format that is around for a long time. However, we're not going to implement technology that has limited use/meaning to our users. Of course we could have integrated the format earlier, but other topics had been more urgent and Ambisonics was not a very relevant format in common post-production workflows before VR became a topic.

However, integrating Ambisonics as a format is still the very beginning of what can be called a workflow.
We will start with that and more things will be coming.

Thanks,
Timo
Timo Wildenhain - Head of Business Unit
Professional Audio Unit
Steinberg Media Technologies GmbH
Hamburg, Germany
Checkout Steinberg on YouTube, Twitter, Facebook and MySpace!

User avatar
Bifop
Member
Posts: 320
Joined: Thu Dec 16, 2010 4:28 am
Contact:

Re: DAW based VR audio content production?

Post by Bifop » Fri Sep 30, 2016 12:09 am

Ozo is being demonstrated at the Los Angeles AES convention this week !

Looks promising.
Personal setup : Nuendo 10 on ASUS PRIME Z270-A -I7 7700K - Win10 pro 64bits- SSD - 4 x LCD screens + 40" on Blackmagic intensity. Steinberg UR824 + MR816 - 2 X Avid Artist Mix + Artist control + Euphonix transport. LCR Focal Twin.

Nuage 32 faders on Mac Pro 12 cores. 5.1 Focal twin. Ssl Xlogic Alpha link Madi at workplace.

Oliver.Lucas
Senior Member
Posts: 1400
Joined: Wed Dec 15, 2010 11:26 pm
Contact:

Re: DAW based VR audio content production?

Post by Oliver.Lucas » Sun Oct 02, 2016 10:49 am

The problem with the entire VR thing is that nobody knows if it will ever make it to the mass market.
There are a lot of potential threats to this new technology (price, will a major part of the consumers in the market want to to wear a helmet connected to wires?, the missing killer application for a mass market etc.)

To be quite honest - my bet is that it's going to be as dead as 3DTV or SACD in the close future because everybody will have tried it once, think it's "interesting" and then move on.

My 2 cents are that Steinberg is making a huge mistake in wasting development cycles on this. But that might also only be my ignorant bet. I just don't (want to) see the world connected to a helmet with wires. Maybe I'm getting old.
Main machine: Hexacore 3.3 Cheese grater with USB3 and RME Raydat, 48GB RAM, Radeon HD 7970, Caldigit FASTA USB C, Intensity Pro, macOS 10.14
Avid ProTools S3

PeterGx
Junior Member
Posts: 56
Joined: Tue Feb 23, 2016 9:00 pm
Location: Ljubljana, Slovenia
Contact:

Re: DAW based VR audio content production?

Post by PeterGx » Sun Oct 02, 2016 2:15 pm

Oliver.Lucas wrote:The problem with the entire VR thing is that nobody knows if it will ever make it to the mass market.
There are a lot of potential threats to this new technology (price, will a major part of the consumers in the market want to to wear a helmet connected to wires?, the missing killer application for a mass market etc.)

To be quite honest - my bet is that it's going to be as dead as 3DTV or SACD in the close future because everybody will have tried it once, think it's "interesting" and then move on.

My 2 cents are that Steinberg is making a huge mistake in wasting development cycles on this. But that might also only be my ignorant bet. I just don't (want to) see the world connected to a helmet with wires. Maybe I'm getting old.
It was all about VR in IBC this year. And when I wanted to see a better resolution headset there was none. Feature films in VR look weird, pixellated and there are so many technical and artistic issues to to be solved, like depth of field, lighting, action timing to name a few.
I agree we have some time and there is no need for Steinberg to jump in at this point.

Nevertheless I see a lot of potential in VR, but mostly in science, turism and education where you don't really need fancy VR audio.

People with wires moving their heads definitely look even more isolated than those with phones and facebook.

User avatar
Fredo
External Moderator
Posts: 2440
Joined: Tue Dec 14, 2010 11:20 am
Contact:

Re: DAW based VR audio content production?

Post by Fredo » Sun Oct 02, 2016 2:18 pm

I do think that VR and 360 movies will become -at least- a hype.
I however don't think there is business for us in it.

I don't think that the young people who are now recording their skate/jump or aother adventures with their GoPro's will go through some kind of audio post process before they post their video on YouTube.
Of course there will be some cool companies that will jump on the format and so some really cool stuff with it.
I don't think however that there will be (enough) business for us in it.

ANd for the record, I am as sceptical about Dolby Atmos and Auro 3D.
I don't see the old fashioned 5.1 going away in the near future.
Just for the fact that only one out of 100 movies really benefit from these formats.

I hope I am wrong though ...

Fredo

User avatar
MattiasNYC
Grand Senior Member
Posts: 3627
Joined: Thu Dec 16, 2010 9:27 am
Contact:

Re: DAW based VR audio content production?

Post by MattiasNYC » Sun Oct 02, 2016 4:49 pm

As for VR I'm guessing gaming will be the first field to benefit commercially from it, and it's also the field in which there's still a fair amount of revenue to be made and a fair amount of content control (i.e. less copyright infringement compared to music/film/tv). So I think services will still be needed there. If the porn industry follows then that too will possibly push production towards VR.

For more 'pedestrian' VR I agree that a lot of people won't bother with it, but on the other hand I think the bigger issue technically and especially practically is the visual experience. We block out the rest of the world when we put on those VR headsets or glasses, but we don't actually have to do that with audio. If audio is delivered using regular headsets then the technology is already there. So there's at least the potential for audio to grow somewhat independently of video, assuming we have the imagination to come up with something useful.

Anyway, I think there's business in it for engineers, just not for a lot of us, yet. And there's of course also the question of how much of this will be traditional engineering and how much will be simply creating assets which are then automatically placed/mixed using algorithms.

As for Atmos/Auro3D I slightly disagree though. I have to say that the formats are pretty nice when done right. I think the bigger issue is really aesthetic restraints on the directors. Listening to something like Star Trek "Into Darkness" in Atmos + converted-to-3D was pretty meaningless in my opinion. Both visually and aurally. The mix was just so extremely busy that the enveloping sensation was lost. Gravity on the other hand was completely different. With a more dynamic mix I think Star Trek could have benefited from it as well, but who knows, the movie was pretty much wall-to-wall action anyway so perhaps it wouldn't have fit the film.

At any rate, I think as we become more comfortable with working with it we'll see more and better use of it. Some people still argue that stereo is sufficient, yet to me the difference between it and 5.1 is huge once you're A/B-ing, and I also feel 7.1 is superior to 5.1...... and if done well Atmos to 7.1 (I've unfortunately never heard Auro 3D).
Nuendo 7.1.4 / Lynx TWO-B / Windows 10 Pro 64-bit / Ryzen 1700 3.7GHz (oc) / 16GB Corsair Vengeance DDR4@3200MHz / Nvidia GTX 660 / ASUS x370-A mobo/ 500GB WD Blue system drive / Crucial BX100 250GB SSD media / spinners for library/backup ::::: iZotope RX / Phoenixverb Surround / DaVinci Resolve / Faderport / Applied Acoustics UltraAnalog / my pet pony Frank

Getalife2
Member
Posts: 518
Joined: Sat May 24, 2014 3:32 pm
Contact:

Re: DAW based VR audio content production?

Post by Getalife2 » Mon Oct 03, 2016 1:27 am

I'm assuming everyone commenting has experienced Oculus Rift in person? I don't see how that level of immersion is going away. I think it's gonna be big, long term.
N10.0.20 - i7 5960X/32 GB at 4.3GHz with x7 SSDs - Win 7/64 - 2x RME MADI - 3X UAD-2 Quad - VEP

User avatar
Bifop
Member
Posts: 320
Joined: Thu Dec 16, 2010 4:28 am
Contact:

Re: DAW based VR audio content production?

Post by Bifop » Mon Oct 03, 2016 6:13 pm

Getalife2 wrote:I'm assuming everyone commenting has experienced Oculus Rift in person? I don't see how that level of immersion is going away. I think it's gonna be big, long term.
I concur totally. i think it'll make it big in video games, documentaries...
Then artistic exhibitions, tourism, theme parks will be more in the realm of Augmented reality. But the two will merge at some point in the future IMO.
I am glad to see Steinberg pioneering in this arena.
Personal setup : Nuendo 10 on ASUS PRIME Z270-A -I7 7700K - Win10 pro 64bits- SSD - 4 x LCD screens + 40" on Blackmagic intensity. Steinberg UR824 + MR816 - 2 X Avid Artist Mix + Artist control + Euphonix transport. LCR Focal Twin.

Nuage 32 faders on Mac Pro 12 cores. 5.1 Focal twin. Ssl Xlogic Alpha link Madi at workplace.

Oliver.Lucas
Senior Member
Posts: 1400
Joined: Wed Dec 15, 2010 11:26 pm
Contact:

Re: DAW based VR audio content production?

Post by Oliver.Lucas » Tue Oct 04, 2016 7:43 am

Fredo wrote: ...
I don't think however that there will be (enough) business for us in it.
..
Unfortunately this is exactly how I see it. :?
Main machine: Hexacore 3.3 Cheese grater with USB3 and RME Raydat, 48GB RAM, Radeon HD 7970, Caldigit FASTA USB C, Intensity Pro, macOS 10.14
Avid ProTools S3

User avatar
ChrisPolus
Member
Posts: 576
Joined: Sat Jun 13, 2015 9:32 am
Location: Schweiz
Contact:

Re: DAW based VR audio content production?

Post by ChrisPolus » Tue Oct 04, 2016 4:44 pm

Oliver.Lucas wrote:
Fredo wrote: ...
I don't think however that there will be (enough) business for us in it.
..
Unfortunately this is exactly how I see it. :?
Me too. I think VR or AR is going to be huge. But it's always a question of subsets. A huge number of people have a TV or computer by now in their homes. A subset of those has an HD TV (these days many more, but I'm sure there are still people with old CRTs or flat screens but SD resolution in the world, not everybody is first world), and of those, only a subset has 4K HDTV. That's the same in gaming. Many people have computers, only a small subset has gaming machines or does gaming on a computer, and of those, only a tiny subset buys peripherals to game in VR or watch a video in VR. So the market will be very small for a long time I think. There will be those super high end demo projects, probably Red Bull and the porn industry will jump on it, but it's nothing compared to just regular mixing work for TV and cinema.

Also, for games, my opinion is that, because games are interactive, it's the audio engine that has to do the heavy lifting. Sound designers will continue to provide normal mono or stereo sounds as they always did and the sound engine within a game then has to translate that stuff for VR headphones. Not a lot will change.

For movies, where the position is fixed but the view can be rotated with a headset, there's probably more work needed to mix that. So there will be more work in movies than games. But again. Tiny subsets. That's at least my opinion with my current knowledge of things.
Handmade Win10 x64 Machine, Intel 6 Core CPU, ASUS Prime Board, 16GB RAM, 1080 GTX
MacBook Pro 15" Late 2016 with Touchbar, latest macOS, 16GB RAM
Latest Nuendo version, Logic Pro X, Reaper, UAD Apollo Duo + Twin MK2 via Thunderbolt

User avatar
Bifop
Member
Posts: 320
Joined: Thu Dec 16, 2010 4:28 am
Contact:

Re: DAW based VR audio content production?

Post by Bifop » Wed Oct 05, 2016 12:08 pm

Meanwhile, Behringer are working on Augmented Reality for their forthcoming synth, the Deepmind 12.
https://youtu.be/-9MTlsA-wi4

Nothing to do with OZO, but interesting nonetheless in regards to this discussion. At some point, we'll have immersive sound and AR/VR wtih user interaction.

Now, will it give us jobs ?
Personal setup : Nuendo 10 on ASUS PRIME Z270-A -I7 7700K - Win10 pro 64bits- SSD - 4 x LCD screens + 40" on Blackmagic intensity. Steinberg UR824 + MR816 - 2 X Avid Artist Mix + Artist control + Euphonix transport. LCR Focal Twin.

Nuage 32 faders on Mac Pro 12 cores. 5.1 Focal twin. Ssl Xlogic Alpha link Madi at workplace.

Oliver.Lucas
Senior Member
Posts: 1400
Joined: Wed Dec 15, 2010 11:26 pm
Contact:

Re: DAW based VR audio content production?

Post by Oliver.Lucas » Thu Oct 06, 2016 11:17 am

Bifop wrote:...
Now, will it give us jobs ?
The "problem" for us is, that VR unlike movies is a machine mixed format where the computer will do it's post production on the fly as it happens.
Main machine: Hexacore 3.3 Cheese grater with USB3 and RME Raydat, 48GB RAM, Radeon HD 7970, Caldigit FASTA USB C, Intensity Pro, macOS 10.14
Avid ProTools S3

User avatar
ChrisPolus
Member
Posts: 576
Joined: Sat Jun 13, 2015 9:32 am
Location: Schweiz
Contact:

Re: DAW based VR audio content production?

Post by ChrisPolus » Fri Oct 07, 2016 11:42 pm

Oliver.Lucas wrote:The "problem" for us is, that VR unlike movies is a machine mixed format where the computer will do it's post production on the fly as it happens.
Nailed it.
Handmade Win10 x64 Machine, Intel 6 Core CPU, ASUS Prime Board, 16GB RAM, 1080 GTX
MacBook Pro 15" Late 2016 with Touchbar, latest macOS, 16GB RAM
Latest Nuendo version, Logic Pro X, Reaper, UAD Apollo Duo + Twin MK2 via Thunderbolt

Tronic
New Member
Posts: 19
Joined: Sun Aug 21, 2016 11:32 am
Contact:

Re: DAW based VR audio content production?

Post by Tronic » Thu Nov 10, 2016 6:11 pm

Fredo wrote:I do think that VR and 360 movies will become -at least- a hype.
I however don't think there is business for us in it.
Do you mean for your studio's business? because if this is Steinberg's view I think I will have to move on. If you mean your own business, ignoring this might be foolish.
VR Will Be A $38 Billion Industry By 2026
Wild figures, pulled out of thin air, but, the commitment to this technology is real, all the big hitters are pouring money into it, and that's what decides whether this should be viewed seriously or not, calling it hype is shortsighted.
How Microsoft wants to dominate virtual reality
Intel Acquires Voke VR Startup As It Moves Into Immersive Sports
Imax Completes Round Of Virtual Reality Funding
Facebook’s CTO on why he's betting big on AI, VR
Why The Next Decade For Gaming Will Be Anything But Casual
etc. etc.

Tronic
New Member
Posts: 19
Joined: Sun Aug 21, 2016 11:32 am
Contact:

Re: DAW based VR audio content production?

Post by Tronic » Thu Nov 10, 2016 6:19 pm

Oliver.Lucas wrote:
Bifop wrote:...
Now, will it give us jobs ?
The "problem" for us is, that VR unlike movies is a machine mixed format where the computer will do it's post production on the fly as it happens.
virtual/augmented reality products will be designed, produced, and project managed by humans. VR audio assets will have to be produced by humans. Immersive audio environments will have to be created by humans. Convincing audio spatialisation requires mixing and auditioning by humans. More roles, potentially, means more jobs.

User avatar
jorisdeman
Member
Posts: 321
Joined: Sun Dec 19, 2010 8:20 pm
Contact:

Re: DAW based VR audio content production?

Post by jorisdeman » Fri Nov 18, 2016 4:07 pm

I've been working in the games industry for over 20 years, and VR is an interesting proposition; but it is true that it is still early days; I think we're at the stage of 'format wars' where after a while, the dominant player will emerge with a couple of other platforms surrounding it; that's how its often been with consoles as well.
But the technology, though it is improving leaps and bounds is still in its infancy.
I've had the chance to try out the Oculus, Morhpheus and Vive and the potential is fantastic; I just wasn't sure whether the hardware was quite up to it yet (still all fairly low-res).
The other issue is that it requires a shift in game design, that (from people I've worked with) will take some time to master; how to best deal with the new interactivity, nausea, movement.
Everybody's trying to come up with the game or app that will be a platform seller, and I'm not sure it's there yet, but we'll see....

What I'm interested in to know is what people feel they need in their tool set.
Some of the game audio will be spatialized in real-time, and so creation-wise would be done (imho) in the usual way.
Other stuff will be 'pre-baked' with hrtf processing or, as Tronic suggests, Ambisonics.
But what are the other features that people need?
Nuendo 10, Mac Os Mojave / Windows 10 | iMac Pro 8 core | X-keys |PT Control | VSLE Pro | UAD Apollo Quad via Thunderbolt | Dual Xeon & i7 Hexacore Slave PC's | G-tech G-Raid drives

www.jorisdeman.com

Yellowcab
New Member
Posts: 18
Joined: Sun Dec 19, 2010 9:11 pm
Contact:

Re: DAW based VR audio content production?

Post by Yellowcab » Fri Dec 16, 2016 9:49 am

We have quite recently started working on high profile VR projects at Yellow Cab. One of the big ones was an Assassins Creed VR trailer for Ubisoft.
Quite frustrating for the moment as it's a mess player-wise with a few different formats available, and Nuendo not being up to par bus-wise to handle higher order Ambisonic which is (for now) the best way of getting a decent result down the line when converting to binaural.
We are actively investigating solutions, but for AC we turned to mixing in Pyramix, which is a whole world of pain in itself.
Steven Ghouti
YELLOW CAB Studios
--------------------------
11 x N7 PC - 3 Euphonix S5 - 1 Euphonix S5MC

User avatar
fuzzydude
Member
Posts: 313
Joined: Sat Jan 22, 2011 5:21 pm
Contact:

Re: DAW based VR audio content production?

Post by fuzzydude » Thu Dec 22, 2016 11:07 am

@Yellowcab - just wondering why Pyramix instead of Reaper?
Comps+OS: Macbook Pro's 10.13.4 I PC's - i7's - M2's - SSD's I Win10 Pro x64 (V-1809)I Nuendo 10 | Cubase Pro 10 I Wavelab 9.5 Pro | Absolute Collection | VSTConnect (latest versions)

Post Reply

Return to “General”

Who is online

Users browsing this forum: No registered users and 3 guests