Record & Edit Ambisonic Spatial Audio for 360 & VR180 in Premiere for Oculus Go, Facebook, YouTube

[@TheMhankel]

Man, this tutorial was a trip! And by that I mean "Great work, man!". Keep it up and thank you!

[@CPittful]

Thanks for the great tutorial Hugh! Before watching this I was trying to cheat the spatialization process by adding my mono track from the lav mic directly as a head-lock track. The result was a disaster because the voice from head-lock mono and ambix tracks will compete with each other and sounds like a reverb effect. From all the internet you're the only one teaching us how to sync mono voice tracks with spatial recording. Thanks again and keep up the good works, my man!

[@hughhou]

Glad it help. I actually have an update tutorial want to make about this whole workflow about headlock audio mixing - got a lot more experience now but just don't have the time to make it lol.

[@chumpboy]

@@hughhou Hi Hugh, did you make this updated tutorial? I'm having trouble finding it. I'm looking for a simpler way to add a lav voice over or background music to a video with ambisonic audio without having to use a DAW and all these complicated steps.

[@degreecinema3603]

This tutorial help me to finish my college thesis. Thank you so much!

[@hughhou]

Glad I could help! And thank you of writing and picking VR as your focus!

[@zombiehandflix]

Thanks for that Hugh. You are my hero. If you ever get to Montreal, hit me up, I'll buy you dinner.

[@hughhou]

Yes. I really want to go to Montreal! That is my plan next year to get a VR filmmaking gathering or workshop going :)

[@zombiehandflix]

@@hughhou Cool. Stay in touch. I can help set that up.

[@TheArunster]

You are beautiful! Thanks for your content.

[@sophiaflot-warner3325]

Great stuff Hugh! That intro was too funny!

[@hughhou]

Thanks!!!!!!!!

[@moko11222]

love this dude

[@hughhou]

haha thank you!!

[@pedrogonzalezgil]

Great work, lots of information, thanks!

[@hughhou]

Glad it was helpful!

[@watsnick]

Awesome tutorial bro!

[@hughhou]

Awww thanks!

[@hayleybooboo]

You rock Hugh! Thanks for such an informative release!!!

[@gisellchittadini3020]

hi hugh, thanks so much for the video. I ask you a question, would you have another installer for the 360 ​​spatial workstation? Since the one in the drive doesn't work for me, do you know why? thank you!

[@buffaloin3603]

Intense. Thank you for the excellent walk through

[@hughhou]

My pleasure!

[@cielaczek81]

Hugh. What kind of ambisonics format Insta360 ONE X2 uses?

[@stage_one]

Thanks for all your videos. I looked a lot, but did not find how to transfer from insta360 one x2 to KZbin without unnecessary settings to get spatial sound. Can this be done with insta360 studio + adobe preimere only?

[@hughhou]

One X2 has a 4 channel mono source - you will need to spatialize for now yourself with Facebook Spatial Sound station.

[@papaipequeno]

Hey Hugh, FB spatial audio is not working well... Are you going to make a 2021 360 áudio vídeo?

[@hughhou]

Yes. But this tutorial work great for FB spatial audio - what is not working? Nothing is really change. The new tutorial is more about recording technique using higher order ambix Mic.

[@gabrielegelfofx]

fantastic tutoria! I'd like to see this workflow in DaVinci 15 Fairlight.

[@hughhou]

Fairlight is an entire different story lol. It will take me a while to learn just that. DaVinci tutorial is coming up tho with Fusion.

[@360fs]

Does 360 video even playback in Fairlight?

[@junipershuey9249]

@@360fs yes it does if you load the ambix file as an adaptive track. You can use the rode spatial vst to rotate and reorient the sound field with the video and then you can export the track separately and then add the meta data injector and it plays as 1st order ambisonic that rotates with the head tracking. I am hoping to find a mixdown option so that you could export a "3dmaster" track that has a mixdown but haven't figured that out yet

[@RoccoPornoFunk]

THANK YOU so much. You are the Man!

[@hughhou]

Glad it helped!

[@sunshinebsphd7206]

Great share! Thanks for the awesome work Hugh! Could I use Adobe Audition instead of Reaper?

[@hughhou]

Yes to some extent. But Audition is not a full-on DAW.

[@MixbusStudioQc]

You're the best !! Thank you so much :)❤️

[@hughhou]

You're welcome 😊

[@DaveMakes]

Your videos have been so useful for me, thanks for making them!

[@hughhou]

Awwww... I am glad it helps!

[@salgadoprojects4321]

Hi, is there an easier way to record and add spatial audio today? I noticed this tutorial is 1.5 years old and wondered if there's a newer way now. Thanks.

[@hughhou]

This is still the best tutorial to follow along - there is no newer way to do that. If so, I will make a tutorial - trying to keep my stuffs fresh as well. But not more movement in the audio world.

[@salgadoprojects4321]

@@hughhou Thanks ! Keep up the good work.

[@357elizabeth]

Hi Hugh!! thank´s for the tutorials... I have a question about the fan noise of the insta 360 pro 2 and the audio recording with the ZOOM H3-VR... so when you use this two, you turn off the fan of the Insta 360 pro 2 or you clean the audios of your ZOOM later with plugins?

[@hughhou]

I always turn the fan off of the Pro 2 - make sure you set that in setting as well. Then the H3VR just sit on top with clap sync

[@jonnythegreek1]

Good stuff. I work exclusively in FCPX, but I was able to follow along in Premiere well enough.

[@hughhou]

Great to hear! I need to work on more FCPX tutorial.

[@blackswann]

Has anyone else ran into an issue where the Spatiliaser effect cause Reaper to crash? I get a C++ Runtime Error as soon as I open the example project and the Spatiliaser effect does not appear in a normal session.

[@Bmo22]

Same issue here

[@grantwilchman]

hey hugh! I love your channel but I'm having a lot of difficulty because of the go pro max. I may be wrong, but I can't find how to export the ambisonic audio from the go pro max video. how do you get it out if it doesnt render out when you export it from the go pro player? I would love a video on it but I know that would take alot of your time but I am just really lost with all of the extra information and having a hard time relating it over to my situation because it doesn't seem to be the same as the videos. Do you have any suggestions:'(

[@hughhou]

There is a FFMPEG command somewhere from GoPro to extract that but I don't remember on top of my head. Use ZOOM H3VR for AmbiX audio tho - it sounds a lot better.

[@grantwilchman]

@@hughhou Ok sweet man!❤️ Thanks for all your help I’ve learned alot from you and besides this little bump youve taught me everything I know about 360 and how to export and all of that so thank you and thanks for getting back so quickly😃👌🏻❤️

[@sylvain.syro.robert]

I have been in virtual reality experience production for a few years. Integrating Ambisonic sound has always been a big challenge, especially for APK apps. This tutorial has helped me a lot so far. I am finishing two new experiments and realize this morning that facebook has withdrawn its Audio360 Encoder and more software. What should I do to finalize my 3D360 videos?

[@hughhou]

They withdraw encoder? Why you say that?

[@VirtualNYCTours]

How to increase spatial audio effect? I record using Zoom H3-VR but when I turn, it's barely noticeable.

[@hughhou]

Use Lav :) you can also use compressor. More tutorials are coming

[@lucasvinzon8943]

Hey Hugh! Nice Tutorial! Just a question, why turn off Decode Binaural on Control Track?

[@hughhou]

Before you render, render that. If not, your track will become stereo. As Binaural is not a playable format for all the service like KZbin or Facebook - only ambisonic.

[@lucasvinzon8943]

@@hughhou Sorry man, didn't understand, should I turn on Decode Binaural before rendering?

[@ttoommmmiiee]

@@lucasvinzon8943 As I understand it: you switch Decode Binaural ON for previewing your 360 mix while you edit. That way you can hear how it will sound. When it comes to exporting you switch Decode Binaural OFF so that you export 16 channels rather than just 2. The video is a bit misleading and as you can see when Hugh renders his audio there's only two channels being rendered which is wrong... Otherwise a great tutorial. Thanks!

[@nevlynnjohnson3372]

What mount can i use to put the camera and mic together the way you have?

[@hughhou]

You can use any male to male 1/4 on top of the camera.

[@felipeluna.]

Very insightful video Hugh... even though it has been 2 since you uploaded it I wanted to ask you, instead of using adobe premier, can Davinci Resolve be used instead? I appreciate your feeedback

[@hughhou]

So it does not matter what NLE you use. Reaper and FB360 is the most important part of the puzzle. So just render out mov and wav file and reassemble everything within Reaper.

[@felipeluna.]

Perfect brother... I will get to try that out, I appreciate your help, blessings 🤙

[@Immersiveambition]

NEED HELP! Hi Hugh, I have a problem with the Facebook spatial audio workstation plugin, once installed, the VST Audio 360 spatialize does not exist, I do not offer any solution! I tried with the previous version of the plugin, and I managed to have the VST audio 360 spatialize but only with 7-8 channel !!! Which version of the plugin are you using? Were you on MAC when you did this tutorial !? I don't understand why the VST is not on the list, it's crazy! I really need your help! Thanks to you!

[@hughhou]

First after you install the FB workstation - have you refresh your DAW plugin list and make sure it find it? Then it does not sound right you only have 7-8 channels - I will suggest start with Facebook template and then put tracks and modified into your own. You need to give me more details in order to help you :)

[@Immersiveambition]

Thanks Hugh, So now I'm working on 1-10 Channels, and I'm exporting the project to 9 Channels in 2nd order ambiX. The result is not too bad but the spatialization of the sound is not too "high end", but I did not find any solution on the internet for my plugin problem, where the "SPATIALIZER" part of the work station is missing FB is very restrictive. I have a second question to which you can answer: I would like to know with what parameters I have to encode my video + my audio on FB360 encoder, to: -A Video used with 8K visbit in theater mode -A video directly uploaded to an oculus go or a G2 4K pico (playback with Skybox VR for example). "Facebook 360 video" format or maybe "FB360 Matroska"? Meric infinitely!@@hughhou

[@Immersiveambition]

Hi Hugh, I have now watched your tutorial more than 15 times, But I would like to have your method to correctly export your audio for VISBIT 8K ... They only accept 1st order ambiX, but to add a "Headlock" sound it's impossible. I tested all the methods. Even while informing me on the Internet, I do not find the solution, my "headlock" sound always causes problems for Visbit, it only reads it in one earphone! Yet on KZbin, it works perfectly with the same video! I need your help, thank you for everything you do! Jordan Director Drone-ambition (FRANCE)

[@hughhou]

Have Visbit help you to solve this issue? As this is targeted for Oculus TV not Visbit.

[@wakinglife3603]

Hi Hugh thanks for the help! I want to do the same as you describe here with the Insta360 ONE X and the Zoom H2N. Two questions, is the workflow exactly the same? I thought nowadays all of this could be done with the latest version of Premiere Pro and some plugins. Thanks in advance.

[@hughhou]

It is exactly the same. And no. Latest PR is not suggested even it is possible. I am making that tutorial - but in the end - a DAW is need and it is better!

[@syntheticsolace]

i downloaded the audio360 suite from your drive but on install it has an error trying to install ffmpeg, when i opened reaper i have 4 out of 5 360 plugins. i'm missing the spatializer, know how to fix this?

[@hughhou]

Have you watched my latest update and read the pinned comment on that video? kzbin.info/www/bejne/aYHcmKWubaeGgdU

[@syntheticsolace]

@@hughhou I will go watch that, thank you!

[@demofilm]

Dear Hugh can you tell me wich player, or wich method is best to hear the ambisonix in a vr glasses like the occulus, or HP reverb g2 if I play my video in youtube I can really hear my sound change when I look around, but I don't know wich player or how to watch youtube with ambix on my vr glasses. your tutorials are the best.

[@junipershuey9249]

I know that davinci does not work with VST 3 but could this mix down to tracks workflow work in davinci? I feel like it would with the adaptive tracks but it would require a different spatializer plug in other then facebooks 360. Just curious since it would be nice to be able to get a ambisonic 3rd or 1st order from a track that is a mixdown of the other tracks in fairlight just to keep the whole workflow in davinci and then just inject the metadata. (i am not sure why but i can't get the facebook spatializer to show up in any of the DAW's even though it is clearly sitting in the folder. This is on a Mac at work and a PC at home. Same problem. The other four 360 facebook VST3 show up but not the spatializer. so looking for other solutions). Thanks for all you do. Especially in the davinci workflow.

[@hughhou]

I agree but I can’t get AmbiX work with fairlight. But if you have a workflow I would love to know.

[@gxi3602]

Hi Hugh, thanks again for another outstanding tutorial. When recording with h2n and pro 2 am I correct in saying your recording directly to the h2n mic and sd card. over connecting the mic to the pro 2 and recording with line in or usb connected to camera? I'm having an issue with getting 4 channel audio files. Do you have a tutorial about using the zoom h2n specifically with pro 2 and the best settings? thanks

[@liveperformance3608]

Is there a way to add ambisonic audio to a 180 video without spatial workstation?

[@adriaanlokman4154]

Hi Hugh, thanks a lot for your tutorials, I learnt a lot already! I manage to create a great sounding very spatialized mix for my animated VR experience. But how can I check it on my Oculus Rift S before uploading to KZbin or FB? So far I haven't been able to watch it at all on Rift. Do you know a player that can play offline Ambisonic on a Rift S without first having to upload? Thanx!

[@hughhou]

Did you render as FB360 video for sideload? If you use FBencoder as last step - you can hear it. Or you can just upload on KZbin and watch it on KZbin VR to hear it!

[@adriaanlokman4154]

Hi again, I found VHT (Virtual Home Theatre, on Steam) is the perfect solution for playing VR with Ambisonic sound directly without uploading on RIFT S. The demo is free and plays til 6 min. The interface is quite old school but effective as well. Really worth checking, but you might already know it? Add it plays almost everything else too. I hope it runs on Quest as well. Looking very much forward to your next tutorials!

[@stargazer_video]

Please Update! Facebook 360 hasn't been updated since 2020 and does not work on M1Macs. what can we use instead?

[@hughhou]

Does not? Let me check. But you can run in different mode on M1

[@stargazer_video]

@@hughhou Any luck? The official Facebook group doesn't have any solution.

[@papaipequeno]

Same problem here. Please Hugh Hou, is there any other software we can use instead of FB Spatial Audio?

[@papaipequeno]

On MAC 2022

[@alessandroadduci2642]

another question.. :) it's possible use this microphone connected with insta evo? tanx tanx many tanx

[@alessandroadduci2642]

or the only way is with ciack in start record tanx..

[@hughhou]

Nope :(

[@roobarooindia3383]

Hugh, what difference can Zoom H3-VR make if we use that instead of H2N?

[@hughhou]

Huge different - kzbin.info/www/bejne/maqWl6R_eZaXrqM - H2N is not true ambisonic - it missing height info

[@gamerul]

Thank you so much Hugh! your tutorials are so in-depth and great! So this is the only way? No Adobe Audition instead of Reaper?

[@hughhou]

I believe Adobe will roll out its own solution in Audition soon. Until then, REAPER is free and very powerful and in the music industry - REAPER is a well respected DAW.

[@Adela.Buendia]

Hi! Thanks fot the video, I´m having a problem with reaper, when I try to insert the 360 video to spatialize the mono tracks the software crashes. Does somebody knows how to solve this?

[@hughhou]

What OS you are on? And are you on the latest software? I also can be the FB workstation plugin - donwload the lastest and uninstall and re-install it might help.

[@Adela.Buendia]

@@hughhou I have Windows10 and I downloaded the lastets softwares published on the pages, I downloaded the FBworkstation and installed a couple of times bc the reaper didn´t read it. I´ll try that!

[@Adela.Buendia]

@@hughhou Also, the python 2.7 is needed to the final part, right?

[@robertstrind]

I have the same problem. As soon as I hit "Load" I see the plugin windows shows up for one second and then Reaper goes down. When I start Reaper again there is a window letting med send a crash report to Facebook. The video I select is a quicktime render with no sound.

[@robertstrind]

I have now gone through all the 6.x versions - same result. I even tried versions 5.99 and 5.95 which is the version Hugh Hou uses in the video -> same result; Reaper crashes. The same project was loaded every time I installed a new version from the reaper project file that was initially created with the 6.12 version of Reaper.

[@therealtaxman6471]

Hi bro, great tutorial ! I just did a 360 video with ambisonics 2nd order using Reaper. The version for Yotube works perfect! but when I export the version for Facebook 180 or 360 , the sound is not being spatialized, I don´t really what the problem is .I tried (in the Encoder) with the Fb360 setting, also with the Fb180, but stills the same problem. Maybe you can give me a hand!

[@hughhou]

The Facebook Spatial audio is very different from KZbin - KZbin you don't even need this workflow - Premiere can render 4 channels Ambix - but Facebook go up to 16 channels!

[@papaipequeno]

2022, is there any update on 360 ambisonic audio edit? The FB Spatial Studio is not working anymore.

[@hughhou]

It should still work

[@virtual.insanity]

Thank you Hugh!

[@vriosxr]

THANKS AGAIN BOY HUGH HOU

[@hughhou]

You are very welcome 🙏🏼

[@tommunday5856]

Hi, I have followed you instructions but when i go to spacialise in FB360 workstation it loads then crashes immediately. Any Ideas?

[@VRNomad]

Hey Hugh! Have you had any trouble with getting videos to load with the FB 360 workstation? It used to work fine for me until version 3.3. After that, any time I try to load a video Reaper instantly crashes. This is with 2 different, powerful PC's. It works fine on my macbook pro. I've followed the instructions for encoding video as DNxHR LB, etc, but still seem to have this issue, even with low res (regular HD) resolutions. It seems to be an ongoing issue for many people (judging by the FB group) so I was wondering if you had experienced it yourself and if you might have a workaround! Thanks Hugh!

[@hughhou]

I don't. I am avoiding FB 360 workstation for now and did not update for a long while. The older version still work. For now my 1st order workflow is fully Premiere with VST that can handle spatial mixing - I align the capture audio carefully during capture stage to minimize post - only SFX need to place spacially. I will work with FB to see what is going on when I have a moment to sit down and do some research.

[@hughhou]

I am also reading on the Group just FYI - so if there is a solution, prob will be on there. But I will report back if I find something.

[@VRNomad]

@@hughhou Hey Hugh! Thanks for the response! Yeah - for now I have gone back to version 3.2, and aside from a few bugs it's been working. It's the only way I know how to do it! But, hopefully they come out with a fix soon.

[@mantisvfx6425]

i have a error in FB360 encoder "didn't find ffmpeg "

[@hughhou]

Yes you are missing ffmpeg library. You can simply follow the on screen instruction to install ffmpeg.

[@mantisvfx6425]

@@hughhou bro I installed it. But Fb360 didn't find .. please make a video for it...it may help new users

[@Willy_Le_Maitre]

it seems the FB link to ffmpeg is uncompiled. This guy has kindly put it in a form that installs: github.com/tormyvancool/audio360_ffmpeg_binaries?fbclid=IwAR36Yf-xlxkiHBtNaQnwmQ4Scfw877BnVoUdSZLyvA07H73YK2gQ-Rk3LJk

[@kaczorefx]

Hi, do you know what the "Monitor Ambisonics" option in the right click program monitor menu does in Premiere 2019? Should it rotate the sound sphere automatically with the preview monitor finally? The Premiere manual about VR hasn't changed since 2017 so there is no mention of that option :(

[@hughhou]

This video explains it in great detail: kzbin.info/www/bejne/maqWl6R_eZaXrqM - it is actually the most important part of 2019 to make my workflow work!!!

[@adrianparr]

Hey Hugh, is that Aurovis camera on your worktop at the beginning new? I haven't come across that one before. Have you done a review of it yet? How does it compare to the Insta360 Pro 2?

[@hughhou]

Yes. I am working on the review as we speak!

[@gunzshy]

great vid

[@RickDrew]

The H2N no longer has a "spatial" option.....

[@hughhou]

Time to upgrade to H3VR or better F6!

[@RickDrew]

@@hughhou Oops - I found it. It's moved. I was going through all the options and found it my accident. My recorder has V3 of the firmware - the option is moved. It's under rec then rec format then scroll down to the bottom option.

[@michaelauknz]

Okay - For the stupid Question of 2018 - Please can you confirm and detail what specifically is the actual front of the H3-YR and the Insta360 ONE x ? An example - Is it the BRANDED side with the Brand name Zoom H3 - VR or the side with the LCD screen

[@hughhou]

Lol, the Front of the H3-VR is the BACK, the LED - think about this way, should facing YOU - so LED should be the back (south).

[@davidfield8122]

michaelauknz From Zoom: “The side without the LCD screen is the front”

[@SandroTrunz]

Phew! The holy-moly MOTHER of all TUTORIALS - huge, but brilliant - Thx heaps! TROUBLE: I have installed Facebooks "Spatial WorkStation V3.3.1" (x64) The VST3 plugins "FB-360-Control-ambiX /...-Converter-.../...-Mix-Loudness-... & ...Spatialiser-ambiX.vst3" ARE installed in the folder C:\Program Files\Common Files\VST3 (to be on the safe side, I also copied them into C:\Program Files\Steinberg\VSTPlugins ... where my "Oculus Spatializer" is ... which is working). But "TWO BIG EARS" ... they are NOT SHOWING in my REAPER :-( Help? Many thanks, Sandro

[@hughhou]

Did you try to scan new installed VST inside Reaper to make sure Reaper scan and update the plugin list?

[@SandroTrunz]

@@hughhou Hi there, thx for your reply. Yeah - I definitely tried that. Also made sure that they are in the correct folder. Latest Reaper Version / latest Workstation version. Everything else up-2-date too. No "BIG EARS" showing up. I'll also contact the Workstation Developer team @ Facebook :-(

[@GoapprStudios]

So which of Zoom Mic recorders H2n or H3-VR is your choice and why ? Love your content on the University of KZbin I'm learning so much Thank You.

[@hughhou]

I just received the H3-VR and the review is coming next. If you have not invest in any spatial recorder yet - go for the H3-VR - which is a true 1st order ambiX mic - H2N is faked which does not record height information in audio (so you can hear the voice coming from below you or above you if that makes sense).

[@GoapprStudios]

@@hughhou Perfect we had the H3-VR in our budget along with the Insta360 Pro 2. I just wanted to make sure we were getting the right product for the VR. Thank You

[@hughhou]

Yes you are!!

[@bnjobeats]

Does this plugin work with Adobe Audition?

[@hughhou]

Yes. Audtion workflow is coming next

[@bnjobeats]

@@hughhou Oh, so it does not currently work with Audition?

[@AcousticalEducation]

Great

[@chrisw5742]

I bought Reaper. :-)

[@hughhou]

Thank you for supporting the software development community!!

[@chrisw5742]

@@hughhou Hey I was wondering.. I have a Zoom H2n and a normal 360 camera. I have Reaper. My movie editing software sucks though. I have Movavi 360 and it won't do spatial audio. Just looking to do simple 360 with spatial and maybe have music tracks in there also. Trying to follow your tutorials but I get lost.

[@chrisw5742]

I downloaded ffmpeg and Facebook Spatial Workstation.

[@chrisw5742]

And I have metadata injector? hmmmm

[@chrisw5742]

OK I got spatial workstation loaded. template loaded with vst plugins loaded.

[@krolczyk]

awesome

[@fizzylazer]

His eyes...There's just something unnerving about his shiny glassy eyes... They're like... staring through me.

[@aviationodyssey1892]

Your info is misleading. The Reaper it's actually not a freeware! It's embarrassing how people use great DAW without paying little money...

[@hughhou]

Yes. That was a joke. I actually in description state PLEASE PAY FOR REAPER if you use it more than 30 days. Also if you watch the whole thing. I actually support REAPER and pay for the software as well - this will drive them more traffic as supporting REAPER

[@schnauzerTB]

You HAVE tot tell me what shade of lipstick you're wearing girl, it's driving me CRAY CRAY!! xD ... no but seriously, stop that!

[@armandosilva6150]

Good information , but .... why you use makeup looks like girl ?

[@hughhou]

Haha, that is a beautiful filter suppose to be funny.

[@lukasztraczyk3477]

Whats your problm man. Grow up.