Apple Vision Pro for Filmmakers or YouTubers: Onset Filming and Video Editing Insights

Step into the future of filmmaking with the Apple Vision Pro on a real film set with actual clients! From getting live camera feeds into Vision Pro to creative virtual studio setups, this video is packed with insights to help you unleash your creativity and boost your content production. Learn how to streamline your workflow, set up Dual screen editing in Davinci Resolve with Splitscreen, and create your virtual film crew as a solo creator with the Vision Pro.
In my quest to truly integrate Vision Pro into my professional workflow as a Director of Photography / Camera Operator, I've compiled this tutorial sharing my experiences on set. I genuinely believe this can be a game-changer for future filmmakers and content creators who are ready to embrace new technology and innovate in their craft.
Subscribe now to stay updated on the latest tips and tricks for using the Apple Vision Pro in your immersive filmmaking endeavors!
⏰ Timestamp
0:00 - On a film set with Apple Vision Pro
1:30 - A glimpse into the future of filmmaking
2:53 - RED V-RAPTOR Control on Apple Vision Pro
3:07 - How to Stream Camera Feeds into Apple Vision Pro
3:20 - Hollyland Mars M1 Enhanced as Augmented Reality overlay
4:20 - Control Lighting, Sound, and Script Supervising with Apple Vision Pro
4:30 - COLBOR CL 330 remote control in Vision Pro
4:57 - Time is Money on Film Set
5:38 - Other alternatives to get 4K signals into Vision Pro
6:25 - Apple Vision Pro for Solo Content Creators / KZbinrs
7:15 - My Virtual KZbin Studio Setup with Apple Vision Pro
9:15 - Dual-Screen Editing in DaVinci Resolve with Split Screen for Vision Pro
10:48 - My Pro VR180 Camera Setup
⚙️ Gears I used on this setup:
➜ Hollyland Mars M1 Enhanced: amzn.to/4cfJR31
➜ Hollyland Mars 4K: amzn.to/3v4KFGT
➜ Zhiyun FIVERAY M20C: bit.ly/47bsQUo
➜ Canon EOS R5 C VR Creator Kit: bhpho.to/3wqxVLa
➜ Canon RF 5.2mm f/2.8 L Dual Fisheye 3D VR Lens: bhpho.to/3Hs1qwj
➜ My tripod that supports everything: • BEST Pro Tripod under ...
➜ COLBOR CL330 Pro video light with iOs control: amzn.to/4bZPEJL
🐕 FOLLOW ME & Kimchi:
➜ Instagram: / hugh.hou
➜ Facebook: / 360creator
➜ Meta Quest TV: ocul.us/30uMZUj
➜ TikTok: / hughhou
🤝 We are open for HIRE! Reach out: hi[at]hughhou.com
#visionpro #filmmaking

[@jaykeni]

Hugh, you are singularly innovating immersive content creation and its workflows! So impressed! Keep going!

[@hughhou]

Thanks, will do!

[@trippy_blob]

All the swags in this video is inspiring me to become one wiith Daft Punk... In very near future, Hugh... in very near future Thanks again.

[@hughhou]

Nice!!!

[@miketkong2]

Love your enthusiasm and ingenuity!

[@hughhou]

Awww thank you!

[@davidgrieser]

This is an amazing breakdown of how you are using this. Great setup and thanks for sharing!

[@hughhou]

Glad you think so!

[@edgejourney]

Hey Hugh. You really have a LOT of great information when it comes to capturing, editing, and producing 360/180˚ 3D/Spatial video for AVP and other headsets. Thanks so much for sharing! I was wondering if you might also create a video that totally focuses on capturing and producing 360/180˚ Spatial photography for the AVP - perhaps using the Canon R5 C + dual fisheye. There really isn't much available regarding this topic yet. Thanks, and looking forward to your next post! 🙏🏼

[@hughhou]

This is a great idea. I actually use lots of 3D photography in my personally production and animate those 3D photo in 3D 180 video on like our new film "Dolce Mia". I should share more on that process :)

[@edgejourney]

@@hughhou Awesome! I have been capturing 360˚ photos since the 90's - both professionally and for personal use. Many show up in Google Maps and I have over 50 million views. I just recently picked up the Canon R5 C + dual fisheye and I hope to capture both 180 and 360 photo and video content. I have already learned a lot watching your channel.

[@hisbox]

I tried monitoring in Quest 3 before Vision Pro came out. However, in Quest 3, where multi-tasking was not possible, it was nothing more than a big monitor. Your new attempt is informative and wonderful video inspires me.

[@hughhou]

Thank you!! I can actually pull up 2 different brands monitor from 2 different camera I just tried :)

[@iMadScience]

Yeah using the VP as a monitor is awesome, will try to shoot with it someday.

[@nathanonearth]

Great great ideas man! Very useful on set

[@hughhou]

Glad you think so!

[@ansonkiek6471]

Very innovative use for Vision Pro

[@edwinungerer7989]

Great video. Please update if there's an app

[@hughhou]

Will do!

[@RayGill82]

I love this channel

[@hughhou]

Thank you!!!

[@bobbyDig]

Excellent job.

[@hughhou]

Thank you very much!

[@GeraldDonovan]

Another superb video - great to be able to ride along with you on this journey Hugh! A question for you - in your review of the Hollyland Mars 4K a little over a year ago, you mentioned that if shooting in 8K RAW LT on the R5C, it was not possible for the Mars 4K to take the 4K HDMI out from the camera, as it was 4069 pixels wide. Has this been fixed? I'm very interested in using the Mars 4K direct to the iPad app running in the the AVP, but it would be a shame if I can only do this at 1080p.

[@GeraldDonovan]

Sorry - one other thing I am a little confused about. You state in the video that the M1 Enhanced can be used as a 4K wireless transmitter, but on their website, Hollyland explicitly say this is not possible - "The Mars M1 Enhanced can receive a 4K/30fps signal input, and will downscale the video resolution to a 1080P signal for output to the monitor screen when used as a wireless transmitter. The Mars M1 Enhanced does not transmit a 4K/30fps signal wirelessly." Could you clarify please?

[@hughhou]

Sorry I am not be too clear in this video as it is short. Mars M1 take 4K signal from camera upto 4096 4K. But it is pass tho not transmit. I loop it onto my SmallHD 4K display on set. Transmit you will need they to do some firmware update and I think they are still working on it. Transmiting 4K you need Mars 4K. But the bug is still there. I think they might release an upgraded version to fix that instead of firmware as Mars 4K is also old.

[@GeraldDonovan]

@@hughhou Many thanks for the clarification. So currently no way (at a reasonable price) to get DCI 4K from the HDMI output of the R5C into the Vision Pro when shooting RAW?

[@theonekc]

Great stuff Hugh!

[@hughhou]

Glad you enjoyed it

[@lixinzhao6987]

Keep Up good Work！

[@HolzmannMedia]

Great 👍🏼

[@hughhou]

Thank you 👍

[@SomewhereNow]

Hey Hugh, which microphone is that for your set up on location?

[@hughhou]

I will have more indepth in my audio focus tutorial as you saw in this video, my Mic is not standard hehe

[@spediegunz]

How would you compare the vr180 videos on avp to quest 3 are you taking advantage of the dolby vision color space and higher frame rate capabilities in post programs like da Vinci resolve

[@hughhou]

Right now they are very similar as Apple has not unlock the ability to let other creators to upload VR180 content on AVP. Using Moon Player here: kzbin.info/www/bejne/nKe4pZSIidaKgtk - it does work. But It is not native support so it is really hard to compare with Quest 3. HDR support is slow rolling out on AVP but how to grade for AVP is still very unclear on DR. I will need to dive deeper on this topic.

[@spediegunz]

@@hughhou I wonder if apples own vr180 content “immersive video” is even using dolby vision

[@TheCoralClimb]

Hey Hugh Have you ever tried to use the Canon dual lens on a Red Epic-W Helium 8k?

[@hughhou]

Epic-W is PL mount not RF mount right? The flan distance might not match

[@TheCoralClimb]

good point! @@hughhou thanks

[@CalvoSaezLuisManuel]

I think the point of editing in virtual world would be better if instead of moving screens we are able to move just the tools we need out of screen and place them where we want. But for that the OS has to go that way and who knows what are they updating or which ideas they have for future workflow.

[@salehbaker9221]

Can i use canon to sony lens adaptor . I have sony a7r5 but i don't want to buy Canon r5 just for the dual fisheye lens. Is there is a way to use Canon dual fisheye lens on sony emount camera?

[@hughhou]

Unfortunately no. A7R5 does not do 8K, also the sensor coverage will be different. Is there a RF to E adapter?

[@salehbaker9221]

@@hughhou I saw this adapter Metabones T Speed Booster Ultra 0.71x Adapter for Canon Full-Frame EF-Mount Lens to Sony E-Mount APS-C Camera I'm still search for e mount full frame support and will give it a try by renting the Canon dual fisheye lens , I hope it will work😅

[@lokadome5763]

I don't have an Apple Vision Pro or a Mac laptop. I have a MetaQuest 3, a Windows laptop, a CineView SE wireless transceiver, and the camera is an A7s3. Even with this configuration, is it possible to immediately preview the video shot with goggles in real time at the filming location in VR 3D? Do you have any plans to make this tutorial?

[@hughhou]

That will require a custom built template and a live stitch software with a video feeds. I will make one when Canon roll out their official support which is coming :)

[@lokadome5763]

@@hughhou thank you! As of now, MetaQuest 3 isn't easy... That's sad! I'm sad once again because I don't have money to buy Apple Vision Pro and Mac PC! ㅠ_ㅠ Thank you!

[@weiqi1976]

你的影片是否都能用VP觀看，並且有3D效果呢？

[@hughhou]

是的！100需要用vr看

[@rupertchappelle5303]

I could not imagine the vision pro being used for content creation. It's hard enough with cameras - tripods or stabilization - CALF on tripod, EGO stabilized in post. 10 percent rule is hard to beat.

[@hughhou]

But you can use Vision Pro to remote monitoring those camera - this is what this video about. Not replacing it but make other camera better on set.

[@iMadScience]

Have you watched the video bro

[@rupertchappelle5303]

@@iMadScience Have you heard of a video switcher? Mount one on your head. I do a one man gig and do all the post in post. Too much video is always the problem. Two screens is all you need - the edit and the output. Two screens are cheaper than one Vision Pro - BTW - you want to upgrade the memory and get the buyer protection plan too, RIGHT??? Now what is your client going to think when dealing with a GOGGLE FACE??? Please give us 3D TVs again. Don't sell us 200 million goggles that we will end up hating. Besides, neural implants are the new hotness and they will not strain your neck muscles. They will use OS Y to replace OS X. The Y stands for YOU!!! You will be the OS. Welcome to the future. You ARE the machine.

[@iMadScience]

@@rupertchappelle5303 I’m not sure how that’s relevant to the video at all

[@rupertchappelle5303]

@@iMadScience Sorry you feel that way. CHEERS!

[@pumpuppthevolume]

xD "more than 10 hours a day everyday" ......legend SadlyItsBradley and Andrew Edwards have some competition

[@NormanOrtiz]

I guess you can do exactly the same with the Quest 3 and have up to 3 windows of your mac or windows computer using Immersed app and any of those screens could be the view of the camera being transmitted to the computer. I just saved you $3000. Your welcome.

[@hughhou]

In theory yes. In practice no. I use Quest 3 for onset monitoring since it came out (before Quest Pro) when I am shooting for Meta. The problem is the AR screen is crystal clear but the passtho is not good enough for daily operation. Like carrying a 100K+ camera system with Quest 3 on is very dangerous as the reality is not as sharp or clear or distortion free as AVP - so I can't really see the real world. Passtho quality is very important in working high stress environment.

[@NormanOrtiz]

Yeah. But if you want to have the best past through in the industry, just take any headset off your face. :)@@hughhou

[@NormanOrtiz]

@@hughhou I agree the passthrough is not the best or as sharp but I can easily juggle balls or walk all over my house without tripping on anything. I would just don't run with it and with things in my hand but walking carefully is worth the $3000+ savings.

[@PequeLav.]

A long time ago this "creator" was very confused. and stupid" that what he uploaded were videos in virtual reality. I tried to make him understand but like all young people. they think they know everything. today you will realize that he only uploaded 360 3-d. and 180 3-d videos he he. hace mucho tiempo este " creador " estaba muy confundido. y necio" con que lo que el subía. eran videos en realidad virtual. trate de hacerlo entender pero como todo joven. creen saberlo todo. hoy se dará cuenta que solo subía videos 360 3-d. y 180 3-d je je.

[@futureproductions]

If you viewers have $4k to waste on an Apple vision pro that will be out of date in a few years with no wires, follow me into this video journey where I show off expensive tech nobody can buy and help you with bragging...

[@hughhou]

Well if you put it that way ...

[@futureproductions]

@@hughhou im joking.. but honestly it's very expensive most of us cannot afford this stuff... I'm still developing VR experiences on my Q1!

[@HenryMPHone]

⁠@@hughhouthank you for showing us some use cases for the Vision Pro. Not sure why people are so upset about not being able to buy it. It is not for everyone just like a lot of things out there.

[@US-Watcher-nc1xr]

Stupid Idea !

[@richiebillionz00]

How can we shoot a music @hughhou

[@hughhou]

Music video is what I am shooting right now. I will make an update tutorial next :)