Edit Spatial Videos for the Apple Vision Pro

This video shows the workflow I've found to edit your own Spatial Videos for the Apple Vision Pro. You can shoot Spatial Videos on an iPhone 15 Pro or on the Apple Vision Pro headset itself. But, Apple does not offer a way to edit those clips together into a larger projects. This workflow uses the iPhone app Spatialify to convert spatial videos into a format that can be edited. In this video, I use Premiere to edit the videos, but most video editing applications will work.
00:00 - Intro
01:33 - Skip to instructions for the editing workflow
06:55 - Problems and challenges

[@glasshousemtns]

500 subscribers! Congratulations 🙌🏽

[@martinmulcahy1]

Thank you for this very thorough and clear video. I’m a long time filmmaker, but just started dabbling in spatial videos today, and can’t wait to dive in!

[@urbanvr]

Great video!!!

[@SpatialInsights]

Thank you

[@HanleyLeung]

great vid. captured a bunch of vids last night from iPhone and vision pro and trying to figure out how to edit them together

[@SpatialInsights]

Great. I knew people would be trying to do this. I hope the video helps.

[@bobbyDig]

Well done

[@SpatialInsights]

Thanks

[@omnia.armarket]

Question: can you view the spatial video in immersive mode when you play them on the headset?

[@ChanduKale]

I am saving this until I buy an AVP and start editing.

[@504cool]

Thanks for this! I was wondering if there was a way to edit this type of video.

[@SpatialInsights]

Thank you. It would be great if Apple offered a more direct way. But, I think this will work fo rnow.

[@marydeguzman9206]

Hello, The original video (recorded on iPhone) shows in about 100 degree space in the center (even after IMMERSIVE button is clicked). Rest of the window is filled with fog but on the output video after following the exact steps here.. Iphone pro shot, spatialify, primiere pro, spatialify, the entire window is filled with the video, by stretching it in all directions in immersive. like those weird mirrors on fairs. that stretch your image in all sides. and the feeling is that you are at the edge of the cliff. Not sure what i am doing wrong, would really appreciate some insight. Thank you so much.

[@spatialtests]

Please report back on your mixed format clips. They won’t work on a 3DTV, but automatic switching in headset is a simple line of code. A bit of a callback to “please put on your 3D glasses” in the movie theater days. I’ve used Spatialify to do mostly over under exports into After Effects to edit. There’s a blog post with terminal lines to convert edited 3D content back to MV-HEVC files that natively read as spatial. I’ll update the post with the link when I find it.

[@SpatialInsights]

I've thought a lot about this. I'm not optimistic about mixing the two formats. But, I hope to try some ideas.

[@omnia.armarket]

we're trying to find a way to get native MV-HEVC Spatial video files, is there any update on the link?

[@tylerturner3867]

Is there a way to add in text graphics that we know of?

[@fluidoxr]

You can use DaVinci Resolve but you need to follow a long process to convert the original file in left right 3d format then edit (add titles), export and reconvert to spatial video

[@shreyabansal2115]

Does this workflow work the same way with the spatial videos captured inside the headset? Do I first sync my headset to my icloud, then import the video inside one of the apps you mentioned and then export it in side by side frame, import it in premier, edit, export back to my iphone, re- export in the app and then sync it back to icloud?

[@SpatialInsights]

I have not tested it first hand, but I’m very confident this will work with spatial videos capture in the headset itself. However, I do not think it will work if you mix clips shot on an iPhone and clips shot on the headset all together in the same sequence. There are different aspect ratios, so I don’t think you can mix them.

[@knk9118]

Question, if I use filmic pro doubleTake app on IPhone 15 pro to shoot 4k 30 from both main and ultrawide cameras… then use Spatialify app to convert them into special video, would there be any lose of quality? And would the final video be in 4k?

[@SpatialInsights]

Sorry to say, I'm quite confident that would not work. Take a look at our video "Shoot Spatial Video for Apple Vision Pro Now - and More!", starting at about 16:20 for an explanation that should clarify that question. kzbin.info/www/bejne/d4CWdGecl8Seaq8

[@Theboxhouse]

Have you seen any spatial video only sites?

[@SpatialInsights]

To share videos? I have not. I think this is one of the key moments we are waiting on. When Spatial and/or Immersive (VR 180) videos can be easily shared on a platform like KZbin and viewed on the Apple Vision headset easily, that will be an important moment. Of course, you can publish immersive VR180 videos on youtube, but there is no way to view those experiences on the Apple Vision headset. And the 3D "Spatial Video" is entirely new.

[@Theboxhouse]

It's odd that nobody has developed a site to share their spatial videos and everything is so reliant on KZbin@@SpatialInsights

[@yusufomar9102]

Hi everyone, I need your help! The first part of this video was super helpful, converting a batch of iPhone 15 spatial video into a format I could edit on premier. BUT when im converting the edited video back into Spatial, and airdropping to my headset, I'm seeing double. It's not 3D spatial anymore, it's just weird in the headset where it's one video (not side by side) but for example I'm talking on camera and you can see my head twinned. Please help! The file is showing as spatial on iphone after conversion. But it's not playing properly in headset.

[@SpatialInsights]

Can you take a look at 6:05 in the video? When you import your edited video are you sure you selected the “Full Side-by-side format”? If you chose “full side-by-side” when exporting the original clips, you need to make sure you choose the same setting when converting the edited video. If not, I think it may cause the problem you describe. Can you let us know whether that’s the solution? I’m curious to figure it out.

[@yusufomar9102]

@@SpatialInsights Thanks for your reply. I appreciate the effort! It's frustrating being in this early phase of filmmakers trying to figure this all out, but you're definitely a support. Indeed, I both converting the footage as side/by/side and I also brought the edited video back in as side/by/side. If you're inclined, I'd love to send you both some of the raw footage and my edited export for your viewing.

[@SpatialInsights]

@@yusufomar9102 I would be interested in taking a look at your footage as well. Maybe I could find a solution. But, I'm not sure how you could send the footage to me.

[@ruudygh]

Comformed quality lost even with same codec

[@SpatialInsights]

I assumed as much. Thanks for confirming.

[@shakinda_learning]

@@SpatialInsights you need an app that lets you take control over the mb/s of the transfer e.g. an h264 video with 100mb\s is way less compressed than a h264 with 40mb/s

[@stephenbard1590]

There is obviously nothing "special" about "spatial" video -- its just a typical Apple rename gimmick for normal common 3D video with a blurry frame added around it. I personally find the blurry frame to be an annoying artifact that detracts from the normal crisp SBS 3D videos that I view routinely in my Quest Skybox app. I am impressed that Apple's ruse has caused many people and even some gullible reviewers to confer some mystical dreamy "memory" quality to these perfectly common 3D videos. So my question for you is if I start with video with the blurry frame, can you click easily remove the blurry frame with the editing program or by switching the codec?

[@spatialtests]

So you’d rather have 3D content just evaporate into thin air instead of noticing their rebranding can breathe new life into an always struggling format? And it’s not special… it’s spatial.

[@theden0minat0r]

@@spatialtests Agreed! I don’t care if Apple rebrands it. I just want the format to become embraced by the masses.

[@stephenbard1590]

As a 3D/VR fan, I am thrilled that Apple has entered the marketplace since it somehow validates the concepts of 3D and VR for millions of people who had not considered it.@@theden0minat0r