I built an Apple Vision Pro app... visionOS tutorial

Learn the basics of VisionOS development for the Apple Vision Pro. I build a simple app from scratch using SwiftUI and RealityKit to build an app for Apple's new VR/AR platform.
Upgrade to PRO fireship.io/pro
VisionOS Docs developer.apple.com/documenta...
Apple Vision Code Report • Zuck’s brutal takedown...

[@ToffeeMoney]

Finally after 6 months, jeff remembered his password for his second channel

[@aeapplabs]

I think he was taking some time off due to personal reasons.

[@trplnr]

@@aeapplabs Do you not understand the joke?

[@vaisakhkm783]

@@aeapplabs He was training in openai's new server for past few months....

[@user-xl5kd6il6c]

@@trplnr Do you not understand a comment giving more info on to _why_ he hasn't been active on the 2nd channel?

[@DavideDavini]

Ah the Internet and social media. Let’s all be mean to each other for no reason whatsoever. You gotta love it.

[@peterhuijsen]

API key visible at 6:35!!! Should replace it ASAP.

[@beyondfireship]

It's already dead, I figured I leaked it somewhere

[@ercant.6183]

well played@@beyondfireship

[@antongrekov7710]

@@beyondfireship nice ip xD

[@4louisMC]

For anyone who now wants to go look at it, Ill spare you the effort! API Key is "VRnG5AzGKvdEYZEw61stlg95GZyaVDmM"

[@XstahSie]

​@@beyondfireshipI slowed it down just to see if you left a "Hi, mom" message.

[@4RILDIGITAL]

It's not only fun to watch these devices evolve but also building on them. I'm also tempted to explore building a Vision OS app using Swift UI.

[@brandongregori995]

Don't do it, use Objective-C. It's so good

[@denniskj]

scam bot

[@aubreyxengland]

1. make a Flappy Bird clone for VisionOS 2. call it “Farty Turd”, and charge $5 for it 3. ??? 4. Profit

[@nazarshvets7501]

I wonder if they have "Blink Gesture" to make it really hard to play)))

[@MusaAlif-dead]

​@@nazarshvets7501 thats a part of game as we know the flappy bird is hard as hell, yk

[@mikemadmiked1195]

Yooooo wtf I literally thought bout this idea instantly then came to he comment just see someone got ahead of me smart man 👍🏽👍🏽

[@keyonlewis7574]

If I do that I would just make it a 3d flappy bird

[@mikemadmiked1195]

@@keyonlewis7574 that’s a good idea

[@yolokas]

Gotta change your api key! Its visible for a small moment at 6:35

[@Kat21]

that giphy api key is mine

[@LuisSierra42]

He already killed it

[@atemrandyasong5710]

Shit

[@theboredguy6673]

There is so much content out there but the moment I see a fireship video I MUST watch

[@TheAstroG]

Actually True. His videos are really well structured.

[@CristianNazare]

i loved how adding the image into the scene pushes everything down

[@wlockuz4467]

I think that's because its wrapped in a vertical stack.

[@aboliguu1168]

Interesting! I have a slight suggestion on the audio tho. Can you put a high pass / low cut filter at like 80-100hz to your voice, because there is this really low bumping sound that gets somewhat annoying with headphones. Most people probably don’t notice the sub bumping sound, but removing it would make the audio easier to listen to with better sound systems.

[@ssserotonin1373]

Even that is usually too much for some voices, id say at a minimum start at 50, the lows are more important for Vox than you think but definitely 30-50 has to go

[@jerbear7952]

For anyone thinking this is pedantic, I can assure you it is real.

[@aboliguu1168]

@@ssserotonin1373 Yeah, I agree that 100hz can be a bit much but he has pretty high voice so i think 80hz is still pretty safe bet, in case of paranoia about slightly thinner voice, 60hz. P.S I have a decade of audio experience so you don’t have to remind me about ”lows being more important than i think”

[@ayitinya]

tell me you have good sound systems without telling me

[@prohacker5086]

I use 3.75 dollars mobile headphones, I turn volume down not to lose my hearing, filter or no filter

[@enterTheVFX]

Please make more content on how to build virtual worlds or games for visionOS! This was a great insight.

[@DR20005]

I would love to see more Apple Vision Pro development!

[@shapelessed]

I see Switf's JSON deserialisation goes with a similar concept of structs guarding the structure like in GO.

[@XEyedPeasX]

You should change your API Key...

[@Dacas5]

good to see you back. Would love some kubernetes content

[@Insignia_]

You should make a series of tutorials on a specific subject, talking about the code and the choices made in the project. Explaining design decisions and discussing implementation should be fun.

[@StiekemeHenk]

Are the 3d items in the window view 3d? Can you put a 3d item "behind" the window but have it show on top? Like those 3d cards but they're actually flat. I've seen it in a couple of VR games and its a cool effect. Like a sort of portal.

[@GoldonPt]

"I wanna do more tutorial videos" I'd love a fireship take on a *modern* react tutorial, never got to learning it since I got into svelte and vanilla is decent these days, would be cool I think

[@tdubasdfg]

I want tutorials on: -Music playback -Musical interfaces/objects -Programming/staging spatial audio effects

[@erikporter]

I too have the Oculus dev kit from way back when. Fun times!

[@Baebae1947]

This is great, do you have any recommendations for books that follow this sort of teaching style?

[@esnho]

Would be great to understand if Apple has integrated a framework for shared experiences, both remote or in presence

[@arinahomuleba4165]

You api key is available for everyone who watches this video at timestamp 06:35. Just move frame by frame and you can catch it before it gets blacked out

[@stardrake691]

I’d like a video on how to document requirements and create a plan to complete the full project without just keep adding tasks that you didn’t know they had existed when you first started building it. I think there isn’t a fully fledged video on youtube like this and I struggle a lot with it. Maybe a tutorial for this channel.

[@wlockuz4467]

+1

[@krtirtho]

Where's React Native and Flutter for Quest and VisionPro? When 3d vision view landing on Chromium and Safari? When can I use JS to create cross-platform crappy VR apps?

[@carpebios4246]

Great, I want to see how you can make a ball that bounce through the room en change color when je touch it!

[@seifenspender]

Fun tip: For optional binding in Swift you can just use `if let data` instead of `if let data = data`

[@peglegkangaroo]

Can you show us how to make an environment for the Apple Vision Pro

[@Capjuancode]

Please explain how to detect the environment like finding the table in the space.

[@richlira]

I'm suscribed to Pro. And yes, a SwiftUI course would be good

[@miguelhermar]

More Coding Tutorials! 🎉 yess

[@Armetron]

Planning on making more coding tutorials, interesting. How about a tutorial/lesson about Java Spring Boot?

[@7heMech]

Am I the only one who's thinking it can't be safe to have an API key inside a client side app?

[@StiekemeHenk]

No? You'll always need some kind of key somewhere to interact with a server, could be yours or theirs, doesn't matter.

[@BooleanDev]

@@StiekemeHenkusually you use a server you control and authenticate the user with JWT or similar, but this is too complicated for a video (it allows for stuff like rate limiting and access control) any API key embedded in an app can and will be reverse engineered

[@ItIsJan]

​@@StiekemeHenkkey is on the client -> people can extract it, use it to spam key is on your server and the client makes requests to your server -> you can filter requests and do ratelimiting before you run out of credits or similar

[@StiekemeHenk]

@@BooleanDev I am aware but a good built service already allows you to do all that jazz built in so it doesn't have to run through _another_ server and waste your cash. And if your service is public, without accounts, it matters even less.

[@meorung05]

@@StiekemeHenkyou are on a fast track to your very own CVE with that mentality my friend

[@chrisray9653]

Cool demo.

[@lilgohan]

Would like to see more vision content

[@remsee1608]

Jeff, there is such thing as WebXR which lets you program AR/VR apps with JavaScript

[@KidIndia]

My man I want to learn coding from you. let me know where to sign up. You have no BS - straight to the point approach. I love it

[@hugoczerniawski166]

Great vid, as always 👌🏼💪🏼🤘🏻 I would love to see an ai agent coding session. Since it’s a hot topic 👽

[@orioljurnet]

Hi Jeff! Regarding your comment about “more tutorials”, I was wondering if you’ll make something about AI apps with AWS Bedrock, Vertex AI or Azure’s OpenAI. All the process, models, inference endpoints, etc… BTW, great GREAT content man! Love all your videos!

[@adamwarvergeben]

Have you seen the XReal Ultra yet? It's like Vision Pro just as an actual sun glass

[@tylertuthill5121]

Dude I've used all of the VR headsets out right now and this is the ONLY one that's worth buying for me. Just like the iPhone revolutionize the smartphone market when everyone else was making them too, this -is-revolutionizing VR and a key part you left out - Augmented Reality. Hopefully you can start looking for the good in things instead of the bad. Kindness and positivity goes a long way.

[@VaibhavShewale]

damn, soon new channel storm is comming for headset

[@lex0800]

i know its not a big thing in the United States but i have a pico 4 and it also has some pretty good pass through tech. Maby (if u can get ur hand on one) u could make a video about it.

[@toututu2993]

My first VR experience is on Quest 2 is okay but it gets better once I played more decent games on it and it doesn't have to be first time trying it. You'll see VR/AR is even better once more apps come out and you get to try something amazing never in a million years can work on any 2d screen device and it works control better in vr/ar

[@LewiUberg]

I tried VR in 1992 when I was 8. Even those boxy graphics had amazing wow factor 😅

[@AustinDaniels]

For a coding tutorial, could you explain how you made your AutoGPT in your ChaosGPT video using ffmpeg? 😅😭

[@omhmpp]

Good stuff 👍

[@EOS-ci1po]

i'm ready to build the apple vision pro app!! can you announce for me about mac pc spec?

[@BandosLP]

Would be cool to get more content on Kafka and real-time data pipelines with Flink!

[@MegaLietuvislt]

Would it be possible to do this in a mac VBox?

[@RobertFerentz]

I think you can do something rather interesting with the balls scene you made here. Create them further away and then 'throw' them at the user. Now you can make 2 game modes out of that, one where you dodge the balls and one where you catch them. It could be nice a workout and nostalgic experience for when we were nerds in school dodgeball.

[@jonahsim]

love it 😻

[@GrowsDrummer]

Here comes an Idea for a nice use case for AR, but it might be way too complex. Dungeons and Dragons or any other Tabletop game where you will be able to project a map or a grid on the table and being able to move players around.

[@dawid_dahl]

Thanks for the video! Please show how to work with physics.

[@S4ntia60]

Apple vision the killer of responsive apps

[@MirkoRaimoOfficial]

Sorry Jeff, you dropped this one. Here you are: 🏅

[@justinJ689]

Hey, can you do like a list of stuff you will need for developing software for vision pro. Like what is the mininimum I need to be able to get away with developing apps for it?

[@wlockuz4467]

Like he mentioned, you just need a modern Mac laptop or PC. You don't actually need Apple Vision Pro itself because Xcode runs your apps on an Apple Vision Pro simulator.

[@emilk2729]

I keep thinking about "The Jerk" movie from 1979 - when I see people keep wearing VR sets 😂

[@AnonymousAccount514]

awesome

[@lepex8359]

Lets see how long its gonna take to get a vr cross plattfrom framework

[@viperbia]

More Nuxt JS tutorials?? We haven't had those in a while

[@serychristianrenaud]

Thanks

[@rayalavan]

Hey thanks for the awesome video! -- Up next: would love to see a media focused or e-commerce app in Swift for Apple Vision Pro. Also, integration of sensory data (let's get going with voice activation, responding to gestures; you know; the future we're building :D ).

[@vannelo]

The part where you include the Balls() method to the view is missing, can you add it?

[@devagarwal3250]

Jeff is back

[@WOYGx1010]

This was an impressive vidro

[@WOYGx1010]

However, your API key was visible for a second and I’m now going to use it to spam 1000 GIFs a day

[@wwtapsable]

original devkit is dk1, i had both, you showed a dk2 which is the second, its right in the name

[@LauS0]

3:40 You can build native apps on Meta they don't have to be in game engines

[@rickyyy2006]

Hi sir, just want to know if buying a Vision Pro is going to allow me to build and test Vision Pro applications? On Apple website, it says need a Vision Pro development kit. Thanks a lot

[@zeroeternity5686]

I liked how he used zed right after the zed video

[@takshshori3290]

since you said for us to say what we'd like to see in the comments. PLEASE! learn how to develop for vision Os (specifically game dev) and make a playlist teaching us how. or guide us as to the best places to got to learn vision os dev! thanks

[@almirchowdhury9557]

make videos on full immersion vr devlopment with unity

[@BrianShannon1]

PLEASE do a WEBXR Tutorial

[@HELLBOI009]

i have a question can we make an carboard vr app that can access camera and we can see floating icons on that camera view?

[@red9090]

How do I center a div in Apple Vision Pro?

[@qepri]

And what about 'WEBXR' frameworks like Aframe are compatible ?

[@jasonjohnson4803]

So many puns and jokes, just in the 1st 30 seconds.. 😂

[@dk9469]

pls make a tutorial to build a cross plattform ios and android app

[@jp46614]

That split second API key view was definitely intentional

[@zeburgerkang]

yea boi I have a DK2 as well!

[@tdubasdfg]

Cheers to all the creators 🍻

[@dav12344]

can we use Flutter for building visionOs apps ? 🤔

[@ungodlykaveh]

How about some videos on DevOps?

[@SogMosee]

make videos using aws rekognition, openai tts, and generate speech from text WITH word level timestamps, then create a ui that highlights each word as its being spoken, and automatically scrolls down the page

[@romafedor2590]

Unreal on custom c++ classes with blueprints

[@SzBenedek2006]

Make a tutorial on how to make a simple OS. For example for the raspberry pi.

[@batimius]

"...the GIF animations don't seem to play, but to be honest, I don't really care enough to figure out why" 10x developer mindset right there

[@uiedbook7755]

You gotta trust markos

[@purnecol]

i saw the API key i paused just on the right frame kan i tel it?

[@SalarPro]

FIRE

[@faiyazrasul2050]

JavaScript😢.Can you make a video on the Next Js 14

[@Hobnockers]

Does Apple Vision Pro come with a default app to load or import 3d models and PBR-materials? A default 3d viewer?

[@peterwan小P]

"I should have never trusted musk..." hahaha XD got me laugh out loud XDDD

[@user-ze9fb5oh1l]

Can I still program a vision pro app even if I don't own a mac?

[@alphod]

Do a Nlp model building tutorial

[@ingusmant]

Sucks that the vision has an M2 but can't be used as a computer itself including making apps for it.

[@HexPortal]

4:50 why is there an image of "de zilverberg," a tiny retirement home in Belgium lol

[@snapsnocaps9630]

i want to see an idle/clicker game built for the vision pro

[@manasnagelia]

Making iOS apps using Swift would be a good tutorial

[@dragonradius6664]

I didn’t know fire ship was a of vr user. Very based

[@eleah2665]

There are enough Next courses. Anything with Remix would be great.

[@Slashscreen]

You may wanty to reset that API key. Your black bar was off by a frame