I built an Apple Vision Pro app... visionOS tutorial
Вставка
- Опубліковано 17 лют 2024
- Learn the basics of VisionOS development for the Apple Vision Pro. I build a simple app from scratch using SwiftUI and RealityKit to build an app for Apple's new VR/AR platform.
Upgrade to PRO fireship.io/pro
VisionOS Docs developer.apple.com/documenta...
Apple Vision Code Report • Zuck’s brutal takedown...
Finally after 6 months, jeff remembered his password for his second channel
I think he was taking some time off due to personal reasons.
@@aeapplabs Do you not understand the joke?
@@aeapplabs He was training in openai's new server for past few months....
@@trplnr Do you not understand a comment giving more info on to _why_ he hasn't been active on the 2nd channel?
Ah the Internet and social media. Let’s all be mean to each other for no reason whatsoever.
You gotta love it.
API key visible at 6:35!!! Should replace it ASAP.
It's already dead, I figured I leaked it somewhere
well played@@beyondfireship
@@beyondfireship nice ip xD
For anyone who now wants to go look at it, Ill spare you the effort!
API Key is "VRnG5AzGKvdEYZEw61stlg95GZyaVDmM"
@@beyondfireshipI slowed it down just to see if you left a "Hi, mom" message.
1. make a Flappy Bird clone for VisionOS
2. call it “Farty Turd”, and charge $5 for it
3. ???
4. Profit
I wonder if they have "Blink Gesture" to make it really hard to play)))
@@nazarshvets7501 thats a part of game as we know the flappy bird is hard as hell, yk
Yooooo wtf I literally thought bout this idea instantly then came to he comment just see someone got ahead of me smart man 👍🏽👍🏽
If I do that I would just make it a 3d flappy bird
@@keyonlewis7574 that’s a good idea
It's not only fun to watch these devices evolve but also building on them. I'm also tempted to explore building a Vision OS app using Swift UI.
Don't do it, use Objective-C. It's so good
scam bot
There is so much content out there but the moment I see a fireship video I MUST watch
Actually True. His videos are really well structured.
Gotta change your api key! Its visible for a small moment at 6:35
that giphy api key is mine
He already killed it
Shit
i loved how adding the image into the scene pushes everything down
I think that's because its wrapped in a vertical stack.
Please make more content on how to build virtual worlds or games for visionOS!
This was a great insight.
Interesting! I have a slight suggestion on the audio tho. Can you put a high pass / low cut filter at like 80-100hz to your voice, because there is this really low bumping sound that gets somewhat annoying with headphones.
Most people probably don’t notice the sub bumping sound, but removing it would make the audio easier to listen to with better sound systems.
Even that is usually too much for some voices, id say at a minimum start at 50, the lows are more important for Vox than you think but definitely 30-50 has to go
For anyone thinking this is pedantic, I can assure you it is real.
@@ssserotonin1373 Yeah, I agree that 100hz can be a bit much but he has pretty high voice so i think 80hz is still pretty safe bet, in case of paranoia about slightly thinner voice, 60hz.
P.S I have a decade of audio experience so you don’t have to remind me about ”lows being more important than i think”
Good comment and suggestion, sound is important
tell me you have good sound systems without telling me
I would love to see more Apple Vision Pro development!
You should change your API Key...
Fun fact, if you turn on pointer control inside of the Apple Vision Pro, we can see where you’re looking and it makes it so that it’s harder for the viewer to notice the low quality rendering in the places where you’re not looking.
I see Switf's JSON deserialisation goes with a similar concept of structs guarding the structure like in GO.
You should make a series of tutorials on a specific subject, talking about the code and the choices made in the project. Explaining design decisions and discussing implementation should be fun.
I too have the Oculus dev kit from way back when. Fun times!
I want tutorials on:
-Music playback
-Musical interfaces/objects
-Programming/staging spatial audio effects
good to see you back. Would love some kubernetes content
Fun tip: For optional binding in Swift you can just use
`if let data`
instead of
`if let data = data`
You api key is available for everyone who watches this video at timestamp 06:35. Just move frame by frame and you can catch it before it gets blacked out
"I wanna do more tutorial videos" I'd love a fireship take on a *modern* react tutorial, never got to learning it since I got into svelte and vanilla is decent these days, would be cool I think
I'm suscribed to Pro. And yes, a SwiftUI course would be good
I’d like a video on how to document requirements and create a plan to complete the full project without just keep adding tasks that you didn’t know they had existed when you first started building it.
I think there isn’t a fully fledged video on youtube like this and I struggle a lot with it.
Maybe a tutorial for this channel.
+1
Are the 3d items in the window view 3d?
Can you put a 3d item "behind" the window but have it show on top?
Like those 3d cards but they're actually flat.
I've seen it in a couple of VR games and its a cool effect. Like a sort of portal.
Am I the only one who's thinking it can't be safe to have an API key inside a client side app?
No? You'll always need some kind of key somewhere to interact with a server, could be yours or theirs, doesn't matter.
@@StiekemeHenkusually you use a server you control and authenticate the user with JWT or similar, but this is too complicated for a video (it allows for stuff like rate limiting and access control)
any API key embedded in an app can and will be reverse engineered
@@StiekemeHenkkey is on the client -> people can extract it, use it to spam
key is on your server and the client makes requests to your server -> you can filter requests and do ratelimiting before you run out of credits or similar
@@BooleanDev I am aware but a good built service already allows you to do all that jazz built in so it doesn't have to run through _another_ server and waste your cash. And if your service is public, without accounts, it matters even less.
@@StiekemeHenkyou are on a fast track to your very own CVE with that mentality my friend
Cool demo.
I tried VR in 1992 when I was 8. Even those boxy graphics had amazing wow factor 😅
More Coding Tutorials! 🎉 yess
Jeff, there is such thing as WebXR which lets you program AR/VR apps with JavaScript
My man I want to learn coding from you. let me know where to sign up. You have no BS - straight to the point approach. I love it
Dude I've used all of the VR headsets out right now and this is the ONLY one that's worth buying for me. Just like the iPhone revolutionize the smartphone market when everyone else was making them too, this -is-revolutionizing VR and a key part you left out - Augmented Reality. Hopefully you can start looking for the good in things instead of the bad. Kindness and positivity goes a long way.
My first VR experience is on Quest 2 is okay but it gets better once I played more decent games on it and it doesn't have to be first time trying it.
You'll see VR/AR is even better once more apps come out and you get to try something amazing never in a million years can work on any 2d screen device and it works control better in vr/ar
This is great, do you have any recommendations for books that follow this sort of teaching style?
Thanks
Apple vision the killer of responsive apps
Good stuff 👍
Would like to see more vision content
Great vid, as always 👌🏼💪🏼🤘🏻 I would love to see an ai agent coding session. Since it’s a hot topic 👽
Where's React Native and Flutter for Quest and VisionPro?
When 3d vision view landing on Chromium and Safari?
When can I use JS to create cross-platform crappy VR apps?
love it 😻
Sorry Jeff, you dropped this one. Here you are: 🏅
Cheers to all the creators 🍻
Can you show us how to make an environment for the Apple Vision Pro
since you said for us to say what we'd like to see in the comments. PLEASE! learn how to develop for vision Os (specifically game dev) and make a playlist teaching us how. or guide us as to the best places to got to learn vision os dev! thanks
Would be great to understand if Apple has integrated a framework for shared experiences, both remote or in presence
Thank you for creating balls app.
Unreal on custom c++ classes with blueprints
Making iOS apps using Swift would be a good tutorial
Thanks for the video! Please show how to work with physics.
Great, I want to see how you can make a ball that bounce through the room en change color when je touch it!
Planning on making more coding tutorials, interesting. How about a tutorial/lesson about Java Spring Boot?
Would be cool to get more content on Kafka and real-time data pipelines with Flink!
yea boi I have a DK2 as well!
This was an impressive vidro
However, your API key was visible for a second and I’m now going to use it to spam 1000 GIFs a day
Hi Jeff! Regarding your comment about “more tutorials”, I was wondering if you’ll make something about AI apps with AWS Bedrock, Vertex AI or Azure’s OpenAI. All the process, models, inference endpoints, etc… BTW, great GREAT content man! Love all your videos!
i know its not a big thing in the United States but i have a pico 4 and it also has some pretty good pass through tech. Maby (if u can get ur hand on one) u could make a video about it.
That split second API key view was definitely intentional
Here comes an Idea for a nice use case for AR, but it might be way too complex. Dungeons and Dragons or any other Tabletop game where you will be able to project a map or a grid on the table and being able to move players around.
damn, soon new channel storm is comming for headset
ive had the oculus developer, quest 2 and quest 3 for 1 week. Ive already used my vision pro in 10ish days more than all the others combined
Hey thanks for the awesome video! -- Up next: would love to see a media focused or e-commerce app in Swift for Apple Vision Pro. Also, integration of sensory data (let's get going with voice activation, responding to gestures; you know; the future we're building :D ).
Please explain how to detect the environment like finding the table in the space.
"...the GIF animations don't seem to play, but to be honest, I don't really care enough to figure out why" 10x developer mindset right there
PLEASE do a WEBXR Tutorial
Creating a fully immersive environment that has random actions take place (cars driving by, people walking by, etc).
I didn’t know fire ship was a of vr user. Very based
Jeff is back
I think you can do something rather interesting with the balls scene you made here. Create them further away and then 'throw' them at the user. Now you can make 2 game modes out of that, one where you dodge the balls and one where you catch them. It could be nice a workout and nostalgic experience for when we were nerds in school dodgeball.
I liked how he used zed right after the zed video
More Nuxt JS tutorials?? We haven't had those in a while
You gotta trust markos
awesome
Yup 👍
Hi sir, just want to know if buying a Vision Pro is going to allow me to build and test Vision Pro applications?
On Apple website, it says need a Vision Pro development kit. Thanks a lot
original devkit is dk1, i had both, you showed a dk2 which is the second, its right in the name
Have you seen the XReal Ultra yet? It's like Vision Pro just as an actual sun glass
watching this while about to sleep … slept like a baby right after !
It's pretty nice this is built into XCode/Swift. It looks like Meta pretty much forces you into becoming a Unity or Unreal dev.
No, Meta Quest supports OpenXR, so you don't need to use Unity or Unreal.
Would it be possible to do this in a mac VBox?
FIRE
There are enough Next courses. Anything with Remix would be great.
For a coding tutorial, could you explain how you made your AutoGPT in your ChaosGPT video using ffmpeg? 😅😭
How do I center a div in Apple Vision Pro?
3:40 You can build native apps on Meta they don't have to be in game engines
As soon as the apple vision pro supports superhot I'll pick one up
Google glasses was ahead of its time lol
Google Glasses is trash. It's limited and true gimmick that even my $300 destroyed it completely in ashes in capabilities
i have a question can we make an carboard vr app that can access camera and we can see floating icons on that camera view?
make videos using aws rekognition, openai tts, and generate speech from text WITH word level timestamps, then create a ui that highlights each word as its being spoken, and automatically scrolls down the page
Lets see how long its gonna take to get a vr cross plattfrom framework
Yes please more AVP app development videos!
Make a tutorial on how to make a simple OS. For example for the raspberry pi.
The part where you include the Balls() method to the view is missing, can you add it?
... 10 seconds into the video and I realized you've synthesized your voice.
JavaScript giving Jeff the side eye rn 👀
"I should have never trusted musk..." hahaha XD got me laugh out loud XDDD
Does Apple Vision Pro come with a default app to load or import 3d models and PBR-materials? A default 3d viewer?
Please make flappy bird in vr where you hands are the wings
make videos on full immersion vr devlopment with unity
Do a Nlp model building tutorial
I keep thinking about "The Jerk" movie from 1979 - when I see people keep wearing VR sets 😂
yes