Harvard Professor Steven Pinker on Apple Vision Pro
Вставка
- Опубліковано 22 лют 2024
- Harvard professor of psychology Steven Pinker on the science and history behind the Apple Vision Pro.
Read more on Steven Pinker:
www.harvardmagazine.com/2018/...
www.harvardmagazine.com/2023/...
www.harvardmagazine.com/2021/...
More on science and technology:
www.harvardmagazine.com/2021/...
www.harvardmagazine.com/2023/... - Розваги
Talking about motion sickness...that totally "out of the
blue "laughter from the camera person, around 4:30 made me jump!
Yeah lol, timestamp bit late
”Barfogenic”😄 4:15
I wondered if the audio came from elsewhere and then replayed the segment. Then I wondered if he was talking about the first use of most new visual technologies. But no, it's just there.
Yes because the AVP display doesn't have delay 😂
Those antique stereo photo veiwer looked so cool!
This guy knows his stuff! Every professor should know their stuff like this.
I know all this (and more) and I'm not a professor. It's like seeing Michael Jordan dunk and saying "wow that's what GOATs do, they dunk!". And the other players go:"what do you mean?! we all can dunk!"
It’s not just the ability to know the material but it’s also being able to present it in such a way that others enjoy and understand the meaning and the implications without coming off like a complete douche bag. Some thing I think you might know a little bit about and perhaps are also an expert in
@@patrickm.39
Pinker is the best professor in the world
@@patrickm.39 Yeah, and I’m a stable genius 😀
People may not be willing to use added equipment to see a still stereoscopic photo but I'm living proof that does not apply to 3D video. I've watched 3D video of my family thousands of times over the past 3 and 1/2 years first with the Meta Quest 2 and now with the Quest 3. My family is 2,000 miles away and I only get to travel there twice a year so using 3D video cameras to send immersive videos of ourselves back and forth is a game changer for us. It sounds unbelievable but I get the same visual reward of seeing my family through the Quest 3 as I do when I'm there in person. As an added bonus we can spend the majority of our time in the future seeing each other without ever aging!
I am a living proof that it does apply to 3D video as well. I've watched a 3D video a few times in my life and I will never watch it again. I call my family over FaceTime, we have a nice chat, we get the kick of our dopamine and serotonin. Seeing a laugh on my brother's kids can not be compared to any 3d stereoscopic technology. Also there is no bonus for me to see somebody who doesn't age. I want to see the full beauty of my family and the complete maturing and aging process. I understand that you enjoy the VR experience and it makes me happy that there are options for people like you. For most of us, it is already good as it is. Btw, for 5000$ I can pay flight tickets for next 5 years to go and visit my family multiple times per year.
@hl Oh I agree with you about whether to spend 5000$ on a Vision Pro. I watch my VR videos on a $499 Meta Quest 3. I also have a separate VR camera that I bought in 2019 for less than $300. I use an app called the Skybox VR Video Player to see my videos in 3D. Unfortunately there are no direct flights between my home here and my destination which means that I have to change planes at a major airport along the way. That's more difficult that it might at first seem because I'm 73 years old and have health issues. I can just manage 2 trips a year let alone 5. I'm waiting for a more affordable Vision Pro before I buy one but in the meantime the Quest 3 works fine for my intended purpose.
@@adiidahlYou may have a misconception about what he means by 3D video here. I like watching 3D movies, they’re fun, but they’re also kind of a gimmick and I can take them or leave them. I’d rather have them as an option, but I don’t feel like I’m missing anything if it’s not available.
Then I tried the Apple Immersive Video experiences that they have in the Apple Vision Pro on the Apple TV app (sorry for keeping naming their products here - I swear I’m not trying to promote the product, but it’s important to know that I’m speaking of a very highly specific thing and not just ordinary 3D video). Between this and the Spatial Videos like @affecttheeffect was talking about in their comment, this is not just 3D video. The Spatial Video like they’re talking about is incredible when you see it of your own loved ones. It really is like being right back there and experiencing it in person again, in real life, and not just a photo or video. That isn’t completely immersive - it’s semi-immersive because it’s 3D and it looks exactly the same as when you were there originally in person filming it with your iPhone, but even that isn’t the full experience.
The real experience in the Apple Immersive Video technology that right now is only available in a handful of demos on Apple TV. These are episodic programs in which they’re going to be releasing a series of each of the videos over time in their respective genre. There were 5 videos in total at launch - one of which is just a kind of ad/demo of the Apple Immersive Video technology itself with clips of several of the episodes.
1. A video filmed from 4 different points of view in a music recording studio with Alicia Keys and her bandmates that are touring with her currently. They’re rehearsing a handful of the songs from their tour and going over how they’re planning to perform them, getting a feel for how they’ll all work together, etc., and it is as if you’re actually present right there in the studio right in the middle of all of them all around you. Apple has developed their own special camera and microphone system for this experience that’s integrated with the Vision Pro and their Spatial Audio system that they developed with the AirPods Pro and Max headphones where the audio tracks your head movements, tricking your brain into thinking the sound isn’t coming from the headphones at all, and that it’s right in the room with you. When coupled with the Vision Pro, their camera system is capturing a full 180 degree field of view from left to right, top to bottom, and straight ahead in full stereoscopic 3D video at 90 frames per second in full HDR lighting. When I watched this video, there were a couple points where Alicia was singing while moving around the room and looking at and singing at the cameras, and it felt so completely real that it was actually uncomfortable at a couple spots where it felt like she was about to invade my personal space. There were other points between the songs when the other musicians were moving around the studio while she went to other equipment to go over another song, and I had to pause the video and take off my headphones because the sound and video were so immersive that I was convinced that some of the sounds of movement in the room were in my own actual house and not from the video itself.
2. Another video filmed in Norway of a woman who does highline walking, which is similar to a tight rope, but she is stringing it up across a sheer stone cliff that’s over 3,000 ft. straight down into the canyon below. I have a fear of heights, and this one was so real that I nearly wasn’t able to watch the whole thing. I had to constantly remind myself that I was sitting safely in my room on the ground and that I was only watching a video where everything would be fine. It was very nearly terrifying because of how real it was.
3. Another video is of a rhinocerous preserve in South Africa, kind of like you’d see on PBS or National Geographich or the BBC. The difference is that it’s as if you’re really there (other than no smells). There are a few clips in this video talking about the effect the preserve has on the communities around it and how it impacts the people who live there, and they show some scenes of a group of kids running around in a field playing soccer together. It doesn’t sound like anything special or impressive - it sounds quite ordinary and boring. But that’s what made that experience so impactful - it was one of the points where I realized just how important this new technology is going to be for so many things. When I saw those kids out there playing soccer in the field, and remembered how intimate and close, to the point of discomfort over my personal space, the Alicia Keys video was, and thought about how real and impactful the spatial videos of my own friends and family members are when I watch them back - I realised that this isn’t just one more meaningless piece of technology. This is going to change everything when it gets to the point that it’s easily accessible to everyone. This was one of two points in watching all of these videos where I actually cried because it opened my eyes and hit me just how huge this level of immersion is going to be for people. It isn’t something you can comprehend at an intellectual level - it’s a purely emotional experience, and one that will hit each person differently for different reasons.
4. This is a video that looks like it’s a combination of real world filmed together with relatively high quality CGI mixed in like you’d have in a movie. It looks like somewhere in the Pacific Northwest or maybe Scotland or something and features dozens of dinosaurs. It starts out flying over a lake and approaching an island - you see birds flocking in the sky but by the time you reach the beach on the other side of the island, they’ve landed and they’re like pterodactyls or similar - it’s just a few minutes long, but it gives you a sense of what living among the dinosaurs would have actually felt like if you managed to be among then when you weren’t on the menu. You get a very real sense of size, scale, and presence that no 3D movie has ever been able to give you bceause it’s just 3D on a screen at a theater, whereas this is you standing right in the middle of the scene you’re watching, surrounded by it.
5. The ad/demo reel of the Apple Immersive Video series - this has clips from all of the above episodes as well as from perhaps a dozen others, including ones flying over the Matterhorn, one in a hot air balloon floating over someplace like Canyon Lands or the Grand Canyon or similar in the morning sunshine, a few of steam engine trains coming around the tracks on a snowy mountain, one of a bear meandering quietly into a lake in Alaska or somewhere like that, and a couple from a baseball game where you’re seeing the game from right on the field next to first base as someone hits a ball over near third, and the third baseman grabs the ball and throws it to first to try to get the batter out, and another showing a soccer game from the perspective of the goal net where the opposing team is kicking the ball toward the net, having the ball deflected by the defending team, then managing to get it back and knock it into the goal just past everyone - and you’re seeing the whole thing as if you’re standing right behind the goal net yourself.
In short, it’s incredible, and it’s nothing like you’re thinking of when someone says 3D to you if you’ve seen 3D movies. To me, as someone who enjoys 3D movies, these expereinces are so far above and beyond anything else that I’ve ever experienced that it makes all the previous 3D and VR stuff that I’ve seen feel like it was fake or was just 2D. It’s not flawless - you can still tell that you’re looking at pixels if you really pay close attention - but it’s incredibly close to feeling like the real thing in person when you add in the fact that it’s in 3D, it’s not just in front of you, it’s surrounding you, and all the audio in the environment being filmed is basically like it’s being cast from where you’re actually sitting or standing. It’s that real. It’s an amazing technological experience, but the killer app part of it is that it’s so incredibly convincing that it’s the emotional experience you have while watching it that makes it something truly special. It can’t be adequately described by words.
That said, I’m sure there will be people who it won’t have a huge impact on, and maybe you’ll be one of those, and if so, then that’s fine. But for anyone else who’s reading this - this is like 10 times better than anything “3D” that you’ll have probably ever experienced before in your life. It’s almost like being in the actual location standing there on your own two feet. It’s nothing like just watching a video. You see where you look - not where the camera was pointed. You hear what’s there as if it’s here, not in a recording. It’s the resolution, the framerate, the color depth, the dynamic range, the total surround sound that’s entire dimensions beyond any “surround sound” you’ve ever heard before. It’s techologically just evolutionary, but the experience is definitely revolutionary. I’d say you owe it to yourself to give it a try at some point. You can see those in the Apple Vision Pro demos at any Apple Store if you schedule one. They’ll get you set up with a decent fit and close-enough prescription lenses if you don’t have perfect vision, and you’ll get about a half hour to experience the headset. Make sure they take you through the Apple Immersive Video experiences in Apple TV though - that’s far and away the best thing there is out there at the moment.
@@adiidahlyou seem to have missed some key points.
For example, your comment about comparing seeing kids laugh and 3D is kind of tone deaf.
You may as well say that even 2D photos don’t compare. But that’s not really the point.
@@adiidahl Sad noises from earths atmosphere...
I bought an AVP on Friday and am going from frustrated to loving this very, very young device. The Immersive video is worth the price of admission alone! Right now there aren't many examples of that, but the AVP is literally in its first trimester. As developers follow Disney on being all-in on it, we're going to get Apps that could never work on any other Apple device. I see surgical procedures overlaying an actual body or simulacrum in order to have a guided. hands-on experience. The same goes for manufacturing and so on! Many reviewers don't seem to grasp the vision.
Yea the applications, including in the future being able to have multi-user experiences with Full Body Tracking and the personas faces will only get better and better. You will eventually be able to not just have facetime calls, but will be able to digitally teleport to another persons virtual space, or in their living room and feel you are sitting or standing and walking around with them IRL. Combined with haptic feedback gloves, touch can even be simulated. Steven is a smart guy, but his take being limited to a single element of VR; stereopsis is lacking in imagination and shows he doesn't follow VR/XR/MR industry that closely at all.
There are no words adequate to describe the Immersive Video experience - it’s something you have to just experience for yourself. I swear it makes all the 3D I’ve ever experienced or watched in the past feel like barely 2D or 1.5D. It’s just unbelievable. And if you found that impressive, throw on a pair of the AirPods Max. That really completes the experience, although I’m highly impressed with the built in speakers - those get you 80% of the way to the AirPods Max. The Maxes just make the audio go from very immersive to “holy crap I have to pause this video, someone is in my house behind me!”
The main barriers to mass adoption of VR headsets were motion sickness, the warped, trippy pass through and general blurriness everywhere when in VR. The Apple Vision Pro fixed all those problems while other headsets have not. It shouldn’t be too difficult now that they know how to but they were major obstacles.
You are right. But a main barrier remains: feeling uncomfortable when wearing VR googles. They must become much more lightweight and sweatless to wear. I have a last generation 4k 3D OLED TV. Watching 3D on this thing has no downside whatsoever, as glasses with polarizing glasses are same weight, resolution is indistiguishable and brightness is no issue either (except maybe at daytime). Still, it was killed at the exact moment 3D perfection was achieved. People don't even afford a miniscule disadvantage if not combined with a killer app advantage. Which I assume will become remote presence conference apps.
The AVP has not fixed motion sickness. Some people will feel nauseous when they move their head side to side in the AVP because of motion blur in the AVP. You don't get that type of motion blur on the Quest 3. Lots of people have returned the AVP citing motion sickness as the reason.
If there were any decent shooting games available on the AVP then people would also get motion sick because of that as well.
@@dtz1000you literally contradicted yourself 😂
@@falklumoI watched several videos by a tiny UA-cam XR channel enthusiasts who talked about 3D tvs. He said he’s spent over $20k all together with the last one costing around $5k and he said the APV was amazing. His channel is “Dr Wiggo” I believe. Gamers don’t seem to like the AVP at all, but the vast majority of mixed reality enthusiasts seem to be overjoyed like sadlyitsbradley, MRTV - MIXED REALITY, VR Oasis and Tetiana of DiscoVR.
I loved this. Especially the slow subtle introduction to ASMR in the background. Clever use to keep me essentially sedated and never click away.
If you’re feeling the weight of the Apple Vision Pro on your nose, the fit isn’t correct, even if you did the face scan. Definitely go back to the Apple Store and try of the many face light seals. I’ve gone through 3 different light seals and I finally found one and it feels amazing! I don’t even notice the weight anymore then if I were wearing a pair of headphones.
Good tip. I think in his case it was a demo so I doubt they even tried to get one fitted to him.
pull the strap at the back down, sorts out that issue. I've had/have a few VR headsets, takes a couple of days to get any headset to fit right
There’s also the other less cool looking but way more comfy dual loop band.
I have the Quest 3 which is about 100 grams lighter and I can wear it for about 45 min before I need a break from it. I use it for fitness. I suspect the biggest market for these types of mixed reality devices is going to be fitness related apps. They are surprisingly effective.
I haven't tried it, but this will replace printed IKEA assembly instructions. It could point to the parts, the threaded fasteners, and explain what to do.
It could walk you through troubleshooting a problem with your car, pointing to the actual parts to check.
It could help firefighters navigate in a burning building, identifying the injured, and avoiding dangers.
It could be used to remotely provide medical help in warzones.
This is the first version, but future versions will offer night vision, thermal sensors, etc.
It's just starting!
This man remembers all what he wrote in his How the Mind Works concerning the nausea related to the lagging inconsistencies between various parts of the body, with the vision. His memory is extraordinary!
The 3D on this thing is phenomenal
It's phenomenal on the Quest 3 as well.
@@dtz1000 I’ve had all of these headsets: Gear VR, Oculus Rift, HTC Vive, Pimax 4K, Pimax 5k, Samsung Odyssey, Oculus Go, Samsung Odyssey Plus, HP Reverb, Oculus Quest, Oculus Rift S, HP Reverb G2, Quest 2, and the Quest 3. I’m pretty experienced with VR and have no brand bias. The Vision Pro has the best 3D capabilities and it’s not even close. This includes cinemas, home projectors and tv’s. Whatever Apple has done with the 3D depth sensors have not been done on these other headsets.
@@dtz1000 I like my quest 3 but the 3-D is not as good as on the Apple Vision Pro
@@Tysheeno On the rare occasion that the app or game is available on the AVP then it will look better because of the higher resolution. Not holding my breath for Google Earth VR becoming available on the AVP though.
@@Tysheeno meta has $3k to play with.they already had eye tracking like apple but cost to much. apple has now set the price so other players can work with higher budget knowing customers are willing to pay. same thing with smartphone.
quest isn't close ecosytem and is like 5+ years ahead with rich apps. easier for meta to get 90% to apple than for apple to catch meta.
apple sells vision pro on apple tax. quest 3 is sold at loss and marks goal is vr. he's will do anything to win over on apple here. expect $1500 quest 4 which will trounce apple because quest already plays games
For most users, there's a diminishing return when it comes to screen real-estate. I'm a software dev, having 2-3 monitors is ideal, but I can't imagine any need for more than that. As you said, until we don't have to compromise on comfort for a virtual experience, monitors will be the preference.
I agree with him it's the 3d video and immersive experiences that set VR apart for me right now, although I haven't tried AVP I do have a Quest 3.
We don't need AVP, quest 3 is pretty good by itself and I'm sure quest 4 will have better.
AVP has like 20% better resolution and better MR camera and eye Tracking for 3k more while lacking controllers, content, fov, brightness, comfort and most important content.
Its not a good deal in any way for now
A very solid take. Definitely adds to most reviews
Thanks for the lecture 😊
One theory on motion sickness is that it’s a genetic survival advantage because when eating certain poisonous substances your equilibrium doesn’t match, so those who got sick and threw up survived. Most people can teach their bodies to ignore it but some can’t and a lot don’t want to. It was one of Apple’s primary design goals to eliminate the motion sickness through consistent low latency vision feeds and stable windows, like physical objects. From the reviews I’ve read they largely succeeded as I’ve seen a number of reviewer saying they were highly sensitive to it but didn’t have a problem. Where Apple failed is motion sickness in moving vehicles (planes, trains, automobiles, boats) and in 3D/immersive videos. I think the later can be addressed by video directors understanding the problem and eliminating the panning, it needs mainly stable camera shots, but the instinct is to wow people with flying drone shots. Immersive videos can be extremely intimate and have the ability to make people feel like they’re there so it’s a powerful tool for a new era of movies but experts have to unlearn most of what they know about camera angles, framing, panning and transitions.
I think the first edition, is a litmus test & Apple will reflect on the feedback & their revised edition will rectify all the teething issues. I think it will eventually evolve into a console for games, etc
Excellent treatment of the topic considering the product was not directly demonstrated throughout the narrative. I would offer that the advantages offered by a desktop PC in the late 1980s/early 90s compared to paper and typewriters was far less than this device’s spatial environment relative to the now exhausted flat world of screens. All I’ve done so far with the Vision Pro is the demo but knowing what I do about app developers this is just going to grow regardless of whether or not it’s a good idea. This thing is serious hardware relative to the other glasses/goggles. Again, great narration of some of the more cerebral elements of the subject and history of this domain.
A really detailed and comprehensive way of saying that this product will tank.
Not really, nothing he said was relevant. The AR/VR space is not an extended effort to bring the world stereoscopic depth, and that's all he talked about. It's like saying airplanes are going to fail because the market has shown us people aren't willing to pay to spend time with a crowd of strangers doing nothing. Though technically true, it's utterly irrelevant. If AVP tanks, it will have nothing to do with people's willingness to carve space out for stereoscopic depth.
Think of it as the Tesla roadster. I’m waiting for the model 3. 😂
@@kjmorley-Congrats on your relative affluence; I’m waiting for the 25 kWh Aptera (or maybe Model “2” if it can get at least 6 miles/kWh).
People are so taken over by vision Pro hype that they are forgetting there is already a successful headset (Quest 3). with a thriving community 😊
When facebook haters use and defend the headset you know they are doing something good😏
@@AoptimisticNihilist Are you trolling? Cause if you're serious, you have an interesting definition of "successful" and "thriving." Meta is losing money on every headset sold, 90% of people who buy a Quest never pick their headsets up again after the second week (and of those who do, it's mostly to play Beat Saber), and over the past decade Meta has only manage to get about 500 titles (apps and games) for the Quest (per their own marketing materials).
Subtitling error. At 7:37 professor is referring to “hunt and peck” method of typing, not “front and back.”
I got the sense of 3D from a normal television when I viewed with one eye normally and the other through a camcorder viewfinder. Properly adjusted, to match the naked eye's view there was the sensation of 3D but only when the image moved. This suggested to me that the slight time delay through camcorder to the one eye caused the effect.
Great short video!!
The ocular sense of place is fascinating as it could deliver a cogent emotional sense of real tourism as genuine escapism.
💯 agree! I did the demo at the Apple Store and the AVP is incredible but not many people want a giant pair of goggles on their face for any period of time. I would also be concerned with the longevity of support for a device that is $4000.
Using vr since oculus dk1 its funny seen so many people talking about this just now, only because its from Apple.
I've never really had a problem with motion sickness even at the lowest FPS on certain demanding apps on my Oculus Quest 2, I don't know maybe i'm just lucky but i've personally never experienced it through just wearing the headset. However when the world inside the headset starts to tilt without me moving my head, thats when it really starts to feel weird.
Wide FOV?
Have you tried the Meta Quest 3 Steven? I would be interested how you think it handles the same hurdles you are discussing here in relation to the Apple Vision Pro.
The crisis Meta faces is… if a Vision product were $999 would any normal person buy a $500 Meta Quest 3 in significant numbers? The answer is “no”, and that’s why Zuck shat his pants and tried to become the newest UA-camr. He’s concerned Apple will dominate the $1000+ VR market leaving him the low-margin scraps sold at a loss… in the sub $1000 market. Mark is smart, and is correct to be nervous. Apple entering your space is a shot across the bow.
I would love to see some painting apps
Excellent overview Stephen. I guess I shouldn't be surprised from a Harvard professor! 👍
This is a lecture on stereoscopic imagery, followed by some instructions on how.to.use the Vision Pro. 5 minutes in and I stopped watching because I didn't feel like he would ever get to his opinion on it. This headset is an awesome headset. The spacial videos and images alone are worth it. Watching a 3D movie in this thing is like nothing you've seen before.
Thank you Professor Pinker! I have Better Angels, Enlightenment Now, and an Apple Vision Pro so this was right up my alley.
I’ve done VR many times before but the part in the “Wildlife” immersive video when the rhino puts its horn up close made me instinctively recoil. I also thought about what deep-rooted part of my brain was being triggered observing virtual megafauna.
I strongly believe in your case regarding people's aversion to stereo photography based on history. I heard leaks about this approximately 2 years ago. What I do believe the future holds, and what I'm currently learning and developing code for, is the augmented reality aspect of Vision Pro. I believe the future is in AR, not VR. I anticipate that this device will become smaller, and with the ability to integrate other devices within it, I can see it potentially dominating most of Apple's product lines. Perhaps they are already aware of this and why they still decided to take this approach. I'm interested in hearing more of your thoughts, Prof Pinker!
“The timing of the mixed-reality headset's launch has apparently been a cause of considerable contention at Apple. The company's industrial design team cautioned that devices in the category were not yet ready for launch and wanted to delay until a lightweight AR glasses product had matured several years later”
Great you're developing code for it. I believe the Vision Pro killer app will be some sort of "Facetime Vision", where video call participants meet in a shared virtual space, best the real space of one of the participants scanned via lidar and cameras. Add on apps could focus on virtual whiteboards people can walk to, view out of windows etc. Depending on a possible plugin architecture of that foreseeable Facetime Vision app.
It will be mix of AR and VR
People are so taken over by vision Pro hype that they are forgetting there is already a successful headset (Quest 3) with a thriving community 😊.
When facebook haters use and defend the headset you know they are doing something good😏
@@AoptimisticNihilist vision pro is years ahead in development
Excellent, thanks
I was hoping to hear his impressions of the Vision Pro and his speculation of the future of VR, rather rehashing the basics of VR, that most everyone already knows. A good VR primer however, if you know nothing.
I think youtube showed me this because im interested in this device, and want to say, was really interesting. There are things to think about what this technology represents and how we could use it in every day life to our benefit, and not just as "Oh cool device"
Thank you Prof Pinker!
Love Pinker. Blank Slate more relevant with every year that passes. Pick up a Quest 3, brother, it’s very impressive for the price
Thank you, Steven. I love your work. Cheers.
Our binocular-dependent stereoscopic vision doesn't extend past 7-10 feet (I'm sure there is a more precise number) because it is limited by the distance between our eyes. The real benefits from these headsets will be in viewing and working with complicated shapes at close range (or in "miniaturizing" things that we see at a distance (e.g. by artificially moving our two eyes further apart).
A lot of the eye tracking technology, interface manipulation methods could be replicated and visualized on a 2D flat screen.
You got it the other way around: eye tracking first started on 2D flatscreens; the Tobii eye and head tracking solutions have been around for quite awhile now.
Great take!
Also we all know what the gentleman would like to experience, in these GOOGLES after his cool session creating the funny science EP called Stein Island, also helped the misters legal defence out of his very good heart ;) Love this fella, pure science distilled ❤❤
The difference with this is the immersiveness.. the stereoscopy is just in addition to the fact that you are in another world. Cool info in the vid tho I didn't realize some of the early photography was stereoscopic.
I like this description a lot! Although, this is what we, more veteran VR users, and millions of other users felt many years ago (or some months ago) with Valve, HTC, PSVR 1 and 2 headsets, Quest 1, 2, 3 headsets. It is explained as if this were new tech, but it is an improvement in some regards to tech that has been out there for at least a decade now. A veteran user only sees crisper images with more pixels on Vision Pro. Not many true VR apps though (lots of 2D apps, for sure).
The applications, including in the future being able to have multi-user experiences with Full Body Tracking and the personas faces will only get better and better. You will eventually be able to not just have facetime calls, but will be able to digitally teleport to another persons virtual space, or in their living room and feel you are sitting or standing and walking around with them IRL. Combined with haptic feedback gloves, touch can even be simulated. This is just ONE of many different use cases along with productivity which the AVP is actually already good at in this early stage. Steven is a smart guy, but his take being limited to a single element of VR; stereopsis, is lacking in imagination and shows he doesn't follow VR/XR/MR industry that closely at all.
I had one when I was a little kid - a Viewmaster!
most reviewers miss this, my take after 2 weeks with the AVP is that I'm looking at an evolution. It reminds me when mobile phones first came out and most people thought it was too expensive, not worth it, etc... PC and even laptops are essentially 2 dimensional machines. When the iPhone came out it started the evolution of having a computer in your pocket. AVP is going to be a 3 dimensional computer. This is enabling the next form of computers - the ability to interact in 3D just like we do with everything else in our lives. This will untether the computer. It's only the first version so whatever failings it has is just that - a first edition. I can't wait to experience what is coming in the next decade. On the question of price - yes it's expensive for most people - but so is a Ferrari or a luxury car. If you compare Apples to Apples (pardon the pun) the AVP should be compared to high end professional VR headsets like the Varjo that go for $6k (like the Varjo XR3 that's going for $10K) or Microsoft's HoloLens at $6k. In those scenarios AVP at $3.5k is a bargain. My two cents
This man is brilliant
This is more of the scientific indepth of the VP
Mmm, as a person using VR for the last 5 years, I beg to differ. How can somebody know so much, learn so little? This is a wimsicle take on the AVP. Stereoscopic vision is but a fraction of this technology the AVP and other headsers are inspiring to deliver and that's the key, these devices can not be judged at the moment because so much of the eco system is missing but it does provide some value to those who appreciate it's abilities which is why Apple are in my view being cautious about marketting this.
@@dtrjones yes that's why I said scienctific. There are ofcus grey areas of which we all miss when talking about something. That's his take and I commend the delivery on it. There is soo much to this technology that we are haven't discovered the potentials yet.
this is my kind of review!
Impressive review. I wish one day I could achieve such a level of vocabulary and depth of analysis. It was smashing. Also, it helped me to clear the dilemma regarding Apple Vision. I am not buying it until they resolve the weight-balancing issue and develop more useful apps.
Thanks Steven!
Niche product for now, may improve with refinement of price/size but I personally would like to "walk" through many sets from 2001...
Who was the girl laughing in the background?
So AVP was his 1st headset try on? That sad to hear some one say "Wild wide FOV", when it's the lowest FOV headset out there ever.
Not quite. I manage lab with a dozen HoloLens 2 headsets and their FOV is a pretty pathetic 70 degrees. Pretty poor for headsets that retail at the same price as the Apple Vision Pro which is far better.
@@andrewfranklin7087 I see.
So nothing from -
Oculus?
Valve?
HTC?
Varjo?
And especially Pimax? The older 5k and 8k could go up to 200°.
@@andrewfranklin7087 so, no, you haven't tried anything else besides those 2 being the lowest fov headsets out thre. And yet you chose the words "wild wide fov". Interesting.
Agree on most of what you said; still love my last generation 3D 4k OLED TV which is a marvel to watch 3D blurays actually :) I guess the killer app in our era will be remote presence (I avoid to call it metaverse), where video conference participants are "teleported" into a common room to be together in. It just needs one more generation, to overcome the current uncanny valley for avatars and to make the headset lighter, maybe offloading stuff into the battery box. Interestingly, the Vision Pro lacks this one app exactly, let's call it "Facetime Vision"! Maybe, didn't get ready in time but it is odd still as it would have the depth sensors, lidars and everything to recreate one participants space to be shared with all others. It would also have justified the price as for corporations, for all participants being able to sit around the same table, 4k$ per seat is nothing.
i feel like people who are over hyping the AVP just never tried a quest 3.
that includes apple lol
Apple always gets the credit even though all they do is regurgitate other peoples' products at higher prices. Makes me sick.
lol I have both they are really two different devices in the same form factor. My quest is more like a game console. My AVP is more like a computer.
@@TysheenoYou can set it up like the avp to 95% of it sounds like you haven't got anything Set up for spacial computing it's all there for the apps, quest has been doing g this longer than apple has they can drop everything they want just not been the main focus because gaining is where the money was to get headsets to people this spacial thing is a by product they are dropping but slower.
It's all inthe works that's why it's abetter product for the sake of some screens and better cameras this would have made the avp look silly on release imagine if meta dropped a quest 4 with these items and charged 1 k to cover it because that all that's needed to match the clarity of the avp the fov is crap on the avp smaller fov easier to get the clarity what would have been impressive is if they dropped the highest fov with the Same clarity because that's what the top boys are doing not this 2012 stuff apples.doing.
They don't have a clue just selling high priced item to rich people if they knew what they was doing they would not have the silly gimmicks making the headset heavy and having wires like your a puppet on a string🤣
We all know what the avp clarity will be like we are all used to the upgrade paths of headsets and theain areas ect released upgrade is better screens and cameras and tracking.
AVP will be out of date in no time if you want to see how far xr4 is that is better than avp will tell you where the sector is but on massive fov.
Sorry but I don't see them able to stay relevant it's going to be money down the drain the users will be too low and the prices too high.
If they drop a lower prices item it will lack what they have already done and drop back down the market.
The headsets are old now in the sectors that's why it was a calculated drop it had to be done before anyone dropped the high Res screens that are ready to be dropped.
AVP is a quest 4 pretty much just on apple op system thats it in a nutshell.
The apple sheep really showed the world on this release that marketing and the cult is what keeps apple going and it's worrying with the tech that's already out there is not even recognised is a joke.
Apple are leechers and copy cats that's all they can do once they are in the sector.
The avp is going to be a very slow death from now no upgrade path for at least 2 years everyone on the sector will have better clarity with new screen and the avp is a locked down apple fan boy system the rest are the real stuff worth buying.
Very good analysis Professor, maybe the demo hurt your nose because it wasn't a perfect fit, I wear my Vision Pro for hours at a time and it doesn't really bother me, some minor adjustments here and there and I'm fine. Weight is not a problem either and I even built the Dune Lego set using virtual instructions and having to look down to put it together, I use the regular head band. The Vision Pro is now my main Mac, I do use an Apple Magic keyboard for convenience depending on what I have to do, let's face it, until Siri 2.0 is launched voice recognition still makes a few mistakes. Overall this is the best product I've tried in a while and we are at version 1.0, exciting times ahead.
That an interesting take. The current Vision Pro v1 is merely a developers version and think it will need at least 3 iterations for it to be widely adopted. Big number one, addressing the greatest complaint, and that is weight. Samsung, Google and Qualcomm has teamed up to bring out their copy of the Vision Pro, but since has scrapped their version and start again as soon as apple announced theirs.
I watch iFixIt tear down, and there are tons of connectors & screws. V2 will have them integrated to each others, negating the need for screws and connectors, lighten up the weight for sure. I'm willing to be half a pound less. I have the iPad v1, and it weights a ton. It has thick back plate. These days iPad weight aren't even close to the v1 iPad (still sitting on my bookshelf).
Interesting topic. However I still like 3D movies. Thinks can get bigger if the glaces get like normal glaces. Or if more dimensions are projected, like feel and smell. Or interactive movies where you are a part of the movie, a kind of advanced gaming. Other thinks that are interesting is design. You can see directly how new furniture looks like at home, or a new garden design. I saw once at a technical event a version of kitchen designs where you could choose from.
Turn up the volume! Sheesh! Why can't UA-camrs get the volume level right?
You shouldn't need to reach for the volume when an ad plays!
It's a shame that proper 8K 3D 180 VR cameras aren't widely available or cheap for consumers.
Thank you for this great take! I appreciate the historical background, learned a lot. I have an Apple Vision Pro, and feel like this is something different from anything that’s come before. I think it’s a combination of the incredible dual processors and top end cameras; Taken altogether, there’s an experience here without compare. Reducing the weight of the AVP + Reducing the size of it on the face are important hurdles to get over for greater mass adoption. The current size and weight create a device that is socially isolating… Like trying to have a conversation with someone wearing tinted ski goggles.
But, seen from another point of view (intentional) the classic stereographic card systems appeared in the mid-19th Century, and remained popular in that form until after WWI, and arguably until later. So there's a certain amount of historical false compression going on here; and given that the entire history of personal computing isn't yet half as long as the period of stereography (leaving out the ViewMaster era, another 30 years), I think even a ten year lifespan of a product like the Vision Pro would be more than justification for a company like Apple or Meta to go all in on it.
Lovely
I think it will be great for education, especially self-education, say like you're learning biology and how blood flows in and out of the heart.
“History tells us people are not willing to endure…”. I don’t know, being Apple, it’s (much shorter) history tells me people will endure, haha. I still think it’s going to be a niche product, at least until it’s almost invisible like a pair of glasses, but others like the Oculus/Quest are pretty common and popular, and here to stay. The thing about Apple is that it’ll definitely make more people aware of it, and probably boost the sales of Quest 3 even, haha. I believe we have finally reached the era of AR/VR, and I’m excited for it!
The first thing i noticed was the Maori dictionary
I think the vision pro is more confortable than previous methods. But my wallet still experiences discomfort.
i have motion sickness just looking at the price
Yet it’s not the most expensive VR headset out there. There is one on the market now for $9500.
It's actually inline with other Apple offerings, but the technology inside is so cutting edge that most people get sticker shock. That said, the Apple I cost $666.66 (I kid you not) which is roughly $3500 in today's dollars and look at Apple now.
Stevens talking about the vision pro like it’s the worlds first VR/AR device
I thought I was watching Apple Vision Pro Coursera.
Apple's focus could have been on scratchless front shield to protect the camera lens and not project a false image of the eyes just for what exactly.
I don't think the front facing lenticular screen shows an avatar of your eyes, it's just a video feed of your real eyes. So no "creepiness factor" no uncanny valley... that was your imagination ,.. you just transposed the facetime persona's scan with the eye vision lenticular passthrough
Is mostly enduring the discomfort of losing 3500 dollars for a gimmick with almost no dedicated apps
You said there is parallax in the 3d videos, but 360 Vroomers on youtube with nearly 30 years experience of shooting 3d said there is no parallax. I wonder who is right?
I’ve been talking to the White House through social media telling them they really need to be studying the effects of VR and AR on the mind because it’s already to the point where you feel like you’re on acid when you’re in the headset and it’s going to get worse the headsets get better. We need to be careful about what we feed ourselves. 0:19 geek. I would’ve never thought a professor had a geeky hobby also 😂. Can’t it be a regular photographer like the rest of us you have to do it stereoscopic 😂. I’ve had a couple of stereoscopic cameras myself, and it was the last time when we went to the 3-D TV phase. 5:38 if you take that weight and put it directly centered on the top of your head, it gets to be a lot more manageable. I just changed headbands on the quest three to Bobo, VR and now the headset is sitting on top of my head where the face plate barely even touches my face and it’s much better. This is the most comfortable headset and strap I’ve owned out of a half dozen. Someone can make a head strap for the Apple vision and resolve this to include putting the battery on the back with the cord wound up. It at least work for part of you until we get lighter headsets. Where is our graphene at? LOL 6:15 I would refer to that as a glancing fake : ) 7:46 I’ll sell you a set of 10 rings at $200 apiece since it’s an apple accessory that will give you haptic feedback when you move your finger 😂. Wait till I get you all geared up one day with wearables to the point that you can barely walk down the street and you have to pull a battery cart😂
My favourite take on the Vision Pro.
You omitted Apple's greatest innovation. They have designed their APIs so that if you are viewing a web page on the Internet in the Apple Vision Pro, the website does not know what you are looking at. (The location of your eyes on the browser cannot be determined by the website, unlike how currently they can determine the location of your mouse in your web browser on your Mac or PC.) This is an element of privacy, and it's something you don't speak about or value. But millions do care about privacy, and that will be a huge differentiator between Apple and everyone else. No other developer of VR displays will value privacy, and this will give Apple a huge advantage for at least ten years.
Ask a distinguished Harvard professor and leading intellectual to evaluate a product and you'll get an explanation that sounds like it's from a distinguished Harvard professor and intellectual.
another question is: how healthy is it to look at this for several hours a day. short distance looking at two screens might impact eyesight and your vision in the long run. i see use cases for architects and product designers, but as apple is too aggressive locking their systems down, i doubt the vision pro will succeed in that department, same with gaming. apple is too unopen source - that is why as a first gen iphone user switched to android years ago. i do not see the "killer" app nor do i see apple doing enough to encourage devs to create apps for the vision pro.
I agree with admitting there are problems with user adoption with the AVP even considering future versions. However the technology, form factor and even delivery will evolve and this device really is just for prosumers / developer kit. There's a much wider context here that is unknown to folks just evaluating this headset and that's working with content in a spatial environment which in an inevitable path which will not dissapear, it will just evolve and Apple are Meta just getting aquaited with that relatively speaking.
Really good explanation Steven, many thanks. I believe that the killer app use for this product will be the ability to talk perfectly 3D face to face with people remotely. The recent interview of Mark Zuckerburg recently by Lex Friedman using the cutting edge META scanning technology is what the Vision Pro needs in their ecosystem. It will be amazing. The first company to democratise this technology will become the market leader.
The professor is right, and history repeats itself. It's neat, but people are not willing to go through the discomfort and sacrifice comfort over some 3D viewing. We already live "3D" so we're good, it's a novelty and it wears off. VR games however....
He needs to try more devices.
Can’t wait for the QUEST 3 fanatics to bash his opinion cuz nobody cares about their plastic of choice.
PTSD will be a thing from photorealistic games.
Don't think you can compare the Vision pro with those antique things...even the modern 3d glasses are no comparison at all
Don't think that we should judge the success or potential failure by the 1 generation of this product
The success of all technical inventions is the mass of content for a whole bunch of people. Not only creators, not only rich kids.
If UA-cam will be an immersive content place, and phone cameras and mics could create immersive contents where you can be life wherever you want ... concerts, holiday places, practical lectures ... the size of this thing will be smaller in years to come
Think of it as generation 0 rather than generation 1. It is the Apple I in a wooden box: that first model only sold 175 units and yet launched what is now a $3 trillion company 48 years later, and none of the current products look anything like a hand-assembled hobbyist computer placed in a wooden box.
need a little work on your audio...
People are so taken over by vision Pro hype that they are forgetting there is already a successful headset (Quest 3) with a thriving community 😊
When facebook haters use and defend the headset you know they are doing something good😏
did this guy actually say "wild... wide field of view" three times in a row?
The professor failed to mention Viewmaster.
He said "killer app". Does this guy listen to Nilay Patel?
I don’t know who Nilay Patel is, but I know the phrase “killer app”. Not sure where I got it from, but I think it’s out there in the ether days when talking about new tech.
@@willmosse3684 Yeah I suppose so. Nilay is editor in chief of The Verge. I’ve heard him say it a lot in reference to Vision Pro.
It is not logical to compare toys and high tech computer hardware!😮😮😮
In conclusion; expensive toy destined for a drawer
It depends on who you are and what you do. Some believe as the professor does, and others have already incorporated it into their professional work-flow and consider it indispensable.
I mean at some point you really have to ask yourself, what problem does this solve? I honestly can’t see any problems this solves, or at least any problems not created by VR headsets in the first place. Sure the tech is cool, but I’ve watched enough Black Mirror to NOT be looking forward to the day when we all wear contacts to augment what is a pretty fine analogue experience of reality as is. I don’t think this tech will thrive, despite the hype behind it, like the dead metaverse before it this doesn’t work because information is easier and faster to access in 2D, it’s simply a more efficient interface and info tech is about efficiency and ease of use. I don’t think Jobs would be too enamoured of the product either, he was for innovation, of course, but innovation that the customer wanted, not innovation that the company tells you to want, when he came back to save Apple he dispensed with almost every product the company at that point was making to FOCUS it. I think this piece of hardware soundly falls into the latter category of product, society isn’t crying out for a more immersive ‘reality’ in anything but gaming. And this is NOT a gaming focussed product in any meaningful way.
Listening to this you would think that the Apple Vision Pro was the first VR to hit the world. It's just a VR headset. And "3D" is all he's talking about regarding this? How about when you turn your head the whole scene changes giving the illusion not of 3D but of literally being someplace else? This is a Harvard professor's take on VR? Sad.
Why would I want to be immersed in a random video? I think this might be good foe surgeons, or people looking for leaking water pipes..
Oh my there is a massive landscape of opportunities waiting for Apple and its developers. Innovation and change can be unsettling for some people. Is there going to be a part 2 with your conclusion? How long was your demo or do you own a Vision Pro? I actually own a Vision Pro and I find this new technology fascinating, realizing that this is generation #1. Just like the iPhone when it first came out we were all wondering why Apple was making this new and different cell phone. It was certainly difficult to use. The iPad felt like it would flop as well, because we all know how much better our computers accomplished our work. Be patient... and know that there is much more that will evolve out of this new technology. Examples: Being immersed in a building design, being present with another person while they are traveling, seeing a place you simply cannot go. My experience as an owner: Apple Vision Pro has an impressive, immersive experience of "I am really there". I was never disoriented, nor did I experience nausea, I simply really enjoyed every moment.
"a massive landscape of opportunities " name a few... besides the ones you mentioned that are gimmicks. " Being immersed in a building design" Did you ever design any buildings? understand the process? "with another person while they are traveling, seeing a place you simply cannot go." those things were already possible, yet people didn't want them much. 3D technology for immersive learning isn't new, I was using it in 2000 already! and didn't have as much value as people think it may.
Harvard Professor vs Mark Zuckerberg
This is audio is really difficult to hear. Too quiet.
Turn up the volume on ur device. Ur welcome 👍
This is writing is difficult to read
turn it up genius
Hence the subtitles on screen… I can imagine how it feels sitting in his class, but that’s a pretty good speech
It sounds fine
I expected a video with a psychological perspective on a world in which people rather virtually “expand”, “change” and “enhance” how they perceive the world instead of actually enhancing the real world, but apparently who cares about that…
I wanted a 3D tv so bad and still do and still mad they don’t still sell them. People are complete idiots.