Master Spatial Video: Vision Pro & Canon Dual Fisheye Lens Workflow

Поділитися
Вставка
  • Опубліковано 2 жов 2024

КОМЕНТАРІ • 187

  • @MichaelDSwanson
    @MichaelDSwanson 7 місяців тому +25

    Great video as always, Hugh! Thank you for highlighting my spatial command-line tool. I'm glad that it worked well for you. FYI that I added some documentation yesterday, and the link can be found on the download page that you mentioned (and linked-to in your description).

    • @hughhou
      @hughhou  7 місяців тому +1

      Thanks again!

  • @alfredoistic
    @alfredoistic 7 місяців тому +4

    UA-cam’s support for 3D content, especially for side-by-side uploads, seems to have changed. Previously, there was an option to checkmark videos as 3D content directly on the platform, but this feature appears to be no longer available. This change has made it difficult for creators who wish to upload and present their content in 3D format. How can I do that on UA-cam?

    • @hughhou
      @hughhou  7 місяців тому +1

      Yes. I have several tutorials on this topic - but I will make a follow up soon and add Spatial Video support

    • @alfredoistic
      @alfredoistic 7 місяців тому

      thank you brother and happy Lunar New Year@@hughhou

    • @0LoneTech
      @0LoneTech 5 місяців тому

      Not only is it no longer available to mark stereoscopic content, they destroyed the existing tags, breaking most classic "3d" videos. They later made exceptions for a handful like OK Go music videos, but all who are not getting the elusive support have to reupload with embedded metadata, losing links, likes, views, comments etc.
      If you remux into Matroska format, you can set stereo_mode, e.g: ffmpeg -i input_file.mkv -c copy -metadata:s:v:0 stereo_mode=1 output_file.mkv

  • @hakanyucel1639
    @hakanyucel1639 7 місяців тому +25

    It can be only ONE VR King!!! And it's Mr HH 🤩

  • @CarlAmadeusHillerFilmmaker3D
    @CarlAmadeusHillerFilmmaker3D 7 місяців тому

    hey Hugh, thx for this amazing video again!! Just one thing - it seems that your Mistika code for 10% off doesn't work?

  • @jaykeni
    @jaykeni 7 місяців тому +3

    Spatial video is cool, but I don’t understand why, if you have the capability to capture VR180 with the Canon R5c/Dual Fisheye Lens, you’d want to crop it to a small 3D rectangle?

    • @AdamKontras
      @AdamKontras 7 місяців тому +3

      Yeah, if you know what you're doing... there's no way you go back to spatial video. Well produced VR180 will now impress those with an Apple Vision Pro even MORE. BTW - the moon player is the closest to being able to play local VR180 files perfectly. There's a strange warp with the playback though... makes everything look like it was filmed on a giant ball. Bummer. But it should be fixed soon.

    • @hughhou
      @hughhou  7 місяців тому +2

      As Adam said. But most people don't know what VR180 is - just look at my video comments lol. Spatial Video is a gateway drug for them to get into VR180. But from 2D to VR180 is a big jump. Apple think that, not me.

  • @TheVirtualTim
    @TheVirtualTim 4 місяці тому +1

    I normally really appreciate videos that go through workflow and best practices … but this was PAINFUL to watch. 25% of the way through the video and you are still just rambling on. Please CURATE your content … find a way to concisely make a point and move forward without re-re-re-making the same point. I stopped the video at 30% of the way through and decided to leave a constructive comment. It sounds like you know what you are talking about … but aren’t able to convey that information to others.

    • @hughhou
      @hughhou  4 місяці тому

      Thank you for the feedback. I will take into the account. Some of my viewers think I am going too fast on the key knowledge and some more experience viewers think I am repeating myself a lot. I do need to strike a balance to make everyone happy. Maybe better chapter list will help jump to session interests you the most?

  • @TristanMark
    @TristanMark Місяць тому +1

    Hey Hugh, thanks a lot for this video. I'm facing an issue after i render the video on mistika. There are these unusual reference dots appearing. Is it becuase im on a trial version ? how do i fix it ?

    • @hughhou
      @hughhou  Місяць тому

      That sound like more a GPU issue - hardware rendering bug... mmmmmmm

  • @alejandrochueke8575
    @alejandrochueke8575 3 місяці тому +1

    hi Hugh, how ru? i hope you doing well. I am not a professional in filiming . I am in toy business, and after expeireniced the apple vision pro apple demo, i was thinking if there is any way, i can take video or picture of my business toy showroom and show to my customers anywhere with the vision pro. Making an inmersive exprience so they can see and even select some of my products. Is there any profesional camera, i can easly do by myself? or if i need to hire a professional servise? i will really much preciate your guidance

    • @hughhou
      @hughhou  3 місяці тому

      I will start with just your iPhone to test water before investing immersive camera. But Canon is what I used :)

  • @ActionKingOfficial
    @ActionKingOfficial 7 місяців тому +1

    Which camera is better to use to record real estate tour videos for real estate agencies 180 or 360?

  • @trancemuter
    @trancemuter 7 місяців тому +1

    can you please confirm with me if the Spatial Video on the Quest plays back with the parallax effect it has in the Vision Pro? the Meta’s demo video showing off the new Spatial Video playback does not have the parallax effect to my eyes, the only thing it has is the blurred borders but it’s just a regular 3D video. thanks!

    • @hughhou
      @hughhou  7 місяців тому

      v62 is not out yet? I can't test it until it is out. Unless I missed the update?

    • @trancemuter
      @trancemuter 7 місяців тому

      I got the v62 update a few days ago and I tried it, looks like a regular 3D with blurred borders placed in the home environment with a little bit of dimming of the surroundings, it is pleasant to look at but there is 0 parallax effect on it as far as I can tell. I thought that Apple figured out how to process 3D footage with AI and introduce a little bit of a parallax effect to make it look like a pseudo volumetric video, even if it is very subtle it would go a long way to add realism and reduce the nauseating effect of regular 3D, I don’t have an AVP so I have no idea how the spatial video looks in it but I am pretty sure that is not as exaggerated as their promo video shows, am I wrong? how does it look to you on the AVP headset? An other interesting thing is that Boz, the Meta VR boss, on the Meta demo video explains what their “spatial” video is and it was nothing more than explaining how 3D video works in general, no parallax was mentioned in it and the video itself is just a simple 3D video on the Quest 2 I have. So are all the rest of the demo clips. What they did is they added a native 3D video player to the Quest OS so it can play the 3D videos recorded on the iPhone 15, nothing more imo, they are riding on the AVP hype… lol, again, there is no parallax effect in it at all, neither does your demo spatial video that I downloaded and also played through the Meta TV portal. My iPad pro recognizes it as a spatial video in the Photos app and it even displays a little icon confirming that it is that. Unfortunately I could not upload it to the headset through the Meta Mobile app as Meta is suggesting (they are very sloppy with programing in general btw), there is no upload button yet in the gallery on the app, according to reddit posts many people have similar experience, looks like they are rolling this feature out in increments. Maybe there is parallax effect on the Quest 3 or Pro but not on the Quest 2? idk, but it was underwhelming to be honest, I’ve been using the Quest 2 to view 3D videos and pictures for years now, I am a 3D photographer, so I got very exited about the possibility to record 3D video on the iPhone and even more excited about the “spatial” aspect of it but that is not coming through on Meta’s implementation of it. Confusing for sure, but I will get to the bottom of this! 😂🤣😅 Thank for your videos, they are very useful for 3D creators!

  • @garychung_plane
    @garychung_plane 7 місяців тому +3

    These days, I've been watching your video over and over again for three or four hours a day.
    I've been under the illusion that I know you for a long time.
    I'm always thankful!

    • @hughhou
      @hughhou  7 місяців тому +1

      Wow, thank you! Hey you do know me now!! If you watch last 3 of my videos, you have been in my house and see Kimchi 3 times lol.

  • @barbertekk
    @barbertekk 7 місяців тому +3

    This is the video I've been waiting for. I bought the r5c with the dual fisheye 2 years ago. Picked up the 1tb vision pro and was hoping I could use it all together!

    • @hughhou
      @hughhou  7 місяців тому +1

      Now this is the KING of spatial video as well, not only VR180. Spread the love so more Dual Fisheye owner know they just triple the value of their investment

  • @nextcurve
    @nextcurve 7 місяців тому +1

    I find that the iPhone 15 Pro Spatial Video is better at close quarters than the AVP. Anyone else notice the same thing? I also like the 16:9 aspect ration versus the square off of the AVP.

    • @hughhou
      @hughhou  7 місяців тому +1

      Yes! We actually explain it why on this video: ua-cam.com/users/shortsUbDPpcwlCh0

  • @Earther地球玩家
    @Earther地球玩家 3 місяці тому +1

    Hello blogger, I saw the 360 ​​panoramic photos you took on immerse. They are very high-definition, but the pictures I took using DJI Mavic 2Pro & Insta360 x3 are not clear. I want to know how you did it. Looking forward to it. You can answer and reply🙏

    • @hughhou
      @hughhou  3 місяці тому

      We have lots of workflow on 360 panoramic photos. Here is a good one to start: ua-cam.com/video/hg1m-GlYnuI/v-deo.htmlsi=wQbuSD5tOjW2AaF6 / ua-cam.com/video/vb8-2gQYp8c/v-deo.htmlsi=tvDvJSqIeOg-PMnK

    • @Earther地球玩家
      @Earther地球玩家 3 місяці тому

      @@hughhou thanks so much!!

  • @TechWithTrey
    @TechWithTrey 7 місяців тому +1

    Hi! I tried recording 3d vids on my quest 3 but they come out smooshed. Do u have any tips?

    • @hughhou
      @hughhou  7 місяців тому

      New v62 will have lots of improvement. Wait till end of this week for update and try again?

  • @nayanmisra8447
    @nayanmisra8447 7 місяців тому +1

    is it possible to do the ffmpeg spatial video encoding part of the workflow in an windows pc?

    • @nayanmisra8447
      @nayanmisra8447 7 місяців тому +1

      also is it possible to view any regular 3d sbs video as a spatial video on the meta quest?

  • @JimboSkinner
    @JimboSkinner 7 місяців тому +1

    Help Hugh! I’m using the 7 day trial of Mistika and the rendered output file has lost all the detail of the original file. The original is an 8k file, and I rendered to two side by side 4k images per your guidance, but Mistika just destroyed the detail in the image. Is it the free license or do your encodes also lose a lot of the image detail? Thanks for the video!

    • @hughhou
      @hughhou  7 місяців тому

      Mmmm... I render in ProRES from Misitka, and then I added VFX and Graphics on Davinci Resolve - maybe even light color grade. So try ProRes render but not compressed H265 / H264? Resolve is my final step.

    • @JimboSkinner
      @JimboSkinner 7 місяців тому

      @@hughhou thanks! I think part of the problem is the conversion to rectilinear expands the video far beyond the 4k image box, and so only about half of the image is used, as it stretches. So resolution is lost. I am trying to do this expand in Premiere, where I can control how much resolution is lost.

  • @Kougs
    @Kougs 7 місяців тому +3

    That was a very long process. But I got my first one done. It seems to be the only way to accomplish this at this moment. Rendering left and right eyes and recombining…
    It’s always good to learn the manual way first I agree! Thanks Hugh!

    • @hughhou
      @hughhou  7 місяців тому +3

      I am sure it will get easier in the workflow. This is week 2 of AVP lol. I still have lots to learn. We are in the same boat. When I have new trick I will share it immediately

    • @JimboSkinner
      @JimboSkinner 7 місяців тому

      Did you notice a loss of detail after the Mistika render? I’m using the 7 day trial version and the render (transcode actually) looks like half of the resolution of the original

  • @sowelllm6751
    @sowelllm6751 7 місяців тому +2

    Hi there,
    Thank you for providing such valuable insights!I have some questions that I'd love to discuss further with you:
    1.Cost vs. Performance: Considering the significant price gap between the iPhone 15 Pro Max and the Canon EOS R5 C Mirrorless Cinema, how do they compare in terms of performance and value when it comes to producing high-quality spatial video content for VR?
    2. Software Optimization and Workflow: How might the iPhone 15 Pro Max leverage its computational capabilities to streamline the process of capturing and editing spatial video for VR, especially compared to the Canon camera setup? Furthermore, considering Apple's expertise in software optimization, once the files are viewed in the Vision Pro, could Apple employ dedicated software enhancements or upscaling tricks to further enhance the final result?
    3. Editing Complexity and Apple's Approach: Editing and preparing spatial video can be quite intricate, particularly given Apple's current lack of a dedicated editing tool in Final Cut for their new spatial video format. Have you heard any rumors or insights about potential developments in this area that could simplify the editing process?
    I eagerly await your thoughts and insights on these questions. Thanks again for all your invaluable help. And keep up the amazing work!

    • @justincruz8352
      @justincruz8352 7 місяців тому +1

      iPhone spatial only shoots in 1080P

    • @hughhou
      @hughhou  7 місяців тому

      1. Consumer vs Professional quality. This should be always RENT than own. And get your clients pay for most of the cost. Hint commerial level. You can certainly use an iPhone to shoot commerials these days. But this is more a robust workflow.
      2. I have a iPhone only workflow already which is in Davinci Resolve - link in this video description. FPC has no news so far. Crazy!
      3. Yes. Apple is working hard on FPC to support Spatial Video. It is matter of time now. Right now, Resolve can do most of the thing and it is almost like free (if you get a BM camera or products).

    • @sowelllm6751
      @sowelllm6751 7 місяців тому

      Got it, thanks! @@hughhou

  • @sidgesrione
    @sidgesrione Місяць тому +1

    Thanks! Do you have a tutorial like this to create Spatial Videos on Davinci Resolve from R5C?

    • @hughhou
      @hughhou  Місяць тому

      Yes right here: ua-cam.com/video/kwVlVEXg3og/v-deo.htmlsi=vAdFzHD0R0DwOApd and this for encoding: ua-cam.com/video/PJWsscXmJiE/v-deo.htmlsi=E2clcH6p7PyFxSQ7

    • @sidgesrione
      @sidgesrione Місяць тому

      @@hughhou thank you. Just finished watching and it's an excellent one for VR180, but only mentions Spatial video conversion at 15:40
      Still an excellent video!

  • @wearemxr
    @wearemxr 7 місяців тому +1

    Cant find the link to the video to try on my vision pro. Where is it?

    • @hughhou
      @hughhou  7 місяців тому +1

      Here. It is official release now as a film: ua-cam.com/video/NN8eBxTNgB0/v-deo.htmlsi=CbApKSDHEdrzFHWF - download the free trailer. The tallking head is iPhone and the film itself is R5C - you can even see the image quality different here! Great for educational purposes.

  • @nextcurve
    @nextcurve 7 місяців тому +1

    Very well done and informative. I think the big thing that Apple did especially with the iPhone 15 Pro is consumerize and grossly simplify the workflow you showcase in this video especially taking the main camera and the ultra wide lenses to compose the Spatial Videos ready for viewing on the Apple Vision Pro. Keep up the great work!

    • @hughhou
      @hughhou  7 місяців тому +2

      Indeed so everyone can try Spatial Video - which make brands aware of the format and want to do it professionally. Then leads to more jobs for creators - everyone win in the end! Thank you!

    • @nextcurve
      @nextcurve 7 місяців тому +1

      @@hughhou It makes more of us creators. But I'm personally excited to see what pros like you do in creating new content with Spatial Video and other immersive formats. I'm hoping that Apple and other's produce cinematic Spatial Video (not VR180). The display quality on the AVP is so impressive. That is what really commands that big price tag of the AVP. Micro-OLED is not cheap. Apple had to pay through the nose. They will eventually make the technology more accessible for others in the next couple of years. It's part of the Apple catalytic formula.

  • @AnilGorentla
    @AnilGorentla 7 місяців тому +2

    Hey Hugh, big thanks for this video ! It's incredibly helpful. After extensive research for a solution, I finally found it in your video.

    • @hughhou
      @hughhou  7 місяців тому

      Glad it helped!

  • @JasonWendling
    @JasonWendling Місяць тому

    Photos: I'm interested in creating spatial photos for the AVP. I can't seem to find any info on how this works with the Canon dual fisheye lenses. How difficult is the workflow?

  • @JamesHustler
    @JamesHustler 7 місяців тому +1

    Can you render with software to get better quality instead of hardware? Like x265 vs video toolbox? It makes such a big difference with H265, wondering if possible with MV-HEVC

    • @hughhou
      @hughhou  7 місяців тому

      H265 is HEVC - so yes in theory? MV-HEVC just has 3D wrapper on top of HEVC.

  • @lucanv
    @lucanv 7 місяців тому +1

    Hugh, do you know a way to inject vr180 UA-cam metadata without the creator app? I am trying to inject metadata at 8640x4320 resolution and the app gives me an error

    • @hughhou
      @hughhou  7 місяців тому

      Yes. Premiere natively support it! I use Premiere still on render.

  • @Flat2VR
    @Flat2VR 7 місяців тому +1

    Great tutorial, thanks! Did you say that you knew of a way to play 3D SBS (non 180 / 360) without the spatial format in AVP? I couldn't find a way to do that yet (and none of the apps like Moon support it yet either)

    • @hughhou
      @hughhou  7 місяців тому

      I think you still need to tell AVP this is 3D video in metadata. Just don't inject spatial metadata.

  • @rubenlazaro726
    @rubenlazaro726 7 місяців тому +2

    Thanks hugh! Very interesting tutorial. Will you provide some tutorial for customized 3d rig for shotting spatial video. Such 2 Gopro for example. I already have the Canon R5C but i think we can produce high quality spatial video in another 2D regular cameras. As long as we can sync it or have a 63.5mm IPD.

    • @hughhou
      @hughhou  7 місяців тому +2

      Oh yes! That is coming next! 2X Insta360 or GoPro!!!!

    • @rubenlazaro726
      @rubenlazaro726 7 місяців тому

      🥰We know that you are always prepared to surprise us. You're the best!

  • @GrandProductionsMedia
    @GrandProductionsMedia 7 місяців тому +1

    I believe its Clog 2 not 3 as the R5 & C isn't not clog3

    • @hughhou
      @hughhou  7 місяців тому +1

      I shot at C log 3 why you think it is not C log 3?

    • @GrandProductionsMedia
      @GrandProductionsMedia 7 місяців тому

      @@hughhou wow yea I guess I was misinformed from a video, was clog 3 supported on The r5c since the beginning? I just noticed in the menu on mine yesterday 🤔 I film mostly on my mavo.

  • @artenman
    @artenman 7 місяців тому +1

    Why does this guy talk like he's DJing at EDC?

  • @jeromelozano
    @jeromelozano 7 місяців тому +1

    Thank you Hugh for this very interesting video! You always manage to find great workflows that are a big help for creators 👏.
    In my opinion, spatial videos are not very convincing; I find this technology less immersive than 180 or 360 videos that envelop the viewer, but that's just my opinion

    • @hughhou
      @hughhou  7 місяців тому +1

      Glad it was helpful! Yes for people know VR180. But for massive audience out there have not heard of VR180, 3D Spatial Video is their gateway drug onto immersive storytelling. My hope is more people come here and understand the format and what is out there. And slowly move them into VR180 - the true immersive format - also pushing by Apple and heavy by Meta and Pico.

  • @legacy_mens
    @legacy_mens 6 місяців тому +1

    объясните простыми словами- это устройство демонскрирует 3Д сепарацию кадров, для отдельных глаза как в 3Д кинотеатре через поляризационный или анаглифный метод ?

  • @CinemaNinja
    @CinemaNinja 6 місяців тому +1

    Thanks for your videos! Can we get an updated version of this coming from premiere with the canon plugin? Not sure what’s best codec to render to from premiere before doing the terminal steps…

    • @hughhou
      @hughhou  6 місяців тому

      Premiere does not support 3D editing (old school 3D) so in Adobe is hard. But I will let you know if I figure out how as I am pretty good at Premiere and After Effects.

  • @toysfilms7328
    @toysfilms7328 4 місяці тому

    great job as usual . but the images from mystika are really bad, a lot of artifact, a lot a colored dots i use the demo version of mystika any advice? thx

  • @Jack-bc9dh
    @Jack-bc9dh 5 місяців тому +1

    Another great video! thanks Hugh! However I don't find the video download link in the description, can you show it again?

    • @hughhou
      @hughhou  5 місяців тому

      It is on my patreon: www.patreon.com/HughHouFilm

    • @Jack-bc9dh
      @Jack-bc9dh 5 місяців тому

      @@hughhou Thank you!

  • @lixinzhao6987
    @lixinzhao6987 7 місяців тому +2

    这副360眼镜真好!我们喜欢!❤

  • @thematterworkstv
    @thematterworkstv 7 місяців тому +1

    Wondering - Have you noticed a big difference in the quality and playback of your VR180 & VR360 videos on the AVP vs the Meta Quest, Hugh? Thank your generous commitment to your channel.

    • @hughhou
      @hughhou  7 місяців тому

      To be 100% honest, not really lol. AVP color is better and playback is smooth without refresh rate issue. But the quality is not like night and day different. But this is prob b/c the solution is not official yet. When Apple provide their Apple TV pipeline, then will be huge different!

  • @MorzakEV
    @MorzakEV 7 місяців тому +1

    I love Kimchi. Great name for a great doggie. My dog is called noodle!

    • @hughhou
      @hughhou  7 місяців тому +1

      Lol thank you and Kimchi said hi

  • @Gorto68
    @Gorto68 7 місяців тому +1

    Where is the smaller "spatial" file generated from?

    • @hughhou
      @hughhou  7 місяців тому

      Sorry my director do not want me to put that out yet as that is part of this film: ua-cam.com/video/iAG2AN94tZA/v-deo.htmlsi=6IVvpZ4IJXWz-SJ3

    • @Gorto68
      @Gorto68 7 місяців тому

      Thank you@@hughhou -- I meant is that smaller file something that is generated from a workflow, or is that literally just a short clip.

  • @TheCoralClimb
    @TheCoralClimb 7 місяців тому +1

    Hey man, quick question:
    Have you ever tried to use two GoPros with the max lens side by side to get Stereo VR 180?
    Saw some samples online but wondering if you had any suggestions or concern that would steer me away from trying it.
    Thank you!

    • @hughhou
      @hughhou  7 місяців тому

      Honestly? I will not suggest it. Sync will be a nightmare as GoPro is not genlock sync and it will drift as rolling shutter. Great for people doing it but in practical shooting is hard to control. The drift can not be fixed in post.

    • @TheCoralClimb
      @TheCoralClimb 7 місяців тому

      Thank you very much for the reply!
      I was just trying to help a friend who need to shoot a music video in Italy and doesn’t have access to a Canon R5. So even with a remote that triggers both cameras, they’ll have sync issues…good to know, you saved us a lot of editing headaches!
      What camera would you try to get, even sacrificing some quality in favor of easy availability in Europe?
      Thanks a ton!

  • @spediegunz
    @spediegunz 7 місяців тому +1

    Does the parallax effect show if viewing on quest or in my case pc vr apps like virtual desktop or virtual home theater ?

    • @hughhou
      @hughhou  7 місяців тому

      I need to test v62 on Quest 3 to report back. In theory, Meta is trying to show the full potential of Spatial Video but I have not have time to test it out yet.

  • @IMMERSIVA-PROD
    @IMMERSIVA-PROD 7 місяців тому +1

    The best solution is Canon R5 + dual lens fish eyes ? Is any other solution with the best resolution possible ? Can it be streamed ?

    • @hughhou
      @hughhou  7 місяців тому

      I will have other solution very soon making a new tutorial on this topic. R5C can not do HLS streaming but this one can (and will work on Vision Pro if someone build the player app): ua-cam.com/video/jmOX6aHj8oI/v-deo.htmlsi=HxN0DCQmrWws7Hum

  • @rasmuseriksson6805
    @rasmuseriksson6805 7 місяців тому +1

    Great video Hugh! So money aside, if you would have all the cash in the world. Which system would you think you would use for spatial video for Vision Pro?
    2 x Red Raptors V/Sony Venice 2 in a 3D Rigg and the field of view of..? Appreciate it!

    • @hughhou
      @hughhou  7 місяців тому

      Just 1 V-Raptor [X] is probably what I will go for or dream to own one ... but a UA-camr can only dream lol

    • @rasmuseriksson6805
      @rasmuseriksson6805 7 місяців тому

      Haha Have you tried 6dof on it yet? 😅See that one, but renting is not always bad either!

  • @brettcameratraveler
    @brettcameratraveler 7 місяців тому +1

    Two questions:
    I know the Quest 3 can playback 16:9 framed Spatial Video, but can it playback VR180 (3D) as a Spatial Video? If so, which player?
    Also, I watched your spatial video episode and I'm still not clear on if the parallax effect is fake and simply moves the 16:9 frame around to match your parallax perspective or if it's almost but not quite volumetric video and closer to stereoscopic video that's been given a minor amount of fake volumetric depth using AI generated depth map.

    • @hughhou
      @hughhou  7 місяців тому +1

      1. You will need this tutorial to turn VR180 3D video into Spatial Video first then it can play back. VR180 and Spatial Video is TWO very different thing. It is like 360 video shot on 360 camera and reframe video crop from 360 video. / 2. There is huge debate in this topic. It is like 3D+ - not real parallax - but special treatment to make 3D look better in Spatial Video. It is NOT just 3D but it is not volumetric

    • @brettcameratraveler
      @brettcameratraveler 7 місяців тому +1

      @hughhou Got it. Thank you. I can see how it would help sell a more volumetric-like look without actually doing anything to the parallax of the original stereoscopic video.
      Ideally you'd want to add a depth map via AI and/or the lidar sensor to give it a more realistic parallax.
      Have you played around with Lifecast? It's volumetric video taken from the Canon dual fisheye and brought into Unreal. Would likely look even better in AVP than spatial video.

  • @MobileDecay
    @MobileDecay 7 місяців тому +1

    When I use Spatialify it gives me an mp4 file. Am I doing something wrong?

    • @hughhou
      @hughhou  7 місяців тому

      Not really. MP4 work as well btw but MOV can get lossless audio and way way higher quality!

    • @MobileDecay
      @MobileDecay 7 місяців тому

      @@hughhou Thanks!

  • @nadeemtron
    @nadeemtron 7 місяців тому +1

    Thanks so much Hugh! Just ordered the r5c with dual fisheye and excited. I have a question: this tutorial shows how to create a spatial video for use in apples rectilinear/square Photos app format. And you have many videos regarding 180 degree 3D video for the AVP - but does 180 degree video have all the parallax and “ultra real” benefits of this spatial video method here? I’m trying to figure out if I need to build a rig to capture depth data as a film and recombine in post for nerf/splatting solutions that provide more immersion when I start filming immersive 180 content next week. I guess I’m asking “how did Apple film its demo content in Experience Immersive?” Any guesses? Thanks for everything!! You taught me like two years of stuff in one week!

    • @hughhou
      @hughhou  7 місяців тому +1

      Immersive 180 on AVP is exact the same as on Meta Quest 3 which shot on this setup or similar like RED V-Raptor. There is no movement like spatial video. The best example is Alica Keys or Adventure series on Apple TV. That’s your reference from official Apple.

    • @nadeemtron
      @nadeemtron 7 місяців тому

      Thank you for being so personable and responsive!

    • @dlep2004
      @dlep2004 3 місяці тому

      @@nadeemtron Hi nadeemtron, follow up to your question, how has your journey with r5c and fisheye lens been? Did you manage to shoot immersive video & play it back on vision pro (not spatial)? I'm blown away by apple's demos (MLS, Alica Keys etc.), and want to create that by myself. Thanks!

  • @qingchen8399
    @qingchen8399 7 місяців тому +1

    我的MP4文件无法input,8K SBS

    • @qingchen8399
      @qingchen8399 7 місяців тому +1

      用spatial转换的时候,无法输入,这个工具是对分辨率有要求吗?

    • @hughhou
      @hughhou  7 місяців тому

      没有。是不是你的codec有问题?用handbrake来转换成h264?

  • @martenberkman1320
    @martenberkman1320 7 місяців тому +1

    Hello Hugh, thanks for the impassioned coverage! Hugh, do you have a tutorial to convert circular fisheye to 1:1 equirectangular, in DaVinci Resolve Studio? I would love to streamline this step, before stepping into Spacial. Thanks!

    • @hughhou
      @hughhou  7 місяців тому

      It is very similar on one of my old tutorial about defish Canon Fisheye using Fusion - it is one of my popular Resolve Tutorial on Canon Dual Fisheye lens. Same concept. Instead of 2 fish you get 1 fish here.

    • @martenberkman1320
      @martenberkman1320 7 місяців тому

      Thanks Hugh, found your video (ua-cam.com/video/2GW7nb47rB4/v-deo.html). Unfortunately I cannot find the KartaVR plugins for Resolve/Fusion available anywhere for download (the link goes to the Facebook page, which has not been active a couple years). Any idea where we can find them today? I am looking and will post here if I find anything. Thanks for any leads!

  • @silvertube52
    @silvertube52 7 місяців тому +1

    I would be more interested in comparing the CALF rather than Kandao Ego.

    • @hughhou
      @hughhou  7 місяців тому

      Good suggestion. Let me put my CALF to work!!!

  • @DellWolfensparger
    @DellWolfensparger 7 місяців тому +1

    Hugh, is there any way to use the BMD Ursa 12K for creating spatial video for the AVP? BMD has a huge following, and no one has presented a tutorial or even a guide. With that crazy amount of pixels, you would think there would be a way? I know there is an adaptor to make it compatible with the Canon EF mount. Thoughts?

    • @hughhou
      @hughhou  7 місяців тому

      I am actually super close to Blackmagic and their camera sadly is not RF Mount. RF Mount is only for Canon and RED. I use URSA 12K to shoot test for ESPN for boardcast, but 3D we need genlock sync and global shutter - which BM does not do.

    • @DellWolfensparger
      @DellWolfensparger 7 місяців тому

      I wish there was a 180 lens for this beast! @@hughhou

  • @trancemuter
    @trancemuter 7 місяців тому +1

    ok, the more I look into this spatial video thing the more it looks like it's a scam, there is no praralax effect in it the way apple showed in their presentation, it's the same old 3D video repackeged as something new; it's not; correct me if I'm wrong please! here is a video about this: ua-cam.com/video/xKxjjlY1Vxk/v-deo.htmlsi=nzaCScCqI_0GAfKB

    • @hughhou
      @hughhou  7 місяців тому

      I respect Mic but I don't think he is 100% correct on this one. I have extended experience on the AVP at this point as I have it from day 1 till now, in it prob more than 100+ hours. The source video is 3D yes. But the presentation is different inside AVP - not something I ever experience, especially when I code my own 3D video into Spatial Video as point out in this tutorial. AVP has eye head tracking to offset head movement in 3D to reduce motion sickness and a more immersive view. It is not a 3D video stuck to your face like current Meta or Pico (although this inspire Meta to update Quest to v62 firmware also roll out spatial video support - which they also do not think that is JUST 3D video). It is software magic, yes! Not camera magic but AVP tracking and software live rendering. But call it JUST 3D is incorrect.

    • @trancemuter
      @trancemuter 7 місяців тому

      is great to know that Apple managed to enhance 3D videos like this… but is the parallax effect as extreme as on their promo video? there looks like a real volumetric video with 6DoF… it’s hard to believe it is, that would be some crazy realtime AI video magic!

  • @proxiemail814
    @proxiemail814 7 місяців тому +1

    Great tutorial. But seriously, why is the dog on the kitchen table

    • @hughhou
      @hughhou  7 місяців тому

      Camera test! Kimchi love to be filmed!!

  • @metalograms9702
    @metalograms9702 7 місяців тому +1

    Thanks for that great tutorial! So when playing back the converted file on Vision Pro; do you have parallax effect? (thus 6dof). If this is the case, do you know if the depth is generated on the fly? or by Mike Swanson's tool, stored in the mv-hevc file?

    • @hughhou
      @hughhou  7 місяців тому +1

      NOT 6DoF - 6DoF is only available on VolCap or Game Engine. This is just optical illusion parallax effect using eye and head tracking on the AVP. It is more than JUST 3D but still based on original 3D video. And yes, this workflow add immersive view and "Apple Parallax Effect" (edge blocking and edge parallax). It will work on all 3D video. It has been confusing on this spatial video topic. I wish Apple just say this is 3D+ instead of Spatial Video.

    • @metalograms9702
      @metalograms9702 7 місяців тому

      @@hughhou thanks for the explaination! I was thinking maybe they uses their tof sensor or cameras to create a kind of multi layered video (or even using "Depth Anything" to estimate depth with AI). So it looks like its more about a good 3d integration in the passthough. I've tried the new "spatial video" on Meta Quest 3; does it look the same?

  • @arthurlyrio
    @arthurlyrio 5 місяців тому +1

    Congratulations on the video! Is it possible to stream online with this lens?

    • @hughhou
      @hughhou  5 місяців тому +1

      It is certainly possible. I am working on a easy to follow solution now but take me a while to R&D. Will ping you when I release that workflow.

  • @cinefitstudio2835
    @cinefitstudio2835 7 місяців тому +1

    So where is the link to the download of the spatial video of yours? ☺️

    • @hughhou
      @hughhou  7 місяців тому

      So the sample I used belong to my latest film. So I will release it when I finish the Spatial Video version on AVP. Director do not want to release it until it is correctly color graded. So it should be available no later than Monday. The full film! I will ping you here when it is out.

  • @yuanyuanfeng9118
    @yuanyuanfeng9118 7 місяців тому +1

    万分感谢老师的干货!请问下,这样制作出来的空间视频可以在vision pro里直接播放吗? 还是需要额外下载什么播放器?

    • @hughhou
      @hughhou  7 місяців тому

      不需要播放器-可以直接观看!

  • @jorgediaz4863
    @jorgediaz4863 7 місяців тому +1

    Recording en 3d? ? Price: apple vision +camera 3d?? 10.000 dolares ????? 😂😂😂😂😂😂

    • @hughhou
      @hughhou  7 місяців тому

      Yes But this professional level so you probably rent the camera and get paid BIG DOLLARS from your clients - hint, commerials quality or film quality production. If your client pay for your AVP and your salary, why not?

    • @jorgediaz4863
      @jorgediaz4863 7 місяців тому

      @@hughhou yes, recording for avatar 3 or 4 no?? 🤣🤣🤣👍

  • @user-yv6cj6df7b
    @user-yv6cj6df7b 7 місяців тому +1

    where is the link to download and watch the final video on AVP?
    ..id like to view it

    • @hughhou
      @hughhou  7 місяців тому

      I just realize the clip is part of my upcoming Spatial Video Feature Film - my director won't allow me to release it until launch - which is tomorrow! We are making the world 1st Spatial Film on Vision Pro (or at least we think it is the 1st ...)

  • @mjcuknet
    @mjcuknet 7 місяців тому +1

    So can the quest display spatial video from the iPhone?

    • @hughhou
      @hughhou  7 місяців тому +1

      Yes in v62!!!!!

  • @noel-issa
    @noel-issa 7 місяців тому +1

    Another great video!
    Have you found a way to view 180° 3D VR shot on the Canon Fisheye yet?

    • @justincruz8352
      @justincruz8352 7 місяців тому +1

      Moon player

    • @hughhou
      @hughhou  7 місяців тому

      Yes Moon Player right now. I am sure more to come.

  • @香仮夢
    @香仮夢 Місяць тому +1

    佳能配双鱼眼不知道要多少钱?

    • @hughhou
      @hughhou  Місяць тому

      $2000 美金 - 国内可能跟便宜。美国一般比较贵

  • @svenexenberger
    @svenexenberger 7 місяців тому

    Absolutely great work - as always! I saw the VR180 production from Italy on a Quest 3 yesterday. Wow! Great storytelling and quality. Is there a tutorial that shows how you achieved that wonderful cinematic look I am working with a R5C with dual fisheye. Besides wanting to know how to achieve that cinematic look I need to find the best way to record 90 minutes in a row and get the best quality possible for that very long recording time. Guess I will have to watch all your videos again.

  • @MattRowell
    @MattRowell 7 місяців тому

    I don't see the point of these outside of consumers using a phone and capturing family memories. Production studios would probably rather their experiences be more immersive, not limited by a frame.

  • @kingjames1866
    @kingjames1866 7 місяців тому +1

    On a scale from 1-10. Where do you rank the quest 3 vs vision pro Vr180 playback.

    • @hughhou
      @hughhou  7 місяців тому +1

      They are like 5 vs 6 - all not ideal lol. Maybe need AVP 2 to get there. I am cynical tho.

    • @REDBULLzjxFN
      @REDBULLzjxFN 7 місяців тому

      What would be ideal. How would you get a 10

  • @TheHawaiianc
    @TheHawaiianc 7 місяців тому +1

    Question is it possible use 2 insta360 to make a 180 vr for it? Or the insta360 R 1in?

    • @hughhou
      @hughhou  7 місяців тому +1

      Yes! Tutorial is coming as well!

    • @IMMERSIVA-PROD
      @IMMERSIVA-PROD 7 місяців тому

      I see on the previous comment that 2 goPro will be a nightmare to sync (drift etc...). Is it better on two insta 360 to sync ?@@hughhou I'm waiting for the tutorial too !

  • @DellWolfensparger
    @DellWolfensparger 7 місяців тому +1

    Hugh did a great tutorial on how to make a great spatial video; this is the path and tutor to follow.

    • @hughhou
      @hughhou  7 місяців тому

      Wow, thanks!

  • @TenBearsTravel
    @TenBearsTravel 3 місяці тому

    I simply can't understand him. I really trued.

    • @hughhou
      @hughhou  3 місяці тому

      Awww what do you not understand?

  • @NotElonMuskk
    @NotElonMuskk 7 місяців тому +1

    Can you review the EOS VR utility or its plugin for Premier Pro?

    • @hughhou
      @hughhou  7 місяців тому

      I have both on my channels already. You can search EOS VR Utility Hugh Hou it should show up :)

    • @NotElonMuskk
      @NotElonMuskk 7 місяців тому

      @@hughhouWill do, thanks!

  • @REDBULLzjxFN
    @REDBULLzjxFN 7 місяців тому +1

    Hugh, I returned my Vision Pro because I didn’t see much difference in vr180 vs quest 3 I was playing high quality 8k video. How can Apple make it better given the limitations of vr180 video currently would a developer be able to use foveated rendering? I love vr180 video just wondering if you think I should repurchase Vision Pro I have the money but was initially disappointed vr180 wasn’t 3000 dollars better

    • @hughhou
      @hughhou  7 місяців тому

      Oh no my review is not even out yet lol. Haha, well, right now you are right on. VR180 is NOT technically support on AVP yet. But it is not even 10 days yet on one work that fast on develop something lol. It took 1 year to launch QTV on Meta. So we have to wait at least a month or 2. I don't think Apple will release support until FCP has a solution for making it better.

    • @REDBULLzjxFN
      @REDBULLzjxFN 7 місяців тому

      What is FCP?

    • @KoenKooi
      @KoenKooi 7 місяців тому

      @@REDBULLzjxFN Final Cut Pro

    • @RandallWallace-jg2cb
      @RandallWallace-jg2cb 7 місяців тому

      final cut pro @@REDBULLzjxFN

    • @Gorto68
      @Gorto68 7 місяців тому

      Final Cut Pro@@REDBULLzjxFN

  • @feverpitchcourtside
    @feverpitchcourtside 7 місяців тому +1

    This is not Apple immersive format.

    • @hughhou
      @hughhou  7 місяців тому

      See my other comment of the different between Spatial Video vs Immersive Format. This is about Spatial Video, and convert immersive format video into Spatial Video with way smaller FOV!

  • @JM-xl3ij
    @JM-xl3ij 7 місяців тому +1

    Thanks for a great Video Hugh. Would you have some sample videos that we could download and view on a Vision Pro. I am thinking of getting the 5.2 to use with either the R5 or Red Komodo.

    • @nariza7
      @nariza7 7 місяців тому +1

      I believe the Red komodo is not full frame, so it may not work with the 5.2mm lens

    • @JM-xl3ij
      @JM-xl3ij 7 місяців тому

      Thanks@@nariza7 good point - I had not thought of that.

    • @hughhou
      @hughhou  7 місяців тому +1

      Yes. The full trailer and full film are here: ua-cam.com/video/NN8eBxTNgB0/v-deo.htmlsi=OlRLaQ5Hjc7eDQp1

    • @JM-xl3ij
      @JM-xl3ij 7 місяців тому +1

      Thanks @@hughhou ...Downloading. Shot with the AVP? and it can just be viewed on AVP or needs a player?

    • @JM-xl3ij
      @JM-xl3ij 7 місяців тому

      WOW! Awesome work! What was that filmed on - the really High Def parts? Especially the stabilised walking scenes. Thank you for sharing. I will be subscribing.

  • @NoahSaiah
    @NoahSaiah 7 місяців тому +1

    Amazing video. Thanks Hugh!

    • @hughhou
      @hughhou  7 місяців тому

      My pleasure!

  • @westmcgee9320
    @westmcgee9320 7 місяців тому

    I’m…going to love this video.
    ::waits for ads to end::

    • @westmcgee9320
      @westmcgee9320 7 місяців тому

      Doggonit.
      This isn’t what I hoped it would be. It’s sending me to other hardware and software.
      It’s interesting that the video both assumes we are informed enough to need the tutorial but knowledgeable enough to know things like, what was so wrong with the initial 3D.
      I saw nothing wrong and so, do not know what the problem is that we are trying to solve with subsequent steps.
      Sadly, not for me. Best of luck to others.

  • @VRLANDNL
    @VRLANDNL 7 місяців тому +1

    Awesomeeeee :)

    • @hughhou
      @hughhou  7 місяців тому

      Thank you! Cheers!

  • @vickykk2136
    @vickykk2136 7 місяців тому

    感谢分享,满满的干货~❤

  • @feverpitchcourtside
    @feverpitchcourtside 7 місяців тому +1

    This is not how to create an Apple immersive video. Spatial and Apple immersive format are completely different.

    • @hughhou
      @hughhou  7 місяців тому

      Yes. This is about Spatial Video NOT* immersive format. Immersive Format is exactly the same as what we used to on Meta Quest platform and we have been shooting immersive format on this channels for over 5 years. Apple themselve also only said Spatial Video is new, not Immersive Format as they know immersive format is VR180 video - what the Canon camera capture natively without you doing any extra thing.

  • @trancemuter
    @trancemuter 7 місяців тому +1

    ok, I am confused about this, what you are proposing here is regular 3D not spacial video with paralax, am I right? plus Quest can only play back regular 3D video without the parallax effect so it’s not the real thing. correct me if I’m wrong. I could not find a real spacial video to play on the quest and the demo video Meta is showing is also just a regular 3D video with blurred borders… it’s pretty stupid actually, why fake it with a blurred border, 3D video with a regular border is actually better imo.

    • @hughhou
      @hughhou  7 місяців тому +1

      This is Spatial Video - basically fancy 3D+ video by Apple. Not immersive video. Canon already do immersive video natively - so no need to do anything extra

  • @JS-ow2ct
    @JS-ow2ct 7 місяців тому +1

    I really want to learn from you. But I’m far into this video, and there’s still nothing about the workflow for shooting on the Canon, or editing for distribution to Apple Vision Pro. The music is terribly distracting, and you are so busy hyping and cross-promoting other videos that you aren’t actually delivering on the promise of the title. If you have expertise in this area, you have the opportunity to become THE expert. But you have to teach. You have to be helpful. You have to create substantive content. And right now, this is all hype, smoke and mirrors. Please stop with the magic tricks. And get to the point. I’ll try watching a couple more videos, but soon, I’m going to give up on you, and never watch you again. I don’t want to waste my time on fluff, learning nothing. And OMG the music. Stop with this music. Just talk to us like we are your friends. No more hype.

    • @hughhou
      @hughhou  7 місяців тому +1

      Thank you for the feedback. I should stop the music after intro. This video does go indepth into the workflow. But there is pre-require understanding the space, why use professional camera instead of Vision Pro onboard camera to give a reason why we need to go tho all the trouble to produce high quality content. Not all viewers are as experience as you and need some upsell of the workflow to understand the importance. On an instructional design standpoint, I need the belt and whistle to keep the young generation interests. It is hard to be creators at modern day distrated world and compete with TikTok. But you are 100% right. This video are rapid speed produced, so lot less tho put into it like our normal content. Thank you for sticking around.

  • @Kougs
    @Kougs 7 місяців тому +1

    Thanks! You saved me tons of time!

    • @hughhou
      @hughhou  7 місяців тому +1

      Wow thank you!! More to come. Trying to keep it up 1 video a day but taking a break tomorrow for our Meta Quest VR Film release on Vday :)