Custom Hand Tracking in Unity for HoloLens

Поділитися
Вставка
  • Опубліковано 3 жов 2024

КОМЕНТАРІ • 33

  • @holosoft
    @holosoft 2 роки тому +3

    Awesome video -- thank you! Note, had an issue when touching buttons in MRTK when I was running this, you see the buttons pushing in but the pressed events wouldn't fire --- fixed the issue by turning off the "Sphere Collider" on the finger tip prefabs -- wanted to post that here just in case other run into the same issue :) Thx again!

  • @ImmersiveTechSolution
    @ImmersiveTechSolution Рік тому

    Oh I quickly solved my issue for my sword that's looking more like a lightsaber for the HoloLens 2 🤣🤣 Many thanks, brother!

  • @rowlandgoddy-worlu3382
    @rowlandgoddy-worlu3382 3 роки тому +1

    Very simple to implement.
    good one Ryan

    • @RyanXR
      @RyanXR  3 роки тому

      Thank you, I’m glad you enjoyed it

  • @sinemergingtechnologies8209
    @sinemergingtechnologies8209 2 роки тому +1

    Thank you so much! Maybe it's just me, but the MRTK documentation doesn't seem to explain everything needed to do this. Nor does anything in the MRTK Examples app. Thank goodness we have people like you!

    • @RyanXR
      @RyanXR  2 роки тому

      Thank you for the kind words! I agree, MRTK docs are a good starting place, but lack more in-depth examples. Thanks for watching!

  • @faranaksoleymani4657
    @faranaksoleymani4657 3 роки тому

    Thanks, RyanXR! This is very helpful.

    • @RyanXR
      @RyanXR  3 роки тому

      You’re welcome! Thank you for watching.

  • @王梦笼
    @王梦笼 3 роки тому

    Thanks!This is very helpful

  • @edwardraymondhe4445
    @edwardraymondhe4445 3 роки тому +1

    Great video!!! I'm really curious about, how future devices could reduce the delay of hand tracking, do you think developing products for current devices would be helpful for future ones(with better sensor and tracking algorithm)?

    • @RyanXR
      @RyanXR  3 роки тому +1

      I think it will depend on how much CPU and graphics power can be put into future headsets. The HoloLens has pretty good sensors and tracking algorithms, but I think the tracking delay could be reduced by bumping up the specs of the CPU which is a Qualcomm Snapdragon 850, and the graphics processing which is Microsoft's "holographic processing unit (HPU)".

  • @johnheggelund7943
    @johnheggelund7943 2 роки тому

    Great video, Ryan. Do you have any advice about maximizing FPS when using MRTK?

  • @kheniviraj1621
    @kheniviraj1621 Рік тому

    Hi Ryan, Thanks for this tutorial.
    I'm able to do custom hand tracking. But I want to know how can I add or attach these hand joints in the Hands Prefabs of MRTK? Could you please help me out?
    Thanks in advance!

  • @Sceetzy
    @Sceetzy 2 роки тому

    How do I implement an offset position to this code? I'm trying to have a game object hover above the users wrist

  • @ju26543
    @ju26543 3 роки тому

    Is there any way to have the full hand mesh and have the user moving hand with all fingers moving realtime to place it far from the detected hand?

  • @umairarif88
    @umairarif88 2 роки тому

    Hi Ryan, I am trying to get positions of all fingers to make sign language with following your tutorial. Is this possible to get every fingertip value to make sign language?

  • @miguelflores-rea2351
    @miguelflores-rea2351 3 роки тому

    Hi, Ryan, Thanks for this tutorial. I'm using MRTK for VR in Oculus Quest and I'm trying to modify the hand model in order to add a forearm with inverse kinematics. I haven't find any docs about how to modify the MRTK hand model. I'd appreciate any advice on this.

    • @RyanXR
      @RyanXR  3 роки тому +2

      Hey Miguel, thanks for watching! I haven’t done any development for Oculus Quest unfortunately, so I’m not familiar with using MRTK with it. You might be able to use the hand-tracking code from this video, but I’m not 100% certain it will work. It is also possible Oculus doesn’t allow you to change the hand model, but I hope that is not the case so you are able to complete your project.
      Sorry I couldn’t help you with this one. Best of luck!

  • @KarlStarx
    @KarlStarx 3 роки тому

    Hi, first of all, great video. But I have an issue when I play the project, the camera is moving in a strange pattern and another yellow line appears. It would be great if you can help me out with that

    • @RyanXR
      @RyanXR  3 роки тому

      I haven’t seen that issue before. That is happening with the HoloLens emulator in Unity?

    • @KarlStarx
      @KarlStarx 3 роки тому

      @@RyanXR I have no Idea why that was happening, I set up everything new and now its working perfectly fine. Thank you so much for this tutorial

  • @pemainsolo94
    @pemainsolo94 3 роки тому

    it worked, how to build it ?

  • @marcoardizzone7761
    @marcoardizzone7761 3 роки тому

    Are you planning to do anything using eye gaze?

    • @RyanXR
      @RyanXR  3 роки тому +1

      No plans right now, but if I build something that uses it in the future, I will make a tutorial.

    • @marcoardizzone7761
      @marcoardizzone7761 3 роки тому

      @@RyanXR Okay, btw thanks for this tutorial, it was helpful!

    • @RyanXR
      @RyanXR  3 роки тому

      No problem. Thanks for watching!

  • @pemainsolo94
    @pemainsolo94 3 роки тому

    tell me how to build, please @RyanXR

    • @RyanXR
      @RyanXR  3 роки тому

      Hi, I have a video tutorial on how to build and deploy to the HoloLens here: ua-cam.com/video/ntaThZjom0o/v-deo.html
      Microsoft also has documentation on how to build and run HoloLens projects here: docs.microsoft.com/en-us/windows/mixed-reality/develop/unity/tutorials/mr-learning-base-02

  • @pemainsolo94
    @pemainsolo94 3 роки тому

    can you shared asset

    • @RyanXR
      @RyanXR  3 роки тому

      Sure, the code and assets can be found here on Github: github.com/Ryan-XR/HandTracking-HoloLens2

    • @pemainsolo94
      @pemainsolo94 3 роки тому

      @@RyanXR it worked, how to build it ?

  • @xinranhuang3801
    @xinranhuang3801 3 роки тому

    Thanks, RyanXR! This is very helpful!

    • @RyanXR
      @RyanXR  3 роки тому

      Glad you found it useful. Thanks for watching!