Making My First Unity Plug-in (with C++) for AR

Поділитися
Вставка
  • Опубліковано 25 жов 2024

КОМЕНТАРІ • 83

  • @hellokozmo
    @hellokozmo 5 років тому +12

    Pushing the boundaries and sending us back the reports! You're doing great work dude! Thanks!!

  • @hoorcool2748
    @hoorcool2748 5 років тому +2

    Happy to see you posting a new video again. I do really appreciate your channel.

  • @MarkGrob
    @MarkGrob 3 роки тому

    Nice to see your publishing again... Tutorials on UA-cam!!

  • @Saicopateful
    @Saicopateful 5 років тому +1

    Great Matt, this is what I’ve been waiting for. It would be great to see it merged with AR Foundation.

  • @chetanmrane
    @chetanmrane 5 років тому

    your videos are always gives boostup to our thinking, always waiting for new videos.

  • @jefffang08
    @jefffang08 5 років тому +1

    Great video sir 👍
    I got opencv 4.1.0 working on my unity project, thanks for sharing such great information. Although I did not need to restart my unity editor (2018.3.2f1) for my updated plugin to take effect for some reason.

    • @asadted7090
      @asadted7090 4 роки тому

      would you mind sharing it? i just need to get the stream from unity to open pose via open cv

  • @obadacharif1744
    @obadacharif1744 4 роки тому

    If you switch the render api to OpenGl for example for both editor and smartphones from player settings unity code will send the webcamtexture pointer depending on the api u specified.
    When the plugin event get issued at end of frame u could create a function and call it inside OnRenderEvent to get the image buffer from the texture pointer using some opengl api functions like glGetTexImage, and of-course it will be different for Vulcan and Metal but probably there is a way for each one...

  • @pulkitmidha5710
    @pulkitmidha5710 5 років тому +1

    Yours videos are always lit

  • @vladsamonin9794
    @vladsamonin9794 5 років тому +4

    Yeay first comment. Opencv in Unity thats doubt!

  • @Joshtrick
    @Joshtrick 2 роки тому

    Hi Matthew, thinks for this awsome video.
    I have a question about the ios plugin in the cloak repo.
    At Cloak/Assets/Plugins/iOS/, I see a PluginAppController.mm file, which is not found in the other 2 plugin folders.
    Can you give help to give a short explantion what is that for and is it necessary for the ios plugin?
    Thanks again for this great work.

  • @nischayghadge9497
    @nischayghadge9497 5 років тому

    Great video keep on posting

  • @joshuaanilao3009
    @joshuaanilao3009 5 років тому

    Brooooo!! Thank you so much for this!

  • @euphoricash13
    @euphoricash13 5 років тому +1

    Matt 😂. I had a feeling your next video was gonna be about vision. Glad I was right. Btw have you tinkered with ML Agents ?

    • @MatthewHallberg
      @MatthewHallberg  5 років тому

      yess hopefully there will be more if I can get this damn thing working better lol. I havn't used ML agents directly but I played with Barracuda to see if it would run other models and it doesn't seem to as of yet. Thats actually what let me to this project because I want a good way to run object detection and what not since tensorflowsharp support was removed from ML Agents.

  • @ggyun
    @ggyun 3 роки тому

    fancy Queen!

  • @alexusblack
    @alexusblack 5 років тому

    Good job, thanks for the video

  • @felipeantonio1175
    @felipeantonio1175 4 роки тому

    Graeat Matt. Sorry I have problem in #include "Cannot find"

  • @mxolisinkosinathinene2657
    @mxolisinkosinathinene2657 4 роки тому

    its amazing project
    I am new to the channel but am impressed with all the work you have been doing it beyond what I thought was possible for one person to do. I want to do a foot tracking application for my e-commerce AR App where the user can try on different shoes on the app using AR.

  • @clifflin7149
    @clifflin7149 4 роки тому

    great work

  • @sagarvats4880
    @sagarvats4880 5 років тому

    Great Work Sir , I wanted to know how can i recognize the missing parts of an image ( from numbers 1-9 in a grid , which no. is missing , and then augmenting that no. on the grid ) ?

  • @Zexorii
    @Zexorii 4 роки тому

    On Android Build i have an Issue Unable to find macPlugin. Any idea?
    DllNotFoundException: Unable to load DLL 'macPlugin': The specified module could not be found.

  • @mohanpannirselvam4102
    @mohanpannirselvam4102 5 років тому

    Matt please do for windows. I used the dlib format way. But i think we can go futher. OpenCV is a need for unity

  • @Mohammad-kx2rk
    @Mohammad-kx2rk 5 років тому

    that's genius! keep going

  • @sillyboy1591
    @sillyboy1591 4 роки тому +1

    Please please do it for the windows too.. I'm not rich enough to buy mack :(

  • @Sv9zlsT
    @Sv9zlsT 5 років тому

    very nice, I've tried put open cv into unity about 1.5 years ago, and it worrks somehow on windows, not on mobile, it's hard :)

  • @nicamic123
    @nicamic123 5 років тому

    OHWOW Thats Awesome!!XD

  • @d4567
    @d4567 5 років тому

    can you pls make a video on how to add a 3D object to the real world using machine learning

  • @karansethi1268
    @karansethi1268 5 років тому +2

    😍

  • @lukechaffey9811
    @lukechaffey9811 5 років тому +1

    Really helpful tutorial, but I tried it for my Windows machine and it didn't work. How do I do it?

    • @MatthewHallberg
      @MatthewHallberg  5 років тому +3

      ohh its easy. Just put an ad for your windows computer on craigslist, and then follow the instructions on my github to go buy mac book pro.

    • @lukechaffey9811
      @lukechaffey9811 5 років тому +1

      @@MatthewHallberg Oh ok, are you sure I don't need to just turn it off & on again on Windows? I feel like that could really fix it.

    • @MatthewHallberg
      @MatthewHallberg  5 років тому +2

      No in this case you have to just turn it off and then throw it out the window.

    • @lukechaffey9811
      @lukechaffey9811 5 років тому

      @@MatthewHallberg Alright, I'll give that a shot and see how I go, thanks!

  • @charrystheodorakopoulos4843
    @charrystheodorakopoulos4843 4 роки тому

    Is there a way to install opencv in unity (the .dll files) and make it readDnnModule
    read the darknet module from my assets?

  • @TheJCEguy
    @TheJCEguy 5 років тому

    are you still doing iron man unity voice thingy?

  • @mohanpannirselvam4102
    @mohanpannirselvam4102 5 років тому +1

    Be the one takes down the the greedy guy who sell an open source in the sset store

  • @ajithvanil
    @ajithvanil 5 років тому

    Bro please do a unity starter tutorial

  • @chaffey91
    @chaffey91 5 років тому +1

    Thanks for the tutorial, are you able to help me fix an error in my xcode project?

    • @MatthewHallberg
      @MatthewHallberg  5 років тому +1

      chaff91 yeah sure I’m supposed to work today but screw it.

    • @chaffey91
      @chaffey91 5 років тому

      @@MatthewHallberg Phew, thanks mate. Life saver!

    • @MatthewHallberg
      @MatthewHallberg  5 років тому +1

      @@chaffey91 hahah anytime I love xcode errors.

  • @Hossein.s.a
    @Hossein.s.a 5 років тому +1

    Can I get complete project of this in unity?

  • @loukask.9111
    @loukask.9111 5 років тому +1

    there's also EmguCV.
    Edit: And OpenCVSharp.

    • @MatthewHallberg
      @MatthewHallberg  5 років тому

      So i looked into emgu and I think it ultimately costs money to use but yeah I was also trying to avoid using a wrapper for performance.

    • @arvindpatil9062
      @arvindpatil9062 5 років тому +2

      @@MatthewHallberg after long research finally, I built facial recognition project using emgucv for free...!!

    • @MatthewHallberg
      @MatthewHallberg  5 років тому +1

      Arvind aru that’s amazing! Is performance ok?

    • @arvindpatil9062
      @arvindpatil9062 5 років тому +1

      @@MatthewHallberg yeah ..!! Using eigen face recognition technique... It's working very well....

    • @MatthewHallberg
      @MatthewHallberg  5 років тому

      That’s so awesome I gotta try that!

  • @ericliu2238
    @ericliu2238 3 роки тому

    Does this plugin still run? It seems mac plugin is broken.

  • @sabrango
    @sabrango 4 роки тому

    gotto find root of the opencv code and then turn them into c#
    easy job right?

  • @spadebussines8353
    @spadebussines8353 5 років тому

    can it use it also in face tracking ?

  • @web3.0_metaverse_XR
    @web3.0_metaverse_XR 5 років тому

    Will it work for UWP Apps?

  • @anshagarwal8033
    @anshagarwal8033 5 років тому

    How can I use a different color cloth?

    • @MatthewHallberg
      @MatthewHallberg  5 років тому

      There is a bool in nativelibadapter if you set that to false it will do red, for any other colors you have to make a new threshold in the source code. Check out the tutorial I followed for an explanation on how it works.

  • @LV-ei1ce
    @LV-ei1ce 5 років тому

    Can we do this for windows?

  • @dhruvkhashu4389
    @dhruvkhashu4389 3 роки тому

    7:56 wtffff xD

  • @aliaksandr5145
    @aliaksandr5145 5 років тому

    also, there are aforge(dot)net

    • @MatthewHallberg
      @MatthewHallberg  5 років тому +1

      I probably should have looked into that one more

    • @thebricktop
      @thebricktop 3 роки тому

      its pretty much dead and mostly unportable to other devices because of the system.drawing dependencies

  • @abdulmajidiqbal
    @abdulmajidiqbal 5 років тому +1

    its amazing project
    would you let me know does it work on android

    • @MatthewHallberg
      @MatthewHallberg  5 років тому +2

      Yeah it does if you have a galaxy device you may need to uncheck multithreaded rendering

  •  4 роки тому

    Hi Matthew, your project is very interesting. I have been working in AR with Unity for a couple of years. Have you reviewed ARToolkit 5 for ideas? I remember that years ago they were using a project quite similar to your Cloak: github.com/artoolkit/artoolkit5

  • @abudriaz9678
    @abudriaz9678 5 років тому +1

    Second

    • @MatthewHallberg
      @MatthewHallberg  5 років тому +1

      So close! Thanks for being here early!

    • @abudriaz9678
      @abudriaz9678 5 років тому +1

      Haha iam going to try this on android phone but unforunately i have samsung galaxy s7 😐

    • @MatthewHallberg
      @MatthewHallberg  5 років тому

      @@abudriaz9678 do it and let me know how it goes! you may have to uncheck multithreaded rendering in build settings. I actually have a galaxy S7 too but I never tested on that, probably should lol.

    • @abudriaz9678
      @abudriaz9678 5 років тому

      @@MatthewHallberg i will hahaha you should also man :D

    • @abudriaz9678
      @abudriaz9678 5 років тому

      @@MatthewHallberg it worked on my s7 skull one is working very well but the cloak one is not working well like its working in your video great job btw man :)