Directional Motion Detection and Tracking using Webcam in TouchDesigner

Поділитися
Вставка
  • Опубліковано 11 січ 2025

КОМЕНТАРІ • 69

  • @FunctionStore
    @FunctionStore  2 роки тому +4

    Just noticed that from 5:15 onwards the CHOP channels are showing 0 - but this is only a visual bug due to the recording being in 30 FPS and my project file in 60, so we just happen to miss the frames it shows values :D Gets more clear once I put down the Filter CHOP

  • @JBroadway
    @JBroadway Рік тому +2

    Thank you for making this. I found it very helpful! I hope you continue to make more.

  • @rgrant
    @rgrant Рік тому +2

    Great, just what I was looking for!

  • @jimmysimmons6477
    @jimmysimmons6477 2 роки тому +1

    Love the breakdown, thank you!

  • @michaelcarnohan
    @michaelcarnohan 6 місяців тому +1

    Nice tutorial! Clean implementation of Optical Flow.
    May I suggest bypassing components like your Analyze TOPS when they result in flickering like this in the future... some folks have Epilepsy and this can be a trigger. 🙏

  • @matildemasenello948
    @matildemasenello948 5 місяців тому +4

    Hi! I just finished watching your tutorial but unfortunately I can't understand how you managed to connect the circle to the particles to use it as an element that dictates the movement. Could you help me?

  • @olwaysoliver6880
    @olwaysoliver6880 Рік тому +5

    thanks for the video! i am having trouble with a lot of noise i think.. The thresholds pick up much more flickering visual than yours do, i have tried to adjust my room lighting without real success.. Do you think my webcam is just bad? there is really a lot of bright flashing images in my threshold frames, but i am in a calm and soft lit environment i tried the blur filter but it really didnt do much.. what can i do?

    • @FunctionStore
      @FunctionStore  Рік тому

      Hey, hard to tell without seeing but might be the case with a lot of digital noise from the camera. You could try adding a little bit of feedback to your input image to average the noise a bit more. As last resort if you have an RTX GPU you can try the nvidia denoise top, but would make sure to decimate the resolution to at least half before with a resolution TOP.

    • @FunctionStore
      @FunctionStore  Рік тому +2

      how about changing the Optflow Lambda and threshold?

    • @js4741
      @js4741 10 місяців тому +2

      Hey, just wanted to share I was having the same issue with my built-in webcam (Macbook M1 Pro). A ton of flickering visual from the threshold nodes.
      FunctionStore's suggestion of changing the threshold in the optflow was really helpful. The default optflow threshold value is 0 and I was getting a ton of flickering. As soon as I changed my threshold to 0.004, suddenly my threshold nodes looked a lot more like they do in the youtube video, with just the outline of me/my hand at a lot less noise. Hope this helps someone!

  • @sarahghazi5539
    @sarahghazi5539 10 місяців тому +2

    Hello! Love the tutorial. I just have a bit of trouble with the analyze TOP. Mine is not blinking the way yours is and when I put the top to CHOP, it gives me an error of 'invalid source TOP specified. Love if anyone can help. Thanks!

    • @Huzzaifamughal
      @Huzzaifamughal 14 днів тому

      try pressing the middle mouse key while being on NULL and it will fix it

  • @markus_knoedel
    @markus_knoedel 2 роки тому

    Thank you. Good stuff.

  • @yourcontemporarylife
    @yourcontemporarylife 6 місяців тому +2

    Thanks for this tutorial. My circle seems to be stuck in the top right hand corner once plugging in the null to the center. Do i need to just adjusting the settings as you mentioned? I'm using a 2023 Macbook pro with built in camera. Any help would be great thank you!

    • @CameronByers_UM
      @CameronByers_UM 2 місяці тому

      I have the same issue, did you figure this out?

  • @hernancrocce
    @hernancrocce 9 місяців тому +1

    Hi there. Lovely tutorial and well explained!
    Out of curiosity...What would be a workaround to use also the depht/z axis with the optical flow tool?

    • @FunctionStore
      @FunctionStore  9 місяців тому +1

      Hey thanks! Using this method only I don't think would necessarily be possible to get depth information. Also since this tutorial aired I recommend people to check out MediaPipe

  • @dingwenxiao5660
    @dingwenxiao5660 Рік тому +1

    Can you make a tutorial on how to do this particle effect with Azure Kinect? THANKS~~!

    • @FunctionStore
      @FunctionStore  Рік тому

      If you mean the thing you see on the right: check out Noonesimg's tutorials on flex.

  • @unclefillTV
    @unclefillTV 2 роки тому

    I am not seeing an option for ‘CHOP Reference’ when I right click “center” in my Circle TOP as you show at 13:17. Are you right clicking there? I get different options. Would love to finish this!

    • @FunctionStore
      @FunctionStore  2 роки тому +1

      Hey! I am dragging the CHOP channel onto the parameter. Be sure to activate the viewer of the CHOP (null1, to activate click the little star icon at the bottom right of the operator) and then drag the channel you want to reference!

    • @unclefillTV
      @unclefillTV 2 роки тому

      @@FunctionStore wow! I think I got it. My next question would be, how to get the final effect as you show at the beginning of the tutorial? I’m finally able to move my ball so thank you!! Any help there?

    • @unclefillTV
      @unclefillTV 2 роки тому

      Or does that need it’s own tutorial? 😅

    • @FunctionStore
      @FunctionStore  2 роки тому

      @@unclefillTV do you mean the particles on the right of the screen? Check this tutorial for the basic setup: ua-cam.com/video/0ym50KEXi48/v-deo.html I am controlling the gravity of the system (no speed CHOP needed in this case just math to multiply the values)

  • @so0ofii
    @so0ofii 4 місяці тому

    hi, I was wondering if there could be some expresion that help me with the borders of the circle, it keeps going off the field. Anyone knows?

  • @apofis_media
    @apofis_media 2 місяці тому

    nice one, but how the first visual as example was made ?

    • @FunctionStore
      @FunctionStore  2 місяці тому

      @@apofis_media please read description

  • @SandervanLaarpixellaar
    @SandervanLaarpixellaar 5 місяців тому

    nice work! is this also possible with a image and when you walk by change in liquid?

    • @FunctionStore
      @FunctionStore  5 місяців тому

      @@SandervanLaarpixellaar sure, anything is possible that you can/want to control with a chop

    • @SandervanLaarpixellaar
      @SandervanLaarpixellaar 5 місяців тому

      @@FunctionStore thnx i hope so! because i have a great idea

  • @Skins4497
    @Skins4497 29 днів тому

    Can you make a tutorial on how to connect it with a 3D connected with fragments/sprinkles and make the 3d object disintegrate with the hand motion ? Idk if that’s possible 😅

    • @FunctionStore
      @FunctionStore  29 днів тому

      @@Skins4497 everything is possible but it's too specific for me to make a tutorial on. There's a ton of similar effects out there as tutorials, and connecting them with interactivity is always possible

    • @Skins4497
      @Skins4497 28 днів тому

      @ thank you for responding. Do you do a projects for payment ? I need to make a project for my thesis and I have following plenty of tutorials but I cannot connect different functions with each other. I am a newbie 😅. If you do can I send you a message on your social media accounts? Thanks in advance

    • @FunctionStore
      @FunctionStore  28 днів тому

      @Skins4497 feel free to reach out, if not me, I can recommend someone for sure

  • @jamieguterman9598
    @jamieguterman9598 9 місяців тому

    Great video! Once I make a particle system, where do I attach it?

    • @FunctionStore
      @FunctionStore  9 місяців тому

      Thanks! That's the beauty of TD, you can attach anywhere! But in my case I was controlling the gravity of an Nvidia Flex system.

    • @jamieguterman9598
      @jamieguterman9598 8 місяців тому

      @@FunctionStore Thank you for the advice! I was able to attach the motion tracking to an eye visual I created following this tutorial: ua-cam.com/video/3ptfQFkNaHc/v-deo.html . When The eye moves with my body / hand, I'm getting a looottt of drag on the visuals. Is there a way to fix this?

  • @femi8637
    @femi8637 9 місяців тому

    Hi, great tutorial thanks! I am unable to make all the operators a component, there is no drop down option- could you let me know how to do this? TD newbie here!

    • @FunctionStore
      @FunctionStore  9 місяців тому +1

      hey, sorry not sure what you mean, probably best to watch more beginner courses and come back!

    • @femi8637
      @femi8637 9 місяців тому

      @@FunctionStore okay thank you for your reply!

  • @streamingdev1163
    @streamingdev1163 Рік тому

    I just bought the paetron for this video, what do I do next to get the pixels like you were showing at the beginning of the video?

    • @streamingdev1163
      @streamingdev1163 Рік тому +1

      I am confused on why you didnt show the ability to attach the particles either, very new to TD so kinda confused on what to do next

    • @FunctionStore
      @FunctionStore  Рік тому

      @@streamingdev1163 it was just a quick example to show the kind of interaction you can integrate. The visuals are based on an Nvidia Flex tutorial (and Patreon content so it's unethical to share anyway) linked in the description from Noonesimgs.
      In this video I never claim to share any of the visuals, only ever talk about the interactive component.
      TD has a very steep learning curve but once you reach a certain point you will never want to do anything else so keep on keeping on!

  • @Kancha1996
    @Kancha1996 11 місяців тому

    Can you show how to make basicFlex of your work on video, please?

    • @FunctionStore
      @FunctionStore  11 місяців тому

      Please check description

    • @Kancha1996
      @Kancha1996 11 місяців тому

      @@FunctionStore yes I watch it but idk how to make it move with circle. sry but I'm newbie about this program. 😅

    • @FunctionStore
      @FunctionStore  11 місяців тому

      @@Kancha1996 I was controlling the gravity of the flex system

  • @sliderpox7758
    @sliderpox7758 Рік тому

    Do you know if the circle only tracks 1 person at a time, or can I make it follow multiple hands?

    • @FunctionStore
      @FunctionStore  Рік тому

      Hi it only follows general movement in the camera view. It's not tracking anything in the literal sense so no.

  • @aldyferdiansyah5133
    @aldyferdiansyah5133 Рік тому

    Hi, I'm a new user of TouchDesigner. How do I connect Motion Detection with Nvidia Flex, and are there any tutorials available for this?

    • @FunctionStore
      @FunctionStore  Рік тому

      Hey just connet the output of this tutorial to the gravity or any parameters of the flex you like (probably with some Matb CHOP to get the value in range) . In the description there is a flex tutorial.

  • @saurabhsswami
    @saurabhsswami 6 місяців тому

    Hey! I followed your steps but my result is very janky and had to use another method

  • @ghassanterek4675
    @ghassanterek4675 Рік тому

    how did you create the null component

  • @artnomalie
    @artnomalie Рік тому

    Can this be done without optical flow (i am on mac :) ?

    • @FunctionStore
      @FunctionStore  Рік тому

      Optical Flow from the palette should work on mac!

  • @nadijasafaryan2926
    @nadijasafaryan2926 Рік тому

    I have no source names for the NDI in... how can I fix that?

    • @FunctionStore
      @FunctionStore  Рік тому +1

      Hey I'm only using NDI because my camera image was already occupied by my recording software. You can just use Video Device In TOP for example

    • @nadijasafaryan2926
      @nadijasafaryan2926 Рік тому

      ​@@FunctionStore thank you for your reply. I'm a student who just started with TouchDesigner for a project. Do you maybe have another tutorial on how to make the blue wavy design, like in the thumbnail?

    • @FunctionStore
      @FunctionStore  Рік тому

      @@nadijasafaryan2926 Right, based on this tutorial: ua-cam.com/video/0ym50KEXi48/v-deo.html good luck and have fun!

  • @zasmorning
    @zasmorning 5 місяців тому

    after all the steps, my math TOP only works in positive, not negative... 0, +1, 0 +1 and O dont know why

  • @Anckg
    @Anckg Рік тому

    Do you mind showing us how you did merge the tutorial (ua-cam.com/video/0ym50KEXi48/v-deo.html) and the motion tracking bits together? I've been stuck on it for quite some time, I'm new to TD :]

    • @FunctionStore
      @FunctionStore  Рік тому

      I was controlling the gravity I think

    • @olwaysoliver6880
      @olwaysoliver6880 Рік тому

      would love some help with that aswell, i have been trying to combine these two
      did you manage to do it?

    • @FunctionStore
      @FunctionStore  Рік тому

      @@olwaysoliver6880 I'm controlling the Nvidia Flex Solver's Gravitational Acceleration parameters with the LR/UD channels (multiplied by 5 and having a filter with width of 1)