ml5.js Pose Estimation with PoseNet

Поділитися
Вставка
  • Опубліковано 20 сер 2024

КОМЕНТАРІ • 100

  • @TheCodingTrain
    @TheCodingTrain  4 роки тому +22

    Thanks to Dan Oved who let me know that you can read more about the model and how it was trained in the research paper! arxiv.org/abs/1803.08225

    • @subschallenge-nh4xp
      @subschallenge-nh4xp 4 роки тому

      Are you give me a link of a website can I install the framework that your use

    • @revtane9
      @revtane9 4 роки тому +1

      the index.html just says "Loading...", do you know what's the problem?
      thanks a lot

    • @TheNewton
      @TheNewton 4 роки тому +1

      The Coding Train COCO dataset
      "We train our model on the standard COCO keypoint dataset [1], which an-
      notates multiple people with 12 body and 5 facial keypoints"

  • @vrdash
    @vrdash 4 роки тому +57

    3:01 "if you found you way here it's because you are making some interactive projects". Well no no, we just love your videos and whether they are relevant or not to my daily life, I watch it chooo choooo! :p

  • @ritwikrm771
    @ritwikrm771 4 роки тому +40

    I just want to stand up and applaud for the great work you are doing... You are funny, enthusiastic, full of so much energy literally all the time ... Your tutorials are so easy to understand and follow... I am lucky that I came across a teacher like you.... Keep up the Good Work..!!

    • @vkray
      @vkray 4 роки тому +1

      Ritwik R M Thanks to me.

  • @Bhooklgihai
    @Bhooklgihai 3 місяці тому

    I feel I am watching cartoon and learning... You made it so easy and enjoyable to learn😎

  • @spaarks84
    @spaarks84 4 роки тому +9

    I. love. this. man.

  • @RodrigoStuchi
    @RodrigoStuchi 4 роки тому +1

    Awesome, really appreciate what you are doing!
    The applicability of this topic is huge.
    keep doing and Thank you!

  • @anubhav200
    @anubhav200 3 роки тому

    This video was perfect at so many levels. Thanks for making such awesome videos.

  • @louamacademie5837
    @louamacademie5837 6 місяців тому

    thank you for the great explanation man :)

  • @ahalyasubramanian2315
    @ahalyasubramanian2315 4 роки тому

    Awesome!!! Really helps me to understand the working of posenet.. Thanks a lot!!!

  • @tejasnareshsuvarna7948
    @tejasnareshsuvarna7948 4 роки тому

    You are a teaching jewel. Great content, great background, great music and great you m 🙃

  • @kisame_5331
    @kisame_5331 4 роки тому +1

    I like how some of the parts are sped up... Anyhoo I love your work!!

    • @masonsickler2878
      @masonsickler2878 4 роки тому +1

      he does this a lot, i just love that these sped up parts at the beginning are like 2 seconds of footage

  • @amansales4226
    @amansales4226 4 роки тому

    I always love your codes and perfection in them

  • @bobg3camcallaghang3cam5
    @bobg3camcallaghang3cam5 4 роки тому

    I would love to see the followup video on classifying poses! Great mix of info and detail!

  • @MoMoGammerOfficial
    @MoMoGammerOfficial 4 роки тому

    Omg! I was looking for something like this.... This is awesome! I got a perfect idea for my next project :) Thanks man.

    • @vkray
      @vkray 4 роки тому

      Mopeio Official What’s ur idea? Could u share with the world? So, I can copy the idea.

  • @petrsehnal7990
    @petrsehnal7990 2 роки тому

    Great work, sir!

  • @yashwanthd1998
    @yashwanthd1998 4 роки тому +1

    Great as usual..Would like to see build such models in processing..

    • @TheCodingTrain
      @TheCodingTrain  4 роки тому +2

      You can use PoseNet in Processing with RunwayML! ua-cam.com/video/7btNir5L8Jc/v-deo.html

  • @michalbotor
    @michalbotor 4 роки тому +6

    dear daniel,
    a few days ago i bought myself an arduino, and i've been playing with it since then, and to my honest surprise i've found out, that the ide that the arduino uses is build on top of the one, that.. processing uses! so, first of all, congratulations! but.. that brings me to my question to you: would you be willing to make tutorials on the visualization of arduino's data coming from its serial port in processing?
    also i would love to see you make some arduino project in your cabana, like a plant watering system, or a lamp that lights up either because of your movement or lack of sunlight.

  • @jaggyjut
    @jaggyjut 4 роки тому +3

    Hi Dan, thanks for the awesome content. I wanted to know how I could use the posenet model to compare if dancer A (student) is able to move like dancer B (dance teacher) and calculate a score on how close the student pose was to the teacher

  • @akamfoad
    @akamfoad 4 роки тому +1

    That is wonderful😍

  • @MrGeorgeTheCat
    @MrGeorgeTheCat 3 роки тому

    Subscribed, great video! Thank you

  • @StarContract
    @StarContract 4 роки тому

    Absolutely amazing

  • @crypt1n4
    @crypt1n4 4 роки тому

    Really good editing!

  • @user-ko7hd7wi5k
    @user-ko7hd7wi5k 11 місяців тому

    Hi sir,I loved the way of presentation of the matter,could you please tell me on how to implement a sitting posture correction model under ML domain where in we need to detect whether a person's sitting position is correct or not?

  • @Lyrik-Klinge
    @Lyrik-Klinge 4 роки тому

    You are so inspiring!

  • @geoffwagner4935
    @geoffwagner4935 10 місяців тому

    I have heard that eye retina spacing is useful for security,our eye gap is as unique as our fingerprints

  • @radh3y-_-
    @radh3y-_- 4 роки тому +6

    Hi sir, can you teach us to make a qr/barcode scanner.
    Thanks....... otherwise great video

    • @imporbis345
      @imporbis345 4 роки тому

      1. Go to your appstore of your belief
      2. Search for "QR/Barcode Scanner"
      3. Choose the one you like most
      4. Download the choosen app
      5. Finished - Your QR/Barcode Scanner is now on your phone

  • @user-fr7mz3ft8s
    @user-fr7mz3ft8s 8 місяців тому

    the cam image looks fixed on my labtop as soon as I added green ellipse...ㅠㅠ

  • @PcGamerz21
    @PcGamerz21 4 роки тому +1

    Thanks for this Dan.
    I was wondering if you could make car recognition using license and color. From photo detect if it is vehicle and from there extract license plate & vehicle color and output it using only javascript? I have seen this in python but not javascript, would be glad if there is video from you on this :D

  • @izox3530
    @izox3530 4 роки тому

    Hi,coding it's life 👍💛💪

  • @keshavkumar-yb7ss
    @keshavkumar-yb7ss 3 роки тому

    Ohh ok let's suppose I have all the coordinates and skeleton kind of the how you will draw that point over an image like opencv does(my concern is for browser)

  • @arnavsirigere2877
    @arnavsirigere2877 4 роки тому

    Love it!

  • @young_7412
    @young_7412 2 роки тому

    Anyone has following problem when using p5, "TypeError: Cannot read properties of undefined (reading '_report')"? How to solve this problem?

  • @krishnakini6263
    @krishnakini6263 2 роки тому

    thanks , how to flip vedio ?

  • @hussainsalih3520
    @hussainsalih3520 4 роки тому

    Thanks

  • @tx6723
    @tx6723 4 роки тому

    I would enjoy some Java implementations/videos aswell with Java libraries with processing and javafx and deeplearning4j/tensorflow Java on eclipse or maybe even thought ik it's a stretch but some c++ with sfml and open source libraries like imgui

  • @fernandosanchezvillanueva4762
    @fernandosanchezvillanueva4762 4 роки тому

    great!!

  • @rony3044
    @rony3044 3 роки тому

    how can i teach to detect exercises like squats and pushups?

  • @geekelectronics1369
    @geekelectronics1369 3 роки тому

    Great video.
    how can we measure the distance between one keypoint(shoulder) to Another key point(hip)?

  • @adanzeyeasaglik
    @adanzeyeasaglik 4 роки тому

    Hello Dan
    This series is really amazing just like your other Code Train series. Thanks a lot to give us this valuable and understandable training opportunity.
    I just started to learn P5 and ml5 with your videos. Pose detection is great using trained model. I am curious how can I start to an object tracking, not human pose, not object detection but tracking an object coordinates? How should I start, do you have and advice for any documentation using p5 and ml5?

    • @TheCodingTrain
      @TheCodingTrain  4 роки тому

      Hey! This might change soon but you can use this class to get started. Are you in the discord? We can help you more there too! ml5js.org/reference/api-YOLO/

  •  4 роки тому

    Very interesting. Thanks. Each time you completed a task, can we have access to your final code?

  • @Randomness960TVX
    @Randomness960TVX 3 роки тому

    Hi all, i have an issue with posenet with ml5 and p5. There is a preloaded function that permit to export the keypoints ? How can i export the keypoints of each frame to JSON or CSV files?

  • @rachmadimamtarecha5736
    @rachmadimamtarecha5736 4 роки тому

    I got some problem in browser console such as "The AudioContext was not allowed to start" and "OMException: Could not start video source", how to fix this problem?

  • @jonleinena9398
    @jonleinena9398 3 роки тому

    Can you upload any example using Mediapipe? Thanks

  • @emilievaneps8858
    @emilievaneps8858 3 роки тому

    thanks for the video! works perfectly on j5.js but not when I do it locally. Why is this?

  • @jeremymarks8587
    @jeremymarks8587 3 роки тому

    Anyone have any idea if this would work for classifying poses while riding a bodyboard. I need to somehow be able to classify each flip or trick while riding a bodyboard, but I feel the actual board may mess up the pose estimation because it will cut off parts of the body much of the time during the flips

  • @4541047
    @4541047 4 роки тому

    Amazing!!!
    One question. Can you teel when the knees are touching the floor?

  • @mordiaky
    @mordiaky 4 роки тому

    @The Coding Train , can you do a video on Voronoi Tessellation?

  • @rahishkansal2212
    @rahishkansal2212 3 роки тому

    Awesome Tutorial, do there is any model which provide Z coordinate as well?

  • @javierzepeda5258
    @javierzepeda5258 3 роки тому

    Great video, very usefull
    i have a question, if i want to use a canvas of html to stylish them with CSS, how could be?

  • @ozgurkutlu1730
    @ozgurkutlu1730 4 роки тому

    Hi daniel good job. Do you know to way for reducing following point's delay time in video

  • @DeepteshLovesTECH
    @DeepteshLovesTECH 4 роки тому

    Please HELP:
    Uncaught ReferenceError: createCapture is not defined (sketch: line 5)

  • @swaruptripathy9071
    @swaruptripathy9071 4 роки тому

    Can anyone please help me on how to access the IP camera in p5 ?

  • @fedemaster15
    @fedemaster15 4 роки тому

    Can someone help me i was following all the steps in the video but the shapes never showed up

  • @himanshumangal483
    @himanshumangal483 4 роки тому

    The 17 coordinate which we are getting is dependent or independent from location of user from the webcam ??

  • @ronyra
    @ronyra 3 роки тому

    Heyyy, i have a question, how can we train a model to classify which exercise is being done?

  • @ivanbezerra3531
    @ivanbezerra3531 3 роки тому

    Hi, I am working into a project and need to capture and call two points in different bodies. I was able to use pose net to identify the 2 bodies. However, I was not able to call in the code a specific point of each body. Wrist or nose 👃 only for one of the bodies and the code switches on who is more close to the cam. Any good soul out there with a lead on how I might solve? Thanks in advance. I love this channel

    • @TheCodingTrain
      @TheCodingTrain  3 роки тому

      Hey Ivan!
      I'm sure our amazing community might have some people that can help you out!
      Take a look at our help section on Discord! discord.gg/hPuGy2g
      ~The Coding Train Team🚂

  • @warrenchilambe3927
    @warrenchilambe3927 4 роки тому

    please do a trending algorithm in javascript..please please please, only you can do it in a way i can understand please please

  • @wgalloPT
    @wgalloPT 3 роки тому

    What is the code if instead of webcam i have a video in my drive and want to import it?

  • @arpanmondal2126
    @arpanmondal2126 4 роки тому

    While running the sketch on my laptop I was not getting much accurate results as my webcam is not so good, could U just tell me How to use an external camera to connect to my p5js canvas?

  • @rkkmmmkkr
    @rkkmmmkkr 4 роки тому

    can anyone tell me which software he used for video....please pleasse

  • @Johnyindo387
    @Johnyindo387 7 місяців тому

    Ora le University 😊

  • @jeyashreekothai2526
    @jeyashreekothai2526 3 роки тому

    hi Dan , one new requirement..
    I have a project wherein I want to have this webcam feed(which works from createCapture func) and a video from my desktop.. but am not finding the command/function to load a video from my local.. can you please advise

  • @ayusharyal6346
    @ayusharyal6346 4 роки тому

    Can we use posenet to compare dynamic pose with some other pose

  • @pranavkushare5109
    @pranavkushare5109 3 роки тому +1

    Can we use our own trained models ?

  • @ZerofeverOfficial
    @ZerofeverOfficial 4 роки тому

    Anyone know if theres a way to get an FBX out of this?

  • @heloiserozes8230
    @heloiserozes8230 4 роки тому

    Hello ! Did you try PoseNet with Swift (for Apple developers)?

  • @Johnyindo387
    @Johnyindo387 7 місяців тому

    Haruda bhonela tunggal ika😊

  • @martinascomazzon906
    @martinascomazzon906 4 роки тому

    did you ever try to get ground level value? I been trying to detect it for a while now, and there is no possible way to do it. I tried getting the right and left ankle value after like 50 iterations, and it gives me idk 440, and in the next iteration, say iteration 51, it gives me 330, so there is no possible way to detect if for example; the person jumped.
    Do you have any ideas on how to get around this ?

  • @sannaiac
    @sannaiac 3 роки тому

    Thanks,very interesting in this example kemtai.com, How They have to build a PoseNet experience in a WordPress Webisite?

  • @geoffwagner4935
    @geoffwagner4935 10 місяців тому

    and it is almost Halloween

  • @miguelguty399
    @miguelguty399 4 роки тому

    Hi.
    will there be any way to link an IP camera?

  • @DeepteshLovesTECH
    @DeepteshLovesTECH 4 роки тому

    please help: Windows 10
    16: Uncaught ReferenceError: ml5 is not defined

    • @coulomb1
      @coulomb1 4 роки тому

      I looked at thier website... You have to go to the index.html and write under all of the script tags:

  • @ankitsolanki6490
    @ankitsolanki6490 3 роки тому

    Can we find the angle between joints ?

    • @TheCodingTrain
      @TheCodingTrain  3 роки тому

      Yes, the new video I'm about to release called "angles and vectors" will have some tips!

  • @dvaVivy
    @dvaVivy 4 роки тому

    Is it possible to use this on the processing environment?

  • @sayochikun3288
    @sayochikun3288 3 роки тому

    12:48 "I used ml5 to beat ml5"

  • @govindkatyura7485
    @govindkatyura7485 4 роки тому

    I want to use posenet in python for kick detection is it possible ??

    • @TheCodingTrain
      @TheCodingTrain  4 роки тому +1

      See this discussion! github.com/tensorflow/tfjs/issues/572

    • @govindkatyura7485
      @govindkatyura7485 4 роки тому

      @@TheCodingTrain thank you so much for the response , but if you have any other suggestions for the kick detection in a video please help me .

  • @peterhayman
    @peterhayman 4 роки тому

    music while drawing is super distracting, good video tho :)

  • @etherealdude791
    @etherealdude791 4 роки тому

    5:04

  • @Johnyindo387
    @Johnyindo387 7 місяців тому

    Nuvo😊

  • @ZK-im6er
    @ZK-im6er 4 роки тому

    Coding your own vr body tracking camera, anyone?

  • @peterkovinski8476
    @peterkovinski8476 4 роки тому

    It teaches you how to use a Coconut to make a Coconut hat.

  • @jamesking2439
    @jamesking2439 4 роки тому

    pose.nose

  • @museerasyed2504
    @museerasyed2504 3 роки тому

    this has stopped showing keypoints

    • @museerasyed2504
      @museerasyed2504 3 роки тому

      TypeError: Cannot read property 'html' of null
      at modelReady (about:srcdoc:93:20)
      at unpkg.com/ml5@0.4.3/dist/ml5.min.js:124:28684
      at unpkg.com/ml5@0.4.3/dist/ml5.min.js:56:26100