Object tracking in video with OpenCV and Deep Learning

[@park2348190]

I didn't know about IBM's powerai! Thanks for the info.

[@imagenigraphics]

This project was explained simply but when tried, even installing IBM VIsual Insights (formerly PowerAI) is proving difficult for me.

[@Xpertapps]

Отличная работа. Делаем что-то похожее.

[@AamirKhan-px5vu]

thanks for sharing
such a good information

[@Fingiorstyle]

Thank you very much for the video!!

[@yosanmelese2094]

I am considering counting cars worth more than 100K... and just use a highway video to estimate GDP of a country

[@amineoubad2707]

non

[@vanhuypham7584]

too nice, thanks

[@pacejohn454]

Which model did you train with? YOLO or Faster-RCNN? I couldn't find that in the documentation or on this page. Maybe I missed it?

[@amineoubad2707]

oe

[@danielmoraes9637]

great job with deep learning

[@riponsaha8320]

Great tutorial. However, I believe, you will not get better performance by training on the bigger dataset because those are auto-generated and you didn't fix any error labels induced in the auto labeling process.

[@AndreyNikishaev]

You can master Object Detection in this specialized practical online course: learnml.today

[@vidusheemowlasee7200]

Hello in how much time the registration for the powerAI vision is approved?

[@godlysunny1896]

They have made Maximo into a product for sale. How do I use it for tagging images?

[@aleksipesonen9831]

How do I make the system detect differences in "cars"? (in my case they are large paper rolls in factory). I would want the system know when there is a something odd with the object and count it

[@mamoudousano3354]

Fantastic tutorial, Thanks @ Mark Sturdevant. Is it possible to detect only a few cars and for a few moments, maybe cars that go very fast?

[@markstur]

If distance moved from frame to frame is good enough that would be easy to do. You'd still detect all of them, but just highlight ones that move faster. I'm guessing it would work better if you tracked the car across more frames before determining which are fast. For that you'd just have to add a little data with the tracker data to calculate the movement. That's a good idea.

[@mamoudousano3354]

@@markstur ok good, thanks

[@sohrabi.mohammadjavad]

i use yolov3 network for detecting , can i use this code for counting ?

[@paulsesh]

i have the same question

[@ibrahimaba8966]

guys yolov3 is so slow...

[@AndreyKostenkoDr]

Hi Mark, in the counting_cars.ipynb, does the link to the video file need to be updated? input_video_url = "ibm.box.com/shared/static/4r4tf2robabiqu36ocmykrzvojuse5k9.mp4" Also, I cannot download the video manually using ibm.box.com/v/counting-cars-training It says: This shared file or folder link has been removed or is unavailable to you. Any suggestions?

[@dkibe6006]

is there a way to show how you can install the IBM POWER AI VISION (TRIAL VERSION ) in windows 10? am finding difficulty in downloading.thanks

[@markstur]

The pattern was updated and Power AI Vision is now Maximo Visual Inspection. Go to the repo and see the Prerequisites section. It has this link:
Go here to learn more about trial access (Scroll down to the Give it a try section).
www.ibm.com/support/pages/ibm-maximo-visual-inspection

[@M.4.R.V.]

Can I use my camera connected to my LapTop in Real-Time?

[@ibrahimaba8966]

yes you can.

[@igxh5]

Where did u get the video? Or do u know any source of more videos ?

[@stizandelasage]

i'm turning this into a weapon

[@lowqchannel]

can the model differentiate car and heavy vehicle e.g. lorries, buses

[@markstur]

you can train the model w/ images of buses, trucks, etc with different labels using Visual Insights. This quick one was trained w/ a minimal number of cars.

[@eric9964]

So this is an api that would need to be run with wifi?

[@thedude333]

hi, great video, cant access the IBM Maximo Visual Inspection though, is it still available for free ? can you please post a direct link ?
thanks.

[@mustafauysal4187]

PowerAI Vision changed a lot. How can I create a Dataset

[@hemanthsharmam4761]

I have tried kcf opencv tracker which is used in this code before.....But it used to be very slow for multiple objects....If anybody have tried this pls let know how the performance is....fps and system specs used

[@ibrahimaba8966]

Hello if you sue multiple tracker, so you will need to implement mulprocess that's why your code is slow.

[@diegovigil7311]

Hello Mark. I liked the video, but I have tried to do but I think that Power AI Vision has stopped working. After uploaded the video, I have got 5 Frames as you said and then Exported the Labels. However its exporting labels for 3 days. Do you know what could be happening ? Some Tip? Thank you!

[@patrickwalsh8913]

I am getting the same thing. It's been exporting for about half an hour

[@antonioledezma1096]

@@patrickwalsh8913 Im also doing the same it says exporting labels with a circle on and it still the same by 10 days dunno what is going on

[@lucaslin783]

Hi Mark, how can I use powai vision in windows10

[@imagenigraphics]

I'm sorry but is it me or I can't find the json file?

[@shivamverma2091]

can U share the Algorithm you used in the project?

[@TheBorlanddelphi]

Hi Mark, any online class for me learn this lesson?

[@Cristian-ew4in]

Thanks for your video, bro. Do you know how to count objects in android studio?

[@darshinicr3211]

Sir could u explain the application of object detection and tracking

[@markstur]

Object detection allows you to identify and locate objects in an image. For example, we count the cars in an image and draw a box around each one -- instead of just classifying the picture as cars or "not cars". Tracking applies to video. We ran object detection of frames (images), but we'd like to recognize objects that we already detected. If we only cared about average number of cars at any point in time, we might not care to track them. Tracking allows us to count each car once and also time it from start to stop.

[@darshinicr3211]

@@markstur why only Python not c or c++

[@markstur]

@@darshinicr3211 You can choose another language such as c or c++. We chose Python.

[@miguecastillo]

Hi man, do you have any idea of how far can it detect a car?

[@payamb9601]

this is really a rookie question, but how can i use it with my own video, if the finish line is hard coded?

[@markstur]

Good question. You should take the code and modify to work for you. I've seen this code leveraged in surprising ways.

[@anpr]

Thanks for the video, what is the GPU used for training?

[@akshy471]

NVIDIA® TITAN RTX™

[@haroucheriadh8542]

@@akshy471 can we use another GPU [ex: Intel graphics Hd] ???????

[@akshy471]

@@haroucheriadh8542 integrated? Not much useful

[@haroucheriadh8542]

@@akshy471
Yes, unfortunately the graphic card is built-in and cannot be changed. Is there a solution ??

[@wijaywijayakumaran5404]

Fantastic tutorial. Is the "training_video.mp4" link missing?

[@markstur]

You should be able to download the file using this URL: ibm.box.com/v/counting-cars-training

[@wijaywijayakumaran5404]

Thanks Mark

[@tomtao5261]

@@markstur the url is also invaild now

[@markstur]

it got disabled for public access, should be fixed now

[@cristiandavidparramunoz6101]

Nice video, do you know how to implement this in android studio?

[@patrickwalsh8913]

I created the labels but it has been exporting for about half an hour. What did I do wrong? I drew the boxes around 5 cars from each of the two clips, but the export does not seem to work.

[@markstur]

Please try 5 frames and 25-30 labeled cars.

[@patrickwalsh8913]

I created 8 frames and 34 labels but it is still stuck exporting for over a week now.

[@Late-Night-AI]

Got the same problem...the export of the labels doesn't work for me either

[@markstur]

@@Late-Night-AI I'll contact the folks maintaining SuperVessel again. Thanks for commenting in the github issue.

[@tahrirsiddiqui6588]

Great tutorial! My project requires real-time object detection and motion tracking using Azure Kinect 4k camera, does OpenCV have any solutions for real-time?

[@purplehax4957]

You could try to use the YOLO v3 algorithm or an easier but not so good option would be contours.

[@borjonx]

I used the original Kinect (model 1414) with OpenCV inside Processing yesterday for real-time face detection. github.com/atduskgreg/opencv-processing

[@dhruvdwivedy4192]

@@borjonx nIce

[@ibrahimaba8966]

guys yolov3 is slow, you can just use backgroundSUbtraction and TrackerCSRT to achieve the same project in real time. I will publish a link of my code. It's fast and there is no need of deep learning for this kind of project cause the camera is static.

[@viridiaromero]

Great project! I'm trying to run it in my anaconda prompt and it's displaying this error: File "main.py", line 80, in
mask=cv2.morphologyEx(mask,cv2.MORPH_CLOSE,kernalCl)
TypeError: kernel data type = 8 is not supported ... what could be the reason :/

[@markstur]

Thanks! I don't see morphologyEx or kernalCI used in this project. So it's hard to help, but certainly the kernalCI param is setup wrong. The "Structuring Element" section in this doc might help: docs.opencv.org/3.0-beta/doc/py_tutorials/py_imgproc/py_morphological_ops/py_morphological_ops.html

[@rubenscj4772]

i had same problem.

[@alphaO27]

How can I use this Power Ai vision of IBM ? Is it free ?

[@markstur]

Check here to see if a free trial is available developer.ibm.com/linuxonpower/deep-learning-powerai/vision/access-registration-form/ Otherwise you need a Check here for options developer.ibm.com/linuxonpower/deep-learning-powerai/vision/ If you don't have Power hardware then you want to look for a free trial on the cloud.

[@ALLINONETrending]

Hello bro...this video is awesome...i wanted to recognise a spect on a person eye and vehicle name ..is it possible. !?? Please suggest me how to do that ?

[@yalmadiable]

Is it useful for realtime detect and track

[@markstur]

the shared/remote/free server isn't something you'd use for time-critical inference and that's what I've been using. If you are buying your own inference servers you should be able to get good response time (i.e. on edge devices). I know they have options, but I don't have experience with them.

[@yalmadiable]

Well I'm currently looking to develop a thermal detection/track software it's really not easy it has to be real time

[@markstur]

@@yalmadiable I'm not a sales guy, but if you're looking for edge devices, this link might be the right direction www.ibm.com/us-en/marketplace/ibm-powerai-vision/details

[@khoalt8216]

Can you share for me origin video ?! Please :))

[@markstur]

training and testing videos are here github.com/IBM/powerai-counting-cars/tree/master/data

[@user-yw8sr3uj1w]

mac user