i am working with an instance, i get an error if data_config['path'].startswith(COMET_PREFIX): KeyError: 'path' COMET INFO: Couldn't find a Git repository in '/home/ubuntu/PPE_kit_Detection/yolov5_ppe' nor in any parent directory. Set `COMET_GIT_DIRECTORY` if your Git Repository is elsewhere. COMET WARNING: Comet credentials have not been set. Comet will default to offline logging. Please set your credentials to enable online logging. how to solve it
Hi sir, my project is focused on a custom dataset but when I tried to implement it by following your step, I stuck in this line !/content/yolov5/weights/download_weights.sh which shows the error of /bin/bash: /content/yolov5/weights/download_weights.sh: No such file or directory. Can sir please guide me on this as I'm still new to this?
@@karndeepsingh It is not about cloning properly. In new edition of yolov5, the script is in different folder (/content/yolov5/data/scripts). You can download the weights with following commands: !curl -L "github.com/ultralytics/yolov5/releases/download/v5.0/yolov5s.pt" > yolov5s.pt !curl -L "github.com/ultralytics/yolov5/releases/download/v5.0/yolov5m.pt" > yolov5m.pt !curl -L "github.com/ultralytics/yolov5/releases/download/v5.0/yolov5l.pt" > yolov5l.pt !curl -L "github.com/ultralytics/yolov5/releases/download/v5.0/yolov5x.pt" > yolov5x.pt
Hi bhai i got a task from a company.i tried all the steps mentioned here.But i failed to predict on new dataset.Kindly help.though i got rejected from that company but it would be great if you could guide me.please be kind and help me.Thank you.
hi karndeep its a very helpful video but can you tell me after I create the the train set how can I detect a video an find a duplicate video using the same trained model
Thats a total different problem to solve. You may use to embed every frame of video and find the similarity between the two embeddings of the video. You can try Siamese Network to do so.
Hi, I trained a model to detect some custom objects. The model is detecting the objects, but when I convert the model to .mlmodel and embed it inside an IOS app it not detecting anything. Any idea why ?
I am encountering quiet a few errors in this. First the weights were not downloading as the weights file have been moved to data folder. Second, when I give the command to train, it says that data cannot be trained without label. I have created labels and have gone over it many times. I don't know what to do next. Please help
In the dataset that we have uploaded, in test and train folders change the name of the folder of labels from 'label' to 'labels'. After i did that, the error got resolved
Hi Karndeep. I am glad to say that your tutorial really helped in my own project. Thank you very much. I improved mAP from 0.1 to 0.83. So, now my network works properly. Could you please explain how to do with the video clips in the same tutorial? Thank you in advance. Best regards, John
@@karndeepsingh Hey , Thank you for this understanding tutorial But can you please explain the dataset management little bit How the other files are generated?
Hi Karndeep ! Thanks a lot for such a simple and systematic explanation of Yolo5 implementation on custom dataset. Could you please suggest how to use/apply it on mobile /real-time application . How to use this model while driving a car or running it on a video file?
You can save the model in tensorflow lite or onxx format or you can also train Yolov5s model for mobile device detection. For video you use open cv to load the video and iterate through each frame of the video and pass it to the trained yolov5 model for detection.
@@karndeepsingh i can open the video through OpenCV but not sure how to iterate each frame of the video. Would i have to make labelling again on video frames ? or my separate labeled data can be used for video file ?See if you could share any code source to do so , It would be highly appriciated.
Sir, my image size is 2756*4252 pixel...., how can I work with your colab notebook with these dimension. At the training time, It is throwing tcmalloc: large alloc error. Please help to solve this problem.
@@karndeepsingh i'm facing the same issue . I have a dataset of images with size 1500x1376 pixels. Will the label files work properly if I resize the image because I got the label files from using the original image size ?
Hi Karndeep, The detect.py did not generate label.txt files, and it mentioned: 0 labels saved to runs/detect/exp17/labels. Following is the command I used. !python detect.py --source ./data/images --weights best.pt --img 416 --conf 0.4 --save-txt Any suggestions ?
@@karndeepsingh I assigned the correct full path also. But still it says: 0 labels saved to runs/detect/exp4/labels. This is my full Path: !python detect.py --source ./test_unseen_images --weights '/content/drive/MyDrive/yolov5/runs/train/yolo5s_22/weights/best.pt' --img 640 --save-txt --save-conf
At 14:30 1) If we want to combine our custom set in default which yolov5 given sets is it possible? and how 2) or can we delete some classes that we doesn't needs? I would like to make custom sets with person classes, But if I made custom sets in your videos' method Maybe i think i have to make person dataset again . ( I'd like to add my customs to the existing default datasets. )
Hi Kandarp Singh, I have trying to train the Yolov5 on a skin dataset with about 2500 images of resolution 1100x800 on average. I am getting an accuracy of only 0.2 max even after adding custom augmentations to increase the train set size. without augmentation the accuracy is merely 0.11. Can you please advise what could be the issue? I can share weights and Biases results if you wish,
In my data.yaml file i have 33 classes where have also many unused classes.But i need only 18 classes.If train 33 classes(used and unused mixed up),then threre will have any problem to detect?? and i also want to if use only 18 classes out of 33 what actually needed then what can i do? I should do annotate again?? Note: for annotate i use roboflow tools. thank you sir.
If you have already annotated 33 classes then let the model detect those all classes and write a script to only work with the classes you want. Or else train with 18 classes and annotate like how I described in the video( This would take lot of time)
Thank you for the explanation..Excellent tutorial During training yolov5 models in Colab, some problem might occurs due to expired session or GPU usage has already reach the limited so that all the content in the colab directory will be erased.. is there any way to continue the training in this case? Thank you
@@reealtech_xr you can use yolo just you need to convert text to xml. In tensorflow as it takes annotations as XML and then convert it into TFrecords. So, you can do the conversion. Just check the source code or google to convert the files into respective format.
Hi Karndeep, thanks for the tutorial. Pls tell about following thing: After passing new images and using detect.py it'll be able to detect and give coordinate but what about output data ..? Where wil be the label and precision wil be stored or is there any method to store that output data containg label name and precision.. please have a look on this
@@karndeepsingh but there is no results file generating from model. With --save -- txt, --save -- conf Multiple txt file are getting generated, which has, detected class, xmin, xmax, ymin, ymax, confidence . Then how can we get results in csv
Hello sir. Can you pls tell me why the number of images are same as all images in train result? Such as Class Images targets p r all 40 40 Cow 40 20 Cat 40 20 Why the images number is same?
@@karndeepsingh sir the picture of cow images 20 and the picture of cats are 20.. both type of images are in one folder. So why they show cat images 40 and cow images 40?
Hi Karndeep. Thank you for this tutorial, some moments are very useful. Could you please explain if, for example, a parameter of mAP@.5:.95: equals 0.0126, P = 0.736, R= 0.118, and mAP@.5 = 0.0653 These values are unacceptable, and something wrong with the created neural network? Your soonest response will be appreciated. Thank you in advance.
I can't comment on the stats until I know, how much data you used, whether annotations are done correctly or not. How many epochs number of images you have used..etc
Trained and tested my model on colab , downloaded weights for the run. I can not do inference with @t on my local machine (set up is complete) with the same weights.
Don't worry about that file. I created it manually on my local machine to just get the details of the number of classes. You can create using simple python code.
@@karndeepsingh What do you mean created manually ? I have trained my model on google colab with my own data set example : python train.py --batch 16 --epochs 100 --data myconfigfile.ymal --cfg models/yolov5m.yaml --name myexpname . It worked fine on colab. I also did the inference with detect.py example : python detect.py --weights pathtothefolder/best.pt --source path to test images.
Inference worked as well, and object were identified in almost each image. Now I have downloaded these weights to do the inference on my local machine where I have everything setup. When I run detect.py with these weights , It runs but do not generate any results on my test data. I have also pulled the latest yolov5 version.
Hi Karandeep,
Weights are not there in yolov5 folder...can you plz help me out to resolve it
What you use runtime type? Because your train processing so fast. I use T4 GPU but so slow almsot hours train process
i am working with an instance, i get an error if data_config['path'].startswith(COMET_PREFIX):
KeyError: 'path'
COMET INFO: Couldn't find a Git repository in '/home/ubuntu/PPE_kit_Detection/yolov5_ppe' nor in any parent directory. Set `COMET_GIT_DIRECTORY` if your Git Repository is elsewhere.
COMET WARNING: Comet credentials have not been set. Comet will default to offline logging. Please set your credentials to enable online logging. how to solve it
why do we need --nosave --cache command while training?
Hi sir, my project is focused on a custom dataset but when I tried to implement it by following your step, I stuck in this line !/content/yolov5/weights/download_weights.sh which shows the error of /bin/bash: /content/yolov5/weights/download_weights.sh: No such file or directory. Can sir please guide me on this as I'm still new to this?
I would suggest clone it properly. Or else check the repo it has that file or not.
@@karndeepsingh It is not about cloning properly. In new edition of yolov5, the script is in different folder (/content/yolov5/data/scripts). You can download the weights with following commands:
!curl -L "github.com/ultralytics/yolov5/releases/download/v5.0/yolov5s.pt" > yolov5s.pt
!curl -L "github.com/ultralytics/yolov5/releases/download/v5.0/yolov5m.pt" > yolov5m.pt
!curl -L "github.com/ultralytics/yolov5/releases/download/v5.0/yolov5l.pt" > yolov5l.pt
!curl -L "github.com/ultralytics/yolov5/releases/download/v5.0/yolov5x.pt" > yolov5x.pt
@@ilkinhuseynzade7535 Its really worth
sir my question is:-- how we label all the items in a dataset at once????????? Please tell me about this......
You have to go through each and every image to label your data.
@@karndeepsingh ok, thankyou👍
hey could you please tell how to train a model on custom handwritten dataset?
If you wanted to extract the handwritten region then you can simply apply the same approach as discussed in the video
Hi bhai i got a task from a company.i tried all the steps mentioned here.But i failed to predict on new dataset.Kindly help.though i got rejected from that company but it would be great if you could guide me.please be kind and help me.Thank you.
hello... hold on, how did we skip from labeling images to a folder ready to compress? The video was making sense till then... plz help boss! '' }
Thank you so much sir...your explanation was top notch...because of this video i was able to make a project of custom dataset🙏
Good video but the sound of the mouse clicks are way too loud and distracting.
bro during training model it show labels 0 what is it means
Sir can you help me train and test yolo V4,v5 and ssd and compare the results using table like accuracy,speed fps, mAP etc
Why have you used that data.yaml file? do we need that? How to create that data.yaml file?
Plz i need a help ... Error no images found?
hi karndeep! i want to ask how we decide the epoch? is that a formula to decide the epoch??
thanks for video...very helpful
thank you so much , finally a useful , well described tutorial , best regards
My .txt file after detecting has 6 columns. What does each of these represent. The first representing the class
Others are representing the bounding box information
hi karndeep its a very helpful video but can you tell me after I create the the train set how can I detect a video an find a duplicate video using the same trained model
Thats a total different problem to solve. You may use to embed every frame of video and find the similarity between the two embeddings of the video.
You can try Siamese Network to do so.
Hi, I trained a model to detect some custom objects. The model is detecting the objects, but when I convert the model to .mlmodel and embed it inside an IOS app it not detecting anything. Any idea why ?
Convert it into TFLite model or using ONNX type then you can make use of it.
I am encountering quiet a few errors in this. First the weights were not downloading as the weights file have been moved to data folder. Second, when I give the command to train, it says that data cannot be trained without label. I have created labels and have gone over it many times. I don't know what to do next. Please help
In the dataset that we have uploaded, in test and train folders change the name of the folder of labels from 'label' to 'labels'. After i did that, the error got resolved
Hi Karndeep. I am glad to say that your tutorial really helped in my own project. Thank you very much. I improved mAP from 0.1 to 0.83. So, now my network works properly. Could you please explain how to do with the video clips in the same tutorial? Thank you in advance. Best regards, John
You have train yolo models on images and then inference it on video frames.
@@karndeepsingh Hey , Thank you for this understanding tutorial
But can you please explain the dataset management little bit
How the other files are generated?
You are underrated in this you tube
Doing it this way will it allow multiple objects to be detected in the same image?
Yes
Can you share your datasets as well
Check roboflow dataset. You can find dataset.
Hi Karndeep ! Thanks a lot for such a simple and systematic explanation of Yolo5 implementation on custom dataset. Could you please suggest how to use/apply it on mobile /real-time application . How to use this model while driving a car or running it on a video file?
You can save the model in tensorflow lite or onxx format or you can also train Yolov5s model for mobile device detection.
For video you use open cv to load the video and iterate through each frame of the video and pass it to the trained yolov5 model for detection.
@@karndeepsingh i can open the video through OpenCV but not sure how to iterate each frame of the video. Would i have to make labelling again on video frames ? or my separate labeled data can be used for video file ?See if you could share any code source to do so , It would be highly appriciated.
@@shekharkumar1902 Did you find a solution for that?
@@zehra2334 actually , no . I didn't explore in recent time but I know there are solutions for every challenges...
@@shekharkumar1902 yes, I am sure about that :).
excellent thank you very much
it is mandoratory for label images in test folder
Yes. It will help you to understand the performance of model.
Sir, my image size is 2756*4252 pixel...., how can I work with your colab notebook with these dimension. At the training time, It is throwing tcmalloc: large alloc error. Please help to solve this problem.
Using --img 640 while training.
@@karndeepsingh i'm facing the same issue . I have a dataset of images with size 1500x1376 pixels. Will the label files work properly if I resize the image because I got the label files from using the original image size ?
Plz i need a help
The way you explain .Appreciated
Amazing and precise tutorial Loved it
Love this Video, it was very helpful.
do you have the dataset ??
You can download it from Roboflow
@@karndeepsingh thanks man
Hey I can not find the weights folder in yolov5 so im blocked in download all versions of YOLO-V5 Model, can anyone help me please
You can checkout ultranalytics github
@abderrahmenmelliti9627 hi please can you help me with the yolov5 weights download ? i have the same problem
You can visit ultranalytics github or download ultranalytics library to use models
Hi Karndeep,
The detect.py did not generate label.txt files, and it mentioned: 0 labels saved to runs/detect/exp17/labels. Following is the command I used.
!python detect.py --source ./data/images --weights best.pt --img 416 --conf 0.4 --save-txt
Any suggestions ?
Check your best.pt model path.
@@karndeepsingh I assigned the correct full path also. But still it says: 0 labels saved to runs/detect/exp4/labels.
This is my full Path:
!python detect.py --source ./test_unseen_images --weights '/content/drive/MyDrive/yolov5/runs/train/yolo5s_22/weights/best.pt' --img 640 --save-txt --save-conf
Thnx man
thanks
sir in my case your command for downloading all versions of yolo model is not working. says no such directory found
There has been change in the codes since then. Don't run that particular line of cell.
@@karndeepsingh and its also showing cuda error when I am running it with colab gpu
Sir I want to ask how we can change source code for only person detectiom
Its the same process that is shown in the video
You can use coco dataset itself to detect the person and yolo was trained on coco data.
does the labeled pictures comes with the download ?
Yes. Only, If you download the labelled images.
@@karndeepsingh thank you
Thanks!
Thats really amazing .
At 14:30
1) If we want to combine our custom set in default which yolov5 given sets
is it possible? and how
2) or can we delete some classes that we doesn't needs?
I would like to make custom sets with person classes,
But if I made custom sets in your videos' method
Maybe i think i have to make person dataset again .
( I'd like to add my customs to the existing default datasets. )
If you want to only work on with a particular class you have to get the images and respective annotations for it.
Hi Kandarp Singh,
I have trying to train the Yolov5 on a skin dataset with about 2500 images of resolution 1100x800 on average. I am getting an accuracy of only 0.2 max even after adding custom augmentations to increase the train set size. without augmentation the accuracy is merely 0.11. Can you please advise what could be the issue? I can share weights and Biases results if you wish,
maybe you can try increasing the value of epochs...this will take longer to train your model but will give you a good accuracy
What if I had a single class label to model? Does yolov5 work in that case?
Yes
Please i want to be able to detect pedestrian only in a video
Do you know how i can do that?
Hlo sir i need project on smoke detection and its code will help me please
Yes
@@karndeepsingh will u send me the code please or other wise do project on this please sir
Hlo sir please replay us we have no time
In my data.yaml file i have 33 classes where have also many unused classes.But i need only 18 classes.If train 33 classes(used and unused mixed up),then threre will have any problem to detect??
and i also want to if use only 18 classes out of 33 what actually needed then what can i do? I should do annotate again??
Note: for annotate i use roboflow tools.
thank you sir.
Are you using the same classes which are being used while training yolov5 ?
@@karndeepsingh no
If you have already annotated 33 classes then let the model detect those all classes and write a script to only work with the classes you want. Or else train with 18 classes and annotate like how I described in the video( This would take lot of time)
Great job!
Thank you for the explanation..Excellent tutorial
During training yolov5 models in Colab, some problem might occurs due to expired session or GPU usage has already reach the limited so that all the content in the colab directory will be erased.. is there any way to continue the training in this case? Thank you
Reduce batch size, that way colab wont go down
we can create checkpoints for example at each epoch 2 , you can save the weights. Then upload the weight, and you can keep going where you left..
where can I find the data.yaml file?
You dont have to worry on data.yaml file. I prepared on for my own dataset. You have to prepare it for your own dataset.
@@karndeepsingh can you tell me how I can prepare it?
why can't we use xml file formate in yolo
Every type model has different formate to accept. If you go for training any tensorflow model, you need to convert it into TFRecords.
sir can you please tell which model supports xml foemate
@@reealtech_xr you can use yolo just you need to convert text to xml. In tensorflow as it takes annotations as XML and then convert it into TFrecords. So, you can do the conversion. Just check the source code or google to convert the files into respective format.
@@karndeepsingh thanks for your help sir😇
Why best.pt is not save in my run folder
I was facing the same issue, but the next day when I tried training it again best. Pt was seen, don't know how just give it a try.
Remove that --no-save flag from the command, it will start saving !
Hi Karndeep, thanks for the tutorial.
Pls tell about following thing: After passing new images and using detect.py it'll be able to detect and give coordinate but what about output data ..? Where wil be the label and precision wil be stored or is there any method to store that output data containg label name and precision.. please have a look on this
You can mention the argument -save-crop to save the detected objects
@@karndeepsingh is there any option to save the predicted precision in text format? For example for any image of car if it's detected as Car_0.87
How can we save this car_0.87 in text format? Pls share your thoughts
You can pass -save-text argument. Please explore the functions in the detect.py you will understand.
@@karndeepsingh okay thank you so much
Hello karan, I want to save the result into csa file with result, confidence and class name.
do u know, how can we do that..?
Run results.pandas()
@@karndeepsingh but there is no results file generating from model.
With --save -- txt, --save -- conf
Multiple txt file are getting generated, which has, detected class, xmin, xmax, ymin, ymax, confidence .
Then how can we get results in csv
Write a code to convert these text files into CSV
@@karndeepsingh is there is any that we can directly CSV file from model...?
Any link
Check yolov5 github repository.
Hello sir. Can you pls tell me why the number of images are same as all images in train result? Such as
Class Images targets p r
all 40 40
Cow 40 20
Cat 40 20
Why the images number is same?
Did you train on total 40 images combining Cow and Cat together?
@@karndeepsingh yes sir
So, hope you are getting the point. It is showing total 40 images and out of that it has 20 instances of cow image and cat image respectively.
@@karndeepsingh sir the picture of cow images 20 and the picture of cats are 20.. both type of images are in one folder. So why they show cat images 40 and cow images 40?
@@motaherhossain5851 It is total images..you should focus on target.
Hi Karndeep. Thank you for this tutorial, some moments are very useful. Could you please explain if, for example, a parameter of mAP@.5:.95: equals 0.0126, P = 0.736, R= 0.118, and mAP@.5 = 0.0653 These values are unacceptable, and something wrong with the created neural network? Your soonest response will be appreciated. Thank you in advance.
I can't comment on the stats until I know, how much data you used, whether annotations are done correctly or not. How many epochs number of images you have used..etc
@@karndeepsingh Hi Karndeep. Results were obtained by 50 epochs, I would like to use 1000 epochs,
Train it for 500epochs. Surely you will get better accuracy numbers.
@@karndeepsingh Thank you.
@@karndeepsingh sir my question is:-- how we label all the items in a dataset at once????????? Please tell me about this......
sir I want to train 40 + new classes of objects, so i want to train my model in 4 part but i don't find the way to do it .can u help?
Train in 4 part means?
@@karndeepsingh sir my question is:-- how we label all the items in a dataset at once????????? Please tell me about this......
I always see only one weight last.pt in my test folder
Trained and tested my model on colab , downloaded weights for the run. I can not do inference with @t on my local machine (set up is complete) with the same weights.
How you are trying to do the inference?
@@karndeepsingh how did you generate the data.yml?
Don't worry about that file. I created it manually on my local machine to just get the details of the number of classes. You can create using simple python code.
@@karndeepsingh What do you mean created manually ? I have trained my model on google colab with my own data set example : python train.py --batch 16 --epochs 100 --data myconfigfile.ymal --cfg models/yolov5m.yaml --name myexpname . It worked fine on colab. I also did the inference with detect.py
example : python detect.py --weights pathtothefolder/best.pt --source path to test images.
Inference worked as well, and object were identified in almost each image. Now I have downloaded these weights to do the inference on my local machine where I have everything setup. When I run detect.py with these weights , It runs but do not generate any results on my test data. I have also pulled the latest yolov5 version.