Visual Object Recognition | Camera in Webots Simulator | [Tutorial 15]
Вставка
- Опубліковано 21 тра 2020
- Interested in Robotics, Simulation, and can feel a spark..!!??
Wanna have fun with camera mounted on a custom robot in Webots? Then you are at the right place. Soft_illusion Channel is back with a new video..!! (A channel which aims to help the robotics community).
#Webots_tutorial #object_recognization #webots_camera
To understand this video better do watch the previous video on the integration of camera on a robot. Also do watch other videos on how to integrate a slider (linear) and a hinge (rotary) joint.
This video teaches you to perform object recognition using a camera mounted on a robot. The camera on the robot can move using the joints and actuators on the robot. Recognizing different objects using colors has also been taught. No secrets will be revealed here on how to get the magic working. Do watch the video. Have fun as this can be used for various applications from mobile robot surveillance to gaming. Do use this method to make your own gaming apps and share with me.
Controller link:
github.com/harshkakashaniya/S...
As an initial step before diving into Webots, it is important to understand it’s importance and what sets it apart from other simulators like Gazebo and NVIDIA Isaac. User friendly, easy to learn and implement on custom robots and applications are not the only pros. For those who understand the intricacy involved, this software is easy to integrate with ROS, multi-threading is possible and an amazing tool for multi agent navigation.
Wait, that’s not all..!! Good news for Reinforcement learning fans..!!! OpenAI Gym blends well with Webots.
If the above information triggers any thought, please feel free to comment to initiate discussions not only on Gazebo or NVIDIA Isaac but also robotics in general.
Robotics is not difficult..! It is inspiring and challenging..!! We are in the current era of the Robotics Revolution, where Disco will be the name of a pet robot not dog.
This channel is driven with a motive to provide good robotics tools to aid everyone gain a good and simple understanding of this so-called complex robotics domain. Hopefully this will build the bridge to turn the novel ideas of viewers into reality.
Below are links to help you get started with any webots project.
Download Webots:
cyberbotics.com/
Webots tutorial playlist:
• Setting Up environment...
The tutorials begin with the basic installation of the simulator, and ranges to higher level applications like object detection (using camera) and actuator (linear/rotor) control.
Comment if you have any doubts on the above video.
Also do make suggestions if you need a tutorial on any other project topics.
Do Share so that I can continue to make many more videos with the same boost. :)
Happy Coding. :)
#computervision #webots #imagerecognization
![CAD Model to Robot Simulator | URDF to PROTO | Webots | [Tutorial 17]](http://i.ytimg.com/vi/k27HUeuBtMk/mqdefault.jpg)
![CAD Model to Robot Simulator | URDF to PROTO | Webots | [Tutorial 17]](/img/tr.png)
![Introduction to Nodes | Webots Simulator | [Tutorial 2]](http://i.ytimg.com/vi/kn5o0j3-gO0/mqdefault.jpg)
Thanks!!!! I was working on my group project and made the exact mistake you said. Now my robot is able to recognize objects. i appreciate it!!!
Great to hear... Happy coding
thanks a lot so much for this
thanks very much for your help.. i was wondering if you could do a video on how to identify lane or what are the objects that can be identified through the recognition node ... as i would like to insert specific objects within the simulation ... thanks again that was helpful
Good idea...
Let us see how we can plan
Thanks very much!! I have a question. How can i get position_on_image information? I can see in thumbnail of this video!
Is there any API to stop the simulator and clear up the content of the console from the controller based on an evenet? Could you share or direct me to the guide
nice job! I will Subscribe you sir!
Thanks for the sub!
do you have any video and cod for traffic lights detection and their states in webots?
Can you tell me please how we can get the images and use it further for processing in WeBots
i love you!!!!!!!!!!!!!!!!!!
Good to know 😊
👍
Thanks
Hi I need something that detects colours reliably and returns the midpoint of the coloured object
, but i'm unsure on how to do this :/
In that case I will recommend you to look at Opencv libraries. Especially cv2.countours() function or concept of Hough lines
I added a proto node "BungalowStyleHouse' to my model anticipating the camera to recognise. But I can't visualise the node though I can see axis of the node. Do I need to make any change to the model in order to see the Bungalow. Can the camera recognise all objects in the proto
Did the proto build fine with the xacro file.
(Check your proto file does it have 100 s of lines)
If yes, it's axis may be offset move the axis and check around if you see the proto.
And lastly may by your have a scale issue. Change the scale and check the model.
I am not sure about detection of node.
You can check and do comment. If you find a solution.
@@coolrobotics Thanks
Hi there, how do you improve the camera resolution ? :) thanks
Change the resolution in camera node .
Or If you have a proto add a resolution property.
Hello I need help to recognize some objects in a nao robot, how can I integrate the recognition node from the proto file?
Did you find anything?
I don't see the custom robot controller link in the description, thank you
I just edited controller links in the description. Thank you for letting me know.
@@coolrobotics Thank you so much!
@@coolrobotics Hi!!!! I am a student from Taiwan, and I am going to use webots simulation for my project. I wonder how difficult is it to do real world experiment from simulation. Also, do you have temperature scanner sensor?
Difficulty depends on what is to be achieved.
I guess Webots does not have temperature sensor.
@@coolrobotics do you have a video on how to add a temp sensor on the simulation?
Can You show how to integrate opencv in webots environment?
You can integrate ROS and Integration of Open CV with ROS
That will be easiest way to go
Hi, how can I make a robot that follows a line?
Refer this ...
www.cyberbotics.com/doc/guide/epuck
@@coolrobotics I can't find the py code for it. I already made an infrared distancesensor
Okz . Then I suppose you will need to understand the logic in available language and make your own controller in .py
would appreciate it if a python version of this is done...
Also, do cover the image processing part too ( like getting a robot to avoid obstacles recognized by camera feed).
Am attaching a sample world file too...
drive.google.com/file/d/1nhV57CCzD1ng9YxEZ01vuz7TlDYdFyOK/view?usp=sharing
Sure
hello,I am working on a group project,can you plz help me in it
Sure
@@coolrobotics so basically ,it is a project in which I have to design a controller for an epuck
robot that can hit the coloured boxes
in the arena in the given order. The Bot
should avoid other color boxes when
trying to hit the target box in the arena.
After hitting all the three coloured
boxes ( For ex. Green, Violet, Blue), it
should reach (RedBox) and
stop.
So how can i proceed??
Are you guys comfortable with ROS
If you can implement 2 nodes .
One for obstacle avoidance using a distance sensor.
And other will have computer vision pipeline with sedimentation and will use camera
@@coolrobotics I have mailed you,pls check it out
hai soft illusion, i already email you can you please check the email 🥺
Sure...
thanks very much for your help.. i was wondering if you could do a video on how to identify lane or what are the objects that can be identified through the recognition node ... as i would like to insert specific objects within the simulation ... thanks again that was helpful
Sure we will try to make a video