OpenBot: Turning Smartphones into Robots

Поділитися
Вставка
  • Опубліковано 24 гру 2024

КОМЕНТАРІ • 112

  • @erknb3423
    @erknb3423 2 роки тому

    Is this mapping and recording home to android phone? Or make robot vacuum cleaner?

  • @YourOxytocin1
    @YourOxytocin1 3 роки тому +2

    Why is it needed?

  • @raymondlai3586
    @raymondlai3586 Рік тому

    Does it work with iPhone

  • @cryptoworldgames
    @cryptoworldgames 2 роки тому +1

    can we just buy it already made?

  • @mohammedshehada5373
    @mohammedshehada5373 4 роки тому +3

    I could see ultrasonic sensor @0:11 in the video but it's not mentioned in the components!
    Is it required or it can work as in the video with the camera as input only?

    • @matthiasmuller7898
      @matthiasmuller7898 4 роки тому +2

      As you said, we only use the camera feed as input to a neural network. The ultrasonic sensor is optional and not used in this work. It's mainly for looks of the robot. It can be used for simple obstacle avoidance or collision detection. I will add it to the Github repo. They are very cheap, you can buy them for a few $.

    • @mohammedshehada5373
      @mohammedshehada5373 4 роки тому

      @@matthiasmuller7898 Thank you. Its a great effort will be loving forward to try it once the app is online

  • @TheNameOfJesus
    @TheNameOfJesus 4 роки тому +2

    I wonder if the battery in the phone could actually power the wheels. That would simplify the hardware.

    • @matthiasmuller7898
      @matthiasmuller7898 4 роки тому +1

      This is possible, but would make the car very slow and may also not work on many phones.
      1) A voltage of only 5V means low rpm for the motors
      2) Most phones cannot supply power and if they can only small currents (a better alternative would be a power bank, but it still has issue 1)
      3) The phone would get very hot

    • @TheNameOfJesus
      @TheNameOfJesus 4 роки тому

      @@matthiasmuller7898 Ok, thanks. But also bear in mind that the external batteries weigh a lot and can be subtracted from the weight of the vehicle.

    • @matthiasmuller7898
      @matthiasmuller7898 4 роки тому

      @@TheNameOfJesus Yes, but to really reap the full benefits, the car may have to be redesigned. If you would like to explore this directions further, I would be very interested in the results.

    • @TheNameOfJesus
      @TheNameOfJesus 4 роки тому +1

      @@matthiasmuller7898 True, but some smart phones support "REVERSE inductive charging" through their wireless charging system and that means a totally different limit on wattage. For example the Galaxy S20 has 9W *reverse* wireless charging. That's 80% more than the 5W you mentioned. I do own the Lego robot kit but I don't have a well thought out plan for this idea so I'm not going to use it yet.

  • @Slaatje01
    @Slaatje01 Рік тому

    What cable is used to connect the phone to the Arduino?

  • @nareshpullakandam7543
    @nareshpullakandam7543 4 роки тому +2

    How to be part of the community to get the design

    • @matthiasmuller7898
      @matthiasmuller7898 4 роки тому

      You can find all code and instructions on the Github repo. It is open to all.

  • @dougb70
    @dougb70 4 роки тому +1

    0:49 *only* fifty bucks? Seems expensive for a RC car. Why not start there and save some bucks.

    • @matthiasmuller7898
      @matthiasmuller7898 4 роки тому +1

      You can also retrofit an RC car with the OpenBot system. Note that the OpenBot design already includes the microcontroller and additional low-level vehicle sensors.

  • @xpxdavex
    @xpxdavex 4 роки тому +6

    Is there a step-by-step guide for those who aren't so tech savvy? Is the custom PCB board in place of the Arduino and other components?

    • @matthiasmuller7898
      @matthiasmuller7898 4 роки тому +1

      The PCB acts as carrier board for an Arduino Nano and replaces the motor drivers. When using the PCB, you just plug in a Arduino Nano, connect the motors and sensor and you're done.

    • @xpxdavex
      @xpxdavex 4 роки тому +1

      @@matthiasmuller7898 Will you post a slowed down version of the video which starts at 1:05?

    • @smittyplusplus
      @smittyplusplus 4 роки тому

      @@matthiasmuller7898 Interesting, this wasn't clear to me... are you saying with PCB we do NOT need the L298N? I bought the "4 wheels plus L298N" from amazon and was trying to figure out how to fit the pcb and l298N in the mount holes on the printed base.

    • @matthiasmuller7898
      @matthiasmuller7898 4 роки тому

      @@smittyplusplus yes. Either L298N or the PCB. The PCB has integrated motor drivers. These are more efficient and the car will go faster as a results. However, if you are just building one robot, using the L298N will be cheaper and simpler.

    • @matthiasmuller7898
      @matthiasmuller7898 4 роки тому +2

      @@xpxdavex Yes. I'm planning post short videos for the individual steps. But I need to do some editing and re-record some parts.

  • @Raghavendrabsrg
    @Raghavendrabsrg 4 роки тому +7

    THIS Will change the world! In 5 years, all college/universities will use this!!

    • @RobotsEverywhereVideos
      @RobotsEverywhereVideos 2 роки тому

      We've been selling kits since 2011 if you are interested.

    • @nikhildhote1746
      @nikhildhote1746 Рік тому

      @@RobotsEverywhereVideos heya need your help in acquiring kits compatible with Openbot

  • @johnnycase1
    @johnnycase1 4 роки тому +11

    This is huge. Instead of everyone throwing out their phones we can reuse them. It is such a smart idea, truly incredible.

  • @amritlaldave2813
    @amritlaldave2813 4 роки тому +4

    I would like to make with my kids. Is there a step by step video guide?

    • @matthiasmuller7898
      @matthiasmuller7898 4 роки тому +3

      Not yet. But we are planning to release such a video in the near future.

    • @amritlaldave2813
      @amritlaldave2813 4 роки тому

      Thanks my kids are super excited to build this. I am as well, appreciate you open sourcing it!

    • @RobotsEverywhereVideos
      @RobotsEverywhereVideos 2 роки тому

      We sell kits at www.robots-everywhere.com/ and we have been doing so since 2011 :)

  • @tianlee6479
    @tianlee6479 4 роки тому +2

    Does MCU(Arudino Nano) need to perform calculation? Is it okay if you use other single-chip computers(such as Arudino Uno)?

    • @matthiasmuller7898
      @matthiasmuller7898 4 роки тому +1

      You can use any other MCU. It just needs the following features: serial communication (communicate with the smartphone), 4 PWM outputs (control the motors), I/O pins for battery monitoring, speed sensors, ultrasonic sensor (optional), indicator LEDs (optional)

  • @Arlomuzzwho
    @Arlomuzzwho 4 роки тому +1

    Is there a parts list for this project?

    • @matthiasmuller7898
      @matthiasmuller7898 4 роки тому

      Yes, please check the Github repo for BOM and instructions.

  • @lurkfpv1649
    @lurkfpv1649 4 роки тому +2

    Does the phone just connect to the arduino ?

  • @solutionstate
    @solutionstate 3 роки тому

    I am trying to build it, but I couldn't find more instructions and files about how to install and use the "person following" coco dataset as shown on the video, nor the policy files that were shown (to at least start with something), can someone direct me please?

    • @matthiasmuller7898
      @matthiasmuller7898 2 роки тому

      If you install the app, you can download several object detectors and use them. Feel free to join the Slack channel for further discussion and help.

  • @mohammedshehada5373
    @mohammedshehada5373 4 роки тому +1

    And when will the android app be available?
    Thank you

    • @JoeGreeneFilmsOslo
      @JoeGreeneFilmsOslo 4 роки тому

      Piggybacking off this comment, the Android app is listed as "coming soon" in the Github repo linked from their site: github.com/intel-isl/OpenBot

    • @matthiasmuller7898
      @matthiasmuller7898 4 роки тому +2

      The code is currently still in our internal open-source review process. Hopefully in 1-2 weeks or by the time you have finished building your OpenBot.

    • @matthiasmuller7898
      @matthiasmuller7898 4 роки тому

      Firmware and Android App are on Github now.

    • @mohammedshehada5373
      @mohammedshehada5373 4 роки тому +1

      @@matthiasmuller7898 Thank you.
      I will take a look at it

  • @shoubinchen767
    @shoubinchen767 3 роки тому +2

    Amazing

  • @jimmykan7873
    @jimmykan7873 4 роки тому +1

    This is interesting, is there an already compiled app for Openbot on Android Store?

    • @matthiasmuller7898
      @matthiasmuller7898 4 роки тому

      No, at this point you have to clone the repo and compile the application. However, it is pretty straight forward.

    • @jimmykan7873
      @jimmykan7873 4 роки тому

      @@matthiasmuller7898 Alright, thank you!

    • @jimmykan7873
      @jimmykan7873 4 роки тому

      @@matthiasmuller7898 I was able to install Openbot on my Android phone, but it uses front-facing camera instead of the back camera? Is there a way to flip it? Thanks!

    • @matthiasmuller7898
      @matthiasmuller7898 4 роки тому

      @@jimmykan7873 What phone are you using? You can just update the cameraSelection variable.
      github.com/intel-isl/OpenBot/issues/15

    • @jimmykan7873
      @jimmykan7873 4 роки тому

      @@matthiasmuller7898 I am using Moto G5 Plus. will check the setting, Thank you!

  • @reginaferreiravlogs
    @reginaferreiravlogs 3 роки тому +1

    Aqui no Brasil, ela ficaria sem o celular e sem o robô.

  • @nikanetique
    @nikanetique 4 роки тому +1

    it will work with iPhone?

    • @matthiasmuller7898
      @matthiasmuller7898 4 роки тому

      Unfortunately, it only works with Android phones right now. However, the Android Object Detection Demo for iOS would be a good starting point to develop something similar for iOS.

  • @konstantingeist3587
    @konstantingeist3587 4 роки тому +10

    Very cool idea! Why reinvent the wheel if modern smartphones are already packed with all the hardware you need?

  • @elumiomerk4013
    @elumiomerk4013 4 роки тому +3

    That indicating left and right was cute.

  • @orivaldo
    @orivaldo 4 роки тому +14

    This project is very interesting. Congratulations!

  • @framespersecondfps5256
    @framespersecondfps5256 4 роки тому

    @Matthias Müller Hi. I want to make this as my final year project, but the only thing I'm finding difficult for now is the driving policy. If possible can you help me with it when I'm done with the hardware stuff? Thank you

    • @matthiasmuller7898
      @matthiasmuller7898 4 роки тому +1

      Yes. If you struggle with the instructions, you can open an issue on Github.

  • @ellens5401
    @ellens5401 4 роки тому +1

    PCB 제작비 최소수량이 20개 20만원 가량 되네요.. 공구하면 좋겠는데 ㅠ

    • @matthiasmuller7898
      @matthiasmuller7898 4 роки тому +1

      I'm not sure if I understand correctly. Could you please comment in English.

    • @ellens5401
      @ellens5401 4 роки тому

      This is not a ripple that wants an answer. This article that I am looking for a member to follow this project in the same country as me. I want to share the PCB I ordered.

  • @Shuaigede
    @Shuaigede 4 роки тому +2

    Fantastic project well done and thanks for making it open source.
    When and where can we order the custom PCB?
    Coming from the iOS world, would a Samsung GT-i8150 be up to it?

    • @matthiasmuller7898
      @matthiasmuller7898 4 роки тому +2

      I will add the PCB, BOM and instructions how to order it to the repo tomorrow. As far as I know the Samsung GT-i8150 is 7 or 8 years old. A lot of things have changed in Android since then. My guess would be that it probably will not work or at least not with full functionality. But any phone from the past 2-3 years should work. Feel free to test it; I'd be curious to know myself.

    • @matthiasmuller7898
      @matthiasmuller7898 4 роки тому +4

      The PCB instructions are now available on Github.

    • @Shuaigede
      @Shuaigede 4 роки тому

      Thanks, I think I’ll try with a more modern phone, but I will definitely give the GT-i8150 a try and let you know

    • @gui18bif
      @gui18bif 3 роки тому

      Just buy an android. Is it that hard?

  • @vandana2410
    @vandana2410 4 роки тому +2

    In person following, what if there are multiple people on the road? Won't the robot start to follow other people if the algorithm assigns more confidence to other people?

    • @matthiasmuller7898
      @matthiasmuller7898 4 роки тому +2

      Yes, exactly. We have also observed this behaviour in our experiments. If you want to track a specific person and there will be other persons close by, you will need to integrate a tracking algorithm as well.

  • @melvilleseguyhouel3168
    @melvilleseguyhouel3168 4 роки тому +3

    I'm gonna build that robot

  • @AmeenAltajer
    @AmeenAltajer 4 роки тому +1

    Thank you, guys! Love this work!

  • @ianantonius7287
    @ianantonius7287 4 роки тому +3

    Yeah but would a Wookie scare it?

    • @matthiasmuller7898
      @matthiasmuller7898 4 роки тому

      Probably not, especially not the Yoda version. ua-cam.com/video/PEj8jWapGt4/v-deo.html

  • @henrychow6852
    @henrychow6852 4 роки тому +3

    Love this! Is there an IOS version release soon?

    • @matthiasmuller7898
      @matthiasmuller7898 4 роки тому +3

      Probably not any time soon since it requires a fair amount of work and is not our top priority right now.

    • @someoneelse7629
      @someoneelse7629 4 роки тому +3

      Haha, as if...
      Apple will gladly sell you an iRobot for $999 in a few years, but then you will have to buy the wheels separately...
      Then it will roam around and spy on you all day, phoning home the data to the big iCloud....
      They will also claim they invented the mobile-phone robot

    • @gui18bif
      @gui18bif 3 роки тому +1

      Just buy an android, iOS will die soon

  • @andreehret5576
    @andreehret5576 4 роки тому +1

    Nice Job! I Like the Idea of using a Smartphone as the brain of the robot. Is it possible to add also the STEP-files for the phone Mount?

    • @matthiasmuller7898
      @matthiasmuller7898 4 роки тому

      Added to the Github repo.

    • @andreehret5576
      @andreehret5576 4 роки тому

      @@matthiasmuller7898 thanks a lot! Looking forward for Updates of your Project. IT IS definately one to look at. Printing in ihr ultimaker is nearly finished

  • @aneeshputhurethappukuttan8054
    @aneeshputhurethappukuttan8054 4 роки тому +5

    It's interesting. It makes sense to use mobiles for small robots like the one in video. Congratulations.

  • @armyn999
    @armyn999 4 роки тому +2

    very inspiring project..... Kereeeen 👍👍

  • @bastelgarage-ch
    @bastelgarage-ch 4 роки тому +1

    Very cool project of 3D printers is already running :-)
    So far I always connected Android and Arduino with Bluetooth using the MIT AppInventor app.
    What kind of cable do you need? Can you build the cable yourself?
    Does the smartphone have to be OTG-capable or is it possible with anybody?
    Thanks for the great project, I'm looking forward to more.

    • @matthiasmuller7898
      @matthiasmuller7898 4 роки тому

      The smartphone needs to be OTG capable. I'm not sure about building the cable manually, but I don't see any reason why not. Using an OTG adapter should also work. In principle communication via Bluetooth would also be possible, but we did not implement it. A wired connection is more reliable.

    • @bastelgarage-ch
      @bastelgarage-ch 4 роки тому

      @@matthiasmuller7898 Danke für die Info und Grüsse aus der Schweiz :-)

    • @matthiasmuller7898
      @matthiasmuller7898 4 роки тому +1

      @@bastelgarage-ch Gerne.

    • @RobotsEverywhereVideos
      @RobotsEverywhereVideos 2 роки тому

      @@matthiasmuller7898 Incorrect, you can also use the audio jack. The Android AntBot we have been selling since 2011 features an audio-serial option. This has allowed us to use budget Android phones starting from 2.x Let me know if you want more information, as our design has also been open source the whole time :)

  • @android4cg
    @android4cg 4 роки тому +2

    Really great project! a) Please release the APK on the PlayStore. Unexperienced users will need to spend lot of hours to get it finally working b) Is there any shop who offers electronics kit with all required components except 3d printed parts? c) How to control the vehicle. Does OpenBot provide Html webinterface which can be access for control and remote video via browser?

    • @matthiasmuller7898
      @matthiasmuller7898 4 роки тому +3

      a) We are working on it, but it requires some internal processes which take time. b) You can buy some Arduino robot kits that have most of the components but not all. www.banggood.com/de/Educational-DIY-Smart-Robot-Car-Kit-Gesture-Control-Car-Hand-Gesture-Car-For-Arduino-p-1732917.html We expect that some online shops will offer such kits at some point. c) For now, it does not provide such an interface. Control commands are issued from the phone to the microcontroller directly. There is no web interface to the phone yet. So there are two ways to control the robot. 1) Connect a bluetooth controller to the phone (e.g. PS4, XBox). 2) Run an algorithm on the phone to drive the car autonomously. There is already a neural network preinstalled that allows you to let the car follow a person. This can be turned on/off in the app or via a game controller (R1 button).

    • @dougb70
      @dougb70 4 роки тому

      makeblock is about the same thing.

    • @RobotsEverywhereVideos
      @RobotsEverywhereVideos 2 роки тому

      Hello, we have been selling these since 2011. I hope that you had no issues finding the open source designs and schematics on our Wiki. Welcome to the conversation :) www.robots-everywhere.com/

  • @raahimirfan5996
    @raahimirfan5996 4 роки тому +3

    Amazing!

  • @MaksymCzech
    @MaksymCzech 4 роки тому +4

    Great work!

  • @RodCornholio
    @RodCornholio 4 роки тому +1

    Hopefully cheap Chinese knockoffs are available at Best Buy in 12 months.

  • @jcnessi
    @jcnessi 4 роки тому +2

    Cool.

  • @Lucibus
    @Lucibus 4 роки тому +1

    Such a cool and interesting project! Very clever to use the smartphone. Did you test the difference in performance when using the smartphones wide-angle or the telephoto lenses?

    • @matthiasmuller7898
      @matthiasmuller7898 4 роки тому +1

      No we did not, but this would be interesting. With a wide-angle lens navigation should be much easier. But since only recent phones have a wide angle lens, we opted to use the main camera sensor. In the code you can change the camera selection.

  • @bensclaygarden6010
    @bensclaygarden6010 4 роки тому +3

    wow,thanks for sharing

  • @ravisawhney3111
    @ravisawhney3111 4 роки тому +4

    Love this. Want to build it.