Developing a Pick-and-Place Robotic Arm

Поділитися
Вставка
  • Опубліковано 28 вер 2024
  • Development of a 4-DOF serial robotic manipulator designed for pick and place tasks. We discuss robot kinematics, camera calibration, transforming 2D pixel coordinates into 3D world coordinates, object detection and classification, and object localization challenges.
    This project was made by Kai Nakamura, Owen Sullivan, and Evan Carmody for RBE 3001. More details and a full report can be found at kainakamura.co....

КОМЕНТАРІ • 40

  • @Haza3137
    @Haza3137 3 місяці тому +4

    Dude amazing work

  • @timothysands5537
    @timothysands5537 11 місяців тому

    For the forward kinematics, i thought the matrices were exponentials of those 4x4 transformation matrices with [omega, velocity]. Love this video btw, awesome presentation

  • @samm7716
    @samm7716 11 місяців тому +1

    wish i had friends like you

  • @chamodbandara5754
    @chamodbandara5754 11 місяців тому +2

    brother this is awesome! what areas should i study to get in to this.

    • @miron__
      @miron__ 10 місяців тому +2

      probably trigonometry, linear algebra and Python programming

  • @MDFB985
    @MDFB985 11 місяців тому +1

    can you send the link of any paper on this you have cited or writed ?

    • @kaihnakamura
      @kaihnakamura  11 місяців тому +1

      Yes! I've got some more details and a full report on my website at kainakamura.com/project/rbe3001

    • @MDFB985
      @MDFB985 11 місяців тому

      Thanks
      @@kaihnakamura

  • @qutabshah8201
    @qutabshah8201 7 місяців тому

    Can you please explain how we design the algorithm regarding conputer vision based pick and place robotic hand??
    I'm struggling with my project

    • @kaihnakamura
      @kaihnakamura  7 місяців тому

      There’s no one right way to create a computer vision pipeline, but there are certainly some things that help a whole lot. One of the more difficult steps is getting the color thresholding just right since it can vary a lot with ambient light levels so it’ll inevitably pick up some unwanted pixels. To combat this, I highly recommend using the MATLAB imfindcircles function to clean up unwanted pixels. In my experience it works far better than other alternatives like erosion. Best of luck with your project!

  • @NowayJose14
    @NowayJose14 10 місяців тому +1

    Wonder if you could use the new gpt api to understand where objects are and how to mainuplate them

  • @calebjones3062
    @calebjones3062 11 місяців тому +1

    The ball juggler

  • @enderslayer2111
    @enderslayer2111 10 місяців тому

    How can I get to talk to you I wanted to know how u guys came up with the program and did you use java

    • @kaihnakamura
      @kaihnakamura  10 місяців тому

      We used MATLAB to control the arm, you can look at the source code here: github.com/KaiNakamura/RBE3001

  • @enderslayer2111
    @enderslayer2111 10 місяців тому

    You guys use mathlab damn that's cool

  • @khusanakramkhodjaev5583
    @khusanakramkhodjaev5583 11 місяців тому

    this is so cool

  • @GunvitGupta
    @GunvitGupta Місяць тому

    please give code

    • @kaihnakamura
      @kaihnakamura  Місяць тому

      There’s a link in the description where you can find the code. You can also find it here github.com/KaiNakamura/RBE3001

    • @gunvitgupta440
      @gunvitgupta440 28 днів тому +1

      Thank you brother ❤​@@kaihnakamura

  • @enderslayer2111
    @enderslayer2111 10 місяців тому

    Hi can you help me out please

  • @falin9557
    @falin9557 3 місяці тому

    is 1400€ low-cost? I found way better, full aluminium, 6-DOF robotic arms for not even a 10% of the price

    • @sshinde3394
      @sshinde3394 3 місяці тому

      Can you please give link for that?

    • @dinoscheidt
      @dinoscheidt 3 місяці тому

      Ha … one can always spot the noobs prone to falling for scams from the far east @falin9557. A single motor of this thing costs 300 USD (they use the DYNAMIXEL X430)… same cost for equivalents that have the driver, sensors and torque of 4,8 newton meter to enable this size and repeatability.

    • @dinoscheidt
      @dinoscheidt 3 місяці тому +3

      There is sadly no link. @OP is just a someone who pulls on a door with a push sign. This arm uses already quite affordable DYNAMIXEL X430 motors having a driver, sensors and torque of 4.8 newton meter. A single motor is about 300USD… and they are needed to enable the arms range and repeatability.

  • @python.programmer5567
    @python.programmer5567 3 місяці тому +1

    How do you display the data in a 3d simulation?

    • @kaihnakamura
      @kaihnakamura  3 місяці тому

      All of the 3D plots were made in MATLAB, mostly using the plot3 and quiver3 functions. Full code can be found here: github.com/KaiNakamura/RBE3001

    • @python.programmer5567
      @python.programmer5567 3 місяці тому

      @@kaihnakamura thank you

  • @HalaHala-rq7ys
    @HalaHala-rq7ys 2 місяці тому

    Can u do another project where it can play board games like chess , x o

  • @DIYRobotGirl
    @DIYRobotGirl 11 місяців тому

    How are the servos not blocki g each other with no timed millis. I still dont understand in the code how the servos know where to go or when?

    • @miron__
      @miron__ 10 місяців тому

      The Dynamixel servos are more advanced than normal servos. They each have their own processor and can receive a command to move their joint to a specific position, which they then do without additional help from the main computer

  • @nickhermann5858
    @nickhermann5858 Місяць тому

    nice

  • @removechan10298
    @removechan10298 2 місяці тому

    great work!

  • @enderslayer2111
    @enderslayer2111 10 місяців тому

    Can you do more of this videos how did you guys design the hand was it via solidworks I working with a robot hand but I having trouble with it

    • @kaihnakamura
      @kaihnakamura  10 місяців тому

      The arm we used is the OpenMANIPULATOR-X. More details about it can be found in our full report here: kainakamura.com/project/rbe3001

  • @kid-a
    @kid-a 11 місяців тому

    Very nice video! The reference frames shown @3:46 are left-handed, not right-handed. Was this intentional?

    • @kaihnakamura
      @kaihnakamura  11 місяців тому +1

      Good catch! No this was not intentional, the x and y axes should be switched in each frame.

    • @kid-a
      @kid-a 11 місяців тому

      @@kaihnakamura Got it. Anyway, really good video. With your permission, I'd like to use this video for when I'll teach RBE 3001 in C term.

    • @kaihnakamura
      @kaihnakamura  11 місяців тому

      @@kid-a Absolutely, feel free to use this video!

  • @GunvitGupta
    @GunvitGupta Місяць тому

    can you give me code? please