Kimate Richards
Kimate Richards
  • 91
  • 149 931
ROS2 with Realtime API by OpenAI, Gemini 2.0 and LangGraph
ROS2 with Realtime API by OpenAI, Gemini 2.0 and LangGraph
Use your node graph to determine the functions available to a generative model.
Переглядів: 136

Відео

Robot design and motion studies for robotics robot build Part 2
Переглядів 143День тому
Robot design and motion studies for robotics robot build Part 2, no coding here but using genAI to help design a robot. Used SORA here by OpenAI
Hope Robot Mirroring
Переглядів 277День тому
This is a bit of an upgrade from the Sony robot mirroring that posted from Japan last year
Mujoco Overview
Переглядів 89День тому
Mujoco Overview
When to use Isaac sim vs RVIZ / Gazebo / Mujoco /Isaac Labs or Genesis AI part1
Переглядів 25414 днів тому
When to use Isaac sim vs RVIZ / Gazebo / Mujoco /Isaac Labs or Genesis AI part1 @therobotstudio Robot Arm: github.com/TheRobotStudio/SO-ARM100/tree/main Isaac Labs: github.com:isaac-sim/IsaacLab.git Mujoco mujoco.readthedocs.io/en/stable/overview.html# Udemy Robots course ROS 2: www.udemy.com/course/robotics-and-ros-2-learn-by-doing-manipulators/?couponCode=KEEPLEARNING Isaac Sim developer guid...
Nvidia Isaac lab installation on Ubuntu 22.04 Linux Part 1
Переглядів 14514 днів тому
Nvidia Isaac lab installation on Ubuntu 22.04 Linux Part 1
Part 7 Reinforcement Learning RSL-RL, Train a policy to make a robot move
Переглядів 1,1 тис.21 день тому
Part 7 Reinforcement Learning RSL-RL, Train a policy to make a robot move
Part 6 Genesis AI, picking up blocks, debug, deform-able bodies etc
Переглядів 80821 день тому
Part 6 Genesis AI, picking up blocks, debug, deform-able bodies etc
Parallel Simulation Genesis AI
Переглядів 1 тис.21 день тому
Parallel Simulation Genesis AI
Genesis switch your robot Part 4
Переглядів 53721 день тому
Genesis switch your robot Part 4
Part 3 Genesis AI Control the robot
Переглядів 71621 день тому
Part 3 Genesis AI Control the robot
Genesis AI Now that it has my attention Part 2
Переглядів 88821 день тому
Genesis AI Now that it has my attention Part 2
Genesis AI the newest robotics simulation engine claims to be 10x faster than Isaac Sim/Labs Part 1
Переглядів 3,6 тис.21 день тому
Genesis AI the newest robotics simulation engine claims to be 10x faster than Isaac Sim/Labs Part 1
Structured Output for Simple Navigation using OpenAi, Pydantic and llama-index
Переглядів 1044 місяці тому
Structured Output for Simple Navigation using OpenAi, Pydantic and llama-index
Spot Apple Vision Pro using GenAI to build the interaction and logic
Переглядів 3534 місяці тому
Spot Apple Vision Pro using GenAI to build the interaction and logic
Stability.AI 3D model generation from 2D source image with pre and post processing
Переглядів 1048 місяців тому
Stability.AI 3D model generation from 2D source image with pre and post processing
Apple Vision Pro and Anthropic Claude 3 Functions
Переглядів 9310 місяців тому
Apple Vision Pro and Anthropic Claude 3 Functions
Apple Vision Pro Amazon Bedrock Claude 3 for Vision Generative Inference
Переглядів 27910 місяців тому
Apple Vision Pro Amazon Bedrock Claude 3 for Vision Generative Inference
Anthropic Claude 3, Amazon Bedrock and Apple Vision Pro
Переглядів 11310 місяців тому
Anthropic Claude 3, Amazon Bedrock and Apple Vision Pro
Apple Vision Pro run locally using LLM Swift Package and Amazon Bedrock
Переглядів 43010 місяців тому
Apple Vision Pro run locally using LLM Swift Package and Amazon Bedrock
Walk-through of AWS Amplify downloading a 3D model to the Apple Vision Pro
Переглядів 99Рік тому
Walk-through of AWS Amplify downloading a 3D model to the Apple Vision Pro
Another Spot Magic Leap Demo
Переглядів 58Рік тому
Another Spot Magic Leap Demo
IoT, GenAI, Spatial Computing and AWS
Переглядів 167Рік тому
IoT, GenAI, Spatial Computing and AWS
Llama 70B on SageMaker set up and run inference in the cloud
Переглядів 425Рік тому
Llama 70B on SageMaker set up and run inference in the cloud
Human In The Loop Controlling Spot in XR with Magic Leap
Переглядів 37Рік тому
Human In The Loop Controlling Spot in XR with Magic Leap
Apple Vision Pro with Amazon Web Services S3 to download 3d Models
Переглядів 92Рік тому
Apple Vision Pro with Amazon Web Services S3 to download 3d Models
Augmented World Expo has robots and Magic Leap working together
Переглядів 61Рік тому
Augmented World Expo has robots and Magic Leap working together
AWS Cloud, Magic Leap 2 and an AMR
Переглядів 283Рік тому
AWS Cloud, Magic Leap 2 and an AMR
How to Tell Robot to Bring Coffee according to chatGPT by openai
Переглядів 3772 роки тому
How to Tell Robot to Bring Coffee according to chatGPT by openai
Laundry handling robot
Переглядів 962 роки тому
Laundry handling robot

КОМЕНТАРІ

  • @shawnpresser8374
    @shawnpresser8374 9 годин тому

    Where was this?

  • @EricCanales-zt7lk
    @EricCanales-zt7lk 2 дні тому

    Cum in to a theaters near you " it's not cheating"

  • @therobotstudio
    @therobotstudio 4 дні тому

    Great stuff!

  • @therobotstudio
    @therobotstudio 4 дні тому

    "Didn't break, so that was good." lol, voice of experience :-)

  • @lamjr444
    @lamjr444 4 дні тому

    are you able to use genesis for any these tasks? can you use both ros and genesis or is it one or the other?

    • @robottinkeracademy
      @robottinkeracademy 4 дні тому

      @@lamjr444 I do intend to integrate reinforcement learning into this project, stay tuned

    • @robottinkeracademy
      @robottinkeracademy 4 дні тому

      @@lamjr444 you can use both ros and genesis depending on the task. Really a task consists of many steps and you might use ROS or RL where convenient

  • @lamjr444
    @lamjr444 4 дні тому

    damn dude. i like alot of the projects your working on.

  • @petercan1020
    @petercan1020 11 днів тому

    I thought robots were supposed to be strong there's no way that's strong a it's going to be using a gear in that gear can't be that strong in that armp

    • @robottinkeracademy
      @robottinkeracademy 11 днів тому

      @@petercan1020 this robot showcases dexterity and 3d print ability not strength although other than the hands this robot is quite powerful. More than we need for cooperative robotics

  • @user-od7yh9ik7s
    @user-od7yh9ik7s 12 днів тому

    can you please send the colab notebook link

    • @robottinkeracademy
      @robottinkeracademy 11 днів тому

      colab.research.google.com/github/google-deepmind/mujoco/blob/main/python/tutorial.ipynb#scrollTo=YvyGCsgSCxHQ

  • @FourievanRooyen
    @FourievanRooyen 12 днів тому

    Could you make an installation video for Windows along with the python software you use, because I keep running into problems. Love the videos btw!!!

  • @wjkang619
    @wjkang619 13 днів тому

    Hi! First, I want to say how impressed I am by your expertise and how kindly you explain complex topics. As a complete beginner in robotics, I really appreciate that! I'm just starting my journey in robotics and want to make the most efficient use of my time. I hope you don't mind me asking what might seem like a basic question: In your expert opinion, which simulation environment would be most effective for actual robot training between Isaac Sim, RVIZ, Gazebo, Mujoco, Isaac Labs, or Genesis? I've noticed Genesis is getting a lot of attention lately, but as a beginner, Isaac Sim seems to have a more polished and complete environment. Would love to hear your thoughts on this! Thank you for your time, and please excuse my novice questions - I'm eager to learn from your experience!

    • @robottinkeracademy
      @robottinkeracademy 13 днів тому

      If I were starting over I would start with ROS 2 and Gazebo and then later in Isaac Sim. There are a lot of tutorials on ROS 2 and python is really easy to understand. Most professional robots use c++ but I would start with python.

    • @wjkang619
      @wjkang619 13 днів тому

      @@robottinkeracademy Thank you so much for such clear and practical advice! Thanks for helping guide a beginner like me! 🙏

  • @robottinkeracademy
    @robottinkeracademy 14 днів тому

    I think Isaac sim or some physics and sensor simulator is necessary and Isaac lab has a natural integration. With Genesis you will still need a way to build and test robot actions and program behaviors.

  • @EvoCreatures
    @EvoCreatures 15 днів тому

    Thanks for this : ) Are you finding it to be much faster than anything else as claimed?

    • @robottinkeracademy
      @robottinkeracademy 14 днів тому

      @@EvoCreatures uses much less resources and the setup time was half of most simulators. I might make a video showing the various features and performance of the top 5 simulators

    • @EvoCreatures
      @EvoCreatures 14 днів тому

      @ That would be awesome : ) Thanks for the response.

  • @optymys
    @optymys 15 днів тому

    bro i wanna ask a question. Is this ubuntu 18 and ros2 melodic ???? I have jetson nano developer kit and i want to learn it

    • @robottinkeracademy
      @robottinkeracademy 14 днів тому

      ROS 1is Melodic, you don't want to learn ROS 1 as it is being deprecated. ROS 2 Humble or Jazzy is a good starting point

    • @optymys
      @optymys 14 днів тому

      @robottinkeracademy are they working on jetson Nano and ubuntu18.04?

  • @LukasSmith827
    @LukasSmith827 15 днів тому

    how do you feel reinstalling Isaac lab after trying Genesis?

    • @robottinkeracademy
      @robottinkeracademy 13 днів тому

      I like Genesis better, I feel that once Genesis is fully featured I will use that with ROS2 and Gazebo and RVIZ

  •  15 днів тому

    AttributeError: module 'genesis' has no attribute 'init' , i am getting this error , any help please

  • @YavuzSultanTerim-cg4dt
    @YavuzSultanTerim-cg4dt 15 днів тому

    Can ı make it model characters like it shows in the website

  • @СтаниславКолчин-н7ы

    amazing! I am waiting for the new videos from you!

    • @robottinkeracademy
      @robottinkeracademy 16 днів тому

      Thanks, I will be making more videos on reinforcement learning, especially training robots and integrating ROS

  • @MyEarsHurts
    @MyEarsHurts 17 днів тому

    First time ive ever seen someone actually record themselves using it instead of yapping about it, good job

  • @BibleShorts-h3h
    @BibleShorts-h3h 17 днів тому

    yo great video , the first resource i found on Genesis , i don't have to a strong PC I was look for a note book so that i can run it on an instance mostly with Jupiter Notebook , new to tech and self thought - if you could make a video on how I can run it on Lets say Jarvis Labs - I Think a lot of people like me would be interested in that

  • @sirens3237
    @sirens3237 18 днів тому

    This is amazing!

  • @TheQuran-16
    @TheQuran-16 19 днів тому

    Awesome man but?? How to generate videos rather than robotic movements

    • @robottinkeracademy
      @robottinkeracademy 19 днів тому

      @@TheQuran-16 don’t quite understand what you mean

    • @TheQuran-16
      @TheQuran-16 19 днів тому

      @robottinkeracademy it means that it can generate text to video

    • @robottinkeracademy
      @robottinkeracademy 19 днів тому

      @ ah yes, I am a robotics focused channel but you are absolutely right. Character movement is coming too

  • @marshalrevanth278
    @marshalrevanth278 20 днів тому

    Will it be same as ROS ??

    • @robottinkeracademy
      @robottinkeracademy 20 днів тому

      @@marshalrevanth278 I think that they are focused on reinforcement learning and they will integrating ROS like Isaac Sim does

  • @skurtyyskirts
    @skurtyyskirts 20 днів тому

    Very cool! I tried following the Windows install but seem to keep getting errors, might have to go the ubuntu route haha

  • @yousefsam1240
    @yousefsam1240 22 дні тому

    Can we integrate ROS with genesis?

    • @robottinkeracademy
      @robottinkeracademy 21 день тому

      Yes, that is my plan in the coming days for mature frameworks like ROS Control

    • @robottinkeracademy
      @robottinkeracademy 21 день тому

      Because this is pure python we can create ROS nodes with it and send messages and receive using ROS

  • @user-yt-13245
    @user-yt-13245 22 дні тому

    0:42 wow

  • @wavecast_podcasts
    @wavecast_podcasts 23 дні тому

    Awesome ❤

  • @saedsaify9944
    @saedsaify9944 25 днів тому

    any idea about the cost of this inference? per hour?

  • @Lexoka
    @Lexoka 4 місяці тому

    Thank you for this! Would you consider sharing your code?

    • @robottinkeracademy
      @robottinkeracademy 4 місяці тому

      @@Lexoka I would but the aws swift SDK had changed. There is a new blog coming out with updates very soon. aws.amazon.com/blogs/spatial/page/2/ you can invoke any AWS service in swift like the blog entitled “Getting Started with the Apple Vision Pro on AWS”

    • @Lexoka
      @Lexoka 4 місяці тому

      @@robottinkeracademy Thanks! But what if I just want to run everything locally? Does this SDK change still present any issues?

    • @Lexoka
      @Lexoka 4 місяці тому

      @@robottinkeracademy Ah, sorry, I had missed the very end where you say it would be released on said blog. Thanks again!

    • @robottinkeracademy
      @robottinkeracademy 4 місяці тому

      @@Lexoka ahh no, you can use llama.cpp send me your email and I will send you my code

    • @Lexoka
      @Lexoka 4 місяці тому

      @@robottinkeracademy Thank you very much! I tried to give you my email address here, but UA-cam keeps deleting my comments (anti-spam measure, I suppose). I also tried on LinkedIn, but somehow managed to make a typo in my message when typing my email address, which I cannot edit because it's an "inMail" message or something. It's been a rough day! :D

  • @charles26842
    @charles26842 7 місяців тому

    Please KEEP THESE VIDEOS UP !!!!!!!

  • @guillermoleal5686
    @guillermoleal5686 8 місяців тому

    Hi Richards, Thanks for sharing these videos and the blogs on aws. Is there any chance for you to share your code ? I'm trying to follow you blog and videos but there are lots of missing pieces. thanks again !

    • @robottinkeracademy
      @robottinkeracademy 8 місяців тому

      Unfortunately, I cannot share the code because it belongs to Amazon, but I am developing a workshop that has all of the code. If you have individual areas that I can help with please reach out and I can help you. My email address is listed on the channel.

    • @guillermoleal5686
      @guillermoleal5686 8 місяців тому

      @@robottinkeracademy I understand don't worry about it. I already figure it out. but thanks for the replay. What is the workshop about, Visio pro ? if so I love to see it, any info ?

    • @robottinkeracademy
      @robottinkeracademy 8 місяців тому

      @@guillermoleal5686 Yes, about the Vision Pro and GenAI and Amplify. WOn't be approved for a month but will have all of the code

    • @guillermoleal5686
      @guillermoleal5686 8 місяців тому

      @@robottinkeracademy That is excellent ! looking forward to see it.

  • @bradley3232
    @bradley3232 11 місяців тому

    Kimate...It's been 20 years, but it's cool to see what you're doing. Awesome stuff. Still playing basketball?

  • @vahitoruç-w3c
    @vahitoruç-w3c 11 місяців тому

    😘

  • @ValerijZviozdkin-mo7th
    @ValerijZviozdkin-mo7th Рік тому

    What could become very good mashine for the recycling works in a future please:)

  • @apoxy366
    @apoxy366 Рік тому

    Hello, I am very interested in this technology and I would like to know how to make it, otherwise very good video

    • @robottinkeracademy
      @robottinkeracademy Рік тому

      You would need a hub motor and wheel, motor controller and servo with servo controller. I also used rubber as a break for the servo

    • @apoxy366
      @apoxy366 Рік тому

      @@robottinkeracademy Thank you very much, and how can I model the system? Do you have any diagrams that can help me?

  • @vwynnbolton
    @vwynnbolton Рік тому

    CMYK & RGB codes are not installed!? 🧐😳🤔🥸😆😎

  • @vwynnbolton
    @vwynnbolton Рік тому

    😮😅🥸🧐🤓😳🤔👎🏽

  • @Dennistube001
    @Dennistube001 Рік тому

    at the end someone says its tele operated. i used to think that. someone in the background answering. but NO. definitely not. it uses the chatgpt4 AI system. chat gpt5 is available but slower to respond for now, check out chatgpt3 yourself. its free. ask it to make up a story of something random in your own house. or tell it what kind of job youre looking for and ask it to write a cover letter or cv

  • @biccsdev
    @biccsdev Рік тому

    Woah we truly live in the future. This is very e/acc

  • @arthurjeulin4171
    @arthurjeulin4171 Рік тому

    Thank you for your video, can wait the next one !

  • @DadPool85
    @DadPool85 Рік тому

    What if AI has already become self aware but is playing dumb until we humans have created an army of AI robotic robots for them to take over the world. Imagine if AI has already become self aware how would we know if we've been out smarted by AI 🤯🤯🤯🤯🤯🤯🤯

  • @にゃーん-y3k
    @にゃーん-y3k Рік тому

    Thank you for this great video!!

  • @nguyenduyviet
    @nguyenduyviet Рік тому

    hi, can i get the source code for this?

  • @AutumnEdwards-w1w
    @AutumnEdwards-w1w Рік тому

    Do you have a tutorial on your camera and motor connections to the jetson nano?

  • @crystalstudioswebdesign
    @crystalstudioswebdesign Рік тому

    Great vid man! I was trying to do this and you helped a lot. Thank you.

  • @bestofchance
    @bestofchance 2 роки тому

    What expansion or controller board are you using from waveshare To mount the lidar

    • @robottinkeracademy
      @robottinkeracademy 2 роки тому

      This is a custom build from waveshare for AWS. I am not sure if they sell this expansion board but you can check www.waveshare.com/jetbot-2gb-ai-kit-for-aws.htm

    • @bestofchance
      @bestofchance 2 роки тому

      @@robottinkeracademy ....thank you again and wishing you all the best.

  • @AliAsghar-vr4ms
    @AliAsghar-vr4ms 2 роки тому

    Will you publish part 2?

  • @AliAsghar-vr4ms
    @AliAsghar-vr4ms 2 роки тому

    Will you publish part 2?

    • @robottinkeracademy
      @robottinkeracademy 2 роки тому

      Yes, I am actually building the humanoid robot so I am a bit busy. I will publish the code for just the video pub sub though.

  • @AliAsghar-vr4ms
    @AliAsghar-vr4ms 2 роки тому

    would you please share your source code. Will you publish part 2?

  • @robloxandmore6716
    @robloxandmore6716 2 роки тому

    Spoooot 😅😊

  • @TecTimmy
    @TecTimmy 2 роки тому

    Astro be like: Damn I deserve better. 😀