- 91
- 149 931
Kimate Richards
United States
Приєднався 20 лют 2020
I am interested and currently working in the areas of spatial computing and robotics. I develop iOS, C#, OBJ-C, C++ and Python apps, control systems and IoT. ROS2, ROS, ISAAC, Realsense, MoveIT, OpenVINO, Micro-ROS and NVIDIA Jetson products. I work for Amazon (AWS) but this channel is my personal musings.
ROS2 with Realtime API by OpenAI, Gemini 2.0 and LangGraph
ROS2 with Realtime API by OpenAI, Gemini 2.0 and LangGraph
Use your node graph to determine the functions available to a generative model.
Use your node graph to determine the functions available to a generative model.
Переглядів: 136
Відео
Robot design and motion studies for robotics robot build Part 2
Переглядів 143День тому
Robot design and motion studies for robotics robot build Part 2, no coding here but using genAI to help design a robot. Used SORA here by OpenAI
Hope Robot Mirroring
Переглядів 277День тому
This is a bit of an upgrade from the Sony robot mirroring that posted from Japan last year
When to use Isaac sim vs RVIZ / Gazebo / Mujoco /Isaac Labs or Genesis AI part1
Переглядів 25414 днів тому
When to use Isaac sim vs RVIZ / Gazebo / Mujoco /Isaac Labs or Genesis AI part1 @therobotstudio Robot Arm: github.com/TheRobotStudio/SO-ARM100/tree/main Isaac Labs: github.com:isaac-sim/IsaacLab.git Mujoco mujoco.readthedocs.io/en/stable/overview.html# Udemy Robots course ROS 2: www.udemy.com/course/robotics-and-ros-2-learn-by-doing-manipulators/?couponCode=KEEPLEARNING Isaac Sim developer guid...
Nvidia Isaac lab installation on Ubuntu 22.04 Linux Part 1
Переглядів 14514 днів тому
Nvidia Isaac lab installation on Ubuntu 22.04 Linux Part 1
Part 7 Reinforcement Learning RSL-RL, Train a policy to make a robot move
Переглядів 1,1 тис.21 день тому
Part 7 Reinforcement Learning RSL-RL, Train a policy to make a robot move
Part 6 Genesis AI, picking up blocks, debug, deform-able bodies etc
Переглядів 80821 день тому
Part 6 Genesis AI, picking up blocks, debug, deform-able bodies etc
Genesis AI Now that it has my attention Part 2
Переглядів 88821 день тому
Genesis AI Now that it has my attention Part 2
Genesis AI the newest robotics simulation engine claims to be 10x faster than Isaac Sim/Labs Part 1
Переглядів 3,6 тис.21 день тому
Genesis AI the newest robotics simulation engine claims to be 10x faster than Isaac Sim/Labs Part 1
Structured Output for Simple Navigation using OpenAi, Pydantic and llama-index
Переглядів 1044 місяці тому
Structured Output for Simple Navigation using OpenAi, Pydantic and llama-index
Spot Apple Vision Pro using GenAI to build the interaction and logic
Переглядів 3534 місяці тому
Spot Apple Vision Pro using GenAI to build the interaction and logic
Stability.AI 3D model generation from 2D source image with pre and post processing
Переглядів 1048 місяців тому
Stability.AI 3D model generation from 2D source image with pre and post processing
Apple Vision Pro and Anthropic Claude 3 Functions
Переглядів 9310 місяців тому
Apple Vision Pro and Anthropic Claude 3 Functions
Apple Vision Pro Amazon Bedrock Claude 3 for Vision Generative Inference
Переглядів 27910 місяців тому
Apple Vision Pro Amazon Bedrock Claude 3 for Vision Generative Inference
Anthropic Claude 3, Amazon Bedrock and Apple Vision Pro
Переглядів 11310 місяців тому
Anthropic Claude 3, Amazon Bedrock and Apple Vision Pro
Apple Vision Pro run locally using LLM Swift Package and Amazon Bedrock
Переглядів 43010 місяців тому
Apple Vision Pro run locally using LLM Swift Package and Amazon Bedrock
Walk-through of AWS Amplify downloading a 3D model to the Apple Vision Pro
Переглядів 99Рік тому
Walk-through of AWS Amplify downloading a 3D model to the Apple Vision Pro
Llama 70B on SageMaker set up and run inference in the cloud
Переглядів 425Рік тому
Llama 70B on SageMaker set up and run inference in the cloud
Human In The Loop Controlling Spot in XR with Magic Leap
Переглядів 37Рік тому
Human In The Loop Controlling Spot in XR with Magic Leap
Apple Vision Pro with Amazon Web Services S3 to download 3d Models
Переглядів 92Рік тому
Apple Vision Pro with Amazon Web Services S3 to download 3d Models
Augmented World Expo has robots and Magic Leap working together
Переглядів 61Рік тому
Augmented World Expo has robots and Magic Leap working together
How to Tell Robot to Bring Coffee according to chatGPT by openai
Переглядів 3772 роки тому
How to Tell Robot to Bring Coffee according to chatGPT by openai
Where was this?
CES in Las Vegas
Cum in to a theaters near you " it's not cheating"
Great stuff!
"Didn't break, so that was good." lol, voice of experience :-)
are you able to use genesis for any these tasks? can you use both ros and genesis or is it one or the other?
@@lamjr444 I do intend to integrate reinforcement learning into this project, stay tuned
@@lamjr444 you can use both ros and genesis depending on the task. Really a task consists of many steps and you might use ROS or RL where convenient
damn dude. i like alot of the projects your working on.
I thought robots were supposed to be strong there's no way that's strong a it's going to be using a gear in that gear can't be that strong in that armp
@@petercan1020 this robot showcases dexterity and 3d print ability not strength although other than the hands this robot is quite powerful. More than we need for cooperative robotics
can you please send the colab notebook link
colab.research.google.com/github/google-deepmind/mujoco/blob/main/python/tutorial.ipynb#scrollTo=YvyGCsgSCxHQ
Could you make an installation video for Windows along with the python software you use, because I keep running into problems. Love the videos btw!!!
Hi! First, I want to say how impressed I am by your expertise and how kindly you explain complex topics. As a complete beginner in robotics, I really appreciate that! I'm just starting my journey in robotics and want to make the most efficient use of my time. I hope you don't mind me asking what might seem like a basic question: In your expert opinion, which simulation environment would be most effective for actual robot training between Isaac Sim, RVIZ, Gazebo, Mujoco, Isaac Labs, or Genesis? I've noticed Genesis is getting a lot of attention lately, but as a beginner, Isaac Sim seems to have a more polished and complete environment. Would love to hear your thoughts on this! Thank you for your time, and please excuse my novice questions - I'm eager to learn from your experience!
If I were starting over I would start with ROS 2 and Gazebo and then later in Isaac Sim. There are a lot of tutorials on ROS 2 and python is really easy to understand. Most professional robots use c++ but I would start with python.
@@robottinkeracademy Thank you so much for such clear and practical advice! Thanks for helping guide a beginner like me! 🙏
I think Isaac sim or some physics and sensor simulator is necessary and Isaac lab has a natural integration. With Genesis you will still need a way to build and test robot actions and program behaviors.
Thanks for this : ) Are you finding it to be much faster than anything else as claimed?
@@EvoCreatures uses much less resources and the setup time was half of most simulators. I might make a video showing the various features and performance of the top 5 simulators
@ That would be awesome : ) Thanks for the response.
bro i wanna ask a question. Is this ubuntu 18 and ros2 melodic ???? I have jetson nano developer kit and i want to learn it
ROS 1is Melodic, you don't want to learn ROS 1 as it is being deprecated. ROS 2 Humble or Jazzy is a good starting point
@robottinkeracademy are they working on jetson Nano and ubuntu18.04?
how do you feel reinstalling Isaac lab after trying Genesis?
I like Genesis better, I feel that once Genesis is fully featured I will use that with ROS2 and Gazebo and RVIZ
AttributeError: module 'genesis' has no attribute 'init' , i am getting this error , any help please
Can ı make it model characters like it shows in the website
not yet as far as i can see
amazing! I am waiting for the new videos from you!
Thanks, I will be making more videos on reinforcement learning, especially training robots and integrating ROS
First time ive ever seen someone actually record themselves using it instead of yapping about it, good job
I try to post when others aren’t covering it
yo great video , the first resource i found on Genesis , i don't have to a strong PC I was look for a note book so that i can run it on an instance mostly with Jupiter Notebook , new to tech and self thought - if you could make a video on how I can run it on Lets say Jarvis Labs - I Think a lot of people like me would be interested in that
This is amazing!
Awesome man but?? How to generate videos rather than robotic movements
@@TheQuran-16 don’t quite understand what you mean
@robottinkeracademy it means that it can generate text to video
@ ah yes, I am a robotics focused channel but you are absolutely right. Character movement is coming too
Will it be same as ROS ??
@@marshalrevanth278 I think that they are focused on reinforcement learning and they will integrating ROS like Isaac Sim does
Very cool! I tried following the Windows install but seem to keep getting errors, might have to go the ubuntu route haha
I will try it and let know
Can we integrate ROS with genesis?
Yes, that is my plan in the coming days for mature frameworks like ROS Control
Because this is pure python we can create ROS nodes with it and send messages and receive using ROS
0:42 wow
Awesome ❤
Let me know what you think of it after trying it out!
any idea about the cost of this inference? per hour?
aws.amazon.com/sagemaker/pricing/
Thank you for this! Would you consider sharing your code?
@@Lexoka I would but the aws swift SDK had changed. There is a new blog coming out with updates very soon. aws.amazon.com/blogs/spatial/page/2/ you can invoke any AWS service in swift like the blog entitled “Getting Started with the Apple Vision Pro on AWS”
@@robottinkeracademy Thanks! But what if I just want to run everything locally? Does this SDK change still present any issues?
@@robottinkeracademy Ah, sorry, I had missed the very end where you say it would be released on said blog. Thanks again!
@@Lexoka ahh no, you can use llama.cpp send me your email and I will send you my code
@@robottinkeracademy Thank you very much! I tried to give you my email address here, but UA-cam keeps deleting my comments (anti-spam measure, I suppose). I also tried on LinkedIn, but somehow managed to make a typo in my message when typing my email address, which I cannot edit because it's an "inMail" message or something. It's been a rough day! :D
Please KEEP THESE VIDEOS UP !!!!!!!
Hi Richards, Thanks for sharing these videos and the blogs on aws. Is there any chance for you to share your code ? I'm trying to follow you blog and videos but there are lots of missing pieces. thanks again !
Unfortunately, I cannot share the code because it belongs to Amazon, but I am developing a workshop that has all of the code. If you have individual areas that I can help with please reach out and I can help you. My email address is listed on the channel.
@@robottinkeracademy I understand don't worry about it. I already figure it out. but thanks for the replay. What is the workshop about, Visio pro ? if so I love to see it, any info ?
@@guillermoleal5686 Yes, about the Vision Pro and GenAI and Amplify. WOn't be approved for a month but will have all of the code
@@robottinkeracademy That is excellent ! looking forward to see it.
Kimate...It's been 20 years, but it's cool to see what you're doing. Awesome stuff. Still playing basketball?
Still playing but way below the rim these days.
😘
What could become very good mashine for the recycling works in a future please:)
Hello, I am very interested in this technology and I would like to know how to make it, otherwise very good video
You would need a hub motor and wheel, motor controller and servo with servo controller. I also used rubber as a break for the servo
@@robottinkeracademy Thank you very much, and how can I model the system? Do you have any diagrams that can help me?
CMYK & RGB codes are not installed!? 🧐😳🤔🥸😆😎
😮😅🥸🧐🤓😳🤔👎🏽
at the end someone says its tele operated. i used to think that. someone in the background answering. but NO. definitely not. it uses the chatgpt4 AI system. chat gpt5 is available but slower to respond for now, check out chatgpt3 yourself. its free. ask it to make up a story of something random in your own house. or tell it what kind of job youre looking for and ask it to write a cover letter or cv
Woah we truly live in the future. This is very e/acc
Relax Andreesen 😂
Thank you for your video, can wait the next one !
What if AI has already become self aware but is playing dumb until we humans have created an army of AI robotic robots for them to take over the world. Imagine if AI has already become self aware how would we know if we've been out smarted by AI 🤯🤯🤯🤯🤯🤯🤯
Thank you for this great video!!
hi, can i get the source code for this?
Do you have a tutorial on your camera and motor connections to the jetson nano?
Great vid man! I was trying to do this and you helped a lot. Thank you.
What expansion or controller board are you using from waveshare To mount the lidar
This is a custom build from waveshare for AWS. I am not sure if they sell this expansion board but you can check www.waveshare.com/jetbot-2gb-ai-kit-for-aws.htm
@@robottinkeracademy ....thank you again and wishing you all the best.
Will you publish part 2?
Will you publish part 2?
Yes, I am actually building the humanoid robot so I am a bit busy. I will publish the code for just the video pub sub though.
would you please share your source code. Will you publish part 2?
Spoooot 😅😊
Astro be like: Damn I deserve better. 😀