Jetson Nano + RealSense T265 Tracking Camera

Поділитися
Вставка
  • Опубліковано 4 лис 2024

КОМЕНТАРІ • 135

  • @rickhunt3183
    @rickhunt3183 5 років тому +2

    Combining the Camera and the Jetson Nano certainly opens a lot of possibilities for robotic navigation and obstacle avoidance. A gps receiver would be a good addition. The demo only shows a fraction of the potential that’s available to someone with an imagination and the money to invest. This could easily be turned into a serious autonomous lawn mower or other independent robotic device. I hope you’re planning on taking this in a specific direction at some point. It’s about time for a project. Good job.

    • @JetsonHacks
      @JetsonHacks  5 років тому

      Thank you for the kind words, and thanks for watching!

  • @NicoDsSBCs
    @NicoDsSBCs 5 років тому +1

    Thanks for showing! I always love to see your videos about the Nano.
    I also make (SBC) review videos on UA-cam. I had to make the choice between the Odroid N2 and the NVIDIA Jetson to buy. I went for the N2. I needed it to do a lot of Blender renders. And it does it great with it's powerful CPU. But now I've gotten a 4K USB3 camera to review. The N2 can only handle 720p software encoding with it. I should have a board with USB3 and hardware encoding(I hope). Maybe the Odroid XU4. I'll have to get it out of the dust. Again thank you.

    • @JetsonHacks
      @JetsonHacks  5 років тому +1

      Thank you for the kind words. You are welcome, and thanks for watching!

  • @TheRealTombi
    @TheRealTombi 5 років тому +1

    Right clicking within the terminal window should paste what held on the clipboard. No need to select paste. Similarly, whatever is highlighted within a terminal windows, is sent to the clipboard

    • @JetsonHacks
      @JetsonHacks  5 років тому

      Thanks for the tips! I think that you need to click the middle button in the Terminal to paste the clipboard contents, as the right button should always bring up the context menu. Of course we always (or at least try) to use the menus in the videos so that it's easier to follow in the tutorials. Thanks for watching!

  • @EricRohlfs
    @EricRohlfs 5 років тому +1

    Nice fire extinguisher. I think I'll put my battery pack inside one when my Jetson arrives next week.

    • @JetsonHacks
      @JetsonHacks  5 років тому

      Mr Fire Extinguisher is impressed! Thanks for watching!

  • @AngelRodriguez-ii8fv
    @AngelRodriguez-ii8fv 27 днів тому +1

    should this work with the Jetson AGX Orin? The app boots up but it does not seem to detect my D435i camera.

    • @JetsonHacks
      @JetsonHacks  27 днів тому

      I do not know, but the video is 5 years old. The updated installation instructions are on the Intel RealSense GitHub: github.com/IntelRealSense/librealsense/blob/master/doc/installation_jetson.md
      Good luck on your project!

  • @_brady
    @_brady 5 років тому +2

    Thank you!!
    these two are made to be used together.

    • @JetsonHacks
      @JetsonHacks  5 років тому

      You are welcome, and thanks for watching!

  • @alexandrecherpillod4010
    @alexandrecherpillod4010 5 років тому

    Great Video!
    In the B&W left & right images do you see the IR pattern (maybe test in low light condition)?
    Is this pattern always the same or is it changing over time?

    • @JetsonHacks
      @JetsonHacks  5 років тому

      I've changed this answer. The T265 does not have an IR emitter, it is a visible light device. Thanks for watching!

  • @glikar1
    @glikar1 5 років тому +1

    Enjoyed! If you don't mind the question. Do you have a background in AI or electronics?

    • @JetsonHacks
      @JetsonHacks  5 років тому +1

      I'm glad you liked the video. I have a computer science degree. Thanks for watching!

  • @kvnptl4400
    @kvnptl4400 5 років тому +1

    Thanks for the nice demo

    • @JetsonHacks
      @JetsonHacks  5 років тому

      You are welcome, and thanks for watching!

  • @erdembaris99
    @erdembaris99 5 років тому

    Thank you for your totorial. I just want to now if i use realsense cameras instead of normal mipi csi cameras for object tracking, what advantages will i have ?

  • @pontosinterligados
    @pontosinterligados 5 років тому

    Thanks for the video once again! I loved the PRO TIP about film covering!
    I am planning to buy one of this set (Jetson Nano + RS T26) for a prototype application only for detecting skeletal tracking and applying some projection matrix at the highest frame rate I can get. I wonder if this could be up to 60fps, and if I could use more than one RS T26 plugged on the same board...

    • @JetsonHacks
      @JetsonHacks  5 років тому +1

      The frame rate of the cameras is 30fps. You can use more than one camera. Thanks for watching!

  • @dgb5820
    @dgb5820 3 роки тому

    Looks great will it work on my pixhawk rover project

    • @JetsonHacks
      @JetsonHacks  3 роки тому

      I do not know. Thanks for watching!

  • @Antz_411
    @Antz_411 5 років тому +1

    Great video!
    Thanks!

    • @JetsonHacks
      @JetsonHacks  5 років тому

      Thank you for the kind words, and thanks for watching!

  • @masseteilchen3000
    @masseteilchen3000 5 років тому

    Very nice overview! Have you got an idea whether you could run RTABMap on a turtlebot platform with this hardware?

    • @masseteilchen3000
      @masseteilchen3000 5 років тому

      Or have you perhaps already tried RTABMap without external odometry?

    • @JetsonHacks
      @JetsonHacks  5 років тому

      RTABMap is designed for use with depth cameras. The images from the T265 need to be rectified before you can use them for that particular package. Thanks for watching!

  • @tremento1400
    @tremento1400 4 роки тому

    Hello Jim, Can you help me figure out how to use both intel realsense t265 and d435 in rviz (ros) as I'm really in trouble right now can you help me out. Thanks in advance!

  • @PRASANNAMALITH-s1g
    @PRASANNAMALITH-s1g 5 років тому

    I want to get the X,Y,Z coordinates of the camera (displayed in the real sense windows) into my python code as a variable. Seems like pyrealsense2 can be used to get that data. But I can't find which function do that exactly. Do you have any idea for that ?

  • @chadwong5959
    @chadwong5959 4 роки тому

    What is the accuracy of T265? Can you measure the distance and length of an object? The accuracy needs to be able to reach an error of about 1 cm, and the carrier may be unstable.

    • @JetsonHacks
      @JetsonHacks  4 роки тому

      Not sure what you are asking. The T265 is a tracking camera.

  • @MohamedAshrafZahana
    @MohamedAshrafZahana 5 років тому

    Thanks for the video. I was waiting for it. Can the D435 work in the same way without patching the kernel?

    • @JetsonHacks
      @JetsonHacks  5 років тому

      Here's a video comparing the differences: ua-cam.com/video/8ckhQP7Af-g/v-deo.html
      Thanks for watching!

  • @nickmarsh9384
    @nickmarsh9384 5 років тому +1

    when you added the swapfile, was that a permanent add ?, or should we add it on a start up file ?

    • @JetsonHacks
      @JetsonHacks  5 років тому +1

      It remains across reboots, no need to add to a start up file. However once you are done with rebuilding the kernel, you may not want the swap file. You can use swapoff to turn off the swap file, and modify the /etc/fstab file. Thanks for watching!

  • @sy2532
    @sy2532 5 років тому

    The install for the d435 on the nano is the same as the t265 correct? So if I plug both camera's in they should both work.... but When I start the ./realsense-viewer I can only add the d435 I can not add the t265. Any idea's?

  • @migueldelahoz4740
    @migueldelahoz4740 4 роки тому

    Hi Buddy. I'm a person with limitations due to amyotrophic lateral sclerosis disease. Sorry, what is the accuracy of the eye tracking of this device?.

    • @JetsonHacks
      @JetsonHacks  4 роки тому

      Hi Miguel. The tracking camera tracks its position in space, not a feature such as eyes. Thanks for watching!

    • @migueldelahoz4740
      @migueldelahoz4740 4 роки тому

      @@JetsonHacks
      This product is not an eye tracker like Tobii eye tracker 5?

    • @JetsonHacks
      @JetsonHacks  4 роки тому

      @@migueldelahoz4740 That is correct. It is not an eye tracker.

  • @Neomanee
    @Neomanee 5 років тому +1

    Anyone know how much power this board draws in deep sleep mode? I saw on the nvidia forums that it was around 10 mW but I wanted a second opinion

  • @Mediahalo
    @Mediahalo 3 роки тому

    could you share the STL for the 3d printed mount?

    • @JetsonHacks
      @JetsonHacks  3 роки тому

      I seem to recall that it's on thingiverse. Search for T265, there are several models there. Good luck on your project!

  • @tjp1806
    @tjp1806 5 років тому +1

    Nice tutorial! Do you think you could test GPU rendering for blender on it? I'm looking into buying 1 or 2 to add to a small render farm and the nano might be very useful

  • @makersgeneration3739
    @makersgeneration3739 5 років тому +2

    Thank you for this new tutorial. 😀

    • @JetsonHacks
      @JetsonHacks  5 років тому

      You are welcome, and thanks for watching!

  • @kerron_
    @kerron_ 5 років тому +1

    Very cool

    • @JetsonHacks
      @JetsonHacks  5 років тому

      It's a very nice device. Thanks for watching!

  • @stormshadow5555
    @stormshadow5555 5 років тому

    What Linux distro are you using in this video on your desktop PC? Thanks.

    • @JetsonHacks
      @JetsonHacks  5 років тому +1

      The computer in the demo is a NVIDIA Jetson Developer Kit which runs L4T, an Ubuntu derivative. Thanks for watching!

  • @ahmedtorky5777
    @ahmedtorky5777 5 років тому

    hmm...the 3D at the end looks terribly imprecise. You picked up from specific geolocation at first and returned it to almost the same point. Yet there is a differential distance that seems to be around 30 cm when we took a side view of the 3D location diagram. Can you show us that again or tell us what that tolerance was, please? It makes a difference to me. Thank you.

    • @JetsonHacks
      @JetsonHacks  5 років тому +1

      I have found it to be very good. It doesn't sound like it meets your needs. Thanks for watching!

    • @ahmedtorky5777
      @ahmedtorky5777 5 років тому

      @@JetsonHacks I admire the support you give and the videos you do are very helpful to me. Thank you! I wonder if it is possible to tweak/improve the location of the realsense with functions or settings that come with it?

    • @JetsonHacks
      @JetsonHacks  5 років тому +1

      There are a large number of parameters to control. It depends on your application as to how you would get better accuracy. For example, if you are using a wheeled robot you can send odometry information to the camera and it will incorporate that information to get better positioning. To be clear, this is a "how to use the T265 with a Jetson Nano" how to, not a qualification of the T265 for a particular use.

  • @ozy5332
    @ozy5332 5 років тому

    Hey! I wanted to ask are there any alternatives for fast paced applications like for example race drones and even if the Tracking and slam is on par for the job would nano be able to handle it?

    • @JetsonHacks
      @JetsonHacks  5 років тому +1

      It's hard to tell, there's a lot of variables. The T265 is pretty new, I certainly don't have enough experience with it yet to give a meaningful answer. Thanks for watching!

    • @ozy5332
      @ozy5332 5 років тому

      @@JetsonHacks I look forward to getting into this any suggestions from where to learn about it and stuff?

    • @JetsonHacks
      @JetsonHacks  5 років тому +1

      @@ozy5332 It's a very large subject. For the drone stuff, Pixhawk and DIY Drones is a good place to start. For SLAM, that's a really big area. It's beyond what I can describe here, but robot operating system (ROS) is as good of starting point as any.

    • @ozy5332
      @ozy5332 5 років тому

      @@JetsonHacks btw for slam with python I was GeoHotz he has a a video where he codes it for hours understood a few things but still long way to go.. thanks for the other references though :)

  • @nikolasengelhard6386
    @nikolasengelhard6386 4 роки тому

    It's rather visual odometry and not slam or is there really a map generated?

    • @JetsonHacks
      @JetsonHacks  4 роки тому +1

      There is a map generated, stored on board the camera. Thanks for watching!

  • @antonwinter630
    @antonwinter630 4 роки тому

    you said it gives POSE data, what is that? is it position/direction data?

    • @JetsonHacks
      @JetsonHacks  4 роки тому

      Correct. You can see in the video that it knows where it is in 3 space, and which direction it is pointing. Thanks for watching!

  • @JohnLevesque_Shogi
    @JohnLevesque_Shogi 5 років тому

    Can a Razer Stargazer be used with the nano instead? It was a realsense webcam

    • @JetsonHacks
      @JetsonHacks  5 років тому

      I don't have any experience with the Stargazer.

  • @pratikparajuli5991
    @pratikparajuli5991 5 років тому

    the line "Build CMAKE: false" at 4:32 does not show up for me, which later shows up as an error message CMAKE_CUDA_COMPLIER not set, after EnableLanguage" How can I fix this?
    Thanks!

    • @JetsonHacks
      @JetsonHacks  5 років тому

      I do not know which L4T version you are running. Newer version of the repository do not rebuild CMAKE. I do not know if you have CUDA installed on your Jetson. Typically you would look for the CUDA compiler and set the path appropriately.

    • @pratikparajuli5991
      @pratikparajuli5991 5 років тому

      @@JetsonHacks Thanks for your quick reply. I am actually using the depth and tracking camera together with python on a RPi4. I'll keep looking how to fix the issue.

    • @JetsonHacks
      @JetsonHacks  5 років тому +1

      @@pratikparajuli5991 The scripts are for a NVIDIA Jetson Nano which has a GPU. For the RPi you will need to modify the script both for that environment and architecture. Good luck on your project.

  • @ericstratten6974
    @ericstratten6974 5 років тому

    Installed librealsense on my Nano last night and was able to confirm that the T265 is working with realsense-viewer. The problem I am having is that the T265 is not detected by realsense-viewer or any other realsense software after a restart where the T265 is left plugged in. If I unplug it and then plug it back in everything works again. Anyone else have this issue? Is it possibly a firmware issue on the T265?

  • @superjaykramer
    @superjaykramer 4 роки тому

    It looks like it's loosing position tracking quite a lot!..then a glitch before re-tracking..

  • @robbyprust
    @robbyprust 4 роки тому

    currently the link shows the camera is unavaible .

  • @sohrabhosseini981
    @sohrabhosseini981 3 роки тому

    does it have jittering issue?

  • @PRASANNAMALITH-s1g
    @PRASANNAMALITH-s1g 5 років тому

    I tried to use RealSense T265 on Jetson Nano. I had 4.9GB free space when I clone the installSwapfile directory. But when I run ./installSwapfile.sh command I got an error "fallocate : fallocate failed: No space left on device" . And my free space became 0. The clone is not that big. Do you know about this issue ?

    • @JetsonHacks
      @JetsonHacks  5 років тому

      The swapfile is 4.0 GB. The library and firmware for the T265 are of significant size. If you were trying to build the kernel too, there's no way that all fits in 4.9GB. Typically when building something like this, you should have an adequate size SD card/USB drive with enough free space. Also, it is recommended that you build on a fresh install.

    • @PRASANNAMALITH-s1g
      @PRASANNAMALITH-s1g 5 років тому +1

      Seems like I should use a 32GB SD card instead of the 16GB one. Thanks for the reply.

    • @JetsonHacks
      @JetsonHacks  5 років тому +1

      @@PRASANNAMALITH-s1g Yes, 16GB just gets you going. If you are going to develop on it or gather data, 32-64GB is a better choice.

    • @PRASANNAMALITH-s1g
      @PRASANNAMALITH-s1g 5 років тому

      It worked well with 64GB microSD card. Thanks

    • @JetsonHacks
      @JetsonHacks  5 років тому

      @@PRASANNAMALITH-s1g I am glad you got it to work.

  • @miguelangelmayori1073
    @miguelangelmayori1073 5 років тому

    Can you show us a real application with this camera?

  • @aabb-zz9uw
    @aabb-zz9uw 5 років тому

    How about using two webcams instead($4 each)?

  • @ericschleicher
    @ericschleicher 5 років тому +1

    Thanks!

    • @JetsonHacks
      @JetsonHacks  5 років тому

      You are welcome, and thanks for watching!

  • @codyvandervoort4079
    @codyvandervoort4079 4 роки тому

    that is awesome

    • @JetsonHacks
      @JetsonHacks  4 роки тому

      Thanks for watching!

    • @codyvandervoort4079
      @codyvandervoort4079 4 роки тому

      @@JetsonHacks Hey man would you be able to help me out, I really want to make an AI to trade forex for me. I can't find any information and im not budging any closer on moving towards my goals I thought you would be the best person to ask for direction. Thanks!!

    • @JetsonHacks
      @JetsonHacks  4 роки тому

      @@codyvandervoort4079 I don't know anything about forex trading. Good luck on your project!

    • @codyvandervoort4079
      @codyvandervoort4079 4 роки тому +1

      JetsonHacks thanks for the reply, I ended up finding some information on quant trading and making charts with R programming, buddy said the neural net he was running for years was too stressful, less complicated the better

  • @kalsprite
    @kalsprite 5 років тому

    How does this camera compare to the zed?

    • @JetsonHacks
      @JetsonHacks  5 років тому

      The T265 is a tracking camera, and the ZED is a RGBD camera. Thanks for watching!

    • @kalsprite
      @kalsprite 5 років тому

      @@JetsonHacks Right, I probably should have asked against the D435. I am looking at a navigation / obstacle camera for a remote lawnmower project, and am between the T265/D435 and the Zed. Main board will be a jetson nano, of course :)
      Do you have an opinion on the comparison? You have videos on all three cameras.

    • @JetsonHacks
      @JetsonHacks  5 років тому +1

      @@kalsprite No opinion. Each has its strengths and weaknesses. If you are using a Jetson Nano, you should be aware that the ZED does all of its processing on the Nano, which can be computationally expensive. That is, there's not a lot of extra computation capacity available past that. The Intel cameras do their computation on board the camera.

    • @mattizzle81
      @mattizzle81 4 роки тому +1

      @@kalsprite Late reply, but oh well. In addition to the heavy computation needed by the ZED, it also works terrible indoors, like in a small room for example vs the Realsense D435, and the Realsense D435 is terrible compared to a TOF sensor like the Azure Kinect or the Realsense L515. Outdoors is another story and TOF/IR does not work as well, so the ZED is competitive outdoors at long ranges.

    • @kalsprite
      @kalsprite 4 роки тому

      @@mattizzle81 thanks! the timing isnt bad at all. i ning on picking up the project again this winter.

  • @sy2532
    @sy2532 5 років тому

    Jim, I have tried installing several times on my nano(with no install issues) , but I am still not able to access t265 using the RealSense-Viewer. I have looked on git hub and found similar problems github.com/IntelRealSense/librealsense/issues/3361 , the only difference is they were using ubuntu16. When I run lsusb I can see the t265 on Bus 001 Device:003: ID 03e7:2150 . But the realsense viewer does not seem to be able to pick it up. If I plug the d435 camera in the viewer instantly picks the camera up. One difference is the Bus the d435 connects to bus 002 while the t265 connects to bus 001. I can plug the t265 into my Windows10 PC and it works fine. Any idea's? The device number is also different t265 it is device 003 while the d435 is device 005.
    I also noticed that using a high end power supply that can provided 5Amps at 5volts really improved the nano's performance. I was using a 2amp max supply and it just was not enough...the nano was slow. Using the d435 I did not get any of the frame errors you were showing. The viewer was the only thing limiting the frame rate and size.

    • @JetsonHacks
      @JetsonHacks  5 років тому

      Did you try to hit the + button and add device?

    • @sy2532
      @sy2532 5 років тому

      @@JetsonHacks The RealSense-Viewer does not list the T265 so there is nothing to add. The d435 just pops up instantly without having to add.

    • @JetsonHacks
      @JetsonHacks  5 років тому

      @@sy2532 How are you interfacing with the T265? Do you have other cameras plugged in at the same time, and are you using a powered USB hub?

    • @sy2532
      @sy2532 5 років тому

      @@JetsonHacks I am plugging directly into the nano USB slot(s). Yes I have had both the t265 and the d435 plugged in at the same time. I have tried swapping USB ports. I have unplugged the d435 and left the t265 plugged in. With the viewer then showing nothing to add at all. The other USB Slots I have a keyboard and mouse directly plugged into the nano. I do have a usb hub(same as you have) but it is not plugged into the nano and I can give it a try if you think it is needed.
      Here maybe something of interest: The Linux Foundation 3.0 root hub is on the 002 Bus. The Linux Foundation 2.0 root hub is on the 001 bus. The camera's are USB 3.0.... yet the only bus that the t265 seems to attach to is the 001 bus... while the d435 seems to always on the 002 bus which is USB 3 hub. My question is how do I get the t265 on the 002 Bus that the USB 3 hub is on? Or is this not relevant.

    • @JetsonHacks
      @JetsonHacks  5 років тому

      @@sy2532 First, I would try the powered hub. The T265 does not need a modified kernel, you can use librealsense on its own. With that in mind, create a new SD card and build librealsense on it, but do not modify the kernel. You should see the T265 work. Also, sometimes just replugging a camera can help it be recognized.

  • @levantestream5
    @levantestream5 3 роки тому

    is possible works with unreal engine???

  • @teemo1832
    @teemo1832 5 років тому +1

    YAW!! 6:44 YAW!! 6:44 YAW!! 6:44 YAW!! 6:44 YAW!! 6:44 YAW!! 6:44 YAW!! 6:44 YAW!! 6:44 YAW!! 6:44 YAW!! 6:44

  • @sdr3059
    @sdr3059 5 років тому +6

    Make python tutorial with Realsense and nvidia nano

    •  5 років тому +1

      .....please?

    • @ozy5332
      @ozy5332 5 років тому

      like developing a slam?

  • @Diamond_Hanz
    @Diamond_Hanz 5 років тому

    eyy!!! =)

  • @helpinghand6282
    @helpinghand6282 5 років тому +2

    Please make nano + d435 real sense

  • @pascalchen2463
    @pascalchen2463 3 роки тому

    i tested this camera last year using raspberry4 and jetson nano, it has an important issue: github.com/IntelRealSense/librealsense/issues/4518, not very stable