Is this tutorial the same for the D455 camera? I got a problem while installing the py realsense wrapper.. it says there are some libaries missing while linking. I am using a d455 camera. Do you know this problem?
Great job! Really impressive! How much different would it be with a d435i and with Jetson Nano? Do you have any ideas? It is ridiculously messy to work with these camera. Don't really get why!
hi, can some help me to do some thing: i wonna do real time scan of object, so you get xy ply pictures and algorithm must put it in one 3d modell together, i cant do it.. it works with 2 ply files but not so well.... Pls help so we can meet us in discord or so...
You are AMAZING! Thank you for simplifying the process!! I’m getting an error that says GLSL not supported. Any leads on how to go on out it further will be greatly appreciated! Thanks in advance!
hi i am also trying to connect my d415 with Rasperry pi. But i am having hard time to get it running. can you please help me or give me your email? or can you emailed me at laxmankumarbal58@gmail.com
Thank you for this video!. Did you measure somehow the frame rate depending on camera resolution settings? Can the resolution be downgraded to QVGA for achieving higher speeds?
What are the limitations of running RealSense/OpenCV on a Raspberry Pi 4? I've seen some really poor frame rates (less than 5) on i5 8GB systems, so I'm curious to see how this video's setup performs.
For now, I've only tried the D435, but as the communication protocols are similar, the Python code *should* work with the rest of the line. At the very least, you can see if the devices are recognized by the realsense-viewer, and then take it from there. HTH!
are there other viewers for intel realsene or is this the only one? i would love to have a camera, raspberry pi and a small screen to measure depths, however i dont need the viewer gui, is it possible to just have the raw depth video feed displayed on screen or must you use the realsense viewer ??
Hi, I followed your tutorial step by step on my raspberry pi4. I can see the camera frames in the realsense-viewer, very fine! But when I try running the python examples in the wrapper/python directory I get an error message like: File "opencv_viewer_example.py", line 13, in pipeline = rs.pipeline() AttributeError: module 'pyrealsense2' has no attribute 'pipeline' I can run "import pyrealsense2 as pr", but it seems nothing is really working. Is there something I am missing? Please let me know and thanks again for your amazing work!
I got the same problem. The fix is copy ~/librealsense/wrappers/python/pyrealsense2/__init__.py into pyrealsense2 install folder where all the .so files are. in my case it is at /usr/lib/python3/dist-packages/pyrealsense2
Receiving this error during the librealsense build process /home/yalt/librealsense/src/libusb/libusb.h:10:82: error: extended character ‘ is not valid in an identifier 10 | /usr/include/libusb-1.0/libusb.h:736:4: warning: ISO C++ forbids zero-size array ▒▒▒dev_capability_data’ [-Wpedantic] Any idea what the source of this could be?
It depends on the system's architecture of the other boards. Since the libraries have been compiled for the SoC on the Pi, you'll need to recompile the source code for other ones. If it's the same architecture (e.g., armv7) then it shouldn't be too bad. Best of luck!
@@datasith it looks like there is very limited compatibility with any dev board and even the more popular odroid has issues dev.intelrealsense.com/docs/odroid thats a shame
@@NSAwatchesME thanks for sharing, and yup, that'd be what i expected. if you find an x86 dev board that works for you (assuming power consumption isn't an issue) then that's an alternative as well.
@@varshaarun9388 hey. This has been months ago. I think I had a GitHub issue raised on the same. As far as I remember this issue is due to vnc viewer. If you connect monitor to the screen it will show the realsense-viewer. Vnc viewer uses virtual tech to simulate monitor to operating system. Only way to solve this is to update glx drivers on raspi. Eventually we shifted to Jetson platform and couldn't reproduce the problem. Will update you with the issue link if we find it.
@@PremSai2244 this is the fix. Unfortunately, the viewer only appears to display correctly if you are VNC without a screen plugged into the pi. Anyone figure out a fix to view with an onboard screen?
You can, one limitation is on the USB speed. Notice that I connected the camera to USB 3 ports. Intel announced a while back support for USB 2 (which are the only option on a Raspberry Pi 3B+): www.intelrealsense.com/usb2-support-for-intel-realsense-technology/ But, you'll have to trade off the smaller bandwidth for image quality. HTH!
Thanks. Still for whatever reason the make install does not copy wrappers/python/pyrealsense2/__init__.py into wherever destination folder pyrealsense2.cpython-37m-arm-linux-gnueabihf.so goes. And it was a bit of pain to figure that out :) PS also on a 4Gbyte Pi4 compiling full throttle works fine. It saves a lot of time. $ make -j4
@@Oscar-db8mp no worries, I was going through a whole lot of comments and answered in a hurry. Let me know if you run into any trouble getting it to work!
Hey! Thanks for your amazing tutorial. So far i've got everything done on my pi4 (running on ubuntu mate) except for the last part where i can't activate the openGL driver : it says that driver and kernel are not present on the system. Do you have any idea what may cause this ? If i dont succeed i guess i'll try to do the same on your linux distribution
would this work with a 16gb sd card? Update: You can install the SDK and be able to successfully install librealsense and run realsense-viewer but you will be at 100% usage and will have no free space to add the python wrapper or anything else. Can confirm that you will need a 32GB sd card
While the Realsense Viewer worked fine, I discovered the python examples didn't. So I went back to study over the instructions, and see this line cmake .. -DBUILD_PYTHON_BINDINGS=bool:true -DPYTHON_EXECUTABLE=$(which python3) I'm assuming now, I should have replaced (which python3) with something. After some Google searching, I found an example something like this cmake .. -DBUILD_PYTHON_BINDINGS=bool:true -DPYTHON_EXECUTABLE=/usr/bin/python3.7 Is this correct? I rebuilding now, but this takes hours. Thanks!
Well, I went back and looked at the video and you are using DPYTHON_EXECUTABLE=$(which python3), so that must be correct syntax. Must be some other issue.
The answer was already posted by Pankrit Kritkiattisak below The fix is copy ~/librealsense/wrappers/python/pyrealsense2/__init__.py into pyrealsense2 install folder where all the .so files are. in my case it is at /usr/lib/python3/dist-packages/pyrealsense2
Yup, the same library works for all RealSense devices. On the Python side you might need to make a few adjustments depending on the actual model, but the included examples are a good starting point for that. HTH!
@@datasith Thanks a lot for the answer, i have not been able to import the correct pyrealsense module, what import have you been having success with? realsense-viewer works fine, but the Thonny IDE doesn't find the module pyrealsense2 nor does it find the pyrealsense module, do you have any idea as to why?
Glad to hear, Shan! For now just OpenCV in addition to the standard pyrealsense2. I haven't gotten the chance to use Open3D so you're right, this might be a perfect opportunity to do so. Thanks for the suggestion!
So I can't test it since I don't have a D435i, but I'm 99% confident that the same command works. The udev rules are part of the `librealsense` library, and they enable USB communication for all "RealSense" devices. So try these same commands, and they should work!
Hello - Everything went smoothly until I executed the following: "cmake .. -DBUILD_EXAMPLES=true -DCMAKE_BUILD_TYPE=Release -DFORCE_LIBUVC=true" Info: REALSENSE_VERSION_STRING=2.45.0 -- Performing Test COMPILER_SUPPORTS_CXX11 -- Performing Test COMPILER_SUPPORTS_CXX11 - Success -- Performing Test COMPILER_SUPPORTS_CXX0X -- Performing Test COMPILER_SUPPORTS_CXX0X - Success -- Setting Unix configurations -- Building libcurl enabled CMake Error at /usr/share/cmake-3.16/Modules/FindPackageHandleStandardArgs.cmake:146 (message): Could NOT find OpenSSL, try to set the path to OpenSSL root folder in the system variable OPENSSL_ROOT_DIR (missing: OPENSSL_CRYPTO_LIBRARY OPENSSL_INCLUDE_DIR) Can you provide some guidance or updates?
Mate, your channel is extremely underrated
I think this channel is on par and superior to many channels about electronics. Kudos for the author.
the Ai_Demos_RPi repository on the video footer does not exist? what it the link for the "demos for the raspberry Pi wiki" mentioned at 0:34?
Is this tutorial the same for the D455 camera? I got a problem while installing the py realsense wrapper.. it says there are some libaries missing while linking. I am using a d455 camera. Do you know this problem?
ตอนนี้แก้ปัญหาได้หรือยัง
is there any need of installing protobuf if i am using ubuntu os in raspberry pi
Thank you for making this video. Still really helpful, despite a few things being different since it was first published.
what are things that are different, my python setup wont work.
Hey, my fonts are missing when I open the realsense-viewer through Vnc Viewer
how do you apply the swapfile? how do you save that file after you changed to 2048? ctrl+o does not seem to work, nor ctr+x
Great job! Really impressive! How much different would it be with a d435i and with Jetson Nano? Do you have any ideas? It is ridiculously messy to work with these camera. Don't really get why!
The Tbb link is no longer working. Please suggest an alternative.
Hi @ACROBOTIC, Why does my comment gets removed? I was seeking for help to understand the problem during the installation procedure
how do I find the 12 digit device_id of the intel realsensecamera?
hi, can some help me to do some thing: i wonna do real time scan of object, so you get xy ply pictures and algorithm must put it in one 3d modell together, i cant do it..
it works with 2 ply files but not so well....
Pls help so we can meet us in discord or so...
You are AMAZING! Thank you for simplifying the process!!
I’m getting an error that says GLSL not supported. Any leads on how to go on out it further will be greatly appreciated! Thanks in advance!
Hi
The GitHub page is not accessable, is there alternative page or way to use that data??
It doesn’t work when I reboot the raspberry pi. I have to unplug and replug
Thank you very much. you save me a lot of time. the process goes very smooth.
Nice video, quite an achievement !
ha! thanks philip. now the real fun begins with some computer vision applications :)
@@datasith Indeed. Build a robot and use the vision system together with that.
@@PhG1961 yup, yup! it'll take some time, but the plan is to mount it on my little robocar. i'm soooo looking forward to it!
Can we use this for interactive floor mapping?
Thank you for the video and the Wiki post. I now have the D415 up and running on the Pi 4.
Hi what frame rate did you get? thanks
@@pisoiorfan On a Raspberry Pi 4 8G using a D415 at 1280x720 in the Realsense viewer 2D I'm getting 29 hardware FPS
@@grokwhy Thank you. Does the lag is annoying/noticeable?
hi i am also trying to connect my d415 with Rasperry pi. But i am having hard time to get it running. can you please help me or give me your email? or can you emailed me at laxmankumarbal58@gmail.com
Thank you for this video!. Did you measure somehow the frame rate depending on camera resolution settings?
Can the resolution be downgraded to QVGA for achieving higher speeds?
In the viewer, which is just a pretty interface to what you can do in code, you can set the resolution and the frame rate.
What are the limitations of running RealSense/OpenCV on a Raspberry Pi 4? I've seen some really poor frame rates (less than 5) on i5 8GB systems, so I'm curious to see how this video's setup performs.
have you tried the latest real sense? and they do lidar too l515
For now, I've only tried the D435, but as the communication protocols are similar, the Python code *should* work with the rest of the line. At the very least, you can see if the devices are recognized by the realsense-viewer, and then take it from there. HTH!
Thank you for this video! it's very helpful.
are there other viewers for intel realsene or is this the only one? i would love to have a camera, raspberry pi and a small screen to measure depths, however i dont need the viewer gui, is it possible to just have the raw depth video feed displayed on screen or must you use the realsense viewer ??
yes it is possible to get the raw depth
Hi, I followed your tutorial step by step on my raspberry pi4.
I can see the camera frames in the realsense-viewer, very fine!
But when I try running the python examples in the wrapper/python directory I get an error message like:
File "opencv_viewer_example.py", line 13, in
pipeline = rs.pipeline()
AttributeError: module 'pyrealsense2' has no attribute 'pipeline'
I can run "import pyrealsense2 as pr", but it seems nothing is really working. Is there something I am missing?
Please let me know and thanks again for your amazing work!
I got this error too.....Do you fix it?
I got the same problem.
The fix is copy ~/librealsense/wrappers/python/pyrealsense2/__init__.py into pyrealsense2 install folder where all the .so files are.
in my case it is at /usr/lib/python3/dist-packages/pyrealsense2
Receiving this error during the librealsense build process
/home/yalt/librealsense/src/libusb/libusb.h:10:82: error: extended character ‘ is not valid in an identifier
10 | /usr/include/libusb-1.0/libusb.h:736:4: warning: ISO C++ forbids zero-size array ▒▒▒dev_capability_data’ [-Wpedantic]
Any idea what the source of this could be?
Are you able to use the same steps for the L515 Intel RealSense Camera?
yes I can confirm these steps worked for the L515
Vamos ahi !! Un servidor desde España!
Un gran saludo, gracias por el aguante!
Will this work with a ReasSense D415?
to use realsense on something like nanopi4 or rock pi 4c or tinker edge r is there specific Linux I need? can use same code?
It depends on the system's architecture of the other boards. Since the libraries have been compiled for the SoC on the Pi, you'll need to recompile the source code for other ones. If it's the same architecture (e.g., armv7) then it shouldn't be too bad. Best of luck!
@@datasith it looks like there is very limited compatibility with any dev board and even the more popular odroid has issues dev.intelrealsense.com/docs/odroid
thats a shame
@@NSAwatchesME thanks for sharing, and yup, that'd be what i expected. if you find an x86 dev board that works for you (assuming power consumption isn't an issue) then that's an alternative as well.
Do you have a video doing this project with an Orange Pi 5? 😎 Thank you.
Could not initialize offscreen context!
GLFW Driver Error: GLX: GLX version 1.3 is required
cant run realsense-viewer suggest a solution, please
Same problem! Were you able to find a solution?
@@varshaarun9388 hey. This has been months ago. I think I had a GitHub issue raised on the same. As far as I remember this issue is due to vnc viewer. If you connect monitor to the screen it will show the realsense-viewer.
Vnc viewer uses virtual tech to simulate monitor to operating system.
Only way to solve this is to update glx drivers on raspi. Eventually we shifted to Jetson platform and couldn't reproduce the problem.
Will update you with the issue link if we find it.
@@PremSai2244 Thanks for the reply. But I dont use VNC server. I have a monitor connected but I was still getting this driver issue.
@@varshaarun9388 then it must be other way round. Try with vnc viewer and without monitor.
@@PremSai2244 this is the fix. Unfortunately, the viewer only appears to display correctly if you are VNC without a screen plugged into the pi.
Anyone figure out a fix to view with an onboard screen?
can i followe this steps for raspberry pi 3b+ ??
You can, one limitation is on the USB speed. Notice that I connected the camera to USB 3 ports. Intel announced a while back support for USB 2 (which are the only option on a Raspberry Pi 3B+):
www.intelrealsense.com/usb2-support-for-intel-realsense-technology/
But, you'll have to trade off the smaller bandwidth for image quality.
HTH!
I must to install OpenCL, how can I do it?
Thanks. Still for whatever reason the make install does not copy wrappers/python/pyrealsense2/__init__.py into wherever destination folder pyrealsense2.cpython-37m-arm-linux-gnueabihf.so goes. And it was a bit of pain to figure that out :)
PS also on a 4Gbyte Pi4 compiling full throttle works fine. It saves a lot of time.
$ make -j4
Is there a new setup or should I still just be using the same setup for my Pi 4?
Did you read the title?
ACROBOTIC sorry about that.
@@Oscar-db8mp no worries, I was going through a whole lot of comments and answered in a hurry. Let me know if you run into any trouble getting it to work!
My Intel RealSense D415 camera is working on my Raspberry pi 4, 4gb model, but the video feed is very slow and laggy. Anyone know how to fix?
Hey! Thanks for your amazing tutorial. So far i've got everything done on my pi4 (running on ubuntu mate) except for the last part where i can't activate the openGL driver : it says that driver and kernel are not present on the system. Do you have any idea what may cause this ? If i dont succeed i guess i'll try to do the same on your linux distribution
Hi Bro. Im trying on ubuntu mate but i get errors. Can you recommend me what distro did you use? Thanks!
Esta GENIAL!! Gracias y un fuerte abrazo Argento!!
Gracias capo, un gran saludo y felicidades for el cambio de nombre de usuario (es joda!) :)
Good video!
What's the frame rate of the depth image could achieve? (848*480)
I'm interested in frame rates too. I think it heavily depends on ROI you define but I need at least 30 fps.
Very good! thanks
would this work with a 16gb sd card?
Update: You can install the SDK and be able to successfully install librealsense and run realsense-viewer but you will be at 100% usage and will have no free space to add the python wrapper or anything else. Can confirm that you will need a 32GB sd card
While the Realsense Viewer worked fine, I discovered the python examples didn't. So I went back to study over the instructions, and see this line
cmake .. -DBUILD_PYTHON_BINDINGS=bool:true -DPYTHON_EXECUTABLE=$(which python3)
I'm assuming now, I should have replaced (which python3) with something. After some Google searching, I found an example something like this
cmake .. -DBUILD_PYTHON_BINDINGS=bool:true -DPYTHON_EXECUTABLE=/usr/bin/python3.7
Is this correct?
I rebuilding now, but this takes hours.
Thanks!
Well, no change
>>> import pyrealsense2 as rs
>>> pipeline = rs.pipeline()
... module 'pyrealsense2' has no attribute 'pipeline'
Well, I went back and looked at the video and you are using DPYTHON_EXECUTABLE=$(which python3), so that must be correct syntax. Must be some other issue.
The answer was already posted by Pankrit Kritkiattisak
below
The fix is copy ~/librealsense/wrappers/python/pyrealsense2/__init__.py into pyrealsense2 install folder where all the .so files are.
in my case it is at /usr/lib/python3/dist-packages/pyrealsense2
Do you think this would work with the intel RealSense d415?
Yup, the same library works for all RealSense devices. On the Python side you might need to make a few adjustments depending on the actual model, but the included examples are a good starting point for that. HTH!
@@datasith Thanks a lot for the answer, i have not been able to import the correct pyrealsense module, what import have you been having success with? realsense-viewer works fine, but the Thonny IDE doesn't find the module pyrealsense2 nor does it find the pyrealsense module, do you have any idea as to why?
It worked if i ran the program through the commandline with python3 *insert programname*.py
ACROBOTIC So also for T265?
Nice !
Why the Argentina futbol Tshirt?
Great.. I was waiting this for a long long time... What python libraries are you gonna use ? Open3D?
Glad to hear, Shan! For now just OpenCV in addition to the standard pyrealsense2. I haven't gotten the chance to use Open3D so you're right, this might be a perfect opportunity to do so. Thanks for the suggestion!
ACROBOTIC great. Thanks. Can’t wait for next video..
nice project
thanks
when enabling permissions at 3.11, what would you do differently on a d435i (different port name I assume)
So I can't test it since I don't have a D435i, but I'm 99% confident that the same command works. The udev rules are part of the `librealsense` library, and they enable USB communication for all "RealSense" devices. So try these same commands, and they should work!
Good video should not have fast forwarded video unnecessarily. Cant read cli commands
Hello - Everything went smoothly until I executed the following: "cmake .. -DBUILD_EXAMPLES=true -DCMAKE_BUILD_TYPE=Release -DFORCE_LIBUVC=true"
Info: REALSENSE_VERSION_STRING=2.45.0
-- Performing Test COMPILER_SUPPORTS_CXX11
-- Performing Test COMPILER_SUPPORTS_CXX11 - Success
-- Performing Test COMPILER_SUPPORTS_CXX0X
-- Performing Test COMPILER_SUPPORTS_CXX0X - Success
-- Setting Unix configurations
-- Building libcurl enabled
CMake Error at /usr/share/cmake-3.16/Modules/FindPackageHandleStandardArgs.cmake:146 (message):
Could NOT find OpenSSL, try to set the path to OpenSSL root folder in the
system variable OPENSSL_ROOT_DIR (missing: OPENSSL_CRYPTO_LIBRARY
OPENSSL_INCLUDE_DIR)
Can you provide some guidance or updates?
I fixed it by installnig libssl
Below is the solution that worked for me:
sudo apt-get update
sudo apt-get upgrade
sudo apt-get install libssl-dev