One Step Closer to Beating Tesla FSD: Navigate on Openpilot
Вставка
- Опубліковано 5 вер 2024
- Openpilot v0.9.4 is a milestone release that now allows the car to make steering decisions based on GPS/Navigation data. Read more here: blog.comma.ai/...
Watch how my Comma Three, installed with Sunnypilot, turns my 2020 Rav4 Hybrid into a DIY Self Driving Car!
Installing Sunnypilot: github.com/sun...
"Free Comma Prime" GPS: github.com/sun...
For more help, visit: discord.sunnyp...
Affiliate Links for gear used in this video:
Comma Three USBC Port Saver: amzn.to/3s4lsui
DJI OSMO Action: amzn.to/3rY306T
Hat POV Mount: amzn.to/3Ys57f9
200GB SDCARD: amzn.to/3DK6QTB
Not Bad. Looks like we are finally getting some improvement.
Thanks for watching! I’m sure your contributions in the past had some influence into what both Sunnypilot and OpenPilot is today.
Are you back to developing and using OpenPilot again?
@@bryan.deleon some, yes. The car in blind spot is for sure my code but I wish comma would have copied my newest version which would cancel the land change. Currently if you nudge and then someone drives in your blindspot it will proceed to drive into the car instead of cancelling the lane change. You could try and see if it is still the case and open an issue. Currently I am shadow banned so anything I post is not visible.
@@ArneSchwarck I would test that if only I have a written agreement to have my car replaced in case of any problems. ;)
I know that if there is someone in my blind spot, the lane change will not be initiated, but I do not know if the lane change would abort midway.
@@bryan.deleon I have tested it intensively and it is one thing that I can not understand. I was not allowed to upstream the lane change code because it was too unsafe. And then months later they just copy it without even giving credit and don't even make it safe in all situations. I thought at least 2 years later I would see someone complain about this and it being fixed with just another copy paste from my fork. Even DP has it integrated with credits to me.
@@ArneSchwarck the OpenPilot community is a fascinating case study of human collaboration and indeed. At its core, we are a peculiar and extremely niche subset of people willing to risk our lives and property (along with others) for a myriad of reasons (hobby, curiosity, early adopter, etc) - it’s no wonder that so many odd interactions occur within the group because it begins with odd people!
Would love more videos showcasing this again. Perhaps more of NoO on non-highway areas/attempting to make turns. Super interesting. This reminded me of some Tesla FSD showcase videos. Thanks for the upload!
I’ll try to get some more videos out soon. Thanks for checking it out!
I am confused about the Scopes to check when I am signing up for map box token I believe you use the private one can you give me some guidance
Great vid. I know everyone wants more open pilot vids!
Thanks for watching! I might have some free time to upload some changes at the very least will have an End of 2023 recap/review of sorts.
Nice video! I'm going to say it made an attempt to go into the driveway but you needed to assist it.
Thanks for watching! I think it lunged right after the driveway, but maybe the model was late?
Great video! Could you make a video going over which toggles you should enable during setup and which you can skip? Thanks again from a new Comma user!
Thanks for watching! For a new user, you should really be using stock OpenPilot for AT LEAST two weeks of actual road time, so you can get a very clear understanding of program’s capabilities and limitations; simple things like understanding the maximum speed at which you car can safely brake for a stopped vehicle for instance - not knowing these minute details can absolutely spell trouble when dealing with the endless toggles in forks like Sunnypilot.
On top of that, it’s really going to be vehicle specific too. What might work for my Toyota would not make sense in a VW for instance. And some things come down to personal preference as well!
But I will make a video on what setting I have applied, but hopefully I hit home on what I said above.
Superb video! Provides a nice variety of driving conditions. Please keep them coming.
I have the impression that future Comma hardware iterations will need more eyes (cameras) to get higher up the autonomous driving scale (OpenPilot being squarely at Level 2). I find it difficult to imagine the single driver facing camera being enough to discern vehicles approaching from the rear that would make lane changes at speed something to do with confidence. Perhap additional side cameras for turns approaching or exceeding 90 degrees and for kerb (curb) avoidance. Heck, given the recent incident in San Fancisco a camera on the underneath might warranted.
Thanks for watching!
Considering Geo Hotz’s main goal is General AI, I wouldn’t be surprised if they move on from OpenPilot and just leave it at Level 2 indefinitely - because I agree with you regarding needing a robust sensor area and data pipeline system.
@@bryan.deleon You are almost definitely right. George Hotz (head of Comma AI & Tiny Corp), in one of his interviews with Lex Friedman (available on YT), did state he was resolutely sticking with Level 2 autonomy.
Found the video!
ua-cam.com/video/_L3gNaAVjQ4/v-deo.htmlsi=ESAmoG9KKnNi2yX9
George Hotz says:
"The only difference between Level 2 and the other levels is who takes liability. I'm not a liability guy. I don't want to take liability. I'm a Level 2 forever."
Looks great to me - been using Tesla FSD for 5 years now.
How are you liking the new updates to FSD lately?
Great video, deserves more views
Thanks kindly! I’m hoping to post a new one soon. Lots going on atm.
Great video! Thanks for posting. Question -- do you think some of the speed issues (going too slow, etc) would be alleviated by using Comma Prime directly instead of the hotspot and Mapbox integrations?
No. They pull the speed data from the same source - Open Street Maps.
Edit: I just re-read your question - in stock form with Comma Prime, the speed OpenPilot chooses is based on e2e training; it doesn't care about posted speed limits since it decides how fast it wants to go based on what it sees in the current scene.
Also note, Comma has removed Navigate on Openpilot in their software due to low performance - good choice imho lol
It’s not “based on camera point of view” how it works is when you set destination mapsd renders smaller image of navigation and that get fed into navmodel. That get fed into regular model. Definitely, watch the comma con presentation if you have not done so.
Thanks for watching and commenting!
Can you give a timestamp of what you quoted?
@@bryan.deleon ua-cam.com/video/ZEMPQjK1ZPw/v-deo.html
Do you use map box? I have never went through the process of setting it up. I’m soooo impressed with this latest update. It’s amazing. I was gawking at it the whole way home hahaha. I had like 7 interactions where I normally have like 25-30
My question got answered hah
@@CrazyAustin48 MapBox indeed! Safe travels.
Hey Brian, super interesting video!
This raises a few questions for me. Does autonomous turning work by stopping at red lights? Can it recognize crosswalks or stop signs?
It is also important that the system detects the speed and adjusts it automatically. Is there also an automatic lane change to overtake slower vehicles?
Thank you for your work and the information!
Thanks for watching! To be clear, I don’t work on the software, I’m just a user lol.
The system is trained to react like a human driver who has shared data to Comma; good or bad drivers - it’s why we see the system doing “California rolls” on stop signs = bad.
The system does detect cross walks, but how heavily those crosswalks effects it’s decision making isn’t very clear. You can learn more about what the system “sees” here: github.com/commaai/comma10k
At this time, it does not automatically overtake vehicles nor does it make lane changes on its own - at least on publicly available forks/versions of the software. It will only change lanes if I initiate them with a turn signal actuation and the GPS/navigation is telling the system a turn is coming up. The software can also tell if the lane you’re in is slower or faster than surrounding traffic, but again it does not act on that information.
Furthermore, the current hardware (driver/cabin monitor camera) and system (my car’s built in blind spot monitoring) isn’t sufficient for automated lane changes imho - no way it can safely check for clear/safe lane changes. The demo Comma uploaded, was probably done over many takes since the lane changes were a huge gamble. A live stream would have been more convincing lol
That’s awesome, I’m over in San Jose too and have been looking for real world experiences with comma in the Bay Area. Have you tried driving it on Highway 17? Highway 1?
Here’s an older video on Hwy 17, and I didn’t record it but drove Hwy 1 a few weekends back to Big Sur: ua-cam.com/video/rj3-dLM3-f0/v-deo.htmlfeature=shared
It’s really going to be car dependent, what car do you have?
Great video, would love to see more NOO testing
Thanks! More in the works.
Welcome back. Great that you're testing the latest dev which seems to be in sync with your GPS and doesn't require too much assistance on your end. Still gotta use those turn signals yourself, right? Driving under the speed limit with fewer cars present while testing the latest dev was also prudent. You mentioned lighting conditions around the first quarter of the video, so I wonder if driving at night will also be a factor, so to speak.
Don't want to be that guy, but you never got back to my questions about Masters of the Universe earlier this year.
Hey Tony, good to hear from you!
You’re gonna have to remind me again about the Masters of the Universe question? 😅
And yes, the newest versions of OpenPilot now use navigation data to influence the path planning. In my experience lighting conditions have a noticeable effect on the performance of OpenPilot while using Experimental/e2e mode - which is needed to use Navigate on OpenPilot.
@@bryan.deleon Thanks for clarifying. Wonder what else is needed to fine-tune the next dev.
I asked two questions, actually:
1. Did you watch Masters of the Universe: Revelation or the CGI He-Man series?
2. Have you come across Mattel's current Masters of the Universe toylines while shopping? Their Masterverse figures are winning fans over, including me. I even painted one in Golden State Warriors colors last year. Shame that I can't post photos here.
@@tonyc.0451 I did watch that animated series! Don’t judge me but the Netflix Algorithm gave me a specific thumbnail with Evil-Lyn and I shameless clicked it lol
Post a link to your custom painted figure and I’ll check it out.
Regarding what else is there for OpenPilot, and I will have to say they need to revisit the driving dynamics unique to each car. At this moment I believe they only needed the wheel base length as a metric to determine turning characteristics. But now that the model is becoming more brazen, it’s clear that the unit doesn’t actually “know” where it is in space in relation to the car; how wide is the car tire edge to tire edge, how is the device triangulated from the front tires, what is the influence of the suspension travel path to turning radii, etc. Its a big problem to solve since each car can be different but it should help in avoiding how much the car “cuts in” when initiating turn. Have you seen people use the flatbeds at Costco? They understand where they want to go, but you can see them struggle with actually doing it sometimes.
@@bryan.deleon Evening again. So OpenPilot must learn to adapt to each individual car. No "one size fits all" method, hmm?
Pardon the shameless plug. I reviewed my Golden State Warrior/Sorceress Teela last year. Hope that this link helps:
ua-cam.com/video/Nd2Mf52CC_A/v-deo.html
@@tonyc.0451 definitely warriors accurate!
Maybe it can be learned, but what could also help is getting tire edge to edge dimensions and also setting a proper guide on installation. Right now it’s just “make sure it’s center” and go; what could be helpful is being very accurate with the install, ie 4cm from x spot on windshield to reference. That way the device/model knows just how close it can be from road edges, corner apex, etc.
Can you do a video on setting up map box on the smart phone and the tethering to sunnypilot from the smart phone? Thanks
Thanks for watching! It's likely that I won't be making a video on MapBox setup anytime soon; but the instructions that I linked are very easy to follow.
what was the service gps that you dont have to pay map box is it
Thanks for watching, and your questions can be covered in the link I gathered and pasted in my description.
Thank you for the video, great features. When I have mapbox navigation turned on, with or without offline maps, the route doesn’t load. Anything to troubleshoot?
Thanks for watching.
I would suggest asking in Sunnypilot discord, for best help.
But for now make sure you check out the GitHub and read on!
@@bryan.deleon thank you
I want this so bad but sadly theres no support for the 2017 Ford Fusion. Rip
Well if you have the time, money, patience, and desire to learn - anything is truly possible: shop.retropilot.org/contact-us/
Link above has discord information where you might be interested.
PS - I suppose if you have money (listed above), you can also just buy a new car too lol
The NON learning of specific user routes is a big no no - the data should be plotted and lidared in major cities on a monthly basis.
“mo’ data, mo’ betta”
Really impressive for what at it's core is essentially a phone. Is 0.9.5 any better?
Thanks for watching! I think like 6 new models have been around since this video. With newest being: github.com/commaai/openpilot/pull/30392
I drove the model prior to the latest, and didn’t see much of an improvement in navigation, turning, or gas/brake. It’s going to be a snails pace - I’ve even heard that routing another cable to attach a laptop/pc to the C3/X for more compute is being tested since the cellphone isn’t powerful enough.
I would love to partner with law enforcement and install these in their cars and train officers. Do you know how amazing this would be for officers needing to run plates? They can use MADS and adjust brake and gas with feet as necessary..it’d be so amazing.
Around here, I think they have the automatic license plate readers on their cars too, not just street posts.
Are you sure the slow speed wasn't because of the cars set speed? It took us a long time to realize that sunnypilots max is based on the speed limit but still only goes up to what you had it manually set to- kinda confusing
My max speed was kept at 75mph for the entirety of the video, and should be evident in the video?
Does this work on Mazda CX-5 too?.. i mean my car model is in the supported cars list but are there any features of Hyundai or Toyota that make them more suitable for Comma 3 and sunny pilot. Thank u for the info
Thanks for watching! The higher the compatibility (steering torque, steering to 0mph, gas/brake to 0mph, etc) of your car the better Sunnypilot will work. Not many users with Mazda on Sunnypilot - most Mazda users gravitate here: torqueinterceptor.com/en-us/products/torque-interceptor-for-mazda
PSA: Comma doesn’t approve with all things in the link above, and I am not sure if they can get your account and device banned from official servers. Best to contact the author to verify.
Hello sir hope you are doing well. I have a 2019 RAV4 XLE Premium and thinking about getting the comma ai system do you think it is worth it? Also does it work with Navigate on OpenPilot ? Also have you tried other forks like frogPilot? I really interested just don’t want to have issues later that will regret my purchase
Thanks for watching! 2019-2021 RAV4’s are arguably the best CUV fully compatible cars for Openpilot (good steering, gas and brake control).
If you have the discretionary funds to afford the $1250 and fully understand you are buying a devkit that WILL come with hiccups, buy it. If you hate it before 30 days, return for a full refund.
I have not tried Frogpilot but may do so in the future.
PS - use stock OpenPilot for at least 2 weeks before using forks - you may find it does more than you need.
Thanks for getting back to me I am going to see what I can come up with. The navigate feature does the car follow the directions?
@@richw992 ummm did you not watch the video you’re commenting in?
I am such an airhead sorry. With the navigate does it door to door?
@@richw992 more like intersection to intersection… or close (if you’re lucky) the parking lot entry way; to better set expectations, imagine it only knows what lane it needs to be in, and will try its best to decipher and decide how to position itself with what’s ahead - it has NO context of anything but what is labeled here: github.com/commaai/comma10k?tab=readme-ov-file#categories-of-internal-segnet
Hiiiii, do you have blind spot monitor on the car?
I do yes. Why do you ask?
If I saw this in 2016 I feel like I wouldn't be that impressed.
I still appreciate you watching! Thanks for stopping in.
@@bryan.deleon I know it's impressive what they're doing, progress has just been so slow in self-driving. Overall would you recommend it? Might have pick one up.
@@JohnboyCollins I tell this to everyone who has the same question: if you have the disposable income to afford one, have already have a car with high OpenPilot compatibility, and like tinkering with DEVELOPMENT kits, then go for it! Otherwise the experience might not be as positive as the one I’ve experienced.
PS - keep in mind that Comma.ai offers a 30-Day Full Money Back guarantee if you find it doesn’t meet expectations!
I also have a 5th gen rav4 hybrid. does OP not do its own turn signal activation or is that always driver-based
What year is your rav4hybrid?
Comma has private code for turn signal activation (stronger “unsafe” steering at slow speed too) for their Taco Bell demo, otherwise it must be initiated by the user.
does synnypilot work on foresters?
Thanks for watching! If a car is on this list, it should work: github.com/commaai/openpilot/blob/master-ci/docs/CARS.md
But other cars could already be supported too, but it’s best you join the sunnypilot Discord (link in my description) and ask in the Subaru channel! Cheers!
Is the blind spot monitoring dependent on the car having a stock blind spot monitor, or is it a comma vision based system?
It uses the built in blind spot monitoring system of the car; I know Toyota cars work, but I am unsure about other cars.
@@bryan.deleon Thanks for the info. Was hoping that it adds its own blind spot monitoring, since it has an inward facing camera.
@@marisakirisame8543 using the DM camera for BSM was the hope of Comma, but it was wishful thinking; too many obstructions and not enough clarity imho: github.com/commaai/comma10k/tree/master/masksd
@@bryan.deleon Hmm I see. Thanks!
nice,,, so how do ya know which of the 3 to use? there a site to show the differences ?
Thanks for watching!
Not sure what "3" you are referring to, but either way, my Comma Three is dead now so I don't know how much help I can be; another thing, Comma has such low confidence in Navigate on Openpilot that they have decided to remove it for now: github.com/commaai/openpilot/pull/32106
@@bryan.deleon ya there is 3 version add ons,, frog pilot ,, dragon pilot , sunny pilot ,, each has different styles of driving
@@MAGApepe Oh there are more than 3 forks to choose from lol
But I am team Sunnypilot - even if my Comma Three wasn’t dead, I would be using SunnyPilot just for his community alone. Cheers!
@@bryan.deleonhow did your comma 3 die?
@@biglonniegruhn I assume it's the USB port, but have not looked at it deeply because I am enjoying drivesidecar.com/ instead.
Are you using laneless or lanefull
Thanks for watching. #TeamLaneless
Do you have toggle nudgless turn ?
Hi thanks for watching! I have it set to “nudge”, the model is deciding to turn on its own… usually lol
Can you tell me which Scopes to check if I am using mapbox
What part of the instructions are you stuck at exactly?
itd be cool to have a hand cam
Like you want a camera on my hand? While I’m turning the wheel or getting ready to take over?
@@bryan.deleon like a camera showing over where the entire wheel is so we can see when you need input
@@xerolxkz5942 that can also be seen on the UI border color; if it isn’t green, OpenPilot doesn’t have 100% control. Check out my other videos, and let me know which has angle works best for you though?
Hey man, how much better is sunny pilot than the stock system? I currently run the stock system and I don’t think it’s as great
I’m sorry if I’m not understanding, but your question implies that you have already tried both, but can’t decide which is better?
@@bryan.deleon is sunny pilot doing a lot of things better than the stock system? I currently run the stock system, it accelerates into tight turns and tight turns isn't as great... Only good in highways ... I've never tried sunnypilot
@@bryan.deleon furthermore, I don't bother using experimental mode on the stock system at all, it's very stressful... If there is a fork that slows for turns and stops for junctions or intersections without being in experimental mode, I won't hesitate to install... That's all I really need...
@@oscarobierefu9660 lots of factors, and to start what car do you have and which device?
@@bryan.deleon Toyota Corolla Hybrid 2020... Comma three x
If i order the comma 3 do i also get sunny pilot?
You have to install it: github.com/sunnyhaibin/sunnypilot#-installation
How do you install the sunny open pilot?
I included links in my description. Please use stock Openpilot for 2 weeks minimum, because you are a new user. Sunnypilot is very complicated.
I have a question regarding the FSD capabilities. You said that it requires Comma prime. Is it because FSD just needs the Internet connection or comma prime provides more than just the Internet? From the beginning, I started using comma 1, my understanding is that Comma Prime just provides cellular Internet and storage footage on their server longer. Has that changed?
[Comma Prime] or [Mapbox with Hotspot using Sunnypilot] to get this: blog.comma.ai/094release/
Nowhere near FSD, maybe near autopilot.
Show an unprotected left turn to show otherwise.
Unfortunately -> My Comma Three is Dead
ua-cam.com/video/vkdO5m5ziJQ/v-deo.html
Will it work on Toyota Corolla 2020?
It should: github.com/commaai/openpilot/blob/master-ci/docs/CARS.md
A phone. A f--ng phone. And it is so close to be on par with Tesla.
This shows (as many other things) that Tesla really is not anywhere near the lead in the game of true self driving cars.
So much passion!
By time make it close to Tesla fsd Tesla will be way ahead of the game
What do you think will come first? Comma reaching FSD levels of autonomy or BYD taking Tesla out?
It's nice, but Tesla is still about 2 years ahead of this.
Thanks watching!
Come on man, it’s not even close to FSD.
Thanks for watching and sharing your thoughts!
Jesus Christ loves you unconditionally and He died & was raised back to life so you can have a relationship with Him and have Eternal Life. ❤️
Bless you for your kind words, but unfortunately I’ve committed Mortal Sins in my life so I’m no longer in His graces. But please stay tuned for more self-driving car videos!
Unfortunately both science and bible scholars have shown the JC story is myth.
Not sure about the unconditionally part. The big flood thing and Sodom and Ghomorgha say otherwise.
@@bryan.deleon the good news is it has nothing to do with what you have or haven’t done, but that he came to claim it all. We bears yours, his hers all of our iniquities. The only thing that he doesn’t want is separation from you and I, his children. Then it’s just a matter of us, forgiving ourselves and walking that tight rope between love and truth.
Love my openpilot, but is completely outclassed by FSD. Not even remotely in Teslas universe, but I guess 1mm closer to something 6 miles away make the title fit. 🤦♀️😂
Thanks for watching and commenting!
I could care less. I wouldn't trust any of these self drive systems.
Then why are you watching it lol.
Yet, here you are? Hilarious bro..
I think you can interact with things, but not trust them; stay vigilant at all times.
If you didn't care you wouldn't have bothered to leave a comment on this video...make us a favor and go whine somewhere else xD
Jesus Christ loves you unconditionally and He died & was raised back to life so you can have a relationship with Him and have Eternal Life. ❤️
Do you use any self driving features when you drive to Church?