Incredible to visualize what the camera is capturing and the amount of data logged for each drive. Every camera having dataset of instructions, I appreciate your sharing greentheonly, you are the best.
how did you access to the cabin cam? im interested in using my tesla cabin cam idont know how to im a software engineer, not good at hack. just in case😅
I noticed a difference between the daytime UA-cam video and the nighttime UA-cam video. The daytime video has the text jumping up and down with the highest percentage at the top. With the nighttime video the text stays in place which makes it much easier to read.
Is this running in shadow mode (practicing) while the driver is in control? I was thinking with the recent announcement of the automatic selection of forward/reverse, that they must have been training a network for that for some time, running in the background. Make you wonder what other things they are training in the background right now... 😉
Not having night vision capabilities really limits the functionality and use. Many instances where camera dark 50%. Comma (, company ) did it right from the get go to include camera with night vision.
Yeah, kinda weird that they didn't include infrared capabilities in the camera. Guess that shows they really weren't originally planning to use it for such a purpose. I bet that'll be changed in new cars, but good luck getting any previous drivers to upgrade the camera.
I was driving quite stoned the other day and had a hard time keep my eyes open enough for the system to detect my retina or whatever it is looking for. The system kept alerting every few seconds. I think they have tweaked the system recently to make it tougher to not be engaged.. I guess it is all for my own safety for which which I will gladly pay the $10,000.
the car runs detections and stores them in RAM for further processing. From then on it's just a technical matter to extract the data for additional uses
This is so basic compared to the offerings of some DMS providers. I don't know why Tesla doesn't phone up Seeing Machines and just do this properly with a successful close-looped system that doesn't have any privacy concerns. That way they can check that drivers are still aware and ready to take over but allow them to be fully hands free.
well, all deploys I've seen of the seeing machines tech in the wild only monitor driver eyes. That means if you mount a game screen on the windshield and look forward while having a game controller in your hand - can't detect that. Tesla sees driver hands which s a big plus. So there are upsides and downsides to both techs. Tesla is mostly blind in total darkness of course which is a valid weakness.
I’m guessing it’s using a softmax of the neural net outputs and there is at least one or more hidden output states. The reason being that you don’t want to force the computer to select one of those options if none are correct
Look at it as being 'confidence' levels, 100% is "I'm 100% sure this is what's happening". You could be 100% sure the driver's using their phone, but also looking to the right for example.
With direct access to the cameras, a better/vustom/reliable/proper scentry mode solution could be achieved. Since You already have the skills to reliably access the cameras, why don’t you launch/monetize such solution?
Great video. So why get a Tesla if you are going to cover the camera as other systems like GM super cruise also use a interior camera to monitor driver attentiveness for it to stay engaged. I just don't understand as people as they walk around with a cell phone with cameras front and back everywhere doing who knows what lol🤔
What kind of product can it be? How big is the hardware? Is the software embedded? How much does such a product cost? Which company manufactures the product?
Umm, this is a Tesla car. All the hardware is built-in by default(though currently I think the cabin camera is optional as it wasn't originally meant for this). The driver monitoring software just runs on the car's computer and it's likely to be rolled out by Tesla in the future to any car with the cabin camera.
@@japzone It would be much more enspiring to get complete information on this important addition. Does Tesla want to start acting mysteriously in the dark?
@@silberlinie Tesla doesn't want to add the feature but they're being pressured to by various governments because of safety concerns with self driving cars. They aren't acting mysteriously, the feature was just in testing.
@@japzone I understand, japzone. In the past, Elon has always clearly distanced himself from the monitoring of the driver in the vehicle by a camera. That's where people's astonishment comes from. In Testa's opinion, the interior camera does not bring any additional safety aspect. I am of the opinion that Elon urgently needs this sensor in the future, despite all this. Namely, when the AI, when the car is completely self-driving, wants to respond more and more to the person's current mood. This will be an extremely important individualization feature of Tesla cars. Translated with www.DeepL.com/Translator (free version)
You may be forever stuck with wheel torque nags then! Rmember this data is only processed in the car and 'Camera blinded' likely has the same effect as 'Phone use' internally. It'd just treat it as driver not paying attention I'd imagine, it wouldn't make much sense to default to paying attention. :)
I mean,if you disable not to share your data you can simple disabled that in the settings. (And if you are very serious about your privacy, then block the "tracking device")
![[CVPR'22 WAD] Keynote - Ashok Elluswamy, Tesla](http://i.ytimg.com/vi/jPCV4GKX9Dw/mqdefault.jpg)
Incredible to visualize what the camera is capturing and the amount of data logged for each drive. Every camera having dataset of instructions, I appreciate your sharing greentheonly, you are the best.
Interesting that the camera dark value only goes to 50%
how did you access to the cabin cam?
im interested in using my tesla cabin cam idont know how to
im a software engineer, not good at hack. just in case😅
I noticed a difference between the daytime UA-cam video and the nighttime UA-cam video. The daytime video has the text jumping up and down with the highest percentage at the top. With the nighttime video the text stays in place which makes it much easier to read.
I think that was am update, doesnt matter day/night .. texto wont jump
would be interesting to see the graphs of the night vision vs day. I bet the data in the noise is helpful derivatively.
Is this running in shadow mode (practicing) while the driver is in control?
I was thinking with the recent announcement of the automatic selection of forward/reverse, that they must have been training a network for that for some time, running in the background.
Make you wonder what other things they are training in the background right now... 😉
Is this currently active in all their cars? In your comments I think you said it was stored in RAM. So in a couple crash with power loss is it lost?
They will probably store the precrash data when it detects it is about to crash
Not having night vision capabilities really limits the functionality and use. Many instances where camera dark 50%. Comma (, company ) did it right from the get go to include camera with night vision.
Yeah, kinda weird that they didn't include infrared capabilities in the camera. Guess that shows they really weren't originally planning to use it for such a purpose. I bet that'll be changed in new cars, but good luck getting any previous drivers to upgrade the camera.
I was driving quite stoned the other day and had a hard time keep my eyes open enough for the system to detect my retina or whatever it is looking for. The system kept alerting every few seconds. I think they have tweaked the system recently to make it tougher to not be engaged.. I guess it is all for my own safety for which which I will gladly pay the $10,000.
How do you get this data? This is incredible! The accuracy is astounding.
the car runs detections and stores them in RAM for further processing. From then on it's just a technical matter to extract the data for additional uses
@@greentheonly Can you say a bit more about "it's just a technical matter to extra the data"?
the data is stored in RAM so you just need to identify where exactly (and how) and then have a program read it and store somewhere else for later uses
@@greentheonly Good work on executing the "how".
Why would the camera be disable on cars coming to Canada? It's in the owners manual.
What happens if you cover the camera? And also weight the steering wheel? Will autopilot/FSD keep working or not? System really needs IR emitters.
If you tape/cover the camera AP refuses to activate in current FSDBeta firmware.
This was posted before the Texas crash. I’m surprised this has not gone viral now.
The car involved in the Texas crash did not have a cabin cam
This is so basic compared to the offerings of some DMS providers. I don't know why Tesla doesn't phone up Seeing Machines and just do this properly with a successful close-looped system that doesn't have any privacy concerns. That way they can check that drivers are still aware and ready to take over but allow them to be fully hands free.
well, all deploys I've seen of the seeing machines tech in the wild only monitor driver eyes. That means if you mount a game screen on the windshield and look forward while having a game controller in your hand - can't detect that. Tesla sees driver hands which s a big plus.
So there are upsides and downsides to both techs. Tesla is mostly blind in total darkness of course which is a valid weakness.
what does the indicator tell? probability? something else? summing up the values is way smaller than 100 % ...
I’m guessing it’s using a softmax of the neural net outputs and there is at least one or more hidden output states. The reason being that you don’t want to force the computer to select one of those options if none are correct
Look at it as being 'confidence' levels, 100% is "I'm 100% sure this is what's happening".
You could be 100% sure the driver's using their phone, but also looking to the right for example.
With direct access to the cameras, a better/vustom/reliable/proper scentry mode solution could be achieved. Since
You already have the skills to reliably access the cameras, why don’t you launch/monetize such solution?
Great video. So why get a Tesla if you are going to cover the camera as other systems like GM super cruise also use a interior camera to monitor driver attentiveness for it to stay engaged. I just don't understand as people as they walk around with a cell phone with cameras front and back everywhere doing who knows what lol🤔
Is that a serious question?
@@a1machinista1 That person believes in 5G chips being injected into people.
@@atk0506 What makes you think that?
So... we couldn't car sex anymore??
You're my favorite.
What kind of product can it be?
How big is the hardware?
Is the software embedded?
How much does such a product cost?
Which company manufactures the product?
Umm, this is a Tesla car. All the hardware is built-in by default(though currently I think the cabin camera is optional as it wasn't originally meant for this). The driver monitoring software just runs on the car's computer and it's likely to be rolled out by Tesla in the future to any car with the cabin camera.
@@japzone It would be much more enspiring to get complete information on this important addition.
Does Tesla want to start acting mysteriously in the dark?
@@silberlinie Tesla doesn't want to add the feature but they're being pressured to by various governments because of safety concerns with self driving cars. They aren't acting mysteriously, the feature was just in testing.
@@japzone I understand, japzone.
In the past, Elon has always clearly distanced
himself from the monitoring of the driver
in the vehicle by a camera.
That's where people's astonishment
comes from.
In Testa's opinion, the interior camera does
not bring any additional safety aspect.
I am of the opinion that Elon urgently
needs this sensor in the future,
despite all this.
Namely, when the AI, when the car is
completely self-driving, wants to respond more
and more to the person's current mood.
This will be an extremely important
individualization feature of Tesla cars.
Translated with www.DeepL.com/Translator (free version)
>Looking down at passanger seat
>Phone and Down stats only go to 15% max
Scary.
Wow, openpilot is so much better than this!
Are you tesla engineer?
no
Thats it, I'm covering my model 3 camera.
You may be forever stuck with wheel torque nags then! Rmember this data is only processed in the car and 'Camera blinded' likely has the same effect as 'Phone use' internally. It'd just treat it as driver not paying attention I'd imagine, it wouldn't make much sense to default to paying attention. :)
You have better removed the 3g/4g antenna so your car won't be able to upload the data to Tesla server.
@@JohnNy-ni9np why?, the engineers can look at the back of the tape for all I care.
Me also
I mean,if you disable not to share your data you can simple disabled that in the settings. (And if you are very serious about your privacy, then block the "tracking device")
+
No thanks, I'll keep my property surveillance free.
First 😅