Tesla SECRETS--Andrej Karpathy on FSD, Optimus and Scaling
Вставка
- Опубліковано 16 вер 2024
- Head to geolog.ie/DRKN... or scan QR Code on the screen and use code DRKNOWITALL to get an exclusive 70% off of Geologie’s award-winning skincare trial set.
**If you are looking to purchase a new Tesla Car, Solar roof, Solar tiles or PowerWall, just click this link to get up to $500 off! www.tesla.com/.... Thank you!
Join this channel to get access to perks:
/ @drknowitallknows
Thanks to Geologie for sponsoring today's video.
**To become part of our Patreon team, help support the channel, and get awesome perks, check out our Patreon site here: / drknowitallknows . Thanks for your support!
Get The Elon Musk Mission (I've got two chapters in it) here:
Paperback: amzn.to/3TQXV9g
Kindle: amzn.to/3U7f7Hr!
**Want some awesome Dr. Know-it-all merch, including the YEAR OF EMBODIED AI Shirt? Check out our awesome Merch store: drknowitall.it...
For a limited time, use the code "Knows2021" to get 20% off your entire order!
**Check out Artimatic: www.artimatic.io
**You can help support this channel with one click! We have an Amazon Affiliate link in several countries. If you click the link for your country, anything you buy from Amazon in the next several hours gives us a small commission, and costs you nothing. Thank you!
* USA: amzn.to/39n5mPH
* Germany: amzn.to/2XbdxJi
* United Kingdom: amzn.to/3hGlzTR
* France: amzn.to/2KRAwXh
* Spain: amzn.to/3hJYYFV
**What do we use to shoot our videos?
-Sony alpha a7 III: amzn.to/3czV2XJ
--and lens: amzn.to/3aujOqE
-Feelworld portable field monitor: amzn.to/38yf2ah
-Neewer compact desk tripod: amzn.to/3l8yrUk
-Glidegear teleprompter: amzn.to/3rJeFkP
-Neewer dimmable LED lights: amzn.to/3qAg3oF
-Rode Wireless Go II Lavalier microphones: amzn.to/3eC9jUZ
-Rode NT USB+ Studio Microphone: amzn.to/3U65Q3w
-Focusrite Scarlette 2i2 audio interface: amzn.to/3l8vqDu
-Studio soundproofing tiles: amzn.to/3rFUtQU
-Sony MDR-7506 Professional Headphones: amzn.to/2OoDdBd
-Apple M1 Max Studio: amzn.to/3GfxPYY
-Apple M1 MacBook Pro: amzn.to/3wPYV1D
-Docking Station for MacBook: amzn.to/3yIhc1S
-Philips Brilliance 4K Docking Monitor: amzn.to/3xwSKAb
-Sabrent 8TB SSD drive: amzn.to/3rhSxQM
-DJI Mavic Mini Drone: amzn.to/2OnHCEw
-GoPro Hero 9 Black action camera: amzn.to/3vgVMrH
-GoPro Max 360 camera: amzn.to/3nORGYk
-Tesla phone mount: amzn.to/3U92fl9
-Suction car mount for camera: amzn.to/3tcUfRK
-Extender Rod for car mount camera: amzn.to/3wHQXsw
**Here are a few products we've found really fun and/or useful:
-NeoCharge Dryer/EV charger splitter: amzn.to/39UcKWx
-Lift pucks for your Tesla: amzn.to/3vJF3iB
-Emergency tire fill and repair kit: amzn.to/3vMkL8d
-CO2 Monitor: amzn.to/3PsQRh2
-Camping mattress for your Tesla model S/3/X/Y: amzn.to/3m7ffef
**Music by Zenlee. Check out his amazing music on instagram -@zenlee_music
or UA-cam - / @zenlee_music
Tesla Stock: TSLA
**EVANNEX
Check out the Evannex web site: evannex.com/
If you use my discount code, KnowsEVs, you get $10 off any order over $100!
**For business inquiries, please email me here: DrKnowItAllKnows@gmail.com
Twitter: / drknowitall16
Also on Twitter: @Tesla_UnPR: / tesla_un
Instagram: @drknowitallknows
**Want some outdoorsy videos? Check out Whole Nuts and Donuts: / @wholenutsanddonuts5741
No Priors podcast: • No Priors Ep. 80 | Wit...
Head to geolog.ie/DRKNOWITALL or scan QR Code on the screen and use code DRKNOWITALL to get an exclusive 70% off of Geologie’s award-winning skincare trial set.
Andrej is fantastic. Please get him on for an interview whenever possible.
Just wait until people like Karpathy are connected to the computer physically. His brain is working so fast he has to slow down just to communicate with us mortals. He is on another level.
Your videos have gotten so good. Really great analysis and explanations.
I agree that a new architecture is needed to reach AGI and ASI. It's a three-part problem (1) Lossless compression within a model. (2) Distinguishing reasoning from mere data and applying reasoning to data. (3) Identifying the difference between useful and useless information both during training and inference. Solving AGI might require a much bigger model to reduce compression, combined with a reasoning model trained in the art of reasoning.
Whats needed for AGI/ASI is a model of the human brain and how the communication path works across the network .... wait, neuralink?
22:32 Good discussion of transformers
Thank you
Great video 🙌
Interesting, We always hear about full surround-video input only for autopilot and FSD. But I was sitting in traffic recently when out-of-nowhere (a front intersecting 4-lane) appeared two or three firetrucks & ambulances moving really fast. Didn't immediately see lights but sure heard the directional sirens. It would seem to me a (relatively) simple thing to have two microphones, each centered on each side of a Tesla. It is easy to filter that audio and detect horns or sirens (or obnoxious cars or police pull-over commands, etc.) doppler-approaching at some speed from any direction. Such real data is trivial compared to processing video. but as a driver, that sort of thing is important to me and I'd think should be important to the Tesla attention and planning software systems as well. Maybe such a feature is built-in, but if so, we never hear about it or see it in system diagrams.
Teslas have microphone in the car, they also have lots of speakers, which technically can act as microphones too. You can bet if you can hear it, the existing microphones are picking this up before you do. In 2021 Elon Musk confirmed that Tesla will start utilizing the internal microphone to help detect the presence of emergency vehicles. This will come in time.
@@BongoWongoOG I do remember that confirmation but have not heard much more than that since. But those are interior (now behind acoustic glass) and not dual spaced far enough apart for accurate directionality and Doppler approach or departure speed determination. External microphones would be inexpensive and involve very light data processing. Besides, it would be neat to talk to your car (with voice recognition) from outside (e.g., "Tesla, open the frunck or door"; "Go park yourself"; "Turn on the exterior or interior lights, etc."; "Record this person yelling at me, etc.")
Cars and Optimus: When you (with your human brain) mount a bicycle, drive a car, fly a helicopter, or pick up a baseball bat, etc., you are training yourself. As you become competent, as Michael Polanyi said, you gradually internalize the skill as "tacit knowledge" and begin to "dwell within the device" as an extension of yourself within typical (but highly diverse) contexts. The same with people who depend upon prosthetics or divers and astronauts who depend upon their suits. So Optimus thought he was a car functioning inside and through a robot. Funny 🙂 ... but reasonable.
And I guess when Optimus uses tools it will think of the tool as 'an extension of itelf', like humans do to a degree.
@@BongoWongoOG Yes, conceptually it will have to. It will need to understand both the functionality of the tool and how to use it, indeed, as an extension of itself and its arms to perform a task.
Thanks doc
Big 6...movie...very gentle form for a robot
Consumer vs Factory space: As long as the robots (including the cars) are not close to sentience or consciousness, then they can be turned on and off; erased or updated; sold, leased or junked; etc. - i.e., treated like machines or computers. But in small business and domestic situations, even if not fully AGI, they become team or family members, full of significant memories, skills, etc., and trusted confidants. Security, longevity, identity, and maybe "ownership" take on primacy there. I doubt leasing would work for Robby the Robot (although temporary did seem to work for Mary Poppins 🙂).
Karpathy uptalking, a true lingo disaster. Beware! You can hear his Slovak accent, so cool. He moved to Can at 16.
If xou wonder why your videos don't get reach; your sponsorships
I dont think he meant FSD will take 10 years, he just put an example or a comparison 10 years into the future. Not necessarily when he think FSD will be solved.
Unless we experience a real breakthrough, it will take many years before we have a fully dependable robotaxi, let alone something approved by regulators around the world.
What Tesla should probably do is to use what they have today to get SAE level 3 on highway driving approved worldwide.
Then, when hardware and software have improved enough, a version for city streets will eventually be ready.
I guess you haven't been paying attention.
No one is taking about the obvious use of Optimus when it can drive a car. Forget retro fitting ICE cars when a robot takes that role. And FSD is a guidance system. I mean why spend $250k to smarten a dumb bomb, you just strap Optimus to it and give it a joystick. $20k
But in truth, no one actually knows what waymo is doing so we ascribe all of this inferiority to their technology without knowing anything about it.
So I asked AI (Perplexity) this question:
Q: Point out differences between Tesla's FSD and WAYMO
AI:
Based on the information provided in the search results, here are some key differences between Tesla's Full Self-Driving (FSD) and Waymo:
Sensor technology:
Tesla FSD relies primarily on cameras ("vision-only" approach).
Waymo uses multiple sensor modalities including lidar, radar, and cameras.
Operational areas:
Tesla FSD can operate across North America and is expanding to other regions.
Waymo currently operates in limited geofenced areas like parts of San Francisco, Los Angeles, and Phoenix.
Level of autonomy:
Tesla FSD is classified as a Level 2 driver assistance system requiring human supervision.
Waymo offers Level 4 autonomous robotaxi service in some areas.
Mapping approach:
Tesla aims for a more generalized solution without relying heavily on HD maps.
Waymo uses detailed maps for localization and navigation.
Intervention rates:
Tesla FSD reportedly requires more frequent human interventions.
Waymo vehicles can drive for thousands of miles without human intervention in their operational areas.
Liability:
With Tesla FSD, the human driver remains responsible.
Waymo assumes liability for its fully driverless operations.
Deployment strategy:
Tesla has released FSD Beta to a large number of customers for testing.
Waymo has taken a more cautious approach, gradually expanding its driverless service.
Current capabilities:
Tesla FSD can operate on various road types but requires constant human supervision
4
.
Waymo offers fully driverless rides in certain areas but has limitations like avoiding freeways in some locations.
================
WAYMO is SAE Level-4
FSD is SAE Level-2
The Robotaxi is here with WAYMO,
FSD - light years behind
Reread what Perplexity told you to understand why Waymo’s Level 4 is not necessarily ahead of Tesla’s Level 2.
@@juliahello6673 Here's the quote:
Level of autonomy:
Tesla FSD is classified as a Level 2 driver assistance system requiring human supervision.
Waymo offers Level 4 autonomous robotaxi service in some areas.
------------
clear to me - WAYMO is RoboTaxi in some areas and FSD ain't crap.
If the majority of vehicles in the population you are operating your FSD vehicles in are human you have a huge problem. The learning curve for imaging the possible stupid moves the human driven vehicles around you MIGHT make is a huge task. As the population of FSD drivers increases the accident rate will go down. This will prove difficult to deal with because humans love to avoid blame and responsibility for their poor driving.
I would expect that insurance companies will rule in favor of FSD. Even now Sentry mode is a huge advantage for most of its users, unless they drive terrible.
I think Waymo has a hardware AND a software problem.
Too much tone down the chatter annoying