Here are the timestamps. Please check out our sponsors to support this podcast. 0:00 - Introduction & sponsor mentions: - Eight Sleep: www.eightsleep.com/lex to get special savings - BetterHelp: betterhelp.com/lex to get 10% off - Fundrise: fundrise.com/lex - Athletic Greens: athleticgreens.com/lex to get 1 month of fish oil 0:58 - Neural networks 6:01 - Biology 11:32 - Aliens 21:43 - Universe 33:34 - Transformers 41:50 - Language models 52:01 - Bots 58:21 - Google's LaMDA 1:05:44 - Software 2.0 1:16:44 - Human annotation 1:18:41 - Camera vision 1:23:46 - Tesla's Data Engine 1:27:56 - Tesla Vision 1:34:26 - Elon Musk 1:39:33 - Autonomous driving 1:44:28 - Leaving Tesla 1:49:55 - Tesla's Optimus 1:59:01 - ImageNet 2:01:40 - Data 2:11:31 - Day in the life 2:24:47 - Best IDE 2:31:53 - arXiv 2:36:23 - Advice for beginners 2:45:40 - Artificial general intelligence 2:59:00 - Movies 3:04:53 - Future of human civilization 3:09:13 - Book recommendations 3:15:21 - Advice for young people 3:17:12 - Future of machine learning 3:24:00 - Meaning of life
AI is way behind especially in "solving Universe" - which was recently solved in free "Time Matters eBook" (Hubble redshift is not due to expansion and Big Bang, but thanks to time dilation in past translates into redshift today; Vera Rubin puzzle about fast spinning spiral galaxies and not falling apart is not due to dark matter, but due to time faster at ~0.001 rate in spiral arms, that alone holds galaxies together; and other, if not all, puzzles about our Universe, "UFO" including).
Seems mind-blowing to me having access to a 3.5 hour talk with one of the greatest minds in the history of AI, while having the chance to learn from his habits, thoughts, and way of seeing life. Such an outstanding job as usual, Lex.
This is what youtube should be used for, not all the crap that drowns the servers and sucks the energy grid like a starving prostitute in red light district
I think you are wrong. I think the variety is what brings in over a million subscribers. There are definitely more subs here because of that then they are for only scientific discussion
I think the more perspectives/kinds of brains Lex talks to the better! If he keeps following his own interests and heart, I feel that's where we'll get the most interesting conversations :)
Lexs skill set and experience make his technical shows beyond what most can accomplish. I honestly havent watched celeb type content, does he bring anything game changing to the table not many others can with them?
@@doge0069 I would certainly disagree with you , not on any technicality because geohot might be better programmer ,but he is to ego driven of a person to be any kind of great leader.
I like the way the Andrej can't quite believe some of the answers he gives, given his depth of knowledge, and laughs nervously as if he's some how breaking the matrix of what knowledge he should disseminate. Very intelligent, very humble chap. Very grateful to Lex for allowing this fascinating interview to take place and to Andrej for being forthright and honest and taking part. I'll certainly remember this interview for a long time to come.
I'm truly inspired, overwhelmed, motivated, shocked at how much I can learn. Lex's questions range from the super geek way over my head to the extremely daring "what does it all mean". His questions really bring out who Andrej really is. On the other end, Andrej is so truthful, transparent, present, it is a pure joy to see and hear the best of how we can be in the world. This podcast is a turning point for me.
after listening to the Kanye West episode I had to listen to this one urgently at the attempt to recover the neurons that flew my brain. Thank you Andrej for such beautiful insights and clear explanations :)
@@boghy1996 I tried, cause a friend told me the end was epic, but then I saw that this episode was published... like a present from heaven, so I changed automatically :)
I really like when Lex interviews people in AI. The questions that he comes with are more refined than normal questions and we also hear his voice more since he is also an expert in the field.
I think Andrew is the definition of a genius. His mind just clicks, he locks in on everything he says. Just a brilliant believe mind, this podcast is amazing.
Andrej is really an incredible person in many ways. Thank you so much for letting us discover more intimately the genuinely kind human being behind the great genius, Lex 🙏
“AI”just like “aliens” need to not be the be all solution for human made problems. If this planet was mostly water and now it’s not and we are mostly water ..
Lex is smart? I think he is alright, but he never came across as "smart" to me. He definitely has some sway getting high profile individuals on his show, and is a reasonable conversationalist.
@@scottydog9997 Lex has a remarkable way of speaking. It looks to me as if he wants to get into a state of purposelessness, to be able to express what his mind finds, uninfluenced and without too much control by his everyday consciousness. It's like ink painting in Zen or Cy Twombly’s struggle for elimination of personal influences on the image result. So it is that Lex lets the words flow out of him, with a minimum of control and at the pace at which they form in his mind. And that's what creates this slurred, indistinct speech pattern. One should not interpret this as a lack of smartness. If you pay attention to the content and less to the form, you will better recognize the sharpness of his mind. (Funny, of course, is the contrast with Andrej's super-accented, extremely efficient speaking style...)
@@0cer0 I'll take that onboard. I just found it incredible how he recoiled when Ye said to him "I don't trust you". It appeared to me to be a weakness, rather than accepting of the fact that they were strangers to each other and not friends. It appeared to me a very childish way of engaging with people, assuming they are friends, when the possibility of it being quite the opposite was 50/50. He obviously has a mind for CS, his interview style is usually non-invasive or posing opposition. I like how he just lets the interviewee just respond without interruption, but that isn't necessarily indicative of someone being formless in their thinking. I don't mind Lex, but I cant help be more skeptical of his expertise, knowledge, and wisdom the more I listen to him. He seems like a man looking for wisdom from others without adequate self introspection. However I could be wrong, given I don't know him personally.
Legendary. One day humans will look back at this era and people like Karpathy will be etched in history like we view Turing, Von Neumann today. Both OpenAI (GPT-3) and Tesla autonomous driving are the first “consumer” friendly applications of AI that truly impressed me, and are the stuff of science fiction. What stood out to me most from this convo is Karpathy’s push back on relating neural nets to the human brain, an often made analogy. Learned many new things today, very grateful for the internet and Lex ❤
I'm an AI grad student. My younger sister is in high school right now and she is very eager to start exploring the subject. I just sent her a clip of Andrej's advice for beginners. Thank you so much Lex and Andrej! Sending you love from the other side of the globe.
In my view, this is the best AI interview conducted by Lex to date. 41:50 - This is the main reason why large language models understand and reason, in many cases, in a similar way to how humans do. The psychological and/or philosophical (extremely simple) idea underlying the success of these large language models is that the brain may be, fundamentally, a predictive system. Whose main goal is the prediction of characters/words, pixels/images, ... If we consider this hypothesis (that could be) true, then we should focus our efforts on developing architectures (e.g. Transformers) that allow us to make better predictions.
His "Unreasonable Effectiveness of RNNs" was top of hacker news eight years ago. He has been a top content producer/big voice/educator in the community for a while. Him blowing up is sampling bias of AI generally being more popular now.
Thank you so much for making these Lex. You get down, you get burnt out, you get lost in the vast field we work in, and these talks help me to motivate and refocus, your work is tremendously appreciated.
Lex, what you said at 1:57 in this podcast was so important for me to hear today. I truly appreciate the way you are working to make our world a better place.
Awww, I absolutely love Andrej! He's so sincere and kind, and such an amazingly accomplished guy. His laugh is so full of joy. My favorite Lex interview to date!
This is the kind of conversation that takes me time to digest because of the complexity of the topics and I found that challenging but satisfying because I get to learn new things, thanks Lex for making knowledge more accessible to everyone
right?? Its so awesome to have access to this very mainstream channel of media that attracts such big players and thinkers in the world that makes our own what it is.
I can't help but really like Andrej. There is a childlike excitement that exudes out of every part of his demeanor. His obvious passion is contageous and that is truly endearing & critical in moving this field forward in a positive direction. Not too many people you could say that about.
Andrej's laugh is so funny and pure. He is a good natured fellow. Lex is a die hard AI fan boy and I think him interviewing Andrej is like talking to someone who shares that passion for AI. Great interview!
Hi Lex, I am a big enjoyer of your interviews! I love how you focus so much on the humanity of yourself and your guests and always have a respectful line of questioning. I don't see that too often in interviewers these days, and watching these are so relaxing. And thanks for taking the time to meticulously timestamp everything. Have a great day!
It's refreshing to watch this again. It's nice watching you share from this from the hip, Lex! Karpathy is always a joy. I gleam deep insights from him. Thank you
I really appreciate you try to show how amazingly complex and how blessed we are to exist,how much we don’t know and how much we need to learn.it’s pure love.
One of things that makes this channel so great is how you highlight these people that never get the recognition they deserve in the mainstream world. That was a good one. I like that guy he's a positive energy for sure.
I am super impressed with what Andrej and team accomplished. Thank you for allowing me to know him a bit better through this interview. You are both very pleasant and interesting people.
Thank you for this fascinating episode with so much positive vibe between you Lex and Andrej. There seems tremendous mutual respect between you too. It's been a pleasant experience. Thanks.
How Andrej described working on a problem is exactly how I do. And what he said about night time quietness being great to focus, 200%. And also becoming obsessed with it and having it all on RAM, it's like he's describing my process, I can relate so much! This happened to me last night and this morning! Best problem solving I've ever done was, hands down, at night! Amazing how he described this so accurately to match my process.
Just wanted to comment and say I'm an average guy. I don't watch all your videos however I do find them very in-depth very interesting when I watch them. THANK YOU for all your hard work I highly appreciate you. You help inspire me to do the best I can. I'm trying to change my life for the better because of people like you.
Love this type of interviews when questions are as insightful and groundbreaking as answers! awesome work - thought provoking and truly inspiring! Thank You!
As usual. Questions on point. Conversation seems very natural. Educational, informative and generally very interesting. You discuss topics that interest me. Unfortunately I can’t have conversations like these because no one in my group thinks like me. They look at me weird. I’m a PhD engineer with an interest in ai, aliens, astronomy and cosmology, evolution and general science and technology. In my works, I’m on my own. Thank goodness for UA-cam and podcast like this.
I am not an engineer. I am an audio engineer. But I love listening to engineers speak because, even if I don't fully understand, it expands my mind and peaks my interest. Thanks Lex for all the great content. Thanks for spreading love in this world
This and many other interviews inspire me. I am currently in healthcare informatics and am looking to make the next step. Trying to use the will and the intellect to take the leap. Hopefully this deterministic future is kind. Thanks Lex and Andrej.
Thank you for this interview. I love the intestinity from Mr Karpathy in answering questions during this interview; further and how he does not seem to trust hi own intuition when asked directly in this interview. For I personally, this is the most insightful and interview on AI. Awesome!
Kanye was extremely disappointing, what a prick he was. I loved the chess interviews though, it inspired me to pick it up, as strategy and problem solving are my weakspots.
Wonderful, Lex. Thanks for all your conversations. This excellent conversation with Andrej Karpathy sent me off into the issue of personal data management with AIs of such centralisation. How the rise of AI/chatbots is subtly coaxing individuals to disclose information in a manner and at a rate perhaps never seen before. It's like a gentle ripple in a serene pond that's turning into a surging wave, and we can no longer afford to just stand by the shore. We have already seen the data collection era has impacted many. It's a topic that remains conspicuously under-explored. A strong undercurrent of data disclosure is reshaping the way we live and interact, and would be a topic for you to explore with an appropriate guest. In truth, the issue of data control has never been more pressing. It's no longer just a futuristic scenario, but a pressing reality that's happening here and now. The wave of AI is sweeping up personal data like never before. The integrity of our personal information hangs in the balance, and we need serious dialogues about this issue in AI. The era of complacency is over. We need to understand the full extent of this digital footprint we're leaving and consider the irreversible impacts it could have on our privacy, security, and our very way of life. Possible candidates: Shoshana Zuboff: She is the author of "The Age of Surveillance Capitalism" and a Harvard Business School professor. She has a deep understanding of the commercial use of personal data. Cathy O'Neil: A mathematician and author of "Weapons of Math Destruction," O'Neil could discuss the algorithmic biases and the often invisible implications of the misuse of data. Yoshua Bengio: Turing Award-winning AI researcher, Bengio could provide insights into how AI and machine learning technologies can be developed and used responsibly to respect personal data. Ruha Benjamin: A sociologist and author of "Race After Technology," Benjamin can provide a crucial perspective on the intersection of race, justice, and data privacy.
Why do you guys all kiss his ass in the comments section? He doesnt even form succinct questions that can provoke direct to the point Simple responses it’s the easiest job in the world
Apart from everything else he's done, Andrej is also one of the most influential people in the rubik's cube community - his old tutorial videos on F2L OLL and PLL on the badmephisto channel were the entry point into high level cubing for a lot of top solvers and content creators today
yes!! from the timestamps it seems as if lex did not bring up his past content related to cubing which is such a shame. I'd love to hear if he's still into it at all and what he thinks about the impact he had as badmephisto
I was just about to say the same thing! About 9 years ago I learned how to solve the 3x3 from his tutorials! Love this man and it's incredible to see what amazing thing's he's done since then. I remember seeing his video about working at Stanford and Google on deeplearning and as a software developer myself, being so inspired!
Smart phones facial recognition bio energies electro magnets detect frequency plus finger prints. See plus average heat moister. Move ment sens er to detect. To recognise. See alice resident evil Tvirus. X
Lex, thank you 🎉🎉 for posting your fascinating conversation with Andrej😊 I was an artist's model for 12 years and I reached my 10k hours in the first 10 years. My final two years were the most enjoyable for me because I really embraced what I learned from my audience. You both are inspirational as intelligent and compassionate communicators. Bravo🎉🎉
I used to work in the auto pilot department (data labeling team) for Tesla and actually got interviewed by him. I always felt like he was the smartest most technical person I've ever met. BTW, he was the only one in the office who had a rubix cube on his desk.
I now realize that I did take something positive from the 30 minutes I spent watching Ye’s interview! It helped me appreciate much more this podcast and this guys. What an amazing two people Lex and Andrej are. Thanks for the podcasts!
Sounds cruel but another good thing is that ppl get to see a & hopefully discern the genius from the not so much. Unfortunately we live at times where Ye is so much more popular than Andrej smh
The most interesting question in this interview is asked at 13:59 when Lex Says, 'The jump from bacteria to more complex organisms is the hardest jump'. How can it be that on earth we made the jump from bacteria to where we are today: a technological society. (and how can it be that we haven't found other planets where this happened too)/ I suspect the main reason lies in the fact that the earth got tilted 4.5 billion years ago. Because of this we have our seasons and every day differs from all other days in terms of temperature and the amount of sunlight and weather conditions overall. Evolution thrives on constantly changing environments . A bacteria might thrive with 18 hours of sunlight everyday (June) but fail to do so with only 6 hours (December). In a situation where earth was not tilted you would get 12 hours of sunlight everyday. So it's plausible that on a tilted earth evolutionary forces are factor X higher than evolutionary forces on a non-tilted earth. This might have speeded up evolution with X billion years and be the main reason we are the most advanced form of life in the universe relatively close to us. @Lex really interested to get your take on this.
Very interesting indeed. It should be possible to estimate different evolutionary speeds by simulating this in a scientific controlled environment. This could give an estimate of how quickly life would get to the current level of complexity in a situation where the earth is not tilted.
Lex, you speak to the most influential and wealthiest guys in our Simulation. Quiet a burden. But you manage time and time again to show us the human behind the name. Thank you for that ❤
I find it amazing that there are people like this around and reassuring too. Lex asks questions that keeps it all flowing and lastly, I find it equally reassuring that nearly every comment is as articulate and positive. These guys are brilliant examples of how the human race is going to become truly superior and well intentioned.
If there where moore people like it he would, but the amount of people who built up a department at Tesla from zero to succes is scares to say the least.
Magic = physics exploit? Mr. Fridman, The treasury of knowledge and wisdom I find in your meaningful discussions are a bright spot in my life. Stay safe and take care.
One of the best talks of Andrej. I particularly love the way Andrej talks with his hands too. It complements what he speaks technically. Thanks for this talk Lex!!
![[1hr Talk] Intro to Large Language Models](/img/n.gif)
Here are the timestamps. Please check out our sponsors to support this podcast.
0:00 - Introduction & sponsor mentions:
- Eight Sleep: www.eightsleep.com/lex to get special savings
- BetterHelp: betterhelp.com/lex to get 10% off
- Fundrise: fundrise.com/lex
- Athletic Greens: athleticgreens.com/lex to get 1 month of fish oil
0:58 - Neural networks
6:01 - Biology
11:32 - Aliens
21:43 - Universe
33:34 - Transformers
41:50 - Language models
52:01 - Bots
58:21 - Google's LaMDA
1:05:44 - Software 2.0
1:16:44 - Human annotation
1:18:41 - Camera vision
1:23:46 - Tesla's Data Engine
1:27:56 - Tesla Vision
1:34:26 - Elon Musk
1:39:33 - Autonomous driving
1:44:28 - Leaving Tesla
1:49:55 - Tesla's Optimus
1:59:01 - ImageNet
2:01:40 - Data
2:11:31 - Day in the life
2:24:47 - Best IDE
2:31:53 - arXiv
2:36:23 - Advice for beginners
2:45:40 - Artificial general intelligence
2:59:00 - Movies
3:04:53 - Future of human civilization
3:09:13 - Book recommendations
3:15:21 - Advice for young people
3:17:12 - Future of machine learning
3:24:00 - Meaning of life
💪🧠
@20:20 were you finally debriefed? lol jk! .. 🎯, though. ☝💙
great interview , lex
AI is way behind especially in "solving Universe" - which was recently solved in free "Time Matters eBook" (Hubble redshift is not due to expansion and Big Bang, but thanks to time dilation in past translates into redshift today; Vera Rubin puzzle about fast spinning spiral galaxies and not falling apart is not due to dark matter, but due to time faster at ~0.001 rate in spiral arms, that alone holds galaxies together; and other, if not all, puzzles about our Universe, "UFO" including).
Imagine if there’s a lag or hack on a self driving car 🚙 it needs a lot of work
Seems mind-blowing to me having access to a 3.5 hour talk with one of the greatest minds in the history of AI, while having the chance to learn from his habits, thoughts, and way of seeing life. Such an outstanding job as usual, Lex.
yes Andrej is lucky to have this time with him
This.
Lex is not the smartest in world bit he is up there
This is what youtube should be used for, not all the crap that drowns the servers and sucks the energy grid like a starving prostitute in red light district
9:41 he suggests that he understand abiogenesis intuitively? uhhhhhhh ok there guy
This is what made Lex famous. We need more scientists, less celebrities!
I think you are wrong. I think the variety is what brings in over a million subscribers. There are definitely more subs here because of that then they are for only scientific discussion
@@MattWalkerTxranger Wrong, most of lexs fanbase is here for scientist podcasts
Don’t watch it if you want it’s that simple. the celebrities pull millions of views so people are obviously interested
I think the more perspectives/kinds of brains Lex talks to the better! If he keeps following his own interests and heart, I feel that's where we'll get the most interesting conversations :)
Lexs skill set and experience make his technical shows beyond what most can accomplish. I honestly havent watched celeb type content, does he bring anything game changing to the table not many others can with them?
The intensity and quality of this long interview reveal the intellectual capacity of both speakers. This has been well worth my time. Thank you!
one of the best podcasts out there on the internet.. the clarity of thought and the depth of answers of Andrej is insane!
Andrej is one of the most generous person there is in AI. His stature is so well deserved.
From Movie he show it...
Romans.. 😎😎😎
geohot > andrej
Thanks Chinese bot
@@doge0069 I would certainly disagree with you , not on any technicality because geohot might be better programmer ,but he is to ego driven of a person to be any kind of great leader.
@@avaksaputra huh?
Andrej speaks so quickly, yet it doesn't sound rushed or thoughtless. Fascinating dude.
I set the speed to .75 to make sure I don’t miss anything
I had to double-check I didn't have it set to 1.25 haha
He’s is overclocked 😊
Reminds me of Ben Shapiro
His brain is bottlenecking his mouth.
One of his biggest plus is his ability to be very efficient, precise and clear in his descriptions and answers
You can tell from the length of the time stamps in the video
"If you can't explain it simply, you don't understand it well enough." - Some random guy
Dude is an absolutely exceptional mind/human being. Amazing to witness intelligence (and communicative skills) at this level
I like the way the Andrej can't quite believe some of the answers he gives, given his depth of knowledge, and laughs nervously as if he's some how breaking the matrix of what knowledge he should disseminate. Very intelligent, very humble chap. Very grateful to Lex for allowing this fascinating interview to take place and to Andrej for being forthright and honest and taking part. I'll certainly remember this interview for a long time to come.
I'm truly inspired, overwhelmed, motivated, shocked at how much I can learn. Lex's questions range from the super geek way over my head to the extremely daring "what does it all mean". His questions really bring out who Andrej really is. On the other end, Andrej is so truthful, transparent, present, it is a pure joy to see and hear the best of how we can be in the world. This podcast is a turning point for me.
after listening to the Kanye West episode I had to listen to this one urgently at the attempt to recover the neurons that flew my brain. Thank you Andrej for such beautiful insights and clear explanations :)
Did you have the patience to listen to the whole episode? I gave up after 20 minutes
@@boghy1996 I tried, cause a friend told me the end was epic, but then I saw that this episode was published... like a present from heaven, so I changed automatically :)
Hahahah dude. Same here.
Pretty close minded lol
@@callamburles3075 sometimes people are so open minded that their brains fall out...
The best interviews - sharp, fun, thought-provoking. Keep it up Lex, love it.
I really like when Lex interviews people in AI. The questions that he comes with are more refined than normal questions and we also hear his voice more since he is also an expert in the field.
I mean… ai is his main thing
I think Andrew is the definition of a genius. His mind just clicks, he locks in on everything he says. Just a brilliant believe mind, this podcast is amazing.
Would be happy to see andrej a second time
heavy plus one!
For sure
he's a moron ..
absolutely
It's time!
Andrej is really an incredible person in many ways. Thank you so much for letting us discover more intimately the genuinely kind human being behind the great genius, Lex 🙏
Amazes me that we have people like Lex and Andrej on this planet. Smart, ahead of their time yet present in moment and both empathetic to our world.
“AI”just like “aliens” need to not be the be all solution for human made problems. If this planet was mostly water and now it’s not and we are mostly water ..
Thank the Lord he gives humanity men with this level of intelligence and sensibility!
Lex is smart? I think he is alright, but he never came across as "smart" to me.
He definitely has some sway getting high profile individuals on his show, and is a reasonable conversationalist.
@@scottydog9997 Lex has a remarkable way of speaking. It looks to me as if he wants to get into a state of purposelessness, to be able to express what his mind finds, uninfluenced and without too much control by his everyday consciousness. It's like ink painting in Zen or Cy Twombly’s struggle for elimination of personal influences on the image result. So it is that Lex lets the words flow out of him, with a minimum of control and at the pace at which they form in his mind. And that's what creates this slurred, indistinct speech pattern. One should not interpret this as a lack of smartness. If you pay attention to the content and less to the form, you will better recognize the sharpness of his mind. (Funny, of course, is the contrast with Andrej's super-accented, extremely efficient speaking style...)
@@0cer0 I'll take that onboard.
I just found it incredible how he recoiled when Ye said to him "I don't trust you".
It appeared to me to be a weakness, rather than accepting of the fact that they were strangers to each other and not friends.
It appeared to me a very childish way of engaging with people, assuming they are friends, when the possibility of it being quite the opposite was 50/50.
He obviously has a mind for CS, his interview style is usually non-invasive or posing opposition. I like how he just lets the interviewee just respond without interruption, but that isn't necessarily indicative of someone being formless in their thinking.
I don't mind Lex, but I cant help be more skeptical of his expertise, knowledge, and wisdom the more I listen to him. He seems like a man looking for wisdom from others without adequate self introspection.
However I could be wrong, given I don't know him personally.
Legendary. One day humans will look back at this era and people like Karpathy will be etched in history like we view Turing, Von Neumann today. Both OpenAI (GPT-3) and Tesla autonomous driving are the first “consumer” friendly applications of AI that truly impressed me, and are the stuff of science fiction. What stood out to me most from this convo is Karpathy’s push back on relating neural nets to the human brain, an often made analogy. Learned many new things today, very grateful for the internet and Lex ❤
OR the advent of artificial super intelligence destroys humanity and this comment ages like milk 😅
I'm an AI grad student. My younger sister is in high school right now and she is very eager to start exploring the subject. I just sent her a clip of Andrej's advice for beginners. Thank you so much Lex and Andrej! Sending you love from the other side of the globe.
In my view, this is the best AI interview conducted by Lex to date.
41:50 - This is the main reason why large language models understand and reason, in many cases, in a similar way to how humans do.
The psychological and/or philosophical (extremely simple) idea underlying the success of these large language models is that the brain may be, fundamentally, a predictive system. Whose main goal is the prediction of characters/words, pixels/images, ... If we consider this hypothesis (that could be) true, then we should focus our efforts on developing architectures (e.g. Transformers) that allow us to make better predictions.
Intelligence is all about predicting the future, nothing more, nothing less
Live in the eternal Now and be free of space and time.
Andrej...went from relative unknown 5 years ago to a absolute legend today. Good for him.
His "Unreasonable Effectiveness of RNNs" was top of hacker news eight years ago. He has been a top content producer/big voice/educator in the community for a while. Him blowing up is sampling bias of AI generally being more popular now.
The entire flow of the podcast has been so natural. I'm sure, it's not only us but Lex and Andrej also enjoyed the conversation.
The chemistry tho 🔥🔥
Thank you so much for making these Lex. You get down, you get burnt out, you get lost in the vast field we work in, and these talks help me to motivate and refocus, your work is tremendously appreciated.
Lex, what you said at 1:57 in this podcast was so important for me to hear today. I truly appreciate the way you are working to make our world a better place.
Awww, I absolutely love Andrej! He's so sincere and kind, and such an amazingly accomplished guy. His laugh is so full of joy. My favorite Lex interview to date!
This is the kind of conversation that takes me time to digest because of the complexity of the topics and I found that challenging but satisfying because I get to learn new things, thanks Lex for making knowledge more accessible to everyone
right?? Its so awesome to have access to this very mainstream channel of media that attracts such big players and thinkers in the world that makes our own what it is.
I can't help but really like Andrej. There is a childlike excitement that exudes out of every part of his demeanor. His obvious passion is contageous and that is truly endearing & critical in moving this field forward in a positive direction. Not too many people you could say that about.
Andrej's laugh is so funny and pure. He is a good natured fellow. Lex is a die hard AI fan boy and I think him interviewing Andrej is like talking to someone who shares that passion for AI. Great interview!
This is one of the most interesting and fascinating interviews I have ever seen. Honestly. It's 2 am in the morning. I gotta sleep, but I can't stop.
This is the best techie interview for November 2022. Clean pure and honest.
Lex and Andrej podcast feels like Saturday morning cartoons all over again.
This all the way!
That's the best compliment he could get right Lex? Burn a Burner PEACE
Exactly. Thanks.
I wish “aliens”would just dear john us so we all can move on with fucking this earth up.
BEST, SPOT-ON analogy. 😁
Lovely interview. Andrej speaks in 1.5x speed and I love that.
I watch him at 1.5x speed while he speaks at 1.5x speed
@@agicortexI was just gonna say the same thing. Lol. It’s what sounds normal to me. I usually do 1.75. He did get me down to 1.5 this round though 😂
Hi Lex, I am a big enjoyer of your interviews! I love how you focus so much on the humanity of yourself and your guests and always have a respectful line of questioning. I don't see that too often in interviewers these days, and watching these are so relaxing. And thanks for taking the time to meticulously timestamp everything. Have a great day!
I love Andrej's laugh... And the absolute humility of his own ego in the purpose of solving his goals- People like him bring me so much joy~
It's refreshing to watch this again. It's nice watching you share from this from the hip, Lex! Karpathy is always a joy. I gleam deep insights from him. Thank you
This is so worth taking time for. Thank you Lex Fridman and Andrej Karpathy.🤓
I really appreciate you try to show how amazingly complex and how blessed we are to exist,how much we don’t know and how much we need to learn.it’s pure love.
One of things that makes this channel so great is how you highlight these people that never get the recognition they deserve in the mainstream world. That was a good one. I like that guy he's a positive energy for sure.
This is my favorite podcast episode. I never listen to or watch any podcasts and i can't believe i watched the entire 3 and half hours of it.
I am super impressed with what Andrej and team accomplished. Thank you for allowing me to know him a bit better through this interview. You are both very pleasant and interesting people.
Andrej speaks so fast. There are moments I think the video is sped up and then Lex’s smooth jazz questions brings everything back to pace.
👆👆👆👆 .. ...
Lol right 🙂
That's because Andrej is probably a hybrid of man and machine.
@@Solarxstorm you're genius extreme !
@@Solarxstorm Artificial Hybrid Intelligence
Dope interview, Andrej is a beast, can't wait to watch Tesla solve autonomy, intelligent/useful humanoid robots, and ultimately AGI.
Look who it is 👋
I think he left Tesla
Thank you for this fascinating episode with so much positive vibe between you Lex and Andrej. There seems tremendous mutual respect between you too. It's been a pleasant experience. Thanks.
😊
How Andrej described working on a problem is exactly how I do. And what he said about night time quietness being great to focus, 200%. And also becoming obsessed with it and having it all on RAM, it's like he's describing my process, I can relate so much! This happened to me last night and this morning! Best problem solving I've ever done was, hands down, at night! Amazing how he described this so accurately to match my process.
Dont know him personaly. Did save his 2018 video Re Tesla
One of Lex’s best interviews, Andrej is fascinating
What a refreshing video and so contrasting compared to the last podcast (which I was only able to listen for 5 minutes).
Just wanted to comment and say I'm an average guy. I don't watch all your videos however I do find them very in-depth very interesting when I watch them. THANK YOU for all your hard work I highly appreciate you. You help inspire me to do the best I can. I'm trying to change my life for the better because of people like you.
Love this type of interviews when questions are as insightful and groundbreaking as answers! awesome work - thought provoking and truly inspiring! Thank You!
10000 hours was the most incredible insight for me. Thanks, Lex for all effort that you are doing to make such educational podcasts.
As usual. Questions on point. Conversation seems very natural. Educational, informative and generally very interesting.
You discuss topics that interest me. Unfortunately I can’t have conversations like these because no one in my group thinks like me. They look at me weird. I’m a PhD engineer with an interest in ai, aliens, astronomy and cosmology, evolution and general science and technology.
In my works, I’m on my own. Thank goodness for UA-cam and podcast like this.
1:29 Lex taking notes while Andrej is explaining neural nets is pure gold😂
he learned that trick from kanye
@@user-gp7zt8sm4w that dude takes notes from HIMSELF
Awesome podcast and i really love Andrej. His latest lectures really are fantastic and i can't recommend them highly enough!
Where can these lectures be found? I discovered Andrej in the last days and I'd like to know also if there are courses taught by him :), thanks
I am not an engineer. I am an audio engineer. But I love listening to engineers speak because, even if I don't fully understand, it expands my mind and peaks my interest. Thanks Lex for all the great content. Thanks for spreading love in this world
This and many other interviews inspire me. I am currently in healthcare informatics and am looking to make the next step. Trying to use the will and the intellect to take the leap. Hopefully this deterministic future is kind. Thanks Lex and Andrej.
Thank you for this interview. I love the intestinity from Mr Karpathy in answering questions during this interview; further and how he does not seem to trust hi own intuition when asked directly in this interview. For I personally, this is the most insightful and interview on AI. Awesome!
Cool interview. I think you should ask for book recommendations for every candidate.
I love that idea! Would be cool to make that a fixed question in every podcast
He made a few actually!
Finally we are back to the OG Lex podcasts. Please do more of this!
Fck chess and other bs! aliens is the shit! 👽🚬
I want lex to interview everyone.
Not evry one ? But the best ones ...
Kanye was extremely disappointing, what a prick he was. I loved the chess interviews though, it inspired me to pick it up, as strategy and problem solving are my weakspots.
I was extrimly engry after that bodcast wtf was that I mean ? be thenkful for lex becous he didn't live that room in the middle of that entrveiw ?
Lex, this is probably your greatest interview to date. Only Ray Kurzweil's may be considered better. Absolutely mind-blowing!
I would add the 2 Joscha Bach episodes to that list as well
@@imransuhail82came here to say this
I've watch this 3 times and still love the conversation.
Wonderful, Lex. Thanks for all your conversations. This excellent conversation with Andrej Karpathy sent me off into the issue of personal data management with AIs of such centralisation. How the rise of AI/chatbots is subtly coaxing individuals to disclose information in a manner and at a rate perhaps never seen before. It's like a gentle ripple in a serene pond that's turning into a surging wave, and we can no longer afford to just stand by the shore. We have already seen the data collection era has impacted many.
It's a topic that remains conspicuously under-explored. A strong undercurrent of data disclosure is reshaping the way we live and interact, and would be a topic for you to explore with an appropriate guest.
In truth, the issue of data control has never been more pressing. It's no longer just a futuristic scenario, but a pressing reality that's happening here and now. The wave of AI is sweeping up personal data like never before.
The integrity of our personal information hangs in the balance, and we need serious dialogues about this issue in AI. The era of complacency is over. We need to understand the full extent of this digital footprint we're leaving and consider the irreversible impacts it could have on our privacy, security, and our very way of life.
Possible candidates:
Shoshana Zuboff: She is the author of "The Age of Surveillance Capitalism" and a Harvard Business School professor. She has a deep understanding of the commercial use of personal data.
Cathy O'Neil: A mathematician and author of "Weapons of Math Destruction," O'Neil could discuss the algorithmic biases and the often invisible implications of the misuse of data.
Yoshua Bengio: Turing Award-winning AI researcher, Bengio could provide insights into how AI and machine learning technologies can be developed and used responsibly to respect personal data.
Ruha Benjamin: A sociologist and author of "Race After Technology," Benjamin can provide a crucial perspective on the intersection of race, justice, and data privacy.
I love how excited Lex is during this interview
Why do you guys all kiss his ass in the comments section? He doesnt even form succinct questions that can provoke direct to the point Simple responses it’s the easiest job in the world
Apart from everything else he's done, Andrej is also one of the most influential people in the rubik's cube community - his old tutorial videos on F2L OLL and PLL on the badmephisto channel were the entry point into high level cubing for a lot of top solvers and content creators today
My mind is blown - I didn't know that! 😱
yes!! from the timestamps it seems as if lex did not bring up his past content related to cubing which is such a shame. I'd love to hear if he's still into it at all and what he thinks about the impact he had as badmephisto
I was just about to say the same thing! About 9 years ago I learned how to solve the 3x3 from his tutorials! Love this man and it's incredible to see what amazing thing's he's done since then. I remember seeing his video about working at Stanford and Google on deeplearning and as a software developer myself, being so inspired!
Whenever I see his name I always think of his tutorials despite using them ages ago.
why did he leave tesla? Tesla please get him back pls
What a pleasant surprise! Thank you Lex, you just leveled up my weekend from great to awesome! Keep up the great work and content 🙂
Smart phones facial recognition bio energies electro magnets detect frequency plus finger prints. See plus average heat moister. Move ment sens er to detect. To recognise. See alice resident evil Tvirus. X
❤❤❤
That's what I call an interview!
Such a piece of normality in today's times feels really refreshing.
Greetings from Kosice, Slovakia.
Lex, thank you 🎉🎉 for posting your fascinating conversation with Andrej😊
I was an artist's model for 12 years and I reached my 10k hours in the first 10 years. My final two years were the most enjoyable for me because I really embraced what I learned from my audience.
You both are inspirational as intelligent and compassionate communicators. Bravo🎉🎉
I used to work in the auto pilot department (data labeling team) for Tesla and actually got interviewed by him. I always felt like he was the smartest most technical person I've ever met. BTW, he was the only one in the office who had a rubix cube on his desk.
👆👆👆👆 .. ...
😁
I like your youtube handle
rubix cube seriously?
I now realize that I did take something positive from the 30 minutes I spent watching Ye’s interview! It helped me appreciate much more this podcast and this guys. What an amazing two people Lex and Andrej are. Thanks for the podcasts!
The Ye interview is iin the bottom 1% of Lex's output in terms of "things I want to listen to". It sure got a lot of views though.
@@DrTune because its simple and the mass audience can relate and understand to that podcast.
Also what other podcasts besides ye is bottom 1%
Sounds cruel but another good thing is that ppl get to see a & hopefully discern the genius from the not so much. Unfortunately we live at times where Ye is so much more popular than Andrej smh
@@rich21421 Which also has an advantage: it allows people like Andrej to focus on what they are doing.
The most interesting question in this interview is asked at 13:59 when Lex Says, 'The jump from bacteria to more complex organisms is the hardest jump'.
How can it be that on earth we made the jump from bacteria to where we are today: a technological society. (and how can it be that we haven't found other planets where this happened too)/
I suspect the main reason lies in the fact that the earth got tilted 4.5 billion years ago.
Because of this we have our seasons and every day differs from all other days in terms of temperature and the amount of sunlight and weather conditions overall.
Evolution thrives on constantly changing environments . A bacteria might thrive with 18 hours of sunlight everyday (June) but fail to do so with only 6 hours (December). In a situation where earth was not tilted you would get 12 hours of sunlight everyday.
So it's plausible that on a tilted earth evolutionary forces are factor X higher than evolutionary forces on a non-tilted earth. This might have speeded up evolution with X billion years and be the main reason we are the most advanced form of life in the universe relatively close to us.
@Lex really interested to get your take on this.
Extremely intesting thought! This might indeed be one of the main reason we have made this jump so quickly.
Very interesting indeed. It should be possible to estimate different evolutionary speeds by simulating this in a scientific controlled environment. This could give an estimate of how quickly life would get to the current level of complexity in a situation where the earth is not tilted.
I love listening to your show Lex! There’s no other word for it! You’re entertaining me, you entice me, you make me think way outside the box!
🙂😊
I really enjoyed this conversation. Andrej is the most intelligent person you’ve ever interviewed.
This is one of the most inspiring interviews I ever witnessed. It might be the base for a Turing test right here...
Yhee imagine if he was an AI, or both was an AI, then end game for humans.
😊😊😊🤧😁😁😁
My favorite podcast so far. I am a big fan of Andrej. Thank you both!!
Lex, you speak to the most influential and wealthiest guys in our Simulation. Quiet a burden. But you manage time and time again to show us the human behind the name. Thank you for that ❤
I find it amazing that there are people like this around and reassuring too. Lex asks questions that keeps it all flowing and lastly, I find it equally reassuring that nearly every comment is as articulate and positive. These guys are brilliant examples of how the human race is going to become truly superior and well intentioned.
Nick Lane and Andrej Karpathy are my 2 favorites. Have watched both > 3 times.
I don't often comment on youtube videos, but Andrej was a joy to listen to. Thank you.
What a conversation! He is brilliant and clearly understand the deeper meaning of what he is talking about, thanks Lex 👏💪👍
🙂😊
Thank you Andrej. Your contributions will definitely continue to make this world a better place.
One of the best interviews on this channel!
Great podcast, keep them coming
You guys should have more podcast together. This is so insightful and very entertaining.
I really hope eventually we will get a second run on this. AI moves so fast, they could probably do this yearly without any issue. :)
Please do more podcasts like this.
If there where moore people like it he would, but the amount of people who built up a department at Tesla from zero to succes is scares to say the least.
Long awaited interview! Great stuff Lex
Excellent interviewer and interviewee. Amazing that this was a year ago, as much of it is still quite relevant.
We need more Lex Fridmans, interviewers who interact with their guests and question at their level.
Then none of us would understand. Lol, jk. It's more like I wouldn't understand
You're so in your element here. This. Is. Why. I. Love. Your. Podcast. Mahalo Lex! 🦄
😊
Magic = physics exploit?
Mr. Fridman, The treasury of knowledge and wisdom I find in your meaningful discussions are a bright spot in my life. Stay safe and take care.
Thank you Andrej and Lex for this 3+ hours interview! Amazing information! Andrej, glad to hear you are considering Tesla 2.
Listening to such a clear mind cultivates a sense of clarity within oneself.
I love Lex, his poetry response at the beginning of this interview is GOLD! and it is the first thing of his that i shared with loved ones
Such an positive symphatic personality with so much knowledge 🙏🏽
Keep this happiness Andre! 🙏🏽
Lex at 0.5 x speed, Andrej at 2 x speed. 😀
I was gonna comment the same thing
Wow, what a compelling conversation. Very interesting. Thank you both.
This is the best interview i have ever heard.
Both did an excellent job.
Love it ❤
He is so inspiring to listen as a future AI/ML engineer. I am a computer science student. Thank you so much for this, Lex Fridman
Very nice! He is sharp, concise and modest. Thanks for this Lex!
Such a delight! Two great minds talking about deep questions.
One of the best talks of Andrej. I particularly love the way Andrej talks with his hands too. It complements what he speaks technically.
Thanks for this talk Lex!!
Wow his smile and laughter just show the child-like innocence and curiosity in that brilliant mind! What a lovely dude!
Books recommendations:
- The Vital Question
- The Selfish Gene
- The Molecular Biology of The Cell