François Chollet: Measures of Intelligence | Lex Fridman Podcast
Вставка
- Опубліковано 13 чер 2024
- François Chollet is an AI researcher at Google and creator of Keras. Support this podcast by supporting our sponsors (and get discount):
- Babbel: babbel.com and use code LEX
- MasterClass: masterclass.com/lex
- Cash App: download app & use code "LexPodcast"
EPISODE LINKS:
Francois's Twitter: / fchollet
Francois's Website: fchollet.com/
On the Measure of Intelligence (paper): arxiv.org/abs/1911.01547
PODCAST INFO:
Podcast website: lexfridman.com/podcast
Apple Podcasts: apple.co/2lwqZIr
Spotify: spoti.fi/2nEwCF8
RSS: lexfridman.com/feed/podcast/
Full episodes playlist: • Lex Fridman Podcast
Clips playlist: • Lex Fridman Podcast Clips
OUTLINE:
0:00 - Introduction
5:04 - Early influence
6:23 - Language
12:50 - Thinking with mind maps
23:42 - Definition of intelligence
42:24 - GPT-3
53:07 - Semantic web
57:22 - Autonomous driving
1:09:30 - Tests of intelligence
1:13:59 - Tests of human intelligence
1:27:18 - IQ tests
1:35:59 - ARC Challenge
1:59:11 - Generalization
2:09:50 - Turing Test
2:20:44 - Hutter prize
2:27:44 - Meaning of life
CONNECT:
- Subscribe to this UA-cam channel
- Twitter: / lexfridman
- LinkedIn: / lexfridman
- Facebook: / lexfridmanpage
- Instagram: / lexfridman
- Medium: / lexfridman
- Support on Patreon: / lexfridman - Наука та технологія
I really enjoyed this conversation with François. Here's the outline:
0:00 - Introduction
5:04 - Early influence
6:23 - Language
12:50 - Thinking with mind maps
23:42 - Definition of intelligence
42:24 - GPT-3
53:07 - Semantic web
57:22 - Autonomous driving
1:09:30 - Tests of intelligence
1:13:59 - Tests of human intelligence
1:27:18 - IQ tests
1:35:59 - ARC Challenge
1:59:11 - Generalization
2:09:50 - Turing Test
2:20:44 - Hutter prize
2:27:44 - Meaning of life
Should be a simulation time-stamp every pod :D lol cheers
@@newwave77 I
We want aurelien geron
7
Invite Terence Tao. He's great!
Listening Francois gives so much insights on everything. He is just simply amazing
Hey, Lex, I love how you dig up the guests that we didn't know we needed to hear and provide high stimulating intellectual discussion, keep it up
This guy is definitely very famous in the ai world! He wrote a very famous and important paper, " on the measure of intelligence" recently
@@jp2kk2 I'm a humble physics student but I'll have to check that one out, thanks!
@@jp2kk2 he created Keras, which might be better known by people.
This man helped me get through my ml elective
“I’m not interested in psychometrics as a way to characterize 1 individual person. I think psychometrics is most useful as a statistical tool. It’s most useful at scale.” This man is a measure of intelligence himself.
Lex, Thank you for providing us layman with this extremely beautiful and captivating podcast. We all appreciate the time and effort you put into this project of yours. Life would truly be quite different without you!
We need Joscha Bach to come back ASAP!
This please!
I've listened to that podcast 3 times already.
We need more Joscha Bach!
That would be epic
hes awesome! :)
We need him to come Bach
Would love to listen to a conversation between François Chollet and Joscha Bach.
When Francois talks, he gives a new insight every time. What a genius!
I love the way these two people think completely differently. I've had conversations about the way I think compared to my significant other, and its surprising to see how both similar and different ours ways of thinking can be!
Foggat
@@justindecker4051 imagine a flat earth believer commenting on your post ☠️
“Intelligence is how efficiently you learn new things”
“Measure of intelligence is ability to change”
Being able to learn comes from ‘understanding structured operation logic” model between events.
And being able to change comes from the ability to use causal inference on a perceived event against the model.
That is consistent with the fact that IQ and the personality trait Openness correlate quite strongly
Am yet to observe non-supportive data of this statement!
But this definition would mean that intelligence in humans is strongly tied to plasticity making children more intelligent than adults. However children struggle with many causal relationships that are easier to grasp as adults. This isn't because children are dumb but that this understanding of operational logic is actually learned. What you are describing is often referred to as "learning how to learn" but this is not the base of learning, just a skill that helps with applying other logical relationships in new contexts. An intelligent system would be capable of reaching this logical understanding but it does not need to start with operational logic a priori.
@@goclbert While I don't disagree, you have to consider that children's minds are not fully developed and lack many computational abilities of adults.
@@goclbert I think going back to Francois point you could argue that this isn't evidence that adults *are* actually smarter since it's just a matter of having more training data 🤣
“Everything we do creates ripples into the future and that’s the path to immortality”
Fransios is such a guy that warms your heart with knowledge!
When he talks I instantly imagine a "smoking" jar with liquid nitrogen, just in this case it's pure liquid intelligence oozing towards us :)
Thanks for these podcasts, lex. I've been looking for a podcast with things that I am interested in. Keep these things coming, I find a lot of value from it.
This is an amazing interview. One of the most rewarding ones I have ever heard. Fantastic!!
'So you disagree with Naom Chomsky?!'
'𝓨𝓮𝓼'
10/10
Gay
@@thisway6539 people are allowed to disagree with each other, that's basically how new ideas sprout
Noam Chimpsky the chimp and Koko the gorilla effectively debunked Chomsky's core assertion that language is the root of intelligence. Various other animal studies have also broadened our conception of intelligence, for example the toolmaking ability of corvids.
@@MattOGormanSmith instead of being the root I'd argue that language is an outcome of intelligence. That it is itself a tool for articulation of more complex and abstract thought that simple action and reflex can't represent efficiently.
Love your work, mate. You're an amazing speaker and an even more amazing interviewer (or vice versa 😃)! Currently chugging through your extensive backlog of interesting content! Love it and keep up the good work!
Thank you both lex and Francois. This was a great pod cast. Thank you for this genuine and honest podcast. I as a viewer appreciate the knowledge you two are able to explain in understanding ways. God bless u both for ur good knowledge on things
This channel is a hidden gem on youtube.
Carry on lex.
Legend says that when Francois applied to Google, the interviewers began to question the level of their own Googliness
This show breaks my brain everytime I watch it. Love it. Thx Lex and guests. Hella outlet.
This one got me really excited
What a great discussion! I loved the metaphor of having a subway map in your head as you write a paper. I do that all the time.
This was really beautiful. Especially the very end starting from the meaning of life. Hoping to be a patron soon. Best wishes
François is such an amazing person, loved this!
Lex, thank you so much for yet another awesome podcast!
I really like the way this man talks for some reason, like he has a fairly thick accent yet is more intelligible than a lot of native English speakers.
Hell yes, I was waiting for exactly this episode ever since I read the paper.
What a great interview, makes me realize how crucial the ability to simulate reality is to intelligence.
Thank you so much for the insightful discussion!
Great guest and great interview! Thanks Lex.
Wonderful fridman, thank you.
Thanks a lot Lex
Lex thank you everyday for inspire me
Loved the Piaget reference. One of the experiments described in Genetic Epistemology has had a profound impact on me.
Would love to hear discussions on the differences in the mechanisms of emotional and classical intelligence.
I request a part 3. I’ve watched a number of these AI interviews, but in my opinion Francois has the deepest and clearest insights on this topic.
I listened to this after consuming thc.
I had several mental breakthroughs by applying the albeit hard for my intelligence level to decipher.
Highly valuable information contained within.
Lex you have an amazing mission to question the questions, That has helped sculpt my mind into one that is slightly more efficient than it was. More efficient at detecting bias.
I still have many biases. But I am getting better at detecting them.
Thankyou youtube for providing such valuable content. The world is both better and worse for the torrents of information literally at our fingertips.
From one random guy on the internet.
Choose the content you consume wisely.
Turn the play speed up incrementally over time as you adjust.
This adds profound gains in efficiency of absorption. The faster play speed becomes a second language. You will become philosophically bi-lingual. Other people will likely not understand 2.0x play speed yet it sounds normal when you become fluent.
3.0x is only 50% faster than 2.0x.
My average level of intelligence. Or maybe the frequency perceptiveness of my ears, will reach a performance ceiling before others with more capacity.
Neurolink has the ability to increase the speed of uptake. In a realm where consciousness consists of stored information combined with interpretation and adaptation.
Learning the dataset is just as important as improvisational ability. Any efficiency increase should produce measurable results in all round performance.
/consciousness.exe
I really like the way this guy thinks. Glad to see him on again!
Good interview (so far). Seems like the proper view on language.
Another great guest and interview. Best response to the meaning of life question I've heard.
"Russian starts with a language and ends with a vodka" :) lol
Spare a thought for those that skipped the ads. That was Lex gold!
Very nice talk!
The best logical person i ever heard talking about intelligences and AGI.
I liked the ad Lex made for Babble.
This blew my mind
my favorite twitter person is back!
Super helpful textbook 📚
Masterclass looks good. I would also like to pre-order that Sci-Fi novel of yours Lex.
Wonderful and very subtle ideas about consciousness and learning. Thank you.
Some historic non-quotes: Descartes on logic: “Remember to always put des cartes before des horse.” and “C’est bien joué Monsieur Des Cartes.” Accordingly to Bertrand Russell, Descartes always wore his sword at his side, even when he was in his apartment.
Thank you. William L. Ramseyer
very interesting
I like the way you reason lex
Bidirectional search 14:45
Just bought his book; what a beautiful coincidence!
Not just new but also difficulty .. level of newness and complexity
Lex, as I observe the world and people around me, I also determined primary measure of intelligence is the ability to adapt to change. This is driven by deeper layers of character/mind that I have identified.
Luv the poem...Pushkin request
This guy.. is intelligent. I believe he has solved what intelligence really is, and that’s amazing. Also he has great insights about thé shortcomings of current deep learning and of neuralink
2:31:15 he is playing both sides do that no manner which one wins he comes on top, this man is a tactical genius as well
Без водки, не случился б не один прорыв! Спасибо тебе за лучшие подкасты, с удовольствием смотрю и узнаю для себя, что-то новое!
Hey Lex, have you heard about Zettelkasten? It's a method of organizing information which is somewhat similar to mind maps but more sophisticated. You might find it useful.
Btw, thanks for you podcasts, they are amazing! ❤️
Do a video on vodka cocktails..
Really admire Francosi Chollet. Thank you for this amazing talk!
The amount of no real words in this pod is out of the charts. Amazing talk as usual, thanks, I learned a lot.
Sorry if I misunderstand, but that seems like a contradictory statement?
@@joeh858 Chollet invented a word to explain something, they ended up using it a few times. I was making a joke about that. It is a good video, great content.
@@MarcosBiga Oh, I see what you meant now by "no real words"
@@joeh858
"Agentness" :)
I just checked it, Oxford English Dictionary doesn't know it :)
Great conversation, general intelligence is a very interesting topic. The intelligent mind seems to me to be a confluence of culture, curiosity and the ability to address new environments and problems in a new and imaginative way, it’s a dynamic constantly evolving awareness of environment, threat level and incentives.
Language - the operating system of the mind. Incredibly profound.
Have David Deutsch on your podcast!!
ungratefulmetalpansy no Deutsch is the basically the father of quantum computation but his views on practically any matter are probably enlightening
@@kevinpurnell9465 especially AGI !
David Deutsch is truly a genius.
Yes, Lex, ask David Deutsch in AGI. This will become a very interesting conversation...
Roger Penrose and Jeff Hawkins were already interviewed so it seems natural to me for Lex to complete the set of AGI experts by inviting David Deutsch.
Love his cute french accent and his calm, quiet and relaxed way of talking during the entire time!
We need an update!
Great conversation. Thank you. A couple things: I wish you had talked about the ability to “know” which transcends our compressed past and our recognized ways of perceiving, by some considered legitimate and real ways of tapping into knowledge which is actually beyond of physical finiteness. Also, our interconnected ness to other life forms. Perhaps even non physical consciousness? How do we factor in ways of learning and perceiving info from these sources which can add to our compressed knowledge as well as, dare I say it, pave ways into new ways of knowing which transcend linear time and space itself? Taking into account recent revelations in the fields of quantum physics and the emerging areas studying consciousness itself, it seems like these considerations are important not only in the development of AI, but also when considering the meaning of life itself.
What the hell? 18k views, 140 comments? These are too low, people dafuq. This shit is the most interesting informative discussion ever
Edit- ... discussion ever today, as every podcast is amazing
This is so much better than jre
The fact that during the entire interview (it looks like) your phone screen is on at full brightness with white background is making me anxious :)
ARC in kaggle still not achieve 0 yet.. so we still have many things to do
@47:20 This is what I was thinking. There need to be models of cognition that can interpret BASIC abstract ideas which can then be iteratively developed. AGI is crippled without these.
Who wants Geoff Hinton on the Podcast ?
I agree with Chollet that language is a layer on a cognitive base. Interestingly, the early universe, according to the standard model, was more accurately described by our language than the reality that we perceive. It wasn't until those few massless particles grew in number and created the force fields that gave the particles mass, that being as we know it came about...which is a combination of being and moving, not separated as in our language of nouns and verbs.
I don't think more intelligence is necessarily a good thing. Rather what we need is more equality, kindness and self-knowledge
One of the few youtube channels that increases my IQ
According to some academics, IQ can't be improved, and it's all to do with what genes you inherited. Which is depressing.
@@halaldunya918 IQ doesn't really matter that much though. If something fascinates you, you will still need to work to understand it better.
Thanks for the pronunciation of his name. I've been struggling since I bought his book "Deep Learning With Python". Btw, he always sounds paranoid in his book. Am I the only one to feel like that?
14:45 bidirectional search. and it's very cool :)
We need another podcast with this based person
There is hope yet for ai research
I really like the way this guy thinks, Francois pushes the boundaries of how to measure intelligence. I like the idea of not using the Turing test when people cheat and people will always cheat so it is best to utilize the scientific method. Like what Kate Darling was referring to, if we tell the judges they are talking to a child from Namibia then it is much easier to get them to agree that the computer is human because we have shifted the judges away from their base of reference. We are tricking them.
Lex, don’t know if you’d see this - for visualizing notes you take, there are tools that allow you take notes in text files and make connections between notes very easily, so you get a “knowledge graph” for free. It’s easier to make connections between thoughts I think. For emacs and org (there’s one for md): github.com/org-roam/org-roam
The test already exists: demonstrate the ability to define, identify the unique characteristics of, ever smaller (or larger) "units" of matter.
The algorithm yet again proved me a fool
Hehe, I read his book: "Deep Learning with python" --> It's by far the best book I've read about this topic.
In my opinion, Human Intelligence often uses heuristics. Computational power can extend these heuristics by the huge amount of operations.
So, the proof of "Four-Color-Theorem" was just possible by the combination of human intelligence and computers.
I ignored the thumbnail twice then I saw the name and clicked in my mind oh he's that deep learning by Manning publication guy 😁
01:50:45 legitimately laughed out loud
I've always been curious, what is Francois' academic background? He's obviously a great engineer -- keras is a beautiful API and a huge success. Somehow he also has the ability and time to also work on deep questions of intelligence. Did he study physics? computer science? something else? PhD? Very curious if anyone knows.
Computer science
The 'child mind' is, at the beginning, pure observation. Language builds out of the interactions between other people. Thinking, pre language, is the child mind. In my opinion, all thinking continues to happen in this mind, and you have to translate on the fly. You get really good at it. Language only has meaning in the interactions between people. But the child mind still has to have a language to be translated. Other than pure observation, what comes before that?
Walking my dog, and I realize that when I have no mental context to narrow focus I just observer. I take in stimuli and it just is. But it's only when I ask a specific question of myself do I start to recall labels and give the scene English language.
In that framework, abstraction must be practiced and it must be shared. You can obsess over language on your own, but there is no guarantee that you will end up with something others agree with.
We can make a camera create an image on a screen, which our brains can then understand as an image. Take the screen out and hook it to an AI, but... What do our eyes do? Does the consciousness illusion keep us from making a proper investigation of what our senses actually do?
Intuition comes before that.
Emotions come before observation, your emotional state dictates your reaction to your observations. The same context and event can happen to the same person but be experienced, interpreted and processes completely differently. Your current mental state whether influenced by lack or sufficient sleep, supportive/toxic work environment, hunger or drunken state, or stressed or euphoric state will determine your reaction to events and ultimately the outcome
Astonishing interview. I agree with Chollet's definition of intelligence and I sincerely hope that we will never develop non-deep learning AI. Or at least not before the final version of Neuralink.
50:18 You can, in fact, train on 100x more data when you add in video and audio
Training data size is not measured in gigabytes though. Just because videos are a lot of data doesn't mean they will provide that much more novel information compared to pictures
@julkiewicz Well, I didn't say novel data. Just more data. The amount of novelty you find in that is not my point
I am always puzzled by what exactly is "human level" driving means by different people. It seems by default it means the best human can be, which is very different from what actually is the human level driving in real world. Just because humans in theory can handle the corner case does not mean the average human would handle them perfectly.
42:40 Lex is correct here. My guess is that the GPT-3 hype surge was just due to more people getting access to the OpenAI API.
for real reasoning we will need a intermediate semantic abstraction in the ai model itself - like a symbolic knowledge graph similar to web3
The more knowledge you have, the more intelligent you can be.
Thanks for getting in the dig at Windows vis-a-vis Linux 😂😂😂😂😂
Can you please interview David Deutsch?
Dude!! Best fucking Advert ever. Nice one.
Cognition id prediction; beautiful. Develop potential, an energetic mind. The brain must be a muscle, mind builds from memory. Let go, begin again from 0...
Language, words spoken, the magic; code. Fix it! Thoughts make all the difference. I am in charge? Pray AI save the day!