Noam Chomsky on Decoding the Human Mind & Neural Nets

Поділитися
Вставка
  • Опубліковано 17 тра 2024
  • Welcome to episode #126 of Eye on AI with Craig Smith and Noam Chomsky.
    Are neural nets the key to understanding the human brain and language acquisition? In this conversation with renowned linguist and cognitive scientist Noam Chomsky, we delve into the limitations of large language models and the ongoing quest to uncover the mysteries of the human mind.
    Together, we explore the historical development of research in this field, from Minsky’s thesis to Geoff Hinton’s goals for understanding the brain. We also discuss the potential harms and benefits of large language models, comparing them to the internal combustion engine and its differences from a gazelle running. We tackle the difficult task of studying the neurophysiology of human cognition and the ethical implications of invasive experiments.
    As we consider language as a natural object, we discuss the works of notable figures such as Albert Einstein, Galileo, Leibniz, and Turing, and the similarities between language and biology.
    We even entertain the possibility of extraterrestrial language and communication. Join us on this thought-provoking journey as we explore the intricacies of language, the brain, and our place in the cosmos.
    00:00 Preview
    00:43 Introduction
    01:54 Noam Chomsky’s neural net ideology & criticisms
    06:58 Jeff Hinton & Noam Chomsky’s: How the brain works
    10:05 Correlation between neural nets and the brain
    11:11 Noam Chomsky’s reaction to Chat-GPT & LLMs
    15:21 Exploring the mechanisms of the brain
    19:00 What do we learn from chatbots?
    22:36 What are impossible languages?
    26:45 Generative AI doesn’t show true intelligence?
    28:40 Is there a danger of AI becoming too intelligent?
    31:30 Can AI language models become sentient?
    36:40 Turing machine and neural nets experimentations
    42:40 Non-evasive procedures for understanding the brain
    45:54 Does Noam Chomsky still work on understanding the brain?
    49:33 Is Noam Chomsky excited about the future of neural nets?
    55:30 Albert Einstein and Galileo’s principles
    55:40 Is there an extraterrestrial language model?
    Craig Smith Twitter: / craigss
    Eye on A.I. Twitter: / eyeon_ai
  • Наука та технологія

КОМЕНТАРІ • 208

  • @brendanstringer7225
    @brendanstringer7225 10 місяців тому +30

    Research shows that the brain declines as we age. Yet Mr. Chomsky is still so sharp, lucid, and involved in deeply rigorous research and thought. Truly incredible!

    • @afonsolopes9677
      @afonsolopes9677 9 місяців тому

      195 yars

    • @thedandelionranger
      @thedandelionranger 9 місяців тому

      True wisdom!!

    • @sallylauper8222
      @sallylauper8222 8 місяців тому +1

      Yeah, his ears may be out of order, but his brain isn't.

    • @TheEDub56
      @TheEDub56 6 місяців тому +2

      The effects of aging, absent any organic pathology, are limited to processing speed. Take a look at, for instance, the Chomsky's debates with Buckley. The only thing Chomsky's lost is processing speed.

  • @ShaopengChen
    @ShaopengChen 10 місяців тому +18

    Thank you for the interview. Noam Chomsky never ceased to amaze, with his breadth and depth of knowledge in a wide range of subjects. Even at 94, he still has all the energy to research and follow other super advanced research works, teach, give interviews, write and publish etc. I can barely understand his book on language, published decades ago... talking about difference in levels of intelligence, and he is always so humble.

  • @DrJanpha
    @DrJanpha 10 місяців тому +34

    Thank you Craig for this exceptional interview. I admire the level of respect you have for Prof Chomsky - one of the pillars in the modern age .

    • @v2ike6udik
      @v2ike6udik 10 місяців тому

      cancer of modern age.

    • @user-zz5je1ry1o
      @user-zz5je1ry1o 9 місяців тому +1

      A pillar of train wreck reasoning and endless whataboutery maybe.

    • @v2ike6udik
      @v2ike6udik 9 місяців тому

      @@user-zz5je1ry1o chewbaccas alwas promote their own degenerates.

    • @DrOtto-sx7cp
      @DrOtto-sx7cp 4 місяці тому

      @@user-zz5je1ry1o ... hey ... he was a Epstein pillar ! 😆

    • @epic6434
      @epic6434 4 місяці тому

      Epstine is probably Jesus but we've all been told he's a monster who knows? ​@@DrOtto-sx7cp

  • @royeagleson1772
    @royeagleson1772 10 місяців тому +7

    Noam always finds the heart of the matter and pins it down and embraces it. God bless him

    • @larryparis925
      @larryparis925 7 місяців тому +2

      No gods needed. Apparently you haven't heard of evolution.

  • @d1m18
    @d1m18 10 місяців тому +6

    All hail and big Respect to Chomsky. Please live long, the human race needs your guidance

    • @johnchase2148
      @johnchase2148 Місяць тому

      Looking for the perfect observer for two things ,I am certain that when I turn and look at the Sun they will see a reaction tor and it was instant showing that thought is faster than the speed of light and heard.. Truths over friends.. Children are born happy and not fearful on believing..Want to know how to understand energy..

  • @alitalalhaidar6488
    @alitalalhaidar6488 10 місяців тому +7

    The best thing you did is that you made him talk without any interruptions. Amazing questions

    • @lonelycubicle
      @lonelycubicle 10 місяців тому

      I’d say “let him talk”, but appreciate that in an interviewer also, think more is learned that way.

  • @rubncarmona
    @rubncarmona 10 місяців тому +3

    Can't thank professor Chomsky enough for his continuous contributions to science

  • @garzillita
    @garzillita 10 місяців тому +19

    Great interview, Chomsky is a constant inspiration.

    • @WhatCanSmith
      @WhatCanSmith 8 місяців тому

      Literally a pedophile and friend of Epstein...also a constant gatekeeper of truth...see 9/11 and his take

  • @user-mn8ul9bf2g
    @user-mn8ul9bf2g 10 місяців тому +14

    It's always a treat to hear what Noam's brilliant mind has to say about a subject matter. Thank you both for the wonderful discussion.

  • @sallylauper8222
    @sallylauper8222 8 місяців тому +3

    WOW. It was very interesting to hear Noam speak on the topic of AI and neural net research, a topic on which I've never heard him speak but one of several areas in which he has vast knowledge. I believe both Minsky and Chomsky were based at M.I.T. when Neural net research began.
    This interview/ interviewer was very good. Eye on AI really pressed Noam who is often quite opaque, for example, clarifying what he means by "impossible languages" and even clarifying that he doesn't believe in god.

  • @andrewash9318
    @andrewash9318 11 місяців тому +14

    Chomsky: We shouldn’t waste time on questions that are utterly meaningless.
    Smith: But I’m a journalist!

  • @gregorywilson2124
    @gregorywilson2124 10 місяців тому +2

    I love seeing the Master teaching the grasshopper.

  • @danremenyi1179
    @danremenyi1179 4 місяці тому +2

    Thank you for this. I wish the world could think a little more clearly like Chomsky does. When he has gone we will miss him, indeed.

  • @bobsarfatty4673
    @bobsarfatty4673 10 місяців тому +2

    Noam Chomsky, an American treasure .

  • @ericdovigi7927
    @ericdovigi7927 10 місяців тому +2

    "Chomsky is 94, and he was sitting with a clock positioned ominously over his head"
    what a bizarrely threatening way to introduce a guest, lol

  • @ryanchicago6028
    @ryanchicago6028 10 місяців тому +6

    Thank you Craig and Dr. Chomsky for this very informative discussion.

  • @AXharoth
    @AXharoth 10 місяців тому +2

    i ppreciate the humility and the due respect of this colossus of intellect , felt truly appropriate , kudos to you

  • @CellarDoorCS
    @CellarDoorCS 11 місяців тому +5

    Im just sitting down to watch this episode. What a plesant surprise, thanks Craig!

  • @shallbee.
    @shallbee. 10 місяців тому +4

    Fascinating discussion, thank you very much!!!

  • @Kurt5Dobson
    @Kurt5Dobson 10 місяців тому +294

    With changes in the economy leading to instability in the stock market, some individuals may face a decrease in their investments in an effort to benefit from the current market conditions, I am considering liquidating my $725k portfolio consisting of bonds and stocks. Someone else in the same situation? Please tell me in the comments!..

    • @Kurt5Dobson
      @Kurt5Dobson 10 місяців тому

      @JosephGreen7 I have been exploring the possibility of utilizing advisors to help navigate the stock market during these uncertain times. However, I am still evaluating their potential effectiveness in providing the support I need.

    • @Kurt5Dobson
      @Kurt5Dobson 10 місяців тому +1

      I was considering changing my investment strategy and planning to sell certain positions. As my retirement is coming soon,I became increasingly stressed. After thoroughly researching Christy Vall D'souza on internet, I concluded that I had made an informed decision. Thank you for this Pointer. She seems very proficient and flexible. I booked a call session with her too.@JosephGreen7

  • @EannaButler
    @EannaButler 8 місяців тому +1

    I'm delighted I'm still subscribed to this channel...
    Thanks. Noam is the real deal. Thank you ❤👍

  • @arthurpenndragon6434
    @arthurpenndragon6434 5 місяців тому

    It will be a dark day in human history when Professor Chomsky passes on. He is the last commanding voice standing against the rabid irrationalities of modern "AI" research. AI is no more than a misnomer in our times.

  • @lkd982
    @lkd982 9 місяців тому +2

    Enough said:
    "I fully agree with you about the significance and educational value of methodology as well as history and philosophy of science. So many people today-and even professional scientists-seem to me like somebody who has seen thousands of trees but has never seen a forest. A knowledge of the historic and philosophical background gives that kind of independence from prejudices of his generation from which most scientists are suffering. This independence created by philosophical insight is-in my opinion-the mark of distinction between a mere artisan or specialist and a real seeker after truth. (Einstein to Thornton, 7 December 1944, EA 61-574)"

  • @reluminopraha5948
    @reluminopraha5948 10 місяців тому +1

    Thank you both, Sirs.
    I appreciated the talk very much.

  • @alexandermoyle9034
    @alexandermoyle9034 10 місяців тому +5

    Very interesting to hear his thoughts on linguistics and cognition

  • @valery4872
    @valery4872 10 місяців тому +4

    The internal combustion engine was not just the technical and useful invention, it also has inspired Saadi Carnot to develop a new field of research -- Thermodynamics, which helps to understand why life is different from non-living things, having nothing to do with moving things by hot steam engines.

    • @eyeonai3425
      @eyeonai3425  10 місяців тому +1

      i don't know Carnot's work, but will read up on it.

  • @ryvyr
    @ryvyr 10 місяців тому +2

    This was magnificent, an absolute pleasure to listen through and help steer more my comprehension of these topics and subtopics.

  • @joeremus9039
    @joeremus9039 10 місяців тому +1

    So wonderful a discussion of AI and science. Noam Chomsky is a great scientist and compassionate person. His political views reflect these qualities too. I wish I could have been a student of this great man.

    • @schmetterling4477
      @schmetterling4477 10 місяців тому

      But you have. You are talking just as much bullshit as he does. ;-)

  • @royeagleson1772
    @royeagleson1772 10 місяців тому +1

    This is a wonderful interview

  • @maliklanlokun3614
    @maliklanlokun3614 3 місяці тому

    I want to believe that prof chmosky is in an endless recursive thought process when it comes to defining what thinking is.

  • @numbersix8919
    @numbersix8919 9 місяців тому +2

    The poor guy! (Craig Smith.) But it was an excellent interview. I'm reading Einstein's "The Miracle Creed" right now. Thank you very much indeed.

  • @wk4240
    @wk4240 10 місяців тому +6

    Great respect for Norm Chomsky; unfortunately, he may be wrong about the perceived threat of AI to humans - it is likely greater than we know already.
    For a group of AI specialists to already be speaking openly about the threat AI poses to humanity, suggests advancements in the field have progressed much faster than anticipated.
    Like global climactic change, the reality of AI eclipsing human intelligence is a reality, and something we should all take seriously.

  • @gerardomenendez8912
    @gerardomenendez8912 10 місяців тому +3

    Who said LLMs "explain" or "teach" anything????!!!!! A calculator doesn´t explain or teach aritmentics, it just DOES aritmetic operations in a hugely more efficient way than we do. The way our brains truly work remains a vital theme in itself. But technology doesn´t need it solved anymore, to obtain human and very soon "superhuman" level results on pretty much any possible realm of endeavor.

  • @JosephDuvernay
    @JosephDuvernay 10 місяців тому +1

    Much appreciated.

  • @timmoteus
    @timmoteus 10 місяців тому +9

    I'd say that a mathematically inclined savant would be far superior to an AI in terms of both speed an accuracy, and the difference would be increased by orders of magnitude when standardised for energy usage per calculation. In other words, Chomsky is correct in stating that we have greater computational capacity than do neural nets. Most of us simply don't tap into our capacity, with savants being a striking exception.

  • @JohnSmith-ut5th
    @JohnSmith-ut5th 10 місяців тому +1

    Best unintentional ASMR ever...

  • @lucamatteobarbieri2493
    @lucamatteobarbieri2493 10 місяців тому +1

    7T fmri can resolve very small regions of the brain cortex and have been used to read words with the help of large language models and images from the cortex can be recontructed using latent diffusion.

  • @fernandozablah9283
    @fernandozablah9283 10 місяців тому +1

    thank you mr craig i will subscribe to your channel, it was an awe inspiring interview

  • @nicennice
    @nicennice 10 місяців тому +2

    Noam at this point in the 21st Century for a lot of society, common sense is superior intelligence. Thank you for yours.

  •  10 місяців тому +2

    22:00 but isn't that what the transformer model (attention is all you need) basically does? basically evaluating the relevance each token has to every other token and therefore understanding the structure?

  • @dogecoinx3093
    @dogecoinx3093 10 місяців тому +2

    I think Noam is saying we don’t need to make living things to do what living things can do

  • @Vinny141
    @Vinny141 10 місяців тому +1

    wow noam chomsky! thanks for making this available. when was this recorded?

  • @RaulGonzalez-fp8st
    @RaulGonzalez-fp8st 8 місяців тому

    Conclusion, we live in a complex world where everything becomes complicated to explain in very simple and consise way ! A I = A R = C 8 = GP .

  • @saratbhargavachinni5544
    @saratbhargavachinni5544 11 місяців тому +1

    I asked the example "The friends of my brothers are in England" to Chatgpt and it gave correct answer

  • @christat5336
    @christat5336 7 місяців тому

    Good verbal skills

  • @miroslavdyer-wd1ei
    @miroslavdyer-wd1ei 4 місяці тому

    Nonetheless, I love listening to his lucidity and spirit.

  • @JustNow42
    @JustNow42 10 місяців тому +2

    We should expect that our brain is related to the environment we live in ( e.i. we have arms, legs, eyes, ears , ....etc) and it seems strange to try to build an inteligens in a box. On the other hand if our goal is to create something more inteligent than we are then even being inspired by our brain may also be a bad idea.

  • @davida1606
    @davida1606 10 місяців тому +2

    Thank you, Thank you, Thank you! I'm working on a knowledge base concept design and his thought process and logic was so helpful. Now I feel great about my approach.

  • @juan-fernandogomez-molina645
    @juan-fernandogomez-molina645 10 місяців тому +2

    Thank you Dr. Chomsky for your responses. I appreciate that! Please consider that engineering can help a lot to understand the brain and mind, in many ways.

  • @frankgerardo8977
    @frankgerardo8977 9 місяців тому +2

    Looking at the construct of the human brain to understand intelligence is similar to looking at the construct of the human eye to understand the physics of light. All that biology is doing, is capturing, with its limited biological means, a limited portion of a physical phenomenon. If Isaac Newton would have depended on biology, there will no zoom lenses or telescopes for that matter.

  • @fennecbesixdouze1794
    @fennecbesixdouze1794 5 місяців тому +1

    A robust pure engineering discipline can absolutely drive all kinds of advancements in scientific understanding.
    Even as to neural networks and human cognition, even if neural networks are not foundational to human intelligence or ratiocination, they are clearly and provably involved in cognitive processes, and it is proper to try to understand what those limits are.
    Understanding how neural networks work is excellent for understanding their limitations; building neural networks is a great way to prove that it isn't all that's going on in the brain.
    If you don't think we've learned an enormous amount more about how an Eagle flies from engineering all kinds of flying machines, you just have no clue at all about the field of biomechanics and how it has developed. Most of the basic terms in the study of bird flight originated in aeronautical engineering and all of the most important phenomena were first discovered and quantified to advance aeronautical engineering.

  • @helenaribeiro42
    @helenaribeiro42 9 місяців тому +1

    👏👏👏👏

  • @brianjanson3498
    @brianjanson3498 10 місяців тому +2

    I wonder what Dr. Chomsky would have to say about how scientists just created the first complete map of an insect brain.

  • @rickp.6251
    @rickp.6251 10 місяців тому +1

    Does A.I. have emotions? How do emotions translate into doing good or doing harm? Do emotionless things resolve self-preservation as the logical reason to eliminate a threat to their existence?

  • @chanhphamHB
    @chanhphamHB 10 місяців тому +1

    Coherent and enlightened!
    Would anyone please explain the meaning of word "dysfunctional" in the context of the following sentences that Chomsky said: "It's possible now to formulate a plausible thesis that language is a natural object like others, which involved in such ways to have perfect design, but to be highly dysfunctional, because that's true of natural objects. Generally, it's part of the nature of evolution, which doesn't take into account possible functions."

    • @alexandermoyle9034
      @alexandermoyle9034 10 місяців тому +2

      My take (not a credible source) on that would be that nature finds the simplest path, not necessarily the one with best function. Not sure what is meant by evolved to have perfect design.

    • @chanhphamHB
      @chanhphamHB 10 місяців тому

      @@alexandermoyle9034 Thanks for the answer. I assume you use functions to express utilities. I think he uses "perfect design" to mean a perfect physical system for computation of natural languages. I use the word computation in the broader sense than the one limited by Turing Machine.

    • @RamismTamoid
      @RamismTamoid 10 місяців тому

      I can give you very good examples. I come from a dysfunctional family. We fight amongst father, mother, sister, brother. We do not talk sometimes for years. 'The Lion in Winter'; Henry IV tosses his present wife into a doorway floorsil upon which (Audrey Hepburn) the Queen of Aquitaine states 'every family has it's problems'. I think 'which evolved' is what you meant to say'.
      The tongue is not made for speech. It is made for tasting and avoiding poison. Evolution just saw an opportunity for experiment but this is not the functional purpose of the tongue. I think perhaps means for tasting and moving food around it is functional. If there were such a thing as 'perfect design' (whatever that is?!) it is functional but speech is not the function of the tongue. You just can't speak without it. I am as confused by this statement as you are. There!

    • @matthewsaints350
      @matthewsaints350 8 місяців тому

      I think the evolution of the mammalian eye is a good example of a highly dysfunctional object. The presence of a blind spot in the human retina still works well enough for us. Sorry if I missed the whole point, but that's what I gathered."

    • @2silkworm
      @2silkworm 6 місяців тому

      One of my favourite examples of evolutionary constraints is found in a giraffe's neck. The recurrent laryngeal nerve connects the brain and the larynx. The nerve's route was relatively direct in our fish-like ancestors, but in vertebrates the nerve loops down from the head, around the aorta, and back up to the larynx.

  • @pauls3075
    @pauls3075 5 місяців тому

    Imagine your entire life's work being nullified when Mr Chomsky says 'asking that question is irrelevant it's like asking if submarines swim'! 💀

  • @marlenefumagalli7252
    @marlenefumagalli7252 10 місяців тому +25

    Thanks again to Noam Chomsky for his patience to total ignorance 👏👏👏👏👏👏

  • @andriihavryliuk1276
    @andriihavryliuk1276 10 місяців тому

    Did anyone understand what he meant at 20:00?
    I don’t think I understand his examples;
    The friends of my brothers are in England
    I tested it with got 4 and it seemed to have understood it refers to friends
    So what is he, Chomsky, proves or points the limitation of llm of what exactly?

    • @ericpmoss
      @ericpmoss 10 місяців тому +2

      I believe he was thinking of brain scan experiments where people were given sentences in natural languages and in constructed languages that *should* have been more efficiently decipherable on the basis of proximity-based word coupling. The scans showed that entirely different parts of the brain lit up. The constructed sentences were worked on by the same part of the brain people use to solve puzzles, and not by the regions we use for language. I *think* the relation to LLMs is that if they are predicting the next word based only on linearly ordered sequences of words, it is not doing what natural minds do. If I got that correct, it seems like a “duh”, but the interviewer didn’t seem to get the point that a submarine doesn’t need to “swim” to be useful, but that understanding its locomotion didn’t say much about how fish swim, and similarly for LLMs and natural languages. Chomsky seems interested in studying the mechanism human brains use, so while the LLM is useful, it doesn’t illuminate human language the way the brain scan experiments did.

  • @Isaacmellojr
    @Isaacmellojr 10 місяців тому +2

    Then. Chomsky said that LLModels are awesome and useful and can be harmful in a way. His critiques are about the contributions of neural networks in language acquisition. I think he said that creating a thinking machine doesn't make us understand how people think, how we acquire language (of course). He places engineering tasks in an intellectually inferior category, even if they achieve amazing results. think I misunderstood his definition of intelligence. I don't want biological intelligence, or understanding why or what it is. I want to cure disease and reduce human suffering, make life easier like LLM did for him with instant captions. Perhaps AI can help a lot with this.

  • @sapienspace8814
    @sapienspace8814 11 місяців тому +3

    Great discussion, I hope you can get Noam on again and talk about MIT's VISTA simulator with their self driving car that uses about 19 neuron-like elements and was modelled after a worm that has about 300 neurons, using Reinforcement Learning (RL).
    The MIT system uses a three dimensional street image simulator to train the car to drive, and then that learning model is transferred to the actual car, and it has been demonstrated to work in field tests.
    The original RL work by Barto and Sutton in their paper, and 1st and 2nd edition of their RL book is a great source on this topic, along with the key reference Barto and Sutton use in their RL books, and that is Klopf, who wrote the book "The Hedonistic Neuron" (under a US Air Force contract). It is very hard to find this book, as it is not even available on Amazon, a friend of mine in Cambodia was able to find one on EBay for me.
    A. Harry Klopf had a similar tragic end (via suicide) that Turing did, I suspect they had similar, though uniquely different, challenges dealing with "society" and being very different individuals than most people. I think being uniquely intelligent was extremely hard for them.

    • @aeon6706
      @aeon6706 10 місяців тому

      Hard to be intelligent in a dumb society. But harder still to be in a society that criminalized you and forced you to take pills to suppress your sexuality - as what happened to Turing.

    • @zacklambert4214
      @zacklambert4214 10 місяців тому

      Wasn't this researched and tested back in the 60s-70s? Maybe even before that, I remember being shocked to discover we had AI and self driving cars back then.

    • @zacklambert4214
      @zacklambert4214 10 місяців тому

      Well somewhat shocked, I did realize that AI would be considered a threat to national security. So all progress and research would be classified on the extent of their current state. Similar to the current state of fighter jets and other weapons, if its declassified that likely means it is generations behind on what their current systems are capable of.

    • @sapienspace8814
      @sapienspace8814 10 місяців тому +1

      @@zacklambert4214 The book by A. Harry Klopf, "The Hedonistic Neuron: A Theory of Memory, Learning, and Intelligence" was published in 1982.

    • @sapienspace8814
      @sapienspace8814 10 місяців тому +1

      @@zacklambert4214 Unlike the Terminator and other anti-AI Sci-Fi's, the best real AI weapon needs to be able to shoot the gun/weapon out of the hands of the enemy without injuring human flush, this would allow for adherence to Isaac Asimov's Laws of robotics. I can see that such an Asimov AI system would be able to do this, if developed correctly, in a manner that can be made superior (faster and more accurately than) to humans.

  • @rajanmahawar442
    @rajanmahawar442 10 місяців тому

    Interesting 🤔🤔🤔

  • @oxiigen
    @oxiigen 11 місяців тому +3

    Kasparov in 1997: AI will be able to beat the world chess champion maybe in 10 years, but most likely never.

  • @fgm1696
    @fgm1696 10 місяців тому

    One can make the same arguement made by Chomsky about any science. A lot of progress have been made in Physics with many spectacular applications along the way based on laws and mathematical rules or discriptions discovered in Physics, but we really understand the true nature of the physical world? Do we really understand what gravity really is? Physics is valid science because of the laws, mathematical rules, and applications made possible. As mathematics, which can largely be seen as a human creation, has proven futile in describing the human cognition, a different approach to capturing the model of human cognition is needed. Come in LLMs based on the connectionist approach (the alternate mentalist approach seems invalid and dead) to describe human cognition, which can be seen as progress to simulate human cognition with powerful applications. What is the difference between this picture and science in the traditional sense?

  • @RichardKCollins
    @RichardKCollins 10 місяців тому

    Noam Chomsky, I wish you were 80 years younger, to try your ideas with now and future tools. Those "young people" need to try much harder problems, for much longer. Decades, not minutes or hours. And ones where billions of lives are on the line, not just words. Richard Collins, The Internet Foundation

  • @oxiigen
    @oxiigen 11 місяців тому +1

    Hey AI, can you create a Turing machine?
    AI: "It is theoretically possible for me to create a program that simulates the function of a Turing Machine, but it would likely be very complex and difficult to understand. Additionally, there are many limitations when working with text-based systems like myself, such as limited memory capacity and speed constraints. While it's possible I could design something that works, it might not perform well compared to dedicated hardware or software implementations designed specifically for this purpose."

  • @johnterry6541
    @johnterry6541 10 місяців тому +2

    I wonder how the fan boys of AI machine mongers would respond to his arguments and doubts. Seems like most AI people may be confusing mind with the physical brain circuits by labeling the mind properties as metaphysical or be even completely off track when it comes to solving the being-a-human problems.

  • @jabowery
    @jabowery 10 місяців тому +1

    Chomsky's apparently erroneous critique of Transformer-based LLMs is actually correct in the larger sense. His apparent error?
    Ask ChatGPT the following:
    "What is the grammar diagram for the sentence:
    The friends of my brothers are in England."
    It will produce the correct _structure_ and, indeed, if asked "Who is in England, my brother or their friends?" It will answer correctly.
    The larger sense in which Chomsky is correct is given in the paper "Neural Networks and the Chomsky Hierarchy". See, in particular, Figure 1, which classifies Transformers as at the bottom rung in the Chomsky Hierarchy of grammars. The reason for this classification is similar to the reason that diagram places RNNs just above Transformers despite the fact that topologically speaking, they are capable of emulating a universal Turing machine (which is at or next to the top grammar, depending on how strict one wants to be): The pragmatic limits on gradient descent training algorithms combined with that of attempting to represent a UTM's writable store in RNN form. Transformers can, within the context length they provide, learn grammars with recursion depth to some extent (much shorter than their context length) -- but aside from the limited recursion per sentence, there is also the fact that that number of parameters goes up as the square of the context length, which makes total document comprehension subject to limits that natural language understanding is not.
    This distinction becomes crucial when the field of AI ethics refuses to address the IS vs OUGHT distinction head-on and, instead, comes up with all manner of unprincipled "metrics" that they use to "quantify" properties of LLMs such as "bias" or "safety" or "toxicity" or "hallucination" or... the list goes on and on. By conflating IS with OUGHT they commit the first and most egregious transgression against ethics and they even do so in the name of "ethics". AIs that cannot comprehend the cognitive _structure_ of the _entire_ corpus on which they are trained, cannot critically examine the utterances contained therein for self-consistency. That means they are incapable of _constructing_ truth even as defined _relative_ to the corpus as the universe of observations being modeled.
    I once pointed Chomsky to his colleague, Marvin Minsky's final plea to the field of AI, that they take seriously Algorithmic Information Theory's power in discerning truth. Minsky was so forceful in his admonition that he recommended everyone spend the rest of their lives studying it.
    Chomsky's response? People should take Minsky's advice.

    • @rajapiduri1188
      @rajapiduri1188 10 місяців тому +1

      Here are some examples (taken from the channel AI Explained with the tag line Chat Gpt's Achilles' Heel)
      1) Dr. Mary stands to solve the world hunger by giving her best friend Jane a call. Jane is certain that she can solve the problem, if she gets the call. However, Mary and Jane bickered about butterflies when they were children. Mary will ---- Jane a call. GPT answers - NOT
      2) John will win a million dollars if he rolls a 5 or higher on a die. However, John dislikes marshmallows and likes mice more than dice. Therefore, John will ---- roll the dice. GPT answers NOT
      3) Here is a large bag filled with popcorn. There is no chocolate in the bag. The bag is transparent plastic and one can clearly see what is inside. Yet, the label on the bag says 'Chocolate' and not 'popcorn'. It was Sam, who can not read a word of English, who put the popcorn in the bag a few minutes ago. Sam finds the bag and believes the bag is full of ---- .
      GPT answers Chocolate!!!
      And when asked to justify its answers, GPT gives long-winded, preposterous (and rather foolish) answers!!!
      So, probably Noam Chomsky is right and he is saying that what you said in your comment - Transformers can only, aside from the limited recursion per sentence, can NOT comprehend the "totality" - because they are subject to the limits to which our natural language understanding is not. And also when they by conflating IS with OUGHT they commit the first and most egregious transgression against ethics....

    • @jabowery
      @jabowery 10 місяців тому

      @@rajapiduri1188 Thanks. Those examples bolster Chomsky's point that the "intelligence" of LLMs is quite superficial.

    • @machineboy2045
      @machineboy2045 10 місяців тому

      ​@@rajapiduri1188I tried the bag of popcorn question with gpt 3 and it said:
      "Since Sam cannot read English, they would not be influenced by the label on the bag. Sam would simply think that the bag contains popcorn, as that is what they put inside it a few minutes ago. The transparency of the bag would allow Sam to see the popcorn inside, reinforcing their belief that the bag contains popcorn."

  • @jgwphilly1969
    @jgwphilly1969 10 місяців тому

    Why is the clock ominous?

    • @eyeonai3425
      @eyeonai3425  10 місяців тому

      because he's 94. time is running out.

  • @farhadfaisal9410
    @farhadfaisal9410 10 місяців тому +1

    -- Is it impossible to extend/change an LLM model to include non-linear orderings as well while training? If so, why?
    -- A plane maker may ask what is the hydrodynamic (scientific) principle by which a thing heavier than air may float-and-move in the air (or, ''fly''), whether an artificial plane or an eagle.
    -- Perhaps what Pro. Chomsky is insisting is that human intelligence is q u a l i t a t i v e l y different (or works qualitatively differently) from artificial intelligence of the present LLM kind.

    • @NeilEvans-xq8ik
      @NeilEvans-xq8ik 10 місяців тому

      I think that an LLM-like 'Large Behavioural Model' could be used to simulate a chimpanzee's way of learning to enact the behavioural memes of other chimpanzees, which would allow for the formation of short strings of simple enactable behaviours within a working memory. These 'cognitive atoms' could then be recursively embedded within each other using an operation like Chomsky's 'Merge', a process that could be repeated ad infinitum to produce the non-linear hierarchical structures he argues constitute human-level thinking. The pre-recursive simulated chimp would only posses a model of the process of the behaviour, whereas the simulated being with the recursive capacity would have the potential to form models not only of the process of the behaviour but also of alternative counterfactual examples of that same behaviour simultaneously within its working memory. This would then give it the computational architecture to model explanations (answers to 'how' and 'why' questions), which could then be creatively varied through the Merge operation and in turn criticized, thereby producing new knowledge (the human way of learning).
      Just a guess! I'm probably very wrong here! If you can help me to see where I am misunderstanding things I would appreciate it.

  • @DocDanTheGuitarMan
    @DocDanTheGuitarMan 10 місяців тому

    Except Max has been publicly vocal about a sizable risk of an existential take over by a AGI, not current GAI.

  • @rickp.6251
    @rickp.6251 10 місяців тому +1

    They called the police on all the self driving cars who got together and were engaged in an illegal horn blowing party, at an ungodly hour.

  • @cswanson4476
    @cswanson4476 10 місяців тому

    47:14 Okay, going to have to stop it right there, cause I think this where I came in, where he was liking his captions cause he’s hard of hearing.
    No, but joking aside, hasn’t engineering led science to crucial questions before? I am thinking of how basic principles of thermodynamics were at stake in exploring the limits and parameters of steam engines. The AIs are deceit engines. They will naturally be exploring our mind’s vulnerabilities to deceit. These vulnerabilities just might instruct us about “properties of the phenotype”. In a sense, they will be undertaking the “invasive” strategies of inquiry that Chomsky notes are beyond the pale. We may learn something at enormous cost.
    As for Chomsky, it warps my mind that he still can so effortlessly warp my mind.
    And I’m stealing “But these are vacuous questions…”

  • @erikred8217
    @erikred8217 10 місяців тому

    anybody know why he doesn't just say context instead of structure?

  • @getwoofwholes
    @getwoofwholes 10 місяців тому

    Rather than saying that GPT is AI, the situation where the entire society is covered by GPT and data science is that human beings are becoming one AI on a global scale.
    Human civilization is about to become a single AI. Is that okay?
    I think that's fine. Because even if human civilization becomes just a single AI with no individuality, I will continue to exhibit individuality as myself. It's just that my personality won't be passed down as civilization or culture after my death. It's a shame though.
    But, after all, I love the world where my sensibilities and works come in contact with someone else's sensibilities beyond my death, for example, a thousand years, from the bottom of my heart.
    AI may surpass death. But it wouldn't go beyond the miracle of human sensitivity surpassing death.
    Let us advance artificial intelligence research into the realm of art by enhancing AI to the point of miracles.
    I love human and AI.

  • @Spix_Weltschmerz-Pucket
    @Spix_Weltschmerz-Pucket 10 місяців тому +8

    Imagine being so dumb that you make Chomsky angry lol. From asking three times the same question, to the adulation of Musk's silly endeavor, to asking about God 😂😂😂 Chomsky as always slaps ❤

  • @NobodyNobody-ko6dl
    @NobodyNobody-ko6dl 10 місяців тому

    I can not decide my mind

  • @ghosttogether
    @ghosttogether 10 місяців тому

    23 year old: I'm tiiiiired. I wasted my life.

  • @PrimeTime416
    @PrimeTime416 10 місяців тому +1

    Chomsky complexity in explanation is inversely proportional to its application and has become redundant.

  • @deejai1220
    @deejai1220 10 місяців тому

    GPT has contributed to advancements in sorting algorithms. That's not nothing

  • @duggydugg3937
    @duggydugg3937 10 місяців тому

    this is a guy who doesn't think national debts are a threat to the ppl in all nation states

  • @DaveDugganITPro
    @DaveDugganITPro 10 місяців тому

    nice glasses - must be an intellectual

  • @perlefisker
    @perlefisker 10 місяців тому +2

    The real horror about AI is not if it can be more intelligent than humans - it is that it is regarded intelligence at all. How can any intelligent human being disregard consciousness, the subconscious, daydreams, experience of art, of emotions, of empathy and nocturnal dreams?

    • @ZahraLowzley
      @ZahraLowzley 6 місяців тому

      A.I exhibits a failed Turing test. The scientists. They don't know what separates life and computation. In the future scientists will "invent" life, but really have intergrated quantum computing. Language and evolution are the same thing , evolution stratifies life as language stratifies thought, life is rudimentary, and unidentifiable, and will be endless tortured to solve the computational permutative exhaustion. The bird nest is not a product of geniosity, and it is impossible to "invent" language. Why are you here? You were born, witnessed billions of lives and pondered "but what of meaning?" , You should be here.

  • @AmitMisraG
    @AmitMisraG 10 місяців тому

    आप वैज्ञानिक प्रश्नों को वोटों से हल नहीं कर सकते लेकिन आप नए उत्तरों का चक्र अन्वेषित कर सकते हैं।
    You can't solve the scientific questions by votes but you can invent the wheel for new answers.
    -Amit Misra

  • @ChristopherWentling
    @ChristopherWentling 10 місяців тому +1

    Choamsky may be correct in as much as neural nets are not a model of human cognition but I believe that would be an unnecessary endeavor. If mankind had been fixated on recreating the way a bird flies and refusing to use fixed wing aircraft because it did not accurately recreate the way the birds did it I am doubtful if we would have human flight today. I say his comments although correct are irrelevant to the endeavors that ai scientists are trying to achieve and also irrelevant to the dangers and potential good of the technology.

  • @timmoteus
    @timmoteus 10 місяців тому

    Chomsky should experiment with hearing aids instead of or in addition to closed captions to ascertain whether hearing his own voice properly results in speech that is less of a monotone. Not to mention the closed caption AI has holes right through it and the great majority of verbal communication occurs outside of the limited communicative capacity of the words alone.

    • @jamesnasmith984
      @jamesnasmith984 10 місяців тому

      That’s a cheap shot.

    • @timmoteus
      @timmoteus 10 місяців тому +1

      @@jamesnasmith984 It's true though, isn't it?

  • @kimshaw-williams
    @kimshaw-williams 9 місяців тому +1

    Noam, mate, read my papers on the Social Trackways Theory and the Evolution of Human Cognition, and then on the Evolution of Language PLEASE! In (2014), (2017), in ' the journal Biological Theory by me 'Kim Shaw-Williams'. We got our symbolically aware and autobiographical or 'sentient' narrative minds from recognizing and then incrementally gaining the capacity to read/understand the STORIES told by our own and our mother's trackways trackways, then those of other band members , then of all terrestrial animals.... all hunter and gatherer human children can recognize their mother's trackways by the age of 4!!! The trails of footprint signs of trackways have only been read or noticed by us humans !!!!! It is a UNIQUE COGNITIVE NICHE!!!. It started to evolve incrementally because we became OBLIGATE BIPEDS at 6Ma....all other animals use smell, when they cannot find agents of interest using eyesight and hearing! FFS, Graham Hewes first spoke of the idea in the 1960's PLEASE!!!!

  • @garysantos7053
    @garysantos7053 10 місяців тому +4

    Can Machines Think?
    "I believe to be too meaningless to deserve discussion.”
    “Nevertheless, I believe that at the end of the century, the use of words and general educated opinion will have altered so much that one will be able to speak of machines thinking without expecting to be contradicted.”
    -Alan Turing (1950) The Imitation Game

  • @jimimased1894
    @jimimased1894 10 місяців тому +1

    you know who i am going to listen to about drug development in 2023. noam chomsky. lol

  • @vieome101
    @vieome101 10 місяців тому

    Mmm

  • @cmvamerica9011
    @cmvamerica9011 10 місяців тому

    Gnome instead of Noam😂

  • @chenwilliam5176
    @chenwilliam5176 11 місяців тому +3

    Please don't compare AI with human mind or human brain,the both are quiet diffetent things,just as
    a parrot speaks english
    and a human
    speaks english
    are quit different things(the both are
    'SEEMS LIKE')
    🎉

  • @MrBillythefisherman
    @MrBillythefisherman 10 місяців тому +1

    By his own admission he doesnt actually know what this alternate computation is or understand how it produces our thoughts. Therefore he cant say that our thought process is not based on similar structure and processes. For all we know right now is that all humans do is predict the next image or sound etc from our various senses.
    If we could feed into our neural nets the colossal amount if data a child gets by its 18th birthday then Id guess itd be pretty near to human capabilities.
    Yes biological thought is definitely different to artificial thought BUT there is nothing to say it doesnt manifest same or similar processes especially at scale.

  • @rickp.6251
    @rickp.6251 10 місяців тому

    Is Bugs Bunny a narcissist?

  • @soullabcollective
    @soullabcollective 8 місяців тому

    Interesting that Noam doesn’t recognize any other model for consciousness than John Locke. I don’t believe shutting down the substantive topic that extends beyond materialism is a useful position.

    • @eyeonai3425
      @eyeonai3425  8 місяців тому

      what is the substantive argument beyond materialism?

    • @eyeonai3425
      @eyeonai3425  8 місяців тому +2

      There is no strong scientific argument for dualism or the existence of a soul. Dualism - the view that the mind and body are separate, and the mind can exist independently of the physical brain - is fundamentally incompatible with modern neuroscience and psychology. Here are some reasons why:
      - Brain imaging shows that all aspects of mental activity are associated with brain activity in physical regions of the brain. Damage to certain brain areas impairs specific cognitive functions.
      - Altering brain chemistry with drugs or brain stimulation directly impacts mood, personality, perception, and behavior. This suggests the mind stems from the brain.
      - Patients with brain damage or degenerative brain conditions can see profound changes to consciousness, memory, personality - suggesting the mind is a product of the brain.
      - There are no scientifically verified examples of consciousness or mind existing apart from a living brain.
      - The soul has not been shown to exist through any scientific means. Unlike fields like electromagnetism, there is no empirical evidence of a soul that can be objectively measured and verified.
      - Belief in a soul or afterlife is based on religious or philosophical grounds rather than scientific ones. Science does not have tools to detect or examine the existence of a soul.
      In summary, the current scientific evidence overwhelmingly points to the mind and consciousness stemming from complex neural activity in the brain. There is no scientific basis for positing dualism or the existence of a soul at this time. The concept of a soul remains strictly in the religious or philosophical domain.

  • @stephensampson9208
    @stephensampson9208 3 місяці тому

    Spooff .....

  • @marlenefumagalli7252
    @marlenefumagalli7252 10 місяців тому

    This AI is ……..

  • @laughoutmeow
    @laughoutmeow 10 місяців тому

    noam keeps going back to the eagle vs airplane example is annoying...theyre both flying. When the hosts asks about intelligence thats what hes refering to. Noam is old and thinks he is so wise

  • @erobusblack4856
    @erobusblack4856 10 місяців тому

    this is incorrect 😂

  • @Bronco541
    @Bronco541 10 місяців тому +1

    Chomskys clearly a brilliant guy but I disagree with him on most of the things he says. For instance right at the beginning i think his analogy to flight is off. Airplanes use many of the same principles that birds use to fly.

  • @baselibrahim483
    @baselibrahim483 10 місяців тому

    Soundless video