Geoffrey Hinton: The Foundations of Deep Learning

Поділитися
Вставка
  • Опубліковано 14 тра 2024
  • Godfather of artificial intelligence Geoffrey Hinton gives an overview of the foundations of deep learning. In this talk, Hinton breaks down the advances of neural networks, as applied to speech and object recognition, image segmentation and reading or generating natural written language.
    #ElevateTechFest
    For more info visit:
    Website: elevatetechfest.com
    Twitter: @elevatetechfest
    Facebook: @elevatetechfest
    Instagram: @elevatetechfest
  • Наука та технологія

КОМЕНТАРІ • 110

  • @blek1987
    @blek1987 4 місяці тому +2

    What a luxury to be able to watch this on-demand, from anywhere, and for free!

  • @dripcode2600
    @dripcode2600 Рік тому

    Always been fascinated with computer neural networks. Exciting times!

  • @atifadib
    @atifadib 3 роки тому +24

    Man he has a great sense of humour

  • @powertester5596
    @powertester5596 Рік тому

    This is extraordinary!

  • @Alp09111
    @Alp09111 5 років тому +5

    loved this, thank you!

  • @neerajsingh-xf3rp
    @neerajsingh-xf3rp 11 місяців тому +1

    deeply insightful

  • @xiaochengjin6478
    @xiaochengjin6478 5 років тому +3

    watching such an amazing video at 5 am

  • @dannyiskandar
    @dannyiskandar 5 років тому

    amazing ..thank you

  • @kentrader2489
    @kentrader2489 4 роки тому +15

    This was a great presentation

  • @shivakumarcd
    @shivakumarcd 6 років тому +92

    "so if you're obsessed with only being one correct answer and you're being able to prove you get it, backpropagation is not for you nor is LIFE"

    • @loopuleasa
      @loopuleasa 6 років тому +5

      classic Geoffrey

    • @wishall007
      @wishall007 5 років тому +11

      He hasn't lost the British sarcasm

    • @shubhampandey1997shreeg
      @shubhampandey1997shreeg 4 роки тому +2

      Actually by that line prof Hinton refers to the time when no one believed in his line and work of research and that decade taught him a great deal of patience until the technology reached a certain level to cope up with his knowledge.

    • @shivscd
      @shivscd 3 роки тому

      @Ernest Alonzo WOW.. Do you think people who watch these video fall for you?

    • @RyckmanApps
      @RyckmanApps Рік тому

      That was the best of his one-liners and zingers.

  • @bensonmwaura9494
    @bensonmwaura9494 5 років тому +1

    A tensor for paradigm shifts.

  • @MrMehrd
    @MrMehrd 5 місяців тому

    13:13 this photo of rnn is most best photo I’ve ever seen about rnns

  • @cowardmildredj.7250
    @cowardmildredj.7250 4 роки тому +2

    loved this, thank you!

  • @kuldeepsingh876
    @kuldeepsingh876 Рік тому +1

    Geoffrey Hinton sir has the super clarity about his thoughts. I love it. He does not beat around the bush.

    • @madamedellaporte4214
      @madamedellaporte4214 10 місяців тому

      He should be put through court for paying with the future of humanity. Of us all so he can make a big stash of money and we see our children have no future ..That is what happens with mad scientists who let their vanity take hold of them.

  • @nguyenngocly1484
    @nguyenngocly1484 3 роки тому

    You can make inside-out neural networks with fixed weighted sums (dot products) and adjustable (parametric) activation functions. Rather than the other way around.
    Then you are free to use high speed fast transforms for the fixed dot products.

  • @jmf3210
    @jmf3210 Рік тому +1

    Cool it with the 1960's slide presentation....definitely needs a producer..

  • @Free_Ya_Mind
    @Free_Ya_Mind 8 місяців тому

    In the nutshell, Artificial Neural Network is just a parametric composite function trained using the chain rule of derivative.

  • @j.wilmararcila4150
    @j.wilmararcila4150 Рік тому

    Gracias doc, que LINDO Mundo en El que sumerced SE mueve !

  • @mohammedalmukhtar5428
    @mohammedalmukhtar5428 5 років тому +7

    He is a Genius..Period.

    • @holmerlike8395
      @holmerlike8395 2 роки тому +1

      AND, you must be a complete moron for believing such !
      Or perhaps simply, just riding the gravy train... Keep it go'in Buddy !

  • @klausunscharferelation6805
    @klausunscharferelation6805 10 місяців тому

    about the singularity
    As Ray Kurzweil says
    When the whole universe becomes a computer,
    What does it calculate?
    Even though the purpose for calculating has already disappeared?

  • @Sp8e
    @Sp8e Рік тому

    I like this guy.

  • @bingeltube
    @bingeltube 5 років тому

    Recommendable

  • @obsiyoutube4828
    @obsiyoutube4828 4 роки тому

    smart!long life

  • @TheCriticsAreRaving
    @TheCriticsAreRaving 4 роки тому +17

    17:16 Hinton flips off the audience

  • @mangoldm
    @mangoldm Рік тому +1

    Are hidden Markov models as relevant as Ray Kurzweil suggested?

  • @Gabcikovo
    @Gabcikovo Рік тому +1

    11:27 Tomáš Mikolov just smiled :))

  • @HerrWortel
    @HerrWortel 3 роки тому +3

    Hinton is giving us the finger at 17:15 xD

  • @janaenae1338
    @janaenae1338 Рік тому

    I really love you!!!❤

    • @loopuleasa
      @loopuleasa Рік тому +1

      this guy was waaaay ahead of his time
      he casually defined what a thought is, and this thought never left my head 5 years ago

  • @paulmitchell5349
    @paulmitchell5349 5 років тому +4

    Knowledge is accessible data.Intelligence is ability to infer.

    • @Bmens71
      @Bmens71 4 роки тому

      paul mitchell like this quote

  • @zakali92
    @zakali92 5 років тому +3

    Absolutely fascinating for a dummy like me

  • @rkara2
    @rkara2 5 років тому +1

    Process or singularity is the Heart of AI.
    Alan Turing clearly define this in his 1936 paper on computable numbers.
    Input > Process > Output (Turing complete expression or circular)
    Process (Turing incomplete expression or non-circular)
    !DA

  • @dearheart2
    @dearheart2 Рік тому +2

    RNN is fun. I made a RNN for translation (word in, "thoughts" (RNN) works out), over the breaks in 1 week in high school in early 80ties. It could learn new words, structures and did an ok translation. Just made it for fun, like all the NN, AI at that time.

  • @PaulScotti
    @PaulScotti 2 роки тому +1

    Could someone clarify? He explained that backprop is better than "mutation" because backprop is parallelized vs. serialized -- but his explanation doesnt convey why backprop is achievable in parallel?

    • @brendawilliams8062
      @brendawilliams8062 Рік тому

      Maybe if you have a neg. and a positive direction then you’d be best covering the known ground. I don’t know either.

    • @panda5088
      @panda5088 9 місяців тому +1

      Because of the way the vector math works, you can calculate the difference in the result that a change to any one weight or bias would cause. Therefore you can adjust the result by manipulating multiple weights or biases at the same time. Here's a pretty good video explaining back prop more in-depth: ua-cam.com/video/Ilg3gGewQ5U/v-deo.html

  • @Gabcikovo
    @Gabcikovo Рік тому +1

    9:37 💜

  • @dearheart2
    @dearheart2 Рік тому +1

    Used evolutionary algorithm for training NN's in the 80ties. Worked well already then. Limited hardware, had to program all myself, but I got general AI that could be used for almost anything.

  • @vtrandal
    @vtrandal 2 роки тому +1

    At 8:59 some comments about RIM. What is RIM?

    • @bcbcbcbcbc
      @bcbcbcbcbc Рік тому

      Research in motion, the original name for Blackberry who used to make smart phones.

  • @TheHamoodz
    @TheHamoodz 5 років тому +16

    How can someone be intelligent enough to invent neural networks and entertaining enough to give a presentation like that. Its almost unfair lol.

    • @ArtOfTheProblem
      @ArtOfTheProblem 5 років тому +3

      and you forgot how clearly he explained the 'key concepts' there is maybe 300 pages of a typical book on the subject compressed into about 20 phrases in this talk.

    • @shubhamp.4155
      @shubhamp.4155 4 роки тому

      He did not invent neural networks

    • @prashanthadepu3013
      @prashanthadepu3013 4 роки тому +2

      @@shubhamp.4155 but he brought to life many of them and redesigned completly

    • @mateuszanuszewski69
      @mateuszanuszewski69 3 роки тому

      It is just math, and nothing else. So if one understands math at academic level can easly learn how neural networks will work and how to manipulate notations on them to get different types. And i am not talking about "oh learn Neural networks in 5 minutes" and people show you how to program a model in tensorflow.

  • @fuckboy323
    @fuckboy323 6 років тому +3

    what is the time of this
    speech ?

    • @ElevateTechCA
      @ElevateTechCA  6 років тому +6

      This speech took place in September 13, 2017 at Elevate TechFest.

    • @jj-ry8xv
      @jj-ry8xv 6 років тому +2

      1998

    • @fuckboy323
      @fuckboy323 5 років тому

      ethan chow you e d

  • @bopeng9504
    @bopeng9504 5 років тому

    Great job Geoff. Pray that God would bless your life!

  • @TomerBenDavid
    @TomerBenDavid 3 роки тому

    Wow :)

  • @paulmitchell5349
    @paulmitchell5349 5 років тому +2

    Learning is not necessarily intelligence.More rapid learning means to twig the concept and apply the concept to new problems.

  • @fallhdesls5226
    @fallhdesls5226 4 роки тому

    smart!long life

  • @ngocquynhnhuhuynh3227
    @ngocquynhnhuhuynh3227 Рік тому +1

    I'm proud to be his student's student 😆 I graduated with a thesis related to AI though have no fundamental knowledge about it 🤣

    • @ngocquynhnhuhuynh3227
      @ngocquynhnhuhuynh3227 Рік тому

      Looking back.. that time was truly a miracle to complete the whole thesis ^^ & also thanks for the accident too. Maybe confronting the bandages, the council was more lenient 😁

  • @sakathvenu
    @sakathvenu 4 роки тому +1

  • @samdavisok
    @samdavisok Рік тому

    25:00

  • @damoonrobatian9371
    @damoonrobatian9371 2 роки тому +1

    Geoff himself doesn't even know how it works! It just works!!! What kind of scientist could be satisfied with this type of "reasoning"? HYPE

  • @kavorka8855
    @kavorka8855 Рік тому

    He failed to give any sensical reasons to his recent assertion about the dangers of AI. He does, however, seem to have issues with google, perhaps he's angry at something google didn't do for him?

    • @prashanpremaratneAU
      @prashanpremaratneAU Рік тому

      If you look at ChatGPT, a leader of a country who is failing politically could ask chatGPT to suggest ways to cling on to power. Now, the answer could result in bloodshed. Another country could use chatGPT like system to control the entire defence establishment. That is the danger of AI according to Junaid Maubeen - Author of Mathematical Intelligence

    • @kavorka8855
      @kavorka8855 Рік тому

      @@prashanpremaratneAU He seems to be stupid, the author.

  • @nbme-answers
    @nbme-answers 4 роки тому

    14:47 symbols go in, symbols go out but in the middle it can't be "symbols"!

  • @leo.budimir
    @leo.budimir 4 роки тому +1

    Damn, he looks like Palpatine here

  • @janaenae1338
    @janaenae1338 Рік тому

    ❤️🧡💛💚💙💜💙💚💛🧡❤️🧡💛
    We are ALL the SAME PERSON experiencing life in a BUNCH
    OF DIFFERENT BODIES!!! which
    means that EVERY PERSON
    that you meet, is really just YOU...
    LIVING IN ANOTHER BODY!!
    you see..you are INTERACTING with YOURSELF at ALL TIMES!!! & once you understand this,you can achieve unity!
    I and my father are one
    Love Thy Neighbor as Thyself
    💜💙💚💛🧡❤️🧡💛💚💙💜💙💚

    • @robertolupot2497
      @robertolupot2497 Рік тому

      Interesting. So how does the death of one body affect the living body?

  • @morthim
    @morthim 4 роки тому

    if you are going to call people stupid you shouldn't contradict yourself and agree with the people you insult.

  • @mateuszanuszewski69
    @mateuszanuszewski69 3 роки тому

    omg so many ads

  • @u2naru
    @u2naru Рік тому

    This guy now says that AI is dangerous after decades of leading projects on AI. Why now not the time this presentation was done?

    • @yadayada111986786
      @yadayada111986786 Рік тому

      He ays himself he was surprised by the pace of the AI development. He thought these dangers would come much later and slower

  • @mutterich5290
    @mutterich5290 2 роки тому

    LM21 was geht ab

  • @dr.mikeybee
    @dr.mikeybee 5 років тому +1

    Professor Hinton is amazing, but there are too many of these NN for dummies lectures. They're starting to clog the space. It's a shame he didn't say anything really interesting here.

    • @mtoman
      @mtoman 5 років тому

      True, finding advanced talks is getting pretty hard.

    • @pd.dataframe2833
      @pd.dataframe2833 4 роки тому +6

      For advanced knowledge you dont come to youtube....you fucking read research papers

    • @atomskreigns8071
      @atomskreigns8071 4 роки тому +2

      Sivaram Karanam and even that's not true you can search any ML topic on UA-cam and get a lecture as advanced as u like a whole series of them

    • @SameenIslam
      @SameenIslam 4 роки тому

      Did you not read the title of this video? Clearly says foundations

    • @OptionGal
      @OptionGal 4 роки тому

      @@pd.dataframe2833, not entirely true. Some of the best research papers are published and presented at symposiums such as this one. We are all very lucky that there are videos of these podium presentations so that we may also be inspired to learn.

  • @JazzyGinger1
    @JazzyGinger1 3 місяці тому

    Hello🦩🦩🦩,
    God the Father loves you so much that He sent Holy, Sinless Jesus (His Holy Son) to earth to be born of a virgin. Then He grew up and died on a cross for our sins. He was in the tomb for 3 days, then Father God raised Holy and Sinless Jesus Christ (Y'shua) to life! He appeared to people and went back to Heaven. We must receive Sinless Jesus sincerely to be God's child.
    John 1:12 says, "But as many as received him, to them gave he power to become the sons of God, even to them that believe on his name."

    Will you receive Christ sincerely?

  • @ancestralrocha7709
    @ancestralrocha7709 5 років тому +4

    Some basic shit? Did I hear correctly?

  • @thiemtranthi7760
    @thiemtranthi7760 Рік тому

    Ok hinton them ok😂

  • @zzbeasley
    @zzbeasley 5 років тому +1

    Is a thought more than an image? Think about it.

  • @bobtarmac1828
    @bobtarmac1828 Рік тому

    Today, Losing your job to ai agents is unacceptable. Ai Jobloss is here. So are Ai as weapons. Can we please find a way to Cease Ai / GPT? Or begin Pausing Ai before it’s too late?

  • @m3n4cE3
    @m3n4cE3 11 місяців тому

    look at them, fatal wound/mark on their forehead

  • @rajaasim8229
    @rajaasim8229 5 років тому +2

    Who dislikes Hinton?

    • @MrCmon113
      @MrCmon113 4 роки тому

      Well he shit on symbolists during the talk.

  • @DanOneOne
    @DanOneOne Рік тому

    thank God I decided not to be a PhD student...

  • @yvespetit
    @yvespetit 2 роки тому

    A spiteful professor who thinks his tinkering with computers does good for humanity! Talk about speech recognition, the machine voice announcing a caller on our phone system is always wrong.