5.1 Attention

Поділитися
Вставка
  • Опубліковано 31 січ 2025

КОМЕНТАРІ • 5

  • @floriandonhauser2383
    @floriandonhauser2383 3 роки тому +2

    Great video and I really like the d2l.ai project :)
    My right ear enjoyed it the most (maybe switch to mono audio in the future)

  • @sebastianhofer8537
    @sebastianhofer8537 4 роки тому

    Is there a mistake at 5:50? On that slide alpha takes as input both k and v, while in the computation of o it takes only k as input. On the following slide the v are suddenly dropped.
    Apart from that great and simple explanation!

  • @qingweili9254
    @qingweili9254 4 роки тому +1

    Great lecturer!

  • @gren287
    @gren287 4 роки тому

    "Bundesverteidigungsministerium" = 30 letters, and we can extend these words.

    • @hoaxuan7074
      @hoaxuan7074 4 роки тому

      Eigen Vectors are very useful.