Low Rank Decompositions of Matrices

Поділитися
Вставка
  • Опубліковано 8 гру 2020

КОМЕНТАРІ • 4

  • @jimmy21584
    @jimmy21584 5 місяців тому +4

    Came here because I’m reading the LoRA LLM paper. Thank you for the clear summary!

  • @kadrimufti4295
    @kadrimufti4295 Рік тому +4

    I don't understand at 3:45 how and why you're multiplying the columns of matrix T by the rows of matrix W. Isn't matrix multiplication done the other way round, rows of T multiplied by columns of W?

    • @hello28572
      @hello28572 Рік тому

      It is another alternative way of representing matrix multiplication

    • @perioguatexgaming1333
      @perioguatexgaming1333 Рік тому

      If you transpose the matrix you get by the above method you will get the same matrix by multiplying rows with columns.