how to make a neural network in scratch

Поділитися
Вставка
  • Опубліковано 29 чер 2024
  • a neural network comprised of 3 layers
    input
    hidden layers
    output
    heres a basic math thing to turn input to output with 2 inputs and 1 output
    input = i
    hidden = H
    connection = C
    output = I1 * C1 * I2 * C2 * H1 * C3
  • Фільми й анімація

КОМЕНТАРІ • 26

  • @pro9code
    @pro9code 6 днів тому +16

    From scratch? IN SCRATCH!

    • @tekratek4077
      @tekratek4077 4 дні тому

      Not that impressive tbh, Just 3 layers

  • @AndevOG
    @AndevOG 4 дні тому +4

    I got recommended this a day after I just made a neural network on scratch

  • @ruroruro
    @ruroruro 4 дні тому +2

    why is The Joker making a neural network tutorial in scratch?

  • @beezow7113
    @beezow7113 6 днів тому +2

    wtf. why did i get this recommended 4 hours after upload lmao this is epic

  • @SentinelAerospaceOfficial
    @SentinelAerospaceOfficial 4 дні тому +1

    this is a good demo on how neural networks work but actually training on this would be really bad as it is quite slow

  • @LimeLiquide
    @LimeLiquide 4 дні тому +1

    thanks this is an easy explanation how neural network works.

  • @kevishere_21
    @kevishere_21 4 дні тому +3

    is this a neural network? at 0:54 there doesn't seem to be any mention of bias or activation functions and I think the equation is supposed to be a weighted sum so i1 * w1 + i2 * w2 + i3 * w3 ... i_n * w_n + b and then activation functions (if there are any).
    Edit: So, after watching the whole video, I'm a bit confused but I think there are some things that are incorrect. NOTE: I might be wrong as well, I'm not an ML expert but rather a hobbyist.
    1)
    It seems like they're trying to do RL with neural networks and a genetic algorithm (ish) approach.
    At 1:28, I'm fairly certain this is a mistake but I'm not entirely sure. It seems like they're talking about the idea of a living penalty (a negative reward given at each timestep to incentivize the agent to achieve the task as quickly as possible). It should be a set reward to -0.1 at the start of the reward code and all the "change rewards" should be modified to "set rewards." The issue right now is that it's "change" instead of "set" so any existing reward given is slightly penalized by -0.1. This means that if the agent's distance is

    • @kevishere_21
      @kevishere_21 4 дні тому

      I didn't watch the whole video tho cuz I was too lazy lol

    • @goid314
      @goid314 3 дні тому

      @@kevishere_21 it probably took you more time to write two comments than to watch until the end...

    • @kevishere_21
      @kevishere_21 3 дні тому

      @@goid314 lol that's weirdly true I should prob watch the whole video but I'm too lazy I'll do it later

    • @kevishere_21
      @kevishere_21 3 дні тому

      @@goid314 ​ OK, just watched the whole video, and I see some problems. I'll update the original comment rq

    • @Blacksoul444
      @Blacksoul444 3 дні тому +2

      yup, his approach isn't quite the "normal" calculation of neural network output.
      Don't take every video on the internet as the holy grail lol.

  • @fizzixww
    @fizzixww 4 дні тому +1

    good

  • @Blacksoul444
    @Blacksoul444 3 дні тому +1

    he talks about the formula, but i have never seen a formula that just multiplies EVERYTHING TIMES EVERYTHING. Seems odd.
    Normally you have the activation function of the sum of the individual weighted inputs of a neuron.

    • @yyhhttcccyyhhttccc6694
      @yyhhttcccyyhhttccc6694  2 дні тому

      couldent find a good tutorial and i got no clue how it works im just gluing together code

  • @thesalmonfish3891
    @thesalmonfish3891 4 дні тому +2

    Love the video but the microphone...

  • @thatprogramer
    @thatprogramer 6 днів тому +1

    O~O

  • @RonicTheEgg
    @RonicTheEgg День тому +1

    this is really poorly optimized man, use some loops and idx variables to do the repeated calculations. is this neat alg?

    • @yyhhttcccyyhhttccc6694
      @yyhhttcccyyhhttccc6694  День тому

      idk the algorithm names it just randomly mutates and the best doin ones get saved and then it uses the best ones the next gen and mutates them

    • @RonicTheEgg
      @RonicTheEgg День тому

      @@yyhhttcccyyhhttccc6694 does it only mutate the weights and bias or can it create new neurons and connections