Fine-tuning a Neural Network explained

Поділитися
Вставка
  • Опубліковано 5 вер 2024

КОМЕНТАРІ • 69

  • @deeplizard
    @deeplizard  6 років тому +2

    Machine Learning / Deep Learning Tutorials for Programmers playlist: ua-cam.com/play/PLZbbT5o_s2xq7LwI2y8_QtvuXZedL6tQU.html
    Keras Machine Learning / Deep Learning Tutorial playlist: ua-cam.com/play/PLZbbT5o_s2xrwRnXk_yCPtnqqo4_u2YGL.html

  • @mohammadaminhosseinniya7849
    @mohammadaminhosseinniya7849 7 місяців тому +2

    Brief, Clear, Understandable and Complete, without usual youtubers playing round. Thank you!

  • @marsrocket
    @marsrocket 4 роки тому +6

    Your videos are by far the best on UA-cam for this kind of thing. Thank you for producing them.

  • @tymothylim6550
    @tymothylim6550 3 роки тому +4

    Thank you very much for this video! The use of an example and the specific explanation on freezing layers really helps me understand how fine-tuning can conceptually be done for similar tasks!

  • @deeplizard
    @deeplizard  6 років тому +1

    Check out the corresponding blog and other resources for this video at: deeplizard.com/learn/video/5T-iXNNiwIs

  • @THEGASDRIP
    @THEGASDRIP Рік тому +2

    Thanks 4 the video and good info.

  • @sathvikchowdaryveerapaneni1290
    @sathvikchowdaryveerapaneni1290 7 місяців тому +1

    Found the perfect explanation of fine tune.

  • @nawmeerahman8574
    @nawmeerahman8574 4 роки тому +2

    All of your tutorials are amazing.Simply explained.Helps me a lot.

  • @shaneebkottakkal3491
    @shaneebkottakkal3491 Рік тому +1

    very help full video

  • @saqlaingujjar6764
    @saqlaingujjar6764 5 років тому +2

    Thanks for the explanation in a very simple way.

  • @codedlAnguage
    @codedlAnguage Рік тому

    Brilliant 🙄🖐️🖐️🖐️🖐️👉💫👉🎶👉📲👉🔌👉❤️👉🙄👉👆👆👆👉🙏👉😃👉😐

  • @CaptainBravo87
    @CaptainBravo87 3 роки тому +1

    What a great channel ... am surprised it still has less than 100k subs!

  • @AnshumanKumar007
    @AnshumanKumar007 6 років тому +3

    Thanks for simplifying the topic.

  • @mohammadmassri2394
    @mohammadmassri2394 10 місяців тому +1

    Thank you for this video!

  • @aram1rasul751
    @aram1rasul751 4 роки тому

    I really enjoyed your lectures. it will be grateful if you could go through an example step by step for hand-digit recognition or car or anything else.
    It will be much better using code from scratch rather than using prepared libraries.

  • @richarda1630
    @richarda1630 3 роки тому +1

    this is so interesting...I can already see the applications for foreign language adaptation, disease classification, drug research...

    • @richarda1630
      @richarda1630 3 роки тому

      also are the weights and biases updated per batch? or per epoch?

    • @deeplizard
      @deeplizard  3 роки тому

      per batch

  • @deeplearningpartnership
    @deeplearningpartnership Рік тому +1

    Good stuff.

  • @fahnub
    @fahnub 2 роки тому +1

    great explanation

    • @fahnub
      @fahnub Рік тому

      Came back to revise the concept. Still helpful.

  • @RemiDav
    @RemiDav 4 роки тому +2

    Exactly what I needed to know before starting that finetuning tutorial ! :)

  • @mdyeasinarafath4450
    @mdyeasinarafath4450 5 років тому +2

    God bless you, Teacher

  • @fritz-c
    @fritz-c 4 роки тому +2

    I spotted a slight typo in the article for this video.
    recofnizing

    recognizing
    I really enjoy your courses so far, by the way. I've stopped and started a few times with studying ML in the past, but this has been a pleasure to go through.

  • @CosmiaNebula
    @CosmiaNebula 4 роки тому

    0:10 intro
    2:00 car recognition example

  • @gourabsarker5491
    @gourabsarker5491 3 роки тому +1

    Great Content !! Please if you can make videos on transfer learning... Thank You.

  • @bindukhadka
    @bindukhadka 8 місяців тому +1

    Thank you ✨

  • @hyunwookim4601
    @hyunwookim4601 6 років тому +5

    thanks for video

  • @JayTheMachine
    @JayTheMachine 11 місяців тому +1

    best video ever

  • @benabdallahrahma8245
    @benabdallahrahma8245 4 роки тому +1

    thank u, it's a very useful video

  • @snehabhapkar7620
    @snehabhapkar7620 4 роки тому +2

    Awesome explanation as always :)

  • @TheAmhdar
    @TheAmhdar 3 роки тому +1

    Thanks a lot !

  • @ajeetverma3679
    @ajeetverma3679 3 роки тому

    {
    "question": "Why do we freeze some of the initial layers of the network in transfer learning",
    "choices": [
    "to use these layers without updating the weights",
    "to exclude these layers while training",
    "to update the weights of these layers",
    "to initialize the weights with zero for these layers "
    ],
    "answer": "to use these layers without updating the weights",
    "creator": "Ajeet Verma",
    "creationDate": "2021-05-08T09:07:14.299Z"
    }

  • @knowhowww
    @knowhowww 6 років тому +2

    amazing explanation. thanks a lot.

    • @deeplizard
      @deeplizard  6 років тому

      Thanks, Knowhow! And you're welcome :)

  • @shujabutt4097
    @shujabutt4097 2 роки тому

    {
    "question": "Fine Tuning related to ",
    "choices": [
    "Transfer learning",
    "Unsupervised learning",
    "Supervised learning ",
    "Association learning"
    ],
    "answer": "Transfer learning",
    "creator": "Hivemid",
    "creationDate": "2022-03-31T10:46:59.763Z"
    }

  • @Waleed-qv8eg
    @Waleed-qv8eg 6 років тому +2

    Great job!
    Thank you so much!

  • @meravchkroun4197
    @meravchkroun4197 2 роки тому +1

    Thank you for the video! Can you send a link to an example how to do fine tuning?

    • @deeplizard
      @deeplizard  2 роки тому +1

      deeplizard.com/learn/video/oDHpqu52soI

  • @coop4476
    @coop4476 7 місяців тому

    For more general neural networks like LLM, would it be possible to fine tune it to basically anything text-based?

  • @lingjiefeng3196
    @lingjiefeng3196 5 років тому +1

    thank you

  •  6 років тому +2

    thanks for this video

  • @benny4013
    @benny4013 3 роки тому +1

    you are amazing guys

  • @MRBOBBY8706
    @MRBOBBY8706 4 роки тому

    Is this just a substantial amount of the If else then statement application? (Not a coder or anything, just remember some stuff from Computing at U of H) I am interested in machine learning stuff as it pertains to my theory/book I am writing. I am using some stuff from this video, that I will reach out to you about later, as I am doing the same with all others whose content I am referencing. Thank you so much for this simplistic explanation.

  • @justchill99902
    @justchill99902 5 років тому +1

    Thank you :)

  • @gerelbatbatgerel1187
    @gerelbatbatgerel1187 5 років тому +1

    ty

  • @DM-py7pj
    @DM-py7pj 11 місяців тому

    how does one freeze some weights please?

  • @hamzawi2752
    @hamzawi2752 4 роки тому +1

    You are extraordinary :)

  • @dr.hafizurrahman9374
    @dr.hafizurrahman9374 5 років тому +1

    Thanks,

  • @ozgunsungar9370
    @ozgunsungar9370 2 роки тому +1

    just wow

  • @imsteven3044
    @imsteven3044 2 роки тому

    Thank you for your video, i have a question i have a model of speech to text in spanish (i didn't train it) i want to improve the model, can i use fine tuning right?

  • @tammanakarthik1288
    @tammanakarthik1288 3 роки тому

    Could anyone say whether Fine Tuning and Transfer learning are same? If not, then how they are different? Thanks in advance!

  • @matharbarghi
    @matharbarghi 4 роки тому

    A quick question. Is there fine-tuning process for text classification using Keras? I see that your focus is on image classification, what about text classification?Thanks

  • @tammanakarthik1288
    @tammanakarthik1288 3 роки тому

    Can anyone say whether Fine tuning and Transfer learning are same?? Thanks in advance!

  • @dennisasamoah2213
    @dennisasamoah2213 4 роки тому +1

    wow

  • @N-e0N
    @N-e0N 4 роки тому

    I have a question, if I have a model that can detect license plates of cars, would it be feasible or possible even, to fine tune the model to make it able to detect license plates of motorbikes?

  • @angelleal3005
    @angelleal3005 3 роки тому

    How is Fine-tuning related to Transfer Learning ?

  • @NVworld2507
    @NVworld2507 6 років тому

    its just like inheritance?? where we can aquires the features of parent class

    • @deeplizard
      @deeplizard  6 років тому +4

      Hey Nilesh - Kind of. With fine-tuning, we take an existing model that has already been trained on a data set, and we "tune" it by modifying layers, parameters, etc. and re-train it on new data. So in a sense, the fine-tuned model is inheriting its parameters from the original model and then being changed incrementally to accommodate its new task/new data.

  • @roger_is_red
    @roger_is_red 4 роки тому

    after each batch are the weights updated?
    does each epoch see the same input data?
    thanks!

    • @deeplizard
      @deeplizard  4 роки тому +1

      Yes, updates occur after each batch. More on this in the blog below. This kind of update is called "mini-batch gradient descent."
      Each epoch sees the same input data, but with batches of data shuffled in a different order.
      deeplizard.com/learn/video/U4WB9p6ODjM

  • @asifahmed2147
    @asifahmed2147 4 роки тому

    What is steps_per_ephocs?

    • @deeplizard
      @deeplizard  4 роки тому +1

      The number of batches that it will take to complete one epoch.
      It is introduced in our blog here:
      deeplizard.com/learn/video/daovGOlMbT4

  • @LayneSadler
    @LayneSadler 4 роки тому

    How is this different from transfer learning? I figured you would be tweaking individual weights based on the title