Standardization vs Normalization Clearly Explained!

Поділитися
Вставка
  • Опубліковано 3 січ 2025

КОМЕНТАРІ • 131

  • @Anna-uh7qx
    @Anna-uh7qx 11 місяців тому +5

    How many more people would understand math if we had explanations like this. I feel like I have been reading math papers written in French, and you just spoke in English for me. Gosh, THANK-YOU.

  • @xTurqoise
    @xTurqoise 2 роки тому +51

    Also in Principal Component Analysis, scaled features are very important because we search for the principal axes that have the highest variance. So if we have one feature in [0,1] and the other one in [1, 100], then the latter one has a much higher variance, even though it may not contain much information to be kept by the PCA.

    • @NormalizedNerd
      @NormalizedNerd  2 роки тому +4

      Great point! Feature scaling is very important in pca also.

  • @severtone263
    @severtone263 9 місяців тому +6

    Your clarity is amazing. This helps! Sub earned

  • @AbheeBrahmnalkar
    @AbheeBrahmnalkar Рік тому +7

    This is the first video I watched and man you have crushed it. This intuitive explanation of math was a joy to watch. Please keep them coming.

  • @NedSar85
    @NedSar85 2 роки тому +108

    This video should be nominated to the UA-cam Oscars/Grammy awards....

    • @rafaelerwin
      @rafaelerwin Місяць тому

      Agree! You deserve the award Man

  • @Mutual_Information
    @Mutual_Information 2 роки тому +10

    I was wondering where you’ve been! Nice to see you back to posting.
    Well covered topic - it’s easy to overlook standardization and normalization thinking they are simple. They have some important subtleties

    • @PritishMishra
      @PritishMishra 2 роки тому +1

      I saw you today in Yannic's channel as well, nice to see you again.

    • @NormalizedNerd
      @NormalizedNerd  2 роки тому +2

      Thanks a lot mate! Really happy to be able to upload again :D❤️

    • @taotaotan5671
      @taotaotan5671 2 роки тому

      Hey DJ, we are waiting for you also!

    • @Mutual_Information
      @Mutual_Information 2 роки тому

      @@taotaotan5671 lol coming soon!!

    • @stayinthepursuit8427
      @stayinthepursuit8427 Рік тому

      A standardization makes the original distribution look more normal . It doesn't just make a zero mean and 1 stdev.

  • @vemundrye8999
    @vemundrye8999 9 місяців тому

    You're doing amazing work here, hopefully one day you will get the recognition you deserve

  • @gactve2110
    @gactve2110 Рік тому +2

    Great videos, dude!
    It's a shame we no longer get this great content

  • @emmyjay4866
    @emmyjay4866 2 місяці тому

    Beautiful explanation and editing. Well done

  • @nishikantanayak7797
    @nishikantanayak7797 4 місяці тому

    Man this is the most intuitively explained video for this topic i ever found ,thanks man

  • @jullienb2055
    @jullienb2055 Рік тому +1

    Great, specially good to explain the misconception with non linear transformations which for some reasons is constantly used in conversations as normalization/standarization

  • @aravindr9109
    @aravindr9109 Рік тому

    Normalisation became new normal to me, great job dude!!!!

  • @jacobnyonyintono1442
    @jacobnyonyintono1442 Рік тому

    This guy explained something my lectures failed in years, in 5 minutes

  • @mahaalabduljalil6596
    @mahaalabduljalil6596 5 місяців тому

    We always learn something new even when I knew the topic from before! you make it more interesting and valuable. Thanks from Kuwait

  • @chwenjun225
    @chwenjun225 Рік тому +2

    thanks man, It's help me so much to understand about normalization
    Very helpful

  • @danrose3233
    @danrose3233 2 місяці тому +1

    So much of machine learning is not novel. It is merely "rediscovered" classical statistics approaches with a new marketing language. The example he shows at the end is essentially principal components using correlation instead of covariance because 2 metrics have vastly different variances or scales.

  • @elotimmi4942
    @elotimmi4942 7 місяців тому

    I just love your channel name so much

  • @TranquilSeaOfMath
    @TranquilSeaOfMath Рік тому +1

    Very nice explanation and demonstration. Good topic.

  • @arijitRC473
    @arijitRC473 2 роки тому +1

    Great to see you back bro ! ✌️

  • @Hitman1Sniper
    @Hitman1Sniper 2 роки тому

    So glad to see you back !

  • @lenko_me
    @lenko_me Рік тому

    Very nice video! Everything became clear as soon as I watched this

  • @Nandini-Maharaj
    @Nandini-Maharaj 4 місяці тому

    such an informative video! good work!!

  • @simonebonato5881
    @simonebonato5881 Місяць тому

    Beautiful video! Thanks!

  • @JKrlo999
    @JKrlo999 4 місяці тому

    Saludos desde Perú, Excelente tus videos! gracias! éxitos.

  • @amitkarmakar1684
    @amitkarmakar1684 5 місяців тому

    can you please make a video on PQN normalization?

  • @hawardizayee3263
    @hawardizayee3263 Рік тому

    May I ask about the technologies that have been used to create this content ?
    I really appreciate sharing.

  • @gustavofoss2280
    @gustavofoss2280 День тому

    unrelated question, how do you animate your videos??

  • @ashraf_isb
    @ashraf_isb 11 місяців тому

    sir olease make more videos, your sessions are very helpful

  • @sailakshmicholanilath9794
    @sailakshmicholanilath9794 8 місяців тому

    Thanks to you I understood why feature scaling is imp, thank legend

  • @paulowiz
    @paulowiz 3 місяці тому

    Really nice explanation

  • @ramblingsofadegenerate1174
    @ramblingsofadegenerate1174 7 місяців тому

    Great explanation boss helped a lot chaliye jaao guru

  • @Skandawin78
    @Skandawin78 10 місяців тому

    great video, to the point with great visuals, subscribed.. Btw, how did you make these nice graphics?

    • @Skandawin78
      @Skandawin78 9 місяців тому

      can you pls respond ?

  • @mmasa1
    @mmasa1 4 місяці тому

    wow bro, this was really really good. Thank you soo much.

  • @jb_makesgames2264
    @jb_makesgames2264 2 роки тому +3

    Good video - your description and explanation is good. However relating the basic explanations to real world problems would be helpful for users. Also using a partial distribution to calculate things such as volatility based on only the negative change is interesting. Also using curve fitting of data to determine parameters for trading and models is also interesting

  • @arhammonds4492
    @arhammonds4492 5 місяців тому

    Wow - what an incredibly helpful video; thank you.

  • @kumardipayan9509
    @kumardipayan9509 2 місяці тому

    Superb explanation

  • @taha7shaikh
    @taha7shaikh 4 місяці тому

    thanks man. amazing video

  • @aditi3601
    @aditi3601 2 роки тому +1

    Absolutely loved the explanation!

  • @Akwjbwbqm
    @Akwjbwbqm 7 місяців тому

    Great lesson! Thank you so much for you video

  • @thomasbates9189
    @thomasbates9189 Рік тому

    High quality content. Thank you!

  • @NiceHirwa
    @NiceHirwa 7 місяців тому

    WOWW! Absolutely loved this! Thanks

  • @valerionetophdcandidate
    @valerionetophdcandidate Рік тому

    Very good. I have a doubt. I would love to hear your comment on it.
    In recent months, I have been reflecting on the apparent prevalence of certain predatory mega-journals, in particular MDPI's Sustainability, which stands out as the journal with the most publications on various topics, according to various tourism bibliometrics. However, this observation has led me to consider the need for further analysis.
    Specifically, it has caught my attention that when using the percentage of publications in relation to the specific research topic in percentage terms (number of articles on a topic divided by the total number of articles published), the magnitude of the contribution decreases drastically. To illustrate this point, let me present a hypothetical example:
    Journal A has published 10 articles on prospect theory in the last five years, but its total output is 600 articles.
    In comparison, Journal B has published 25 articles on prospect theory in the same period, but its total publication volume exceeds 49,000 articles.
    Some bibliometrics would say that Journal B is the one that publishes the most, however, it is just a matter of gaining by quantity. I gave the journals weights based on their percentages (Weight of journal = Percentage of Journal / Highest Percentage among journals) then I did the min-max normalisation (Normalised weight = (Weight of Journal−Min Weight) / (Max Weight−Min Weight)), Then I created a Weighted Metric with Normalisation (multiplying the normalised * their weight). The use of min-max normalisation in this one is correct? Do you think there is a better approach?

  • @DennisKorolevych
    @DennisKorolevych Рік тому

    Jesus, thats so great. Im totally new to data science and ML and Im trying to take it slow to properly understand everything. This video was super great in doing that. I picked up new knowledge that will be helpful for when Im writing my own ML algorithm (probably KNN based image classfication)

  • @NathanCats777
    @NathanCats777 Рік тому +2

    Hi there thanks a lot! I have one question on min-max normalization as I m using Stata. When I use the formula, shall I take into consideration the actual min and max values of the variable, or I should consider the potential/feasible range of values the variable can assume? E.g. I have one variable that can take values -100,+100, yet in my dataset the min is -12 and the max is 34.

  • @ingrid88
    @ingrid88 5 місяців тому

    thank you so much for this!

  • @suyogshinde9050
    @suyogshinde9050 2 роки тому

    Good that you are back!😎

  • @brianthomas9148
    @brianthomas9148 2 роки тому +1

    could you please tell me what software you used for these visualizations

  • @arnobbaiga318
    @arnobbaiga318 5 місяців тому

    Hello brother. If i have given a time scale for a Analysis. Can i use this time scale to normalize my analysis time?

  • @farhanfaiyaz8471
    @farhanfaiyaz8471 Рік тому

    Hey! I wanted to know which software/ tools you used to make videos like this?

  • @Steve-ey9ws
    @Steve-ey9ws 4 місяці тому

    Love it when you have on your glasses

  • @rouanemouaad
    @rouanemouaad Рік тому +1

    Thanks man for the video. this was with no doubt very helpful.
    however i was wondering how do you make all these animations ?
    Thanks in advance for you kindness.

  • @NicolasRicaurte-l1g
    @NicolasRicaurte-l1g 5 місяців тому

    I LOVE YOUR VIDEOS

  • @analyticseveryday4019
    @analyticseveryday4019 2 роки тому

    extremely beautiful viz , teaching methodology is amazing too. I too run ana analytics channel, but u inspired me more

  • @devonrd
    @devonrd 7 місяців тому

    Great video!

  • @xeniosm4549
    @xeniosm4549 Рік тому

    Hi. For deep learning, it best to do min-max normalization (i.e. stretch values to 0-1) or max normalization (i.e. only divide by max to keep within 0-1)? I see a problem with the former approach, as a single outlying value can significantly skew all the rest of the values, making them not very comparable to the reference values.

  • @fosheimdet
    @fosheimdet Рік тому

    Great videos! May I ask what software you use to create your equations/animations?

    • @neha4206
      @neha4206 Рік тому

      I think he uses manim

  • @nipunikalnu8645
    @nipunikalnu8645 10 місяців тому

    what software do you use for animations?

  • @736939
    @736939 2 роки тому

    Please add NLP course.

    • @NormalizedNerd
      @NormalizedNerd  2 роки тому +1

      Hey, have you checked this playlist?
      ua-cam.com/play/PLM8wYQRetTxCCURc1zaoxo9pTsoov3ipY.html
      Feel free to suggest more topics!

  • @DeathlessLife786
    @DeathlessLife786 2 роки тому

    An excellent explanation...Thanks a lot for sharing ....

  • @Anagha-pm3fu
    @Anagha-pm3fu 7 місяців тому

    do you use manim?

  • @kienchung8189
    @kienchung8189 10 місяців тому

    coolest presentation!

  • @craftbalika3568
    @craftbalika3568 2 роки тому +1

    Great to get back nerdy notifications...

  • @vmkkannan
    @vmkkannan Рік тому

    Good Explaintion... thank you very much 😊😊😊😊😊😊

  • @JackSee-wr3le
    @JackSee-wr3le Рік тому

    Excellent visuals!

  • @syifasyuhaidahazman2384
    @syifasyuhaidahazman2384 2 роки тому

    love it. thanks so much for the explanation

  • @matheusalvessoaresdecarval1834

    i'm new to machine learning and theres something i dont quite understand:
    if you scale the X(input), does it affect the Y(output)? In a real life scenario where i want to make a prediction with my model, wont the scalling affect the results? if i shrink the input wont the output also be smaller?

    • @yamanarslanca8325
      @yamanarslanca8325 Рік тому

      By looking at what you are saying: No, I don't think so (don't take my word though, I am new at ML). I'd say your weights will be computed accordingly. But I read that even scaling your outputs (before the training) is a thing, there are people who do that.

  • @roshantonge1952
    @roshantonge1952 Рік тому

    How can you so perfect in explaining

  • @brianthomas9148
    @brianthomas9148 2 роки тому +1

    Your explanation was damn neat!

  • @Ruhsaran
    @Ruhsaran Рік тому

    Excellent! Thanks.

  • @memelol1859
    @memelol1859 2 роки тому

    Omggggg ur back!!!

  • @mohammadzeeshan992
    @mohammadzeeshan992 2 роки тому

    Good video, content animation are amazing.

  • @deborahfranza2925
    @deborahfranza2925 Рік тому

    AWESOME VIDEO TYSM YOU'RE AWESOME

  • @sabastianmoore8467
    @sabastianmoore8467 Рік тому

    Love the sound effects! lol

  • @ryguywy
    @ryguywy Рік тому

    excellent visualization, thanks!

  • @rajarshimaity6838
    @rajarshimaity6838 18 днів тому

    Good Old Maths... Man i miss it..😍

  • @AmNotLegend
    @AmNotLegend 4 місяці тому

    good explanation

  • @alextonev4145
    @alextonev4145 6 місяців тому

    Thank you!

  • @shivanigawande4953
    @shivanigawande4953 2 роки тому

    Yayyyyy! Thanks for an amazing video.

  • @benradmer7668
    @benradmer7668 6 місяців тому

    Can someone here help me with my data preprocessing project or know where i can find help? I am so stuck and cant get over 70%. i really wann do well but dont really know what else do in preprocessing

  • @ramiltaghiyev9712
    @ramiltaghiyev9712 5 місяців тому

    great video

  • @niheltouil7513
    @niheltouil7513 6 місяців тому

    thank you so much

  • @ritira20mila
    @ritira20mila 2 роки тому

    Sorry, I can't understand at 3:10 : Good old [what?] algorithm

  • @tanvirhasanmonir1627
    @tanvirhasanmonir1627 Рік тому

    Very helpful

  • @donghyunlee-zg8hx
    @donghyunlee-zg8hx Рік тому

    2:15

  • @vmendesmagalhaes
    @vmendesmagalhaes Рік тому

    I really hope you are fine now. Your videos helped me a lot in several times. Easily you could be a teacher if you want to. Thanks!

  • @tim_faith
    @tim_faith Рік тому

    thank you

  • @shrinivassampathmuthupalan8283
    @shrinivassampathmuthupalan8283 2 роки тому

    Well explained.

  • @DaniilKanaki
    @DaniilKanaki 6 місяців тому

    Amazing explanation! Thank you.
    The datasets get normalized just like the speaker! (a joke, couldn't help it)

  • @buildlackey
    @buildlackey 10 місяців тому

    superb !

  • @Vikram-wx4hg
    @Vikram-wx4hg 2 роки тому

    Very nice!

  • @lampeve
    @lampeve 7 місяців тому

    You are the best!

  • @cyberpunk_edgerunners
    @cyberpunk_edgerunners 2 роки тому

    thanks bro

  • @S.G.2
    @S.G.2 7 місяців тому

    yes ty

  • @user-wr4yl7tx3w
    @user-wr4yl7tx3w 2 роки тому

    Excellent!

  • @orrin-manning
    @orrin-manning 29 днів тому

    Raise your camera so that you’re not looking down on us

  • @avranj
    @avranj Рік тому

    Bro, but how can we decide which technique to use when? and if selecting normalization then which normalization such as----min-max etc.....? could you please elaborate this.

  • @_dion_
    @_dion_ 6 місяців тому

    excellent.

  • @anilkumarsharma8901
    @anilkumarsharma8901 6 місяців тому

    Noor and malai become normalization 😂😂😂since noor and malaise are top by nature 👌 😂😂

  • @narangfamily7668
    @narangfamily7668 5 місяців тому

    Amazing amazing amazing!!!!!

  • @suyashrahatekar4964
    @suyashrahatekar4964 9 місяців тому

    blud comes after 1 year and does not come back even after another year gone past .