Log Transformation for Outliers | Convert Skewed data to Normal Distribution

Поділитися
Вставка
  • Опубліковано 23 жов 2024

КОМЕНТАРІ • 33

  • @TheAIUniversity
    @TheAIUniversity  5 років тому +1

    What are the other techniques
    I can use to treat outliers or convert negative or positive skewed data into normal distribution form?

    • @nabeelnaseer5592
      @nabeelnaseer5592 5 років тому +1

      roots, exponents, inverse methods..

    • @nizamlootera3163
      @nizamlootera3163 4 роки тому

      In Linear Regression suppose both the variables or features are positively skewed, then we should apply log10 to both of them

    • @XuanTran-ri1hn
      @XuanTran-ri1hn 2 роки тому

      How about log 1 plus?

  • @nabeelnaseer5592
    @nabeelnaseer5592 5 років тому +2

    What can we do if even after the transformation, there are outliers..am kinda puzzled over this notion of natural outliers. Like we are supposed to treat them separately.. can you give some pointers..

  • @mansirawat1052
    @mansirawat1052 Рік тому

    Suppose in one of my outcome measures pre is normal but post is not normal, so should I log transform only the post recording or should I transform both the pre and post values for further analysis?

  • @ajaykushwaha-je6mw
    @ajaykushwaha-je6mw 3 роки тому

    Sir what is the correct sequence of variable transformation.
    First we need to do feature scaling then Gaussian transformation or First Gaussian transformation then feature scaling ?

  • @balamurali75
    @balamurali75 2 роки тому

    Sir small dout I have two variables(independent and Dependent) represented in percentage. If I apply log for only one variable. Will result differs. Is it the correct way of transformation/analysis

  • @pallavijagtap8140
    @pallavijagtap8140 3 роки тому

    Pallavi Jagtap
    1 second ago
    Sir, Once you transform the variables, do we have to use same transformed columns in further process of modelling?

  • @creativesurgeinfidel
    @creativesurgeinfidel 3 роки тому

    Thank you.. Could you please let me know how to convert natural log back to the original value

  • @vinayvvalaboju
    @vinayvvalaboju 2 роки тому

    Can you fix a custom bin And filter data til upper quartile.

  • @aakashv4594
    @aakashv4594 4 роки тому +1

    What are the functions to be applied for negative skews and also if the data has zero

  • @pallavijagtap8140
    @pallavijagtap8140 3 роки тому

    Sir, Once you transform the variables, do we have to use same transformed columns in further process of melling?

  • @durgadeviarulrajan4560
    @durgadeviarulrajan4560 2 роки тому

    Hi, Thanks for the great video. Is it necessary to convert all features into normally distributed, before modeling? Is it a compulsory step to follow in feature engineering?

    • @usmanriaz6241
      @usmanriaz6241 Рік тому

      It confuses me too. tell me if you know now

  • @amitbudhiraja7498
    @amitbudhiraja7498 2 роки тому

    I have a doubt like what is the optimal method to do remove the outliers [Z-score , IQR method] or use transformation methods like log normal or inverse
    Can someone tell ?

  • @elyasmohammadi8409
    @elyasmohammadi8409 4 роки тому +1

    Hello and thank you for this nice video.
    Could you please clarify that what are the axis X and Y before and after log transformation. Thank you in advance

    • @edphi
      @edphi 2 роки тому

      Frequency distribution graph

  • @edphi
    @edphi 2 роки тому +1

    Excellent

  • @MrNabiwishes
    @MrNabiwishes 4 роки тому

    Log transformation applied to train set, and when out of sample data comes in do we apply same transformation...

  • @shrutimadan4451
    @shrutimadan4451 3 роки тому

    using log10 transformation, it didnt give normal distribution.
    How to deal with this?

  • @nikhilgaikwad9954
    @nikhilgaikwad9954 4 роки тому

    after we transformed the column values using log10. if we build a app using flask what values we should pass for that column to predict the output?? the original value or first we need to transform that value using log 10 and then insert??

    • @prathameshmistry3868
      @prathameshmistry3868 4 роки тому

      no,the values are inserted and then transformed in the code

    • @vineethp8925
      @vineethp8925 3 роки тому

      @Prathamesh Mistry can u please explain more clearly because iam also having the same doubt

  • @independent7212
    @independent7212 4 роки тому

    negatively skewed data to normal distribution?

  • @Karthik_info_vlogs
    @Karthik_info_vlogs 4 роки тому +1

    Good info

  • @aniketsultan9497
    @aniketsultan9497 5 років тому +3

    other methods square root, cube root , binning

  • @ankurkamthan5854
    @ankurkamthan5854 4 роки тому

    Why should not taken log with base e and y base 10

  • @nicholaslipanovich827
    @nicholaslipanovich827 3 роки тому

    The information you communicated to us was fine but your delivery could use some work. Trying to repeat yourself less might help.

  • @rohitjaiswal6102
    @rohitjaiswal6102 4 роки тому +1

    Can u share your github link about this codes....

    • @TheAIUniversity
      @TheAIUniversity  4 роки тому +1

      Here you go... github.com/nitinkaushik01/Machine_Learning_Data_Preprocessing_Python/find/master?q=

  • @vuminhquanle1426
    @vuminhquanle1426 4 роки тому +1

    I listened very carefully, cause I can't understand anything at 1.5x Speed

  • @fakhrik
    @fakhrik 4 роки тому

    Why do Indians have to use the word OK so much?