Meerkat Statistics
Meerkat Statistics
  • 137
  • 613 888
GAM - Penalized Least Squares
In this video we explore penalized least squares for Additive Models and penalized IRLS for Generalized Additive Models (GAMs). We'll see how using splines and basis expansions can lead to a simpler solution that replaces the backfitting algorithm.
Переглядів: 119

Відео

GAM - Splines - Natural Cubic Spline, Smoothing Splines
Переглядів 138Місяць тому
This video focuses on natural cubic splines, which are linear at the edges to reduce variance. We'll see how to derive them from the power-series representation and try to understand the new representation. We'll also introduce smoothing splines and show that natural cubic splines are the smoothest interpolators. Lastly, we'll touch on the use of splines in computer graphics for drawing smooth ...
GAM - Splines - Intro (Polynomials, Piecewise Polynomials, Splines)
Переглядів 229Місяць тому
In this video, we introduce splines, a popular method for fitting nonlinear functions in additive models and GAMs. Splines are a compromise between global and piecewise polynomials, they allow for the function to break at several locations called "knots", which unite different parts of the curve.
GLM vs. GAM - Generalized Additive Models
Переглядів 937Місяць тому
Additive and Generalized Additive models differ from LM/GLMs in the way they relate the mean to the x predictors. While G/LMs assume a linear model in x, G/AMs allow for any function approximation that captures the structure between mu (or g(mu)) and x. In this video we will also learn about the backfitting algorithm which is a general method for fitting G/AMs. In a future video we will talk ab...
Regression Diagnostics (2/2) - Generalized Linear Models - Residuals, QQ-plot, Outliers
Переглядів 1962 місяці тому
In this video we will look at how we can diagnose our generalized linear model fit using residuals, QQ-plots and Cook's distance. We will see how to adjust the residuals and hat-matrix of linear regression to apply also to GLMs. Become a member and get full access to this online course: meerkatstatistics.com/courses... * 🎉 Special UA-cam 60% Discount on Yearly Plan - valid for the 1st 100 subsc...
Regression Diagnostics (1/2) - Linear Models - Residuals, QQ-plot, Outliers
Переглядів 2272 місяці тому
In this video we will look at how we can diagnose our linear regression fit using residuals, QQ-plots and Cook's distance. Become a member and get full access to this online course: meerkatstatistics.com/courses... * 🎉 Special UA-cam 60% Discount on Yearly Plan - valid for the 1st 100 subscribers; Voucher code: First100 🎉 * “GLM in R” Course Outline: Administration * Administration Up to Scratc...
GLM - Multinomial Regression (3/3) - Ordinal Data (Cumulative Link)
Переглядів 2123 місяці тому
In this video we will go in depth about ordinal response (y) data and see how we can model it using the cumulative link approach. Alan Agresti's Book: shorturl.at/aHY79 Gordon Smyth's paper: gksmyth.github.io/pubs/edm-gna.pdf Become a member and get full access to this online course: meerkatstatistics.com/courses... * 🎉 Special UA-cam 60% Discount on Yearly Plan - valid for the 1st 100 subscrib...
GLM - Multinomial Regression (2/3) - Nominal Data (Baseline Category)
Переглядів 2223 місяці тому
In this video we will go in depth about nominal response (y) data, and see how we can model it using the baseline category approach. Alan Agresti's Book: shorturl.at/aHY79 Gordon Smyth's paper: gksmyth.github.io/pubs/edm-gna.pdf Become a member and get full access to this online course: meerkatstatistics.com/courses... * 🎉 Special UA-cam 60% Discount on Yearly Plan - valid for the 1st 100 subsc...
GLM - Multinomial Regression (1/3) - Intro
Переглядів 3013 місяці тому
In this video we will look into multinomial regression, and give an introduction to the topic, including a reminder of the categorical and multinomial distributions. In the next two videos we'll go in depth to the two types of models used for nominal and ordinal response (y) data. Alan Agresti's Book: shorturl.at/aHY79 Gordon Smyth's paper: gksmyth.github.io/pubs/edm-gna.pdf Become a member and...
Is war a war crime? (Israel-Hamas war 6 months analysis)
Переглядів 3033 місяці тому
Is war a war crime? (Israel-Hamas war 6 months analysis)
Trees - Weights and Feature Importance (Theory + Code)
Переглядів 3696 місяців тому
How can we incorporate weights into trees? How can we get feature importances? Trees Playlist: bit.ly/MeerkatStatisticsTrees Become a member and get full access to this online course: meerkatstatistics.com/courses/decision-trees/ 🎉 Special UA-cam 60% Discount on Yearly Plan - valid for the 1st 100 subscribers; Voucher code: First100 🎉 "Decision Trees" Mini Course Outline: * Course Materials * I...
Accelerated Failure Time (AFT) vs. Cox Proportional Hazards (CoxPH)
Переглядів 1,6 тис.7 місяців тому
Accelerated Failure Time (AFT) vs. Cox Proportional Hazards (CoxPH)
Accelerated Failure Time (AFT)
Переглядів 1,4 тис.7 місяців тому
Accelerated Failure Time (AFT)
2 Examples - Mixed vs. Regular Models
Переглядів 6597 місяців тому
2 Examples - Mixed vs. Regular Models
Cost Complexity Pruning (Theory + Code)
Переглядів 1,8 тис.7 місяців тому
Cost Complexity Pruning (Theory Code)
Build a Decision Tree from scratch using Python (numpy)
Переглядів 4477 місяців тому
Build a Decision Tree from scratch using Python (numpy)
Decision Trees - Stop Criteria, Categorical Data, NA's, Implementation
Переглядів 2477 місяців тому
Decision Trees - Stop Criteria, Categorical Data, NA's, Implementation
Decision Trees - Split Criteria
Переглядів 4258 місяців тому
Decision Trees - Split Criteria
Decision Trees
Переглядів 1938 місяців тому
Decision Trees
Quantile Regression - Numerical Solutions
Переглядів 1,1 тис.8 місяців тому
Quantile Regression - Numerical Solutions
Quantile Loss
Переглядів 2,3 тис.8 місяців тому
Quantile Loss
Linear vs. Quantile Regression
Переглядів 6 тис.8 місяців тому
Linear vs. Quantile Regression
Israel vs. Palestine - The October 7 Massacre
Переглядів 7419 місяців тому
Israel vs. Palestine - The October 7 Massacre
R vs Python - 25 Coding Differences
Переглядів 1,5 тис.9 місяців тому
R vs Python - 25 Coding Differences
Survival Analysis - Cox PH - Breslow Estimator
Переглядів 71411 місяців тому
Survival Analysis - Cox PH - Breslow Estimator
Survival Analysis - Cox PH - Partial Likelihood
Переглядів 1,4 тис.11 місяців тому
Survival Analysis - Cox PH - Partial Likelihood
Survival Analysis - Cox Proportional Hazards
Переглядів 98911 місяців тому
Survival Analysis - Cox Proportional Hazards
Exploratory FA Code in R (psych)
Переглядів 673Рік тому
Exploratory FA Code in R (psych)
CFA - Code Example in R (lavaan)
Переглядів 903Рік тому
CFA - Code Example in R (lavaan)
SEM - Code example in R (lavaan package)
Переглядів 897Рік тому
SEM - Code example in R (lavaan package)

КОМЕНТАРІ

  • @tassangherman
    @tassangherman 17 годин тому

    You're awesome !

  • @ykoy1577
    @ykoy1577 День тому

    very nice video!

  • @radimnovotny6534
    @radimnovotny6534 3 дні тому

    Thanks so much for this great video. It helped a lot

  • @prateekyadav9811
    @prateekyadav9811 3 дні тому

    Thanks so much brother! I was struggling with this so much. I am following NNs from scratch book by Sentdex and I was stuck at the derivative of softmax because I was not able to understand the notations. Now, I understand that the j=k is referring to the diagonal elements of the gradient matrix :) Thanks

  • @petergorelov6852
    @petergorelov6852 4 дні тому

    Dear David. I want to create generator that will give me the random value - lifespan of healthy human. So we can call it “Gompertz distribution” generator. I need it for learning purpose. So the random lifespan =e^(b0+E). b0= const, E -random value of extremal distribution. Which value of b0 you can recommend? Can you also advise the way for creating extremal distribution generator? I have a ready-made normal distribution generator. It can be used to make an extreme distribution generator. You need to take a sample of size n and take a smaller number from it. Am I right? Which mean and sigma of the normal distribution generator should I take? And what is the sample size to take?

    • @MeerkatStatistics
      @MeerkatStatistics 3 дні тому

      Hey, I would either use the built in Gompertz generator in the VGAM library in R, or use inverse transform sampling: en.wikipedia.org/wiki/Inverse_transform_sampling which only requires sampling from a uniform distribution in [0.1]. I explain this method here: ua-cam.com/video/EyUVj3eeXyA/v-deo.html. Good luck.

    • @petergorelov6852
      @petergorelov6852 3 дні тому

      ​@@MeerkatStatistics , I know that there are other ways to create this generator. But my goal is to create it by using this equition "lifespan =e^(b0+E)" (it is a part of education). And for some reason I cant find acceptable coeeficient b0 and parameters for extremal distribution. I try , but my final result doesnt look like “Gompertz distribution”. Maybe you can help?

  • @HermanFranclinTESSOTASSANG
    @HermanFranclinTESSOTASSANG 4 дні тому

    You are the best. Thank you very much for all your course I really enjoy watching each of them.

  • @钟嘉蕾
    @钟嘉蕾 9 днів тому

    for question2, if a1=Wa0, the columns of W can learn something during training and become different but the rows of W are the same to each other

  • @caty863
    @caty863 13 днів тому

    Pandas should be included in base Python. Any language that wants to call itself worthy of data analytics has to have a built-in dataframe data structure.

  • @tommasomenghini1647
    @tommasomenghini1647 19 днів тому

    Bro you’re so good, thanks man!

  • @navintiwari
    @navintiwari 27 днів тому

    Ah! Finally a good and to the point explanation after searching so much on UA-cam. Thankyou! You have a new subscriber now.

  • @pectenmaximus231
    @pectenmaximus231 Місяць тому

    Beautiful presentation. So clear and informative!

  • @piero8284
    @piero8284 Місяць тому

    There are some mistakes in your notes

    • @MeerkatStatistics
      @MeerkatStatistics Місяць тому

      can you point them out?

    • @piero8284
      @piero8284 Місяць тому

      @@MeerkatStatistics sure. At 3:05, the joint distribution should be written in terms of the transformed variables as p(x,ξ)p(x,ξ), assuming T(θ)=ξT(θ)=ξ is your transformed variable. I don't blame you, as in the paper, the authors omitted a small detail in writing the ELBO of the original variable as the ELBO of the new one

  • @danieledrisian9972
    @danieledrisian9972 Місяць тому

    I love this, thank you! Very clear explanation.

  • @kebenny
    @kebenny Місяць тому

    Thanks for introducing GAM, need you watch several times to understand

  • @anglonrx2754
    @anglonrx2754 Місяць тому

    Gauss didn't invent the linear model; he just claimed to a decade after someone else had. The same is true for Gaussian elimination. Newton invented it, and then Gauss decided to name it after himself.

  • @MisterDives
    @MisterDives Місяць тому

    Loving the spline / GAM series, thank you!

  • @cheikhsadibousidibe1434
    @cheikhsadibousidibe1434 Місяць тому

    First, the conflict did not begin on October 7th. You have been oppressing Palestinians since your illegal occupation, starting with the massacre of Karbala. You take pride in the killing of thousands of children since then. You even bombed a civilian camp where you told people to go to suffer less, only to slaughter them in the middle of the night. How dare you, coward.

  • @mohamedrefaat197
    @mohamedrefaat197 Місяць тому

    Very clear and concise! Looking forward for the follow up video

  • @DelhiiteChetan
    @DelhiiteChetan Місяць тому

    So much information compiled together wonderfully in this video.Hope you come up with more such videos on individual methods with some examples.

  • @whytape301
    @whytape301 Місяць тому

    IMHO, symmetrical or not, the mean is still your expected value. If you want to minimise error, you can only work with the expectation, since that's what you can expect. If you optimised for something else, you may use the mode or whatever else that fits the optimization.

  • @marcospiotto9755
    @marcospiotto9755 2 місяці тому

    What is the difference between denoting p_theta (x|z) vs p(x|z,theta) ?

    • @MeerkatStatistics
      @MeerkatStatistics 2 місяці тому

      I think "subscript" theta is just the standard way of denoting when we are optimizing theta, that is we are changing theta. While "conditioned on" theta is usually when the theta's are given. Also note that the subscript theta refers to the NN parameters, while often the "conditioned on" refers to distributional parameters. I don't think these are rules set in stone, though, and I'm not an expert in notation. As long as you understand what's going on - that's the important part.

    • @marcospiotto9755
      @marcospiotto9755 2 місяці тому

      @@MeerkatStatistics got it, thanks!

  • @farhanshadiquearronno7453
    @farhanshadiquearronno7453 2 місяці тому

    Just wanted to say Thank You !!! Very well explained & so much intuitive 👍

  • @sophia17965
    @sophia17965 2 місяці тому

    at 3:30 , i dont understand why ez1 + ez2 + ez 3 = 1 can someone please explain? thanks

    • @MeerkatStatistics
      @MeerkatStatistics 2 місяці тому

      because they are also divided by the exact same number... so it turns into 1.

    • @sophia17965
      @sophia17965 2 місяці тому

      @@MeerkatStatistics oh 🤦‍♀🤦‍♀duh. Thanks

  • @BalajiChegu
    @BalajiChegu 2 місяці тому

    Great vid. Can you please share that notebook ?

  • @mazensaaed8635
    @mazensaaed8635 2 місяці тому

    for question 1 : it won't be a problem and the network will learn normally because the inputs to the neurons will not be zero or constant since we initialized the weights to be random so the biases will get updated normally. for question 2 : since the inputs to the network are different the deriviative of the output with respect to the wight will not be constant or zero so this weights in the first layer(input) will be updated normally.

  • @mazensaaed8635
    @mazensaaed8635 2 місяці тому

    Thnak you so much , very good explanation

  • @pedrocolangelo5844
    @pedrocolangelo5844 2 місяці тому

    This video is everything I asked for! Thank you so much, Meerkat!

  • @raltonkistnasamy6599
    @raltonkistnasamy6599 2 місяці тому

    thank u so much brother

  • @raltonkistnasamy6599
    @raltonkistnasamy6599 2 місяці тому

    thanka man

  • @ML_n00b
    @ML_n00b 2 місяці тому

    do you have any more tips and tricks for regular linear models?

  • @ML_n00b
    @ML_n00b 2 місяці тому

    very useful video for practitioners

  • @jamalnuman
    @jamalnuman 3 місяці тому

    many thanks for the lecture. we all the time need to know how the factors are calculated from the variables. but how come the factors and their loading can be calculated given that the only given data is the variables? x1=l1f1 + l2f2 + l3f3

  • @paulluc5070
    @paulluc5070 3 місяці тому

    Islam always brings hate and war!!

  • @aza6513
    @aza6513 3 місяці тому

    Wow, will you cover nested logit model? And relationship with gev or vglm

  • @includestdio.h8492
    @includestdio.h8492 3 місяці тому

    Thank u so much!

  • @메호대전
    @메호대전 3 місяці тому

    I was always perplexed by the two different views of seeing linear regression as a fixed viewpoint and a random viewpoint. Now everything is clear: the two viewpoints correspond to the OLS and MLE methods. What a wonderful explanation you provided!

  • @메호대전
    @메호대전 3 місяці тому

    It is the best lecture that I have watched on UA-cam. Thanks.

  • @yanyanxu6339
    @yanyanxu6339 3 місяці тому

    When I run the code with corstr = "AR-M", Mv=1, it shows error message "VC_GEE_covlag: arg has > MAX_COVLAG rows". I don't know why it is

  • @emmanuelandre2807
    @emmanuelandre2807 3 місяці тому

    Le monde made a great video too : 60 % des écoles, hôpitaux et mosquées détruits ou endommagés. There are subtitles

  • @emmanuelandre2807
    @emmanuelandre2807 3 місяці тому

    ua-cam.com/video/soQ-VlaHt88/v-deo.html

  • @emmalopezprado3903
    @emmalopezprado3903 3 місяці тому

    Hi! Really helpfull video, I loved it. However, I still don´t really undertand how the AFT model works. I desperately need to comprehend it because I am doing a proyect about it and I have to finish it in order to finish my degree. Could we contact somehow in order for you to explain me the model? I am Spanish so sorry if there are spelling mistakes. Thank you very much!

    • @MeerkatStatistics
      @MeerkatStatistics 3 місяці тому

      I can give you a private class. Contact me via david@meerkatstatistics.com

  • @stazizov
    @stazizov 3 місяці тому

    Could you please tell me if there is a mistake in the notation? @8:26 z_{i} = z_{l}?

    • @MeerkatStatistics
      @MeerkatStatistics 3 місяці тому

      Hey, yes of course. Sorry for the typo.

    • @stazizov
      @stazizov 3 місяці тому

      ​@@MeerkatStatistics Thank you so much) Great video!!! 🔥

  • @hafizzz
    @hafizzz 3 місяці тому

    Imagine thousands of people in your time being killed and people put out videos like this trying to justify those killings as not being a big deal enough to be considered within their benchmark of what's considered a genocide or not.

    • @MeerkatStatistics
      @MeerkatStatistics 3 місяці тому

      Yeah, war is tragic. But can we at-least admit that it's not a genocide? Imagine your enemy slaughtering entire villages, then when you attack back uses propaganda tools to try and convince the world that it's actually your fault, because you're an "apartheid state" that commits "genocide", in order to put world pressure on you to stop the war, and let them stay in power, just so they can attack you again in the future. Do you think this will stop the conflict? Do you think this will not lead to more thousands of dead?

  • @jakeaustria5445
    @jakeaustria5445 3 місяці тому

    So good, I am familiar with 20% here. Probability, Statistics,Algebra of Random Variables, and Time Series Analysis.

  • @chriss2452
    @chriss2452 3 місяці тому

    Thanks for speaking facts.

  • @arunparit9199
    @arunparit9199 3 місяці тому

    Radical islam is always a trouble, the basic point is - Israel has a right to defend themselves, war is inevitable if the atrocity as for this particular war started by Hamas. So why cant they defend themselves?

    • @AbdulHamid-gx4dv
      @AbdulHamid-gx4dv Місяць тому

      it is, but islam had been long almost dead until the early 19 th century. the existence of Israel resurrected the religion. We could have had a world without islam growing anymore, but Israel made sure it never dies because its existence depend entirely on the existence of Islam as the greater evil in the region. In a world without Islam, why would anyone support the existence of Israel?

  • @Fedayeen77
    @Fedayeen77 3 місяці тому

    Is this video actually real?

  • @foziakhan7680
    @foziakhan7680 3 місяці тому

    😂😂😂- Joker or just Inhumane

  • @yaramarei4853
    @yaramarei4853 3 місяці тому

    I agree that you are the hero’s of false justifications

  • @aryanapologetics
    @aryanapologetics 3 місяці тому

    🥱🥱