Introduction to Bayesian data analysis - part 1: What is Bayes?

Поділитися
Вставка
  • Опубліковано 22 гру 2024

КОМЕНТАРІ • 152

  • @pedroalonso45
    @pedroalonso45 4 роки тому +5

    It's an outrage that you are the one thanking people by the end of the video. Thank YOU!

  • @tighthead03
    @tighthead03 Рік тому +5

    This is an unreal explanation of Bayesian data analysis, thank you so much. This is the clearest and most intuitive introduction I've found, great job.

  • @not_here_any_more
    @not_here_any_more 7 років тому +33

    Nice. It's hard to find explanations of Bayesian data analysis on UA-cam that are clear and correct, and don't use Bayes rule as a rhetorical tool to make dubious assertions. This is excellent. I'll recommend this to students in my biostatistics class.
    Thank you!

  • @dostone
    @dostone 7 років тому +138

    There must be something magic going on here. I have been trying to learn Bayesian methods for countless times. This is the first time I all of the sudden understand every word the speaker says. And the learning curve? Flat!

    • @VerenaKasztantowicz
      @VerenaKasztantowicz 6 років тому +2

      His voice is very magical.

    • @ProfessionalTycoons
      @ProfessionalTycoons 6 років тому +22

      nah due you just had a very informative prior

    • @FuturesLab_TV
      @FuturesLab_TV 4 роки тому

      agreed

    • @benjay5655
      @benjay5655 3 роки тому

      Sorry to be so offtopic but does any of you know a tool to log back into an instagram account..?
      I somehow forgot the password. I would love any tips you can give me

    • @sullivancrosby1132
      @sullivancrosby1132 3 роки тому

      @Ben Jay instablaster :)

  • @Tyokok
    @Tyokok Рік тому

    God, this is the best channel of such DS and ML lecture! Thank you so much for the amazing lecture!

  • @bombaikos
    @bombaikos 4 роки тому +2

    In this clever guy’s video along with 3Blue1Brown ones I have found the best introductory explanation on the topic. Congratulations and thank you!

  • @Jess-fv2et
    @Jess-fv2et 6 років тому +10

    Genuinely one of the best and most straight forward tutorials I've found for Bayesian statistics, bless you

  • @elzaKimura
    @elzaKimura 7 років тому +16

    You are great!!! For years I have been trying to understand Bayesian data analysis and you made so easy to understand!!! Thank you very much!!!

  • @EuroPerRad
    @EuroPerRad 5 років тому +5

    Thanks a lot. Finally, I got a glimpse of how Bayesian data analysis is working.

  • @parkjessica4444
    @parkjessica4444 2 роки тому +1

    This explanation is amazing!!! I've been having a really hard time understanding the concepts and you just made it so easy to follow and understand! Thank you sooooo much! You have a great gift for teaching!

  • @A_Name_6168
    @A_Name_6168 5 років тому +3

    I too have tried to learn Bayesian analysis for a while and found you video to be the missing link I needed. Thank you Rasmus!

  • @HanaKamau
    @HanaKamau Рік тому

    Thank you so much!!!... I have been listening to other videos on this topic, but I only got more confused. This has clarified everything for me. Thank you!

  • @user-or7ji5hv8y
    @user-or7ji5hv8y 6 років тому +1

    Why can’t professors give lectures like this? This helps so much with understanding.

  • @Paul_Klimb
    @Paul_Klimb Рік тому

    man you just blew my brain. wow that was an amazing lightbulb moment, thank you so much!

  • @shengbingyu7157
    @shengbingyu7157 5 років тому

    I am so happy to find a course of Bayesian method that is easy to understand. Excellent! 😀😀😀

  • @chintanadvani1981
    @chintanadvani1981 4 роки тому

    Excellent explanation...!!!! By far the best video on you tube explaining the concepts.

  • @imrem9673
    @imrem9673 4 роки тому +1

    Indeed very nice explanation of Bayes inference, still I have a problem to interpret the posterior, first what if we start with a prior being a binomial 50% (could we? it's could be our assumption why not?) then the posterior will probably show that the leaflet with 38% signing is a disaster business choice (it lowers the willgness to sign) , the prior choice isn't skewing too strongly the inferred result? May be the presented model is simplistic we lack of a "baseline" estimation (we should take this 16 peoples and ask them before seeing the leaflet what is their signing rates for example). The thing is that the leaflet "changes" only our "belief" in the reality not the reality.

  • @mingx009
    @mingx009 3 роки тому

    Greatest lecture on Bayesisn analysis

  • @phu.hoang.nguyen
    @phu.hoang.nguyen 4 роки тому +1

    3 parts of this series about Bayesian are the best videos i found, extremely helpful for beginner. However, this is my lesson after finishing 3 parts. You should highly focus on the reasons "Why NOT use Bayesian" at the end of part 2 and think about the pros and cons, cost-benefit related to your situation. I say this because i made a big mistake, i am NOT READY for this method at this very moment. I looked up for Bayesian because of the fancy and attractive outcome of this method and i wanted to apply it to my thesis in the SHORT TERM. It is obviously impossible! In short, please learn from my mistake, make sure you are ready for Bayes

  • @Nostalgic_stupid
    @Nostalgic_stupid 5 років тому +1

    Awesome voice structure.... fantastic....superb

  • @luizvalente1982
    @luizvalente1982 3 роки тому

    I enjoyed the brazilian music you "sang" while waiting we are acessing the exercise! Great!

  • @karannchew2534
    @karannchew2534 2 роки тому

    Notes for my future revision.
    16:04 A parameter value that is more likely to generate the data we collected, is going to be proportionally more common in this blue distribution. A parameter value that is twice as likely (as some other parameter values) to generate the data we saw is roughly going to be twice as common in this blue distribution.
    Parameter value below 0.1 and above 0.8 almost never result in the data we observed.
    18:33 The Posterior Distribution is really the end product of a Bayesian analysis. It contain both information from the model and from the data. It can be used to answer all sorts of questions (e.g. Maximum likelihood estimate of the mean sign up rate, the posterior mean, the probability of a range of rate, the shortest interval aka Credible Interval that cover 90% of the probability etc.)
    17:05 Bayesian data analysis is all about representing uncertainties with probabilities.
    The sign up rate is still uncertain. But we can use the distribution to answer many questions e.g. Maximum likelihood estimate of the mean sign up rate, the poterior mean, the probability of a range of rate, the shortest interval aka Credible Interval that cover 90% of the probability etc.
    17:52 Translating the histogram to probability, we end up with a probability distribution of the likely sign up rate.
    19:09 As we used uniformly distributed Priors, this is also the parameter value that is the mostly to generate the data we observed. In classical statistic, this type of estimate is known as 'Maximum Likelihood Estimate'.
    This is why Bayesian data analysis is an extension of 'Maximum Likelihood Estimation'. If you used flat prior, you will always get maximum likelihood for free.

  • @piotralanp
    @piotralanp 7 років тому +1

    finally good video about bayessian models! man you're so great!! thank you for your work, the quality is great, and you're a great teacher! keep up good work, you've gained a subscriber!

  • @juliagschwend
    @juliagschwend 2 роки тому

    Nice introduction! Hey, I recognized you humming Tom Jobin's song "Girl from Ipanema" during exercise break. Greetings from Brazil!!!

  • @pingwang6426
    @pingwang6426 5 років тому +2

    Oh my goodness! I finally understand this. Thank you so much. You are genius!

  • @KeisOhtsuka
    @KeisOhtsuka 2 роки тому

    Thank you for 21:13 R Exercises. I did it somehow and it was great (a small point - a misspelling of the word signups in R script caused me a momentary confusion. :)

  • @karannchew2534
    @karannchew2534 3 роки тому

    Help please. At 23:09. I'm unable to relate the formula to the process that created the posterior.
    P(35%|6)∝P(35%)xP(6|35%)
    P(35%|6) is the posterior.
    P(35%) is the prior, from the uniform distribution function.
    P(6|35%) is probability of getting 6 if respond rate was 35%.
    But how does "P(35%)xP(6|35%)" relate to the process described in 13:20-16:00 (and then the codes in the exercise), which select only the results from binomial function that are 6, which then give the posterior histogram? Where/how did "xP(6|35%)" happen in the process?

  • @Skydmig
    @Skydmig 7 років тому +4

    The almost religious divide there has been (and probably still is) between Frequentism and Bayesianism was most amusely described by Andy Field in his recent book "An Adventure in Statistics: The Reality Enigma". He refers to the "Secret Philanthropic Society" as a reserved bunch of innate believers in NHST and the "Doctrine of Chance" as an underground cult waiting outside the building of the NHST believers to bring salvation for their newest initiates.
    I highly recommend reading his book, if not only for the interesting take on a piece of statistics teaching material.

  • @cliffordino
    @cliffordino 5 років тому +2

    This was super useful. I think it would've been helpful had you explained a bit more clearly why 55% was chosen as a prior given that the marketing manager had already completed a polling exercise and found a different %age. Anyways, nicely done. Heading over to DataCamp now. Thanks so much for what you are doing to help demystify Bayesian.

    • @Logic807
      @Logic807 11 місяців тому

      No reason. Could have use another. So many uncertain stuff plugging in....scary

  • @gzitterspiller
    @gzitterspiller 4 роки тому

    When you simulate data, you need some kind of tolerance to compare the generated sample against the real sample, in your example it's a discrete stuff but if you have a distribution it gets tricky.

  • @kirokiro7412
    @kirokiro7412 Рік тому

    Great video🎉.....
    With a uniform distribution at start is this a beta distribution

  • @andreneves6064
    @andreneves6064 6 років тому +22

    Did you sing "Girl from Ipanema"?

  • @denisbaranoff
    @denisbaranoff 5 років тому

    Excellent explanation from excellent country

  • @MS-vl8qe
    @MS-vl8qe 4 роки тому

    Now I can picture the model in my head - super helpful! Thank you so much!

  • @wiama
    @wiama 5 років тому +3

    video on Gaussian Process and Bayesian Optimization please 🙏🏻🙇🏻

  • @dranujtiwari
    @dranujtiwari 3 роки тому

    You are an amazing teacher.

  • @goldfe016
    @goldfe016 7 років тому

    Good lecture. I've studied the Bayes theorem nowadays. It is another good lecture for me. I'm looking forward to next videos.

  • @alexanderkoc2591
    @alexanderkoc2591 7 років тому +2

    Really really good video. Thank you for spending the time on creating this!

  • @devonk298
    @devonk298 6 років тому

    These 3 videos are the best!! What great explanations you have given here. ty

  • @satter87henne
    @satter87henne 6 років тому +1

    great intro. Thanks Rasmus for these three videos!

  • @julianapereira8070
    @julianapereira8070 4 роки тому

    This was amazing. Thank you very much for making this accessible to us, mere mortals, in a fun way, easy to understand :)

  • @madakhseham
    @madakhseham 4 роки тому

    Thanks a lot. I think this one video says it all about Bayesian in core

  • @wilsonne6
    @wilsonne6 5 років тому +1

    I have always been allergic to numbers and maths but now it is making sense.Thank you author

  • @willianherreira7314
    @willianherreira7314 5 років тому

    Thanks Rasmus, indeed you developed a great content and teaching method.

  • @coolshoos
    @coolshoos 5 років тому

    Very interesting. Is the "maximum likelihood estimate" the same thing as dividing 6/16 from the sample?

  • @kyxax
    @kyxax 6 років тому +2

    Excellent explanation. What material (books, courses) would you advice to deeper understand the Bayesian DA but with explination as clear as yours?

  • @marshalljordan2416
    @marshalljordan2416 3 роки тому

    A great into to BAYES data analysis. Now, finally, the fog of confusion is clearing and I begin to think Bayesian.

  • @escargot8854
    @escargot8854 5 років тому +2

    for a shortcut: the rbinom function is vectorized so you can vastly improve on time by removing the loop. "sim_data

  • @iloveno3
    @iloveno3 6 років тому +1

    At 10:50 how does he get that 7 out 16 people sign.up?

  • @bernsbuenaobra473
    @bernsbuenaobra473 3 роки тому

    Two very important decisions and assumptions first to start with the math model to assume for a generative model and the most likely PDF for the prior this will form the simulator. The second step is to perform the simulation and collect simulated data. Filter the results so that those results are picked based on the actual survey result. The way the problem was attacked and demonstrated is entirely unique from the so many people who tried to explain it as clear as mud. Now let me figure it out when there are like multivariate.

  • @pedrocolangelo5844
    @pedrocolangelo5844 3 роки тому

    "... and it is targeted at you who isn't necessarily that well-versed in probability theory and statistics..."
    I think that it is everything that someone who comes to this kind of video hopes to listen.

  • @hardware8188
    @hardware8188 6 років тому

    I am studying machine learning, and the term Bayesian analysis always appears in the papers that I read. I failed to understand it for quite a while, but you video explains everything I want to know. Thanks for all your effort, and the programming exercise is truly a gem for me.

  • @roshanpatel4037
    @roshanpatel4037 3 роки тому

    wow this was an insanely good video major props to you

  • @Yongbangxiang88
    @Yongbangxiang88 6 років тому

    this is absolutely fantastic, enjoying this a lot

  • @PeterKingnz
    @PeterKingnz 4 роки тому

    Pity the example links don't work anymore, But definitely the most down to earth explanation so far

  • @latinadna
    @latinadna 2 роки тому

    What is frequency on the y axis frequency of what?

  • @anibaldk
    @anibaldk 7 років тому +1

    Hi Rasmus, one question:
    IF you know your likelihood distribution to be binomial, shouldn't P(data | θ) = P(r=6, θ) for a given value of θ ? In theory, you wouldn't need sampling, just mathematical calculation using Bayes formula for each possible value of θ.
    For θ [0..1]
    P(θ | data) = P(r=6, θ) x P(θ) / P(data)
    Where P(data) = Σ P(θi) P(data|θi) which can be computed without simulation/sampling either.
    Am I mistaken? Please do correct me as I'm kind of new to this. Thanks!

    • @rasmusab
      @rasmusab  7 років тому

      That is true, for this case you can take this computational short cut!

  • @taylorallred
    @taylorallred 5 років тому +1

    This is amazing teaching! Great work!

  • @nielsfrhr1275
    @nielsfrhr1275 3 роки тому

    Really nice introduction!

  • @bassamhaniya
    @bassamhaniya 5 років тому +1

    hello, please what microphone did you use ? sound quality is great ...

  • @soosjanos
    @soosjanos 7 років тому

    looking forward to it, really liked the first one!!

  • @BHARTGUPTABEC
    @BHARTGUPTABEC 4 роки тому

    when we know the distribution and the parameters how are we getting different value for same parameters

  • @israelaguilar4642
    @israelaguilar4642 7 років тому +1

    Thank you so much for a clear explanation.
    Link to R excercise is down.

    • @rasmusarnlingbaath6704
      @rasmusarnlingbaath6704 7 років тому

      Still down? It works for me if i click the link in the video description....

    • @israelaguilar4642
      @israelaguilar4642 7 років тому +1

      The error is "ERR_CONNECTION_TIMED_OUT". Doesn't matter if I click in the link in the description, or click on the first result in google for "bayesian-computation-with-stan-and-farmer-jons".
      Tried on other web browsers and still the same. Seems I can't reach your website.

    • @rasmusab
      @rasmusab  7 років тому

      Israel Aguilar . Would really appreciate if you could help me error search this! Can you reach my blog at sumsar.net ?

    • @israelaguilar4642
      @israelaguilar4642 7 років тому

      No, I can't reach your blog. I'm triying to connect from Mexico city.

    • @israelaguilar4642
      @israelaguilar4642 7 років тому

      Same error: "ERR_CONNECTION_TIMED_OUT".

  • @RichGillin
    @RichGillin 7 років тому +2

    Excellent production of an excellent subject. Audio, video and slides did not get in the way of transference of the intended knowledge.

  • @MasterofPlay7
    @MasterofPlay7 5 років тому

    can't you just use T test for a/b test to measure if there's a difference (and if is significant) between the two samples?

  • @samimis97
    @samimis97 7 років тому

    As every body else wrote... I am also was trying to understand it and how to use. You nail it man. Can I download the video please ... This gold for me... I can pair the idea of the video goes off line for some reason !!! can I ...

  • @alikhadour2028
    @alikhadour2028 5 років тому

    can we consider ABC a simple or a practical way for forecasting ?

  • @nathaliafernandes5093
    @nathaliafernandes5093 4 роки тому

    loved this video, thank you for the wonderful explanation

  • @ronny8D
    @ronny8D 4 роки тому

    OMG, so this is whats going on! ive tried readings few books on this, but it was never articulated clearly, the books did a lot of hand waving and i was always left extremely confused, and felt like the classical approach was superior. but i like this way of thinking, it has its advantages.

  • @teelee3543
    @teelee3543 6 років тому

    I am looking forward to ask for a help. May I get the slide for this tutorial? Thanks

  • @blackberrybbb
    @blackberrybbb 4 роки тому

    Crystal clear!

  • @HumblyQuestioning
    @HumblyQuestioning 4 роки тому

    You're a hero

  • @Carveasmile
    @Carveasmile 4 роки тому

    Thank you for a really good video and great explainations!

  • @iAmTheSquidThing
    @iAmTheSquidThing 6 років тому

    Is this considered a form of _bootstrapping?_ Since it uses iteration rather than calculus.
    And can we actually say "Assuming the priors, there is a 90% probability that the true value lies within the credible interval." without sparking a massive philosophical debate, like with confidence intervals?

    • @rasmusab
      @rasmusab  6 років тому +2

      It's more that bootstrap can be considered a form of Bayesian model. Just because my videos introduce Bayes using sampling doesn't mean the same calculation could be done using "math" instead :)
      I think that it's not controversial to say: "Given the model, priors and the data there is a 90% probability that the best (for a specific definition of 'best') parameter values lie in this interval."

  • @tshipmatic
    @tshipmatic 4 роки тому

    You are the man!

  • @danielhonig9876
    @danielhonig9876 3 роки тому

    The fish thinking of the formula is Fire!.

  • @uvurgun
    @uvurgun 5 років тому

    Thanks a lot. Really clear explanation.

  • @nigeltan7766
    @nigeltan7766 3 роки тому

    So we bruteforce all possible scenarios and see which instances give us the observed result. From the instances we keep we get a frequency distribution of the baselines for free. Got it!

  • @MrThelastseven
    @MrThelastseven 4 роки тому

    Awesome content! Thank you so much!

  • @nesrinothmann597
    @nesrinothmann597 3 роки тому

    Amazing video!!!

  • @Skydmig
    @Skydmig 7 років тому

    Great video and I liked doing the exercises too.
    Oh and bonus points for "The Girl from Ipanema".

    • @andreneves6064
      @andreneves6064 6 років тому

      Are you Brazilian? I perceive it too. :-)

  • @danroche8014
    @danroche8014 4 роки тому

    this is fantastic!

  • @dranujtiwari
    @dranujtiwari 3 роки тому

    Very very helpful. Thank u

  • @Alticroo
    @Alticroo 5 років тому

    @rasmusab - thank you very much

  • @sakkariyaibrahim2650
    @sakkariyaibrahim2650 Рік тому

    Great lecture

  • @dal2452
    @dal2452 10 місяців тому

    I like the Fish as a Service (FaaS) example.

  • @farnazbayaat5955
    @farnazbayaat5955 3 роки тому

    JUST AMAZING

  • @matt96920
    @matt96920 6 років тому +7

    5:58 -- boom.

  • @TommyLikeTom
    @TommyLikeTom 5 років тому

    If people put as much effort into producing goods and solving problems and less time into predicting data trends the world would be a better place

  • @Rkadecha
    @Rkadecha 6 років тому

    Which mic do you use for youtube

    • @rasmusab
      @rasmusab  6 років тому

      www.thomann.de/gb/the_tbone_sc440_usb_podcast_bundle_02.htm?sid=90e4c379ad9ad75b5494b61d6257db15

  • @pawpawpascal1524
    @pawpawpascal1524 3 роки тому

    I love ske doodles why he waits for me to finish the example.

  • @marianklose1197
    @marianklose1197 4 роки тому

    Great work!

  • @chandrasutrisno
    @chandrasutrisno 7 років тому +1

    where is the rest videos?

    • @rasmusarnlingbaath6704
      @rasmusarnlingbaath6704 7 років тому +1

      I will record them over the next couple of weeks! :)

    • @iamjameswong
      @iamjameswong 7 років тому

      Great work! I only wish that I knew it earlier.

  • @lennartboldin5583
    @lennartboldin5583 7 років тому

    Thank you very much for these videos, Rasmus. I have really enjoyed them since I am actually trying to use Bayesian Data Analysis for a project within my company. Would it be possible to contact you in order to ask a few questions? Thank you very much in advance.

  • @7573436
    @7573436 5 років тому

    This is great!

  • @luisluna11
    @luisluna11 7 років тому

    Awesome video, thanks!

  • @caseyinfo5743
    @caseyinfo5743 3 роки тому

    Thank you so much!

  • @DanielBurrueco
    @DanielBurrueco 6 років тому

    Great explanation...

  • @RottenMonkeyderAffenkopf
    @RottenMonkeyderAffenkopf 7 років тому

    brilliant explanation

  • @vishnuseesahai4611
    @vishnuseesahai4611 7 років тому

    Awesome work!