Are you Bayesian or Frequentist?

Поділитися
Вставка
  • Опубліковано 1 вер 2020
  • What if I told you I can show you the difference between Bayesian and Frequentist statistics with one single coin toss?
    SUMMARY
    It is only by insisting that the parameter may not be a random variable (Frequentist) that it makes any kind of sense to talk about your method's ability to deliver the right answer. As soon as you let the parameter be a random variable (Bayesian), there's no longer any notion of right and wrong.
    BAYES VS FREQUENTIST... FIGHT!
    Visit my blog (bit.ly/quaesita_fvsb) for answers to the questions below.
    What words tell you that we're wading through their territory?
    What are they using statistics to change their minds about?
    What is the main difference?
    What do you win if you choose this side?
    What do you lose if you choose this side?
    So, which one is better?
    Okay... so which one is more objective and "correct"?
    What about small vs large sample sizes as a criterion?
    Cassie, you're killing us here. Are you Bayesian or Frequentist?
    Should I pick a side?
    Learn more:
    Frequentist vs Bayesian fight - your questions answered: bit.ly/quaesita_fvsb
    8min statistics intro: bit.ly/quaesita_statistics
    Statistical Thinking playlist: bit.ly/statthinking
    Controversy about p-values: bit.ly/quaesita_needles
  • Наука та технологія

КОМЕНТАРІ • 590

  • @lrgui9792
    @lrgui9792 3 роки тому +623

    I love this subject! I'm studying Bayesian methods in my PhD, here's my perspective:
    Frequentist reasoning wants to deal objectively with data, so it considers probability to be a property of the world; it says "the coin has probability 1/2 of being heads because that's the frequency of heads in the behavior of this coin"... and there's a right probability, it's a fact from the world, it can be learned by data that shows that frequency in behavior. Data is noisy, but it reveals true propensities through frequencies.
    Bayesian reasoning wants to deal logically with data, so it considers probability to be a property of logical propositions about the world; it says "the statement 'coin landed heads' has a certain probability of being true, it is 1/2 for me and 0 or 1 for you depending on what you see"... the proposition is connected to a point of view, and different points of view will differ in how close they are to the truth about the state of the coin. So probability is subjective in a sense, but all points of view with equal information should objectively agree about probabilities of their statements (it's objectively subjective, just recognizing the existence of different points of view, but they are not supposed to be personal, not opinions). When you update your "belief" over data, it's because data moved your point of view in relation to the "truth". In this example, once we see the coin, we update the statement "coin landed heads" from 1/2 to 0 or 1 depending on what we see (probabilities of 0 and 1 mean perfect information while 1/2 means no information).
    There isn't an actual divide between the two, theoretically... Bayesian reasoning recognizes the relation between frequency and plausibility, while frequentist reasoning recognizes points of view, it just doesn't go there.

    • @ndrsvgl
      @ndrsvgl 3 роки тому +22

      So in other words the frequentists approach will give you a correct answer every time but may need indefinitely to evaluate, while the bayesian approach gives you a result immediately but this result may be wrong.

    • @lrgui9792
      @lrgui9792 3 роки тому +36

      @@ndrsvgl hm... the approaches are answering different questions, both correctly... what is this answer/result that you say they are trying to give?
      in the experiment of the coin, we can arrange for the mutual agreement of the two approaches in every observable event (observable in the sense that it doesn't talk about probabilities)... for example, if you flip the coin and ask for the exact result it will give, both should agree in saying: "I can't tell"... if you say you flipped the coin a zillion times and aks for the proportion of heads, both should say immediately: "it's 1/2" (but they would interpret your question differently)...
      I guess you are talking about this difference: you ask what is the probability of you having a coin in your pocket. One bayesian could say: "I know nothing, so for me it is 1/2"... another bayesian could say: "I saw you handling coins before, and if I have a model for how probable it is for "coin handlers" to have coins in their pockets, I can update that probability of 1/2"... another bayesian could say: "I know that people in this city carry coins in their pockets with a chance of 30%, so it's 30%"... someone could say: "it is 80%, because I saw in the stars", but that wouldn't be bayesian, it's a personal kind of subjectivity... a frequentist would say: "i can't know, because I don't know anything related to the frequencies with which you carry coins in your pocket, i don't talk about probabilities for single events"
      now, those bayesians can't be right at the same time, yes? and that frequentist will take a long time to discover the frequency by making the situation become a repeatable experiment... the thing is, all bayesians are right, but their answers have limited power where the frequentist has no answers at all... it may seem silly, but that "imprecise" reasoning of bayesians has major applications, here's a very understandable example: en.wikipedia.org/wiki/Bayesian_search_theory

    • @N73B60
      @N73B60 3 роки тому +20

      Bayesian and Frequentist are two thinking methods to answer different questions: what I know and what I should know. None are wrong, and it doesn't have to do with psychology or personality. It depends on the situation and which question should be answered first.

    • @ndrsvgl
      @ndrsvgl 3 роки тому +3

      @@lrgui9792@N73B60 Ok, thanks for clarification.

    • @richarddisalvo7952
      @richarddisalvo7952 3 роки тому +5

      My interpretation is that the bayesian reasoning is correct, but the frequentist reasoning is easier for a variety of reasons so scientists often use it instead. I take this comment as empirical evidence for my claim, as the frequentist explanation takes about 1/3 of the words to explain than the bayesian.

  • @soonny002
    @soonny002 3 роки тому +170

    As a psychiatrist, I feel like I rely on both Bayesian and Frequentist philosophies in my everyday work. When advising on diagnoses, I use the Bayesian approach. That is, I gather whatever data I can to inform an opinion (about a diagnosis), and then I update my opinion if and when more data emerges. I'm not overly invested in getting a 'right' diagnosis because a patient's presentation is dynamic and complex such that they can't always be reduced to a single category at all times. I'm happy to revise the diagnosis when necessary.
    But when I'm advising on risks (i.e. the risk of somebody committing suicide, homicide, arson, etc.), I use the Frequentist approach. I am infinitely more concerned about what will happen when a patient has had numerous repeated attempts at harming themselves or others because that informs the probability of how likely a person is going to repeat history. I think to myself, "what will happen if the patient attempts the same move another 100 times?"
    To me (and I'm not a statistician, although I know a little about human psychology), the Bayesian and Frequentist approaches are fundamentally concerned with certainty vs uncertainty. The Bayesian aligns herself with changeable opinions informed by available data, thus she is never completely 'certain' about anything since her opinions change when new data emerges. The Frequentist on the hand aligns himself with unchangeable facts based on logic, thus he is always completely 'certain' about everything as long as his logic holds water.
    The coin toss was a great teaching example. It was a great example because the answer was inconsequential. I mean... Who cares how the coin lands? Nobody was harmed in the making of the video, yes? (I hope). We can allow ourselves to assign equal weight to both philosophies in this teaching scenario when the outcome of the coin toss was inconsequential.
    I suspect people are likely to gravitate towards a Frequentist approach when contemplating decisions that are very consequential because the Frequentist approach feels more tangible to me while the Bayesian approach feels more abstract.
    So I don't think it is a matter of 'are you a Bayesian at heart or are you a Frequentist?' Rather, it may depend on the weight of the decision you are about to make. Having said that, I do acknowledge that some people are more tolerant of uncertainty than others, thus for those people, they are more likely to be Bayesian perhaps.
    Does this make sense?

    • @traininggrounds9450
      @traininggrounds9450 3 роки тому +4

      It's less about the weight of the decision but the fundamental structure of the question. If you ask, "What is the probability I WILL flip a coin heads?" versus "What is the probability this is heads?" then this is the difference between the two thoughts and it doesn't matter the importance or the pertinence or the weight. So you are right in saying it has nothing to do with personality or thought process its just whether or not people are aware about the two different "modes" if you will of an outcome.

    • @ivlis32
      @ivlis32 3 роки тому +6

      Do not mix human senses with the math. Both Bayesian and Frequentist approaches are mathematically solid and they converge when infinite data is available. F. put the uncertainty into sampling, i.e. we do not know the exact value because we only observe a limited subset of the universe and we can make an estimate of the interval where the true value can be. B. put the uncertainty in the value itself: as we have limited data available (including prior knowledge) we can say that the value in question can be drawn from a distribution. So instead of a point estimate B. give you a distribution of values. There is no more correct or less correct approach, it depends on what you want.

    • @harry8175ritchie
      @harry8175ritchie Рік тому

      I like this approach! It definitely depends on how you want to model your problem, and, how you interpret the answer. Let's say your treatment is a parameter. The bayesian approach won't tell you what that parameter is, but will provide static confidence intervals of where it lies. More data, and informative priors will change the shape of this distribution. The frequentist approach will tell you the parameter (the treatment), with variable levels of confidence (depending on the data).

    • @sgordon8123
      @sgordon8123 Рік тому

      I am completely new to this concept but came down as a Bayesian thinker. I immediately thought however that my acceptance of uncertainty and willingness to make decisions even knowing the uncertainty is an unusual quality in me. It tends to drive others nuts as they prefer to be certain before acting. I guess I simply think certainty is an illusion most of the time. And I would definitely say that about medical risks as the research quality is often so poor or misunderstood or out of date and so on. Are you familiar with Ben Goldacre? If not please check his UA-cam lectures.

    • @jjmarcos
      @jjmarcos Рік тому +1

      Psychiatry is GAY.

  • @juancampos1164
    @juancampos1164 2 роки тому +6

    49% heads. - 49% tails - 0.4% a bird steals it - 0.4% it disappears - 0.2% I’m imagining this and it doesn’t exist (but my eyes construct the visual spectrum in my mind)

  • @solsav
    @solsav 3 роки тому +36

    I think it has a lot to do with the nature of the question and the search-space in your problem, rather than your personal choice, to go with a frequentist vs bayesian method.

  • @banana420
    @banana420 3 роки тому +171

    I don't think the framing of Frequentists caring about the true answer is a good one. Bayesians and Frequentists both care about truth, they just care about the true answer to different questions.
    I think the main difference is that Bayesians and Frequentists ask different questions, and use language that implies the questions they care about, which is what makes it so difficult to have a conversation with the other perspective. When truly asking the same question, the two mindsets should converge on the same answer.

    • @milos-simic
      @milos-simic 3 роки тому +26

      The main difference is how probability is defined. For Bayesians, probability is one's degree of belief. So, it is inherently subjective. For frequentists, probability is a law of the universe that regulates an event's long-term frequency of occuring. So, it's opposite of subjective. All the other differences stem from this one.

    • @PACXS
      @PACXS 3 роки тому +10

      Very much agree. Wittgenstein would say: arguing for one, against the other, is simply an abuse of language. There is no contradiction. One is not right, while the other is wrong. Those that argue are misled by their own language use. Language is highly indeterminate. "What side is up?" Sounds like a simple and straightforward question, but it is not. It is based on context, the forms of life, and family resemblances. To the question, "what is the chance it is head's up?", it can be interpreted as in what is the chance your guess is correct, or what is the chance the actual state is head's up.
      In a deterministic universe, the frequentist would not even be able to say there is a 50% chance it lands head's up before the coin has landed. It may not have landed, but how it will land is determined by prior values that have already been set in motion.

    • @jeandenis4353
      @jeandenis4353 3 роки тому

      I agree with banana's comment. For example when I read about zodiac signs, it usually describes the signs strengths and weaknesses.
      But I've always wondered how can someone who is not of that particular zodiac sign classify or identify a sign's attributes as a weakness? This assumption would imply that you've lived through their experiences.

    • @jeandenis4353
      @jeandenis4353 3 роки тому

      P.S. they're trying to raise robots. I think it's in a Disney movie "Inside Out"

    • @redberries8039
      @redberries8039 3 роки тому

      If we say for Frequentists the probability of a system is a 'property of the Universe', a property of the system. Then Baysians allow talk about their belief of that probability, whereas Frequentists restrict themselves to estimates of the probability to calculations on the data. ?

  • @rapmacl1
    @rapmacl1 3 роки тому +179

    LOL. Schroedinger's coin.

    • @cpmathews2566
      @cpmathews2566 3 роки тому +2

      Not only Schrödinger's coin, at 50/50; But when she showed us the coin I could not see it clearly. For me it is still, 50/50. Fore her it's 100%

    • @traininggrounds9450
      @traininggrounds9450 3 роки тому +2

      @@cpmathews2566 You have no concept of the collective. As a collective it was what she said it was both for you and her because we all see the same colors on the rainbow. This schrodinger's cat thing is such a bas tardization of the scientific method and everything that has made progress in science up until that dumb concept came about. It's literally not true. The nature of statistics itself is that we can't determine something or its nature. Schrodinger took the nature of statistics itself and masked physical phenomenon with it and said "this is the fundamental nature of the universe" when the entire time it was relative to us and our ability to know. So statistics and its nature is schrodinger's cat we'll say but not the universe. You may be confused but the universe is certain.

    • @bonob0123
      @bonob0123 2 роки тому +1

      @@traininggrounds9450 relax. quantum bayesianism is a thing. just has its own limitations with locality etc etc.

    • @andrewnguyen3312
      @andrewnguyen3312 7 місяців тому

      Hilarious

  • @marktahu2932
    @marktahu2932 3 роки тому +3

    Thank You.. You are a seriously great teacher, I'd like to see your videos as a necessary part of every high school students curriculum. You remove the jargon and re-frame the learning references to simple, understandable examples which makes the learning of complex issues so much easier.

  • @alexeyzelenskiy2224
    @alexeyzelenskiy2224 3 роки тому +4

    Thank you. Perfect pausing during the presentation. It is so rare among UA-cam presenters.

  • @donnachafitzgerald256
    @donnachafitzgerald256 2 роки тому +10

    Thanks for summarizing this important topic. I've no emotional investment in the Frequentist vs Bayesian debate (I've used both often in my research), but I couldn't help but feel the Bayesian perspective was not given fair credit here. The Bayesian's "point of view" should not be entirely subjective, but rather based on logical principles, that can often be derived from the laws of nature (eg. The shape and symmetry of the coin make it equiprobable to land on heads or tails). The powerful advantage of leveraging prior information for forecasting or evaluating hypotheses also ought to be emphasized more. Ideally, aspects of both Bayes theorem and frequencies should be used (eg. using base rates as prior information in diagnostics). But because the frequentist approach is so much more intuitive to use in science, the Bayesian approach is underutilized. This has been less than optimal for science which has been far too dogmatic about p-values instead. It would be nice if you could emphasize this more in future communications on this topic, thanks!

  • @LegoEddy
    @LegoEddy 3 роки тому +2

    How is it possible that I only found this channel now? This stuff is brain-food-candy for any statistician like me! Keep it up :)

  • @louisbademosi9250
    @louisbademosi9250 2 роки тому

    Hands down the best video I’ve watched on the philosophy behind both the Bayesian and Frequentist approach. Well done

  • @IanALane
    @IanALane 3 роки тому +11

    Two minutes in to my first Cassie Kozyrkov video and I'm subscribed.

  • @the_trevoir
    @the_trevoir 3 роки тому +55

    And the Micheal Baysians don’t care I’d it’s heads or tails, as long as the camera orbits it.

    • @mattc4013
      @mattc4013 3 роки тому

      And as long as there are pyrotechnics and explosions.

  • @SarikaKV
    @SarikaKV 3 роки тому +3

    I am binge watching your videos. Wish I’ve known you and your work before.

  • @navarro_gabrielle
    @navarro_gabrielle 3 роки тому

    This is AMAZING!! Great video. Thanks for sharing!!!

  • @sandEffect
    @sandEffect 3 роки тому

    I like the evolution of these videos into a nice variety of presentation.

  • @josevalencia9233
    @josevalencia9233 3 роки тому +1

    Gracias Ms Cassie. Very well explained. Thanks to YT recommendations as well

  • @PACXS
    @PACXS 3 роки тому +30

    Frequentist: "What is the probability the actual current state of the coin is ..."?
    Bayesian: "What is the probability my estimate of the state of the coin is ..."?
    It seems Frequentists try to take an objective point of view. Meaning: from the perspective of the focal object. Whereas the Bayesians take a subjective view. Meaning: from the perspective of the subject/observer.

    • @ApesAmongUs
      @ApesAmongUs 3 роки тому

      I like that description more than her use of the word "opinion".

    • @zak3744
      @zak3744 3 роки тому +4

      The explanation of frequentist thinking in the video sits uneasily with me. The idea that a flipped, but hidden, coin would be either 0% or 100% (but unknown) while an unflipped coin would be 50%, or a coin flipped and waiting to land would be 50% seems arbitrary. It's more subjective than the Bayesian explanation in a way! There are a number of reasons why the outcome might be obscured to us, whether that data is temporally obscured (you have't flipped it yet, and we experience time in one direction!), or physically obscured (a hand is in the way), or obscured through laziness (the flipped coin is in the air waiting to land and we could measure the rotation and velocity and calculate how it will spin and drop and land, but we don't bother). I don't see, on an ideological level, why it should make a difference which of these it is. So if the hidden coin is "either 0% or 100% but I don't know which" to a frequentist, why not the future event coin too?
      It seems that there is something getting lost in the difference between the questions: "What side *will* this coin land?" and "What side *did* this coin land?" The frequentist as described here doesn't ever change their answer to the first question once the coin has flipped, they just start answering a different question instead, right? As I far off the mark if I were to think that maybe a change in information is being acknowledged in one case explicitly by changing the answer and in the other case implicitly by changing the question?

    • @PACXS
      @PACXS 3 роки тому +2

      @@zak3744 You are correct in many things you say. In a deterministic view, everything is already determined. So, to a Frequentist this would have to mean that all coins being flipped, either in the future or past, all are determined ... and thus none have a probability. Only abstracted coins have probabilities in this sense.
      Elsewhere here, I commented about this being really a linguistic difference. The difference is not really about the understanding of reality, but what question is asked.
      Usually in science the Frequentist question tends to make most sense. It is about the object / objective reality. When you look at it from a decision making agent, it makes sense to look at it from a Bayesian perspective. The question is then about: what is my best estimate based on what I know? Or: the best decision based on the information available to the Agent (e.g., a robot).

  • @CodeEmporium
    @CodeEmporium 3 роки тому

    Loved this!

  • @gcoronado4622
    @gcoronado4622 3 роки тому +1

    thank you for this EXCELLENT video!

  • @sigbjrnfjelland4686
    @sigbjrnfjelland4686 3 роки тому

    What a beautiful philosophical view statistic perspective. Loved it!

  • @biologygeek3601
    @biologygeek3601 2 роки тому

    just came across this wonderful video, very simple explanation, read many articles but still confuse with the technical terminologies they have used in the paper. from this video within 5 minutes i have understood the concept. Thankyou Cassie for sharing wonderful knowledge with us. really appreciate it :)

  • @musanovdarkhan5773
    @musanovdarkhan5773 3 роки тому

    This is the coolest video I've seen in a while!

  • @christopherkemsley4758
    @christopherkemsley4758 2 роки тому +1

    This is a fantastic short explanation of the differences between them - thank you!
    Also, for some reason, you kind of remind me of Kes from Star Trek Voyager…

  • @jamescrud
    @jamescrud 3 роки тому +15

    It seems like it first depends on how a person understands the initial question. I understood it as what's the probability of me guessing if it was heads or tails. Answer is always going to be 50/50. The coin already landed so it was never a question of which way it was resting on your palm. That has already been determined. The only thing left to do is guess the right answer...which is always going to be 50/50.
    Edit: This was such a random video click for me. Lol.

    • @psigreen3864
      @psigreen3864 3 роки тому +2

      This is how I understood it as well. It seems kinda flawed, in a way. Is the way of determining whether you are Bayesian or Frequentist examining how you interpret implications in the question? As I stated in another reply, the question, as I believe is likely to be understood by most, would be "What is the probability [that you could correctly guess] that this coin is heads-up on my palm?" Or is the video saying that Bayensians would assume that she is referring to the guess and Frequentists won't? If that's the case, then Frequentists don't sound very fun at parties...
      I feel like this determines more about how wiling you are to "go along" with a potentially unclear question. I think, in a more casual setting, a Frequentist is still likely to guess 50% because, in their mind, they are going along with the commonly understood implication of the question, or, in other terms, "trying not to be a smart-ass."
      Is this psychology or statistics or both?

    • @mikebirminghamnz
      @mikebirminghamnz Місяць тому

      I agree. I had to watch it again because it made no sense to me! Her metaphor / analogy / example is poor.

  • @acethatmaths9053
    @acethatmaths9053 3 роки тому

    I love how you explained the 2 perspectives.

  • @MrDemoncrusher
    @MrDemoncrusher 3 роки тому +48

    *Neo* "Heads!"
    *Morpheus* - "What if I told you there was no coin...?"

  • @ironnerd8336
    @ironnerd8336 3 роки тому +1

    Holy crap, statistics has a place for me. Never heard of Bayesian before. I gotta do some reading now. Thank you! Seriously, that makes so much sense in my world.

  • @RafaelRabinovich
    @RafaelRabinovich Місяць тому

    Thank you for your clear explanation!

  • @olesiamaltynbaeva6091
    @olesiamaltynbaeva6091 3 роки тому +1

    Cassie, thank you for detailed explanation. Please, please, please tell us more about pros and cons of Bayesian vs Frequentist approaches in the business context.

  • @sojarumojaru
    @sojarumojaru 3 роки тому

    Loved it!! Theoretical chemist by profession, I daily have to navigate the thin line between the groups of people who either call themselves "Statistical mechanicians" or "Quantum mechanics". I might cite this video in future to demonstrate to my colleagues the philosophical difference between the two. :)

  • @cementhaiku
    @cementhaiku Рік тому

    THANK YOU so much for this video, and all your videos. Please keep making them. I love to learn and appreciate great teachers. You accomplish both feats...and I don't think a Bayesian or Frequentist would disagree. But maybe they would. lol. Again, THANK YOU.

  • @albertolopez3017
    @albertolopez3017 3 роки тому

    Excellent vídeo! Thanks for this explanation

  • @rigasok
    @rigasok 3 роки тому +6

    It’s the first time one has questioned it to me... great explanation!

  • @RodrigodaMotta
    @RodrigodaMotta 3 роки тому +2

    It's curious to think about probability and statistics theories in physics. In my perspective, the experimental physicists generally goes with a Frequentist mind, since the common mindset is to try the same experiment over and over and look what percentage they got a "good answer". In the other hand , the theorists care too much about perspective and information, actually the quantum theory is bounded to theses concepts, hence, the resolutions of the problems are made from a Bayesian mind. Your videos are awesome! Loved it!

  • @matthewd4743
    @matthewd4743 3 роки тому

    I like how you paused after you the coin had landed and you were going over options... I was yelling there is no probability since it's a completion action. I guess I'm a frequentist. Thanks for teaching me something 😁 very good lesson!

  • @sjn7220
    @sjn7220 3 роки тому +7

    This is why I’ll never understand statistics beyond mean and standard deviation.

  • @paulomateus5356
    @paulomateus5356 3 роки тому +2

    Congrats Cassie! Your explanation is pretty good. I really appreciate your videos. 👏🏻👏🏻👏🏻

  • @bfredl
    @bfredl 3 роки тому +3

    Amazing. You explained so much in 7 minutes that I previously only have seen explained with much more time. For myself, my data science problems are tricky enough to need the best methods from both camps :)

  • @P_Mann
    @P_Mann 3 роки тому +4

    I think it’s important to understand whether your need is action - doing or not doing something in the real world - or just thought/academic. Bayesian tends to promote action, such as our decision to drive more slowly in poor weather. Frequentist tends toward addressing issues where a discrete level of certainty has utility (often without action), such as hypothesis testing.

    • @inquinimento
      @inquinimento 3 роки тому +1

      Your action vs action recommended as an expert interpreting data?

  • @troelspedersenaau
    @troelspedersenaau 3 роки тому +11

    My own research is in electronic engineering and I teach a graduate course on Stochastic Processes to engineers and applied mathematicians. I do research with both statisticians and other engineers, and have thus develop a rather pragmatic view. Losely, I pick the perspective which helps my current project. This leads me to be Bayesian 50 % of the time and frequentist 50 % of the time. (And Iannoy 100 % of the statisticians most of the time... ) I do not think that you should or need to choose between the two views.
    I think that both views are correct - but it is not the same thing they are looking at! That is probability to a Bayesian models the current uncertanty about an event whereas to a frequentist it models a frequency of correct guesses if the experiment could be repeated. Incidentially, the underlying probability theory (the events, probability measures and all that) applies to both schools. But although the terms (e.g. Probability, expectation, etc) used are interpreted in fundamentally different ways. Many times the two views can lead to the same thing. I pick the view which seems the most helpful in achieving my goal in a certain application.
    A perhaps even more fundamental concern to have, is the view on probability theory itself. The "Are real things random or not?" questions. As a pragmatic engineer, actually, I do not care - what matters to me is that probabilistic models, are very good and convenient models for many phenomena. Applying statistics be it frequentist or Bayesian, lead to many good ways of guessing on phenomena which cannot be observed directly.

    • @philledwith8307
      @philledwith8307 3 роки тому +3

      "That is probability to a Bayesian models the current uncertanty about an event whereas to a frequentist it models a frequency of correct guesses if the experiment could be repeated." -- This feels like a more faithful representation of what's going on, to me.

  • @robertzavaleta6992
    @robertzavaleta6992 3 роки тому

    This was beautiful. Thank you.

  • @JohnJones-rp2wz
    @JohnJones-rp2wz 3 роки тому

    Fascinating explanation, thank you

  • @brunosignoriwustro9460
    @brunosignoriwustro9460 3 роки тому +9

    1:00 I thought it was a trick question and you were going to show the coin stading up, stuck between your fingers, to make a point about how there might not be a probability. Guess that makes me a Bayesian.

  • @alanbarnett718
    @alanbarnett718 3 роки тому +1

    it occurs to me that most situations where you want to know a probability are Frequentist, i.e. they concern things that are already facts, but unknown to us. From a certain perspective *all* probabilities are Frequentist, if you accept that we live in a deterministic universe. All future tosses of the coin are already predetermined!
    Love this post!

  • @rohanpandey2037
    @rohanpandey2037 3 роки тому +49

    Interesting paradox (?) I just came across:
    The probability that I'm a Frequentist is 50%.

    • @jorgecelis8459
      @jorgecelis8459 3 роки тому +5

      so you are bayesian 100%

    • @alanbarnett718
      @alanbarnett718 3 роки тому +4

      You didn't know what it was before you saw this video. So the probability was 50%. If you're a Frequentist.
      Now you can't make up your mind, so the probability is still 50%. If you are either.
      When you've made up your mind, but haven't told anyone, It's still 50%. But only if I'm a Bayesian.
      I have a pain between my ears.

  • @norberelloa9794
    @norberelloa9794 3 роки тому +2

    Clear explanation, thanks. Will it be possible to have a mathematical explanation as well, such as doing the same analysis (for instance comparing mean across two groups) using Frequentist (a t-test) versus Bayesian approach (?) ?

  • @LuckyNrZ
    @LuckyNrZ 3 роки тому +3

    Great video and explanation! :)
    By coincidence, I came up with the exact same example (covered coin toss) to explain the difference between Bayesian and frequentist to my colleagues, and I was also going to use it in a paper I‘m writing. I‘m wondering now, is there a „common source“ of the example that I should be citing?

  • @kentvandervelden
    @kentvandervelden 3 роки тому +1

    I recommend reading the short paper Bayesian Estimation Supersedes the t Test.

  • @Antharmo
    @Antharmo 3 роки тому +8

    Oh, so that's why she called herself a 'recovering' statistician

  • @johnjung-studywithme
    @johnjung-studywithme Рік тому

    that was such a beautiful explanation

  • @hwilliampolenz6713
    @hwilliampolenz6713 3 роки тому

    This is really neat, thanks!

  • @donrossi4319
    @donrossi4319 2 роки тому

    Well done!

  • @iancamleite2285
    @iancamleite2285 Рік тому

    Love this!

  • @MyManinHavanna
    @MyManinHavanna 8 днів тому

    The Baeysian recognizes that the probability is relative to perspective which means recognizing the context of other's perspevtive. Perspective must involve uncertainty. The problem is that it usually loses that component. I think some people combine the two to eliminate their feeling of discomfort.

  • @rohanchess8332
    @rohanchess8332 9 місяців тому

    Amazing video!

  • @JHS270694
    @JHS270694 8 місяців тому

    Beautifully put. Very intuitive.

  • @Sau_UNCCMathFin
    @Sau_UNCCMathFin 7 місяців тому

    Very well explained.

  • @havenbastion
    @havenbastion 3 роки тому +1

    Statistical probability is a measure of ignorance, not certainty. Everything that Does happen always had a 100% chance of happening, we just didn't have enough information to know it. The two perspectives are perfectly compatible.
    Also, knowledge is justified belief.

    • @surfinmuso37
      @surfinmuso37 3 роки тому

      Agree on the first bit, but not on the second. Knowledge is not simply justified belief, some does occur that way but much is also direct knowledge that does not require a belief.

  • @AzharKhan-wn8wy
    @AzharKhan-wn8wy Місяць тому

    “The truth has already been fixed in the universe”.
    Powerful, powerful stuff. 🙏

  • @phg0922
    @phg0922 3 роки тому +71

    A better question is, would you go for Monte Carlo simulations or bootstrap draws for small samples 😉

  • @robmonkriedlinger
    @robmonkriedlinger 3 роки тому

    oh wow!! So helpful for me - thanks!!

  • @vincentpun123
    @vincentpun123 3 роки тому

    Thank you!

  • @KolbiGray
    @KolbiGray 3 роки тому

    I just stumbled across Florence Welch talking to me about statistics and I love this.

  • @mrbattowel
    @mrbattowel 3 роки тому +6

    Hidden under your other hand or hidden in the future, is there a meaningful difference?

  • @peplegal8253
    @peplegal8253 3 роки тому +12

    I would change those fancy names :
    Bayesian -> Relativists.
    Frequentist -> Absolutists.
    .

  • @franciscodasilva4652
    @franciscodasilva4652 2 роки тому +1

    The Bayesian perspective reminds me very much of Schrödinger's cat experiment. :-)

  • @shenruivah6617
    @shenruivah6617 3 роки тому +15

    This, absolutely have no idea why it's in recommendation.
    Don't know why I watched the whole thing too.

    • @andarted
      @andarted 3 роки тому +1

      The algorithm moves in mysterious ways, brother.

    • @JWhitty
      @JWhitty 3 роки тому +2

      because google wants you to further separate yourself from others by now thinking about this

    • @FlumenSanctiViti
      @FlumenSanctiViti 3 роки тому +1

      In part, it's an ASMR. Especially if your head is inbetween good pair of headsets.

    • @dgodiex
      @dgodiex 3 роки тому +1

      ​@@JWhitty Jokes aside, this sounds terribly on point, looking at the current state of affairs.

    • @JWhitty
      @JWhitty 3 роки тому +1

      @@dgodiex of course it's on point. 90% of what is put out by any entity with massive reach is to manipulate opinions. what the fuck is the point of pushing a psychology video to BILLIONS whose only real message is YOURE ALL DIFFERENT AND NOW GO THINK ABOUT IT? She keeps hinting at "what is right? what's more logical? EHHH..." and she leaves it open for people to start mentally pointing fingers. she's egging you on, begging you to judge them. its such bullshit and MATTERS 0%.

  • @Artaxo
    @Artaxo 3 роки тому

    What if I went bayesian in the first question and frequentist on the second? On the third, I couldn't even choose. But I 100% subscribed, great video!

  • @rexbenny1553
    @rexbenny1553 3 роки тому +1

    This video, besides sprouting an interest in the philosophy of probability (to put it lightly) and how English sounds to those who don't speak it.

  • @Speak4Yourself2
    @Speak4Yourself2 3 роки тому

    Thanks a lot!

  • @RavinderRam
    @RavinderRam 3 роки тому

    awesome tutorial..

  • @atticstattic
    @atticstattic 3 роки тому

    That was the coolest thing I've seen this year.....I think....

  • @J_The_Colossal_Squid
    @J_The_Colossal_Squid 3 роки тому +5

    This makes sense to me in terms providing fodder for potentially thinking about how better to modify statistics education curriculums in the US, and I thank you for it.
    I agree they both have their place. My sense is still that Bayesian in general is best, or at least better conceived between the two as being a more efficient process/procedure for studying phenomenological emplacements, such as a state of being, or a state of existence, as distinct from pursuing quantifying outcomes from an empirical perspective.
    I hesitate to nod toward descriptive statistics and the frequentist approach as being more or less truthful just because it is more easily accessible for many, as it is generally "front and center" and in abundance owing to its many different potential tests, in many, if not most US curriculums.
    Also, arguably more pragmatic/efficient from an economic perspective as its allegedly apparently tantamount to an analytical baseline culturally, albeit you'd get no argument from me, that is by no means a guarantee at being ideal across the use-case or potential use-case landscape writ large, and to suggest otherwise would seem to be missing the potential salient implications, which I tend to also agree with any who side with coming out and divulging such implications, as potentially muddiying the waters as to potential personal development, and the joy and importance at having deduced something for oneself.
    Such as the gaps where dialectics is a hindrance, rather than an aid as to developing a conceptual understanding of some, if not _many_ subjects and topics bearing upon knowledge.

  • @mc.rhyme.rivers
    @mc.rhyme.rivers 3 місяці тому +1

    Great video! What are you recovering from as a statistician?

  • @willykitheka7618
    @willykitheka7618 3 роки тому

    You're a damn good teacher madame! If you are not using that talent somewhere along your path, then it's a crying shame!

  • @pezraya5210
    @pezraya5210 Рік тому

    Thanks!

  • @sitrakamatthieu
    @sitrakamatthieu 3 роки тому

    Dam...am i a bayesian ???? O_O
    Also...really great video Cassie ! You are really a great pedagogue !

  • @andrewwhite5250
    @andrewwhite5250 3 роки тому

    I think both perspectives can be beneficial in different scenarios, depending on what you’re trying to accomplish.

  • @doug_sponsler
    @doug_sponsler 2 роки тому +1

    This is a finely done video - props to Kozyrkov for a superb presentation.
    I think, however, the emphasis on the subjectivity of Bayesian inference is a bit misleading. One comes away with the notion that frequentists are interested in reality while Bayesians are interested in opinions. Surely all practitioners of data-based inference are interested in reality; the difference lies in kinds of questions by which reality is sussed out.
    The Bayesian and the frequentist might agree that a given state or process in the world can be understood in terms of definite parameters, i.e. that the flipped coin has already landed. To say that the Bayesian approach is subjective is simply to say that it is concerned with *our knowledge* - or, equivalently, our *uncertainty* - regarding the parameters of interest given available evidence (data + priors). I suppose this could be called "subjective" since it depends on the knowledge available to a subject, but it is certainly not subjective in the pejorative sense of "arbitrary."
    In most cases, at least in my field of ecology, the frequentist is also interested in parameter states. That, after all, is what it means when we ask whether X causes Y. But frequentist methods get there indirectly by inferring the likelihood of evidence (data only, no priors) given assumed parameter states. While these approaches generate parameter estimates (parameter values that maximize the likellihood of the data) with uncertainty (intervals that would contain the true parameter value in X% of hypothetical repetitions of the sampling and analysis process), they do not tell us directly what we really want to know: what should we believe about the unknown state of the paramater? This is what we want to *know* because it guides what we want to *do*, i.e. to understand and potentially intervene in the world. These objectives, like our knowledge, are intrinsically subjective, but in a sense that is both legitimate and unavoidable.
    I also think it is a mistake - not one made explicitly by Kozyrkov, but one occasionally suggested by others - to project approaches to data-based inference onto metaphysics. Choosing between frequentist and Bayesian methodologies should have nothing to do with whether one is an ontological realist or nominalist. As Andrew Gelman puts it, "theoretical statistics is the theory of applies statistics." Pragmatic handling of uncertainty, appropriate to the question at hand, is the only end for which statistics is a legitimate means.

  • @benlacar2109
    @benlacar2109 3 роки тому +1

    Awesome video and great explanation!
    I came across a problem recently that seems like a mix of both philosophies but I can’t wrap my head around how to solve it! Let me tweak the problem to match your example.
    Let’s imagine that you made this video twice, in one you used a fair coin and in the other you used a biased coin. However, we, as the audience do not know which is which. How can we distinguish with

  • @carlosflorescabanillas7801
    @carlosflorescabanillas7801 2 роки тому

    Good explanation

  • @amante2443
    @amante2443 2 роки тому +1

    I believe I cannot love this video enough. I've watched it over and over and recommended it to many people. But then again this is just my belief which I'm willing to change in the future based on the data. I believe this makes me biased towards being a Bayesian, but someone correct me if I'm wrong. 😇

  • @Armando_Lara
    @Armando_Lara 3 роки тому

    What a charisma!

  • @mohammadmujeeb6592
    @mohammadmujeeb6592 Рік тому

    You deserve more views and likes dear

  • @jesse2667
    @jesse2667 3 роки тому

    This video was amazing. I find myself with both, but lean toward the Baysian to answer this coin toss question from the perspective of "given the information I have available to me, my answer is ___". But based on this description, frequentist favoring more ground truth, then I would think for something like testing of a medical diagnostic machine accuracy, I would not care about only the information I have, but also the information I don't have because the true answer could be more important.

  • @liammckenna1479
    @liammckenna1479 3 роки тому

    In my undergraduate statistics courses, I essentially was indoctrinated to think in a frequentist way, to look for the result of a statistical experiment and say that I conclude with 95% confidence (or based on whatever your confidence level was) that a result was significant, or say that I have failed to reject the null hypothesis. So far, I still like that way of thinking.

  • @greglee7708
    @greglee7708 3 роки тому

    great one

  • @AliAhmedOro
    @AliAhmedOro 3 роки тому

    Soo funny ... Now I know Bayesian clearly like never before! and although frequentist now confused 😂😂 ... Blessing to master Cassie for stimulating our do foundations !!!

  • @DaNazmul
    @DaNazmul 3 роки тому

    Thanks.

  • @prudvitheja134
    @prudvitheja134 2 роки тому +2

    161 Bayesians disliked the video

  • @EdeYOlorDSZs
    @EdeYOlorDSZs 3 роки тому

    cute experiment, i like it!

  • @robertquiggleiv8696
    @robertquiggleiv8696 3 роки тому +2

    The way I thought of it was that the chance that an event did/can/will happen is actually always either 100% or 0% and it is just a lack of knowledge that makes it appear otherwise. Or in other words, probability is like a measurement of our own ignorance (are we slightly unsure or very unsure? etc). I don't know if that shit's true, it just looks like it to me.

  • @mischatal
    @mischatal 3 роки тому

    Quality and practical use go hand in hand.

  • @UltraPuppet
    @UltraPuppet 3 роки тому +1

    I'm backing the superposition, where the superposition changes based on the likelihood that you were lying in the reveal, since the coin was too out of focus to tell what the result was.

    • @-danR
      @-danR 6 місяців тому

      I can't believe that we are the only two people who have figured this out.

  • @originalSiiiN
    @originalSiiiN 3 роки тому +1

    no idea what is going on here but i like hearing what you have to say... :)

  • @MrPikoka
    @MrPikoka 3 роки тому

    well, this is amazing

  • @2adamast
    @2adamast 3 роки тому +3

    3:11 "What is the probability this coin is up heads?" Still 50%, there is apparently a third category I am part of. Or more likely the perceived dichotomy isn't one.

    • @totally_not_a_bot
      @totally_not_a_bot 3 роки тому

      50% that it landed heads, or 50% that you'll guess right?
      From what I've been reading in the comments, that pair of questions works better.

  • @DaveScottAggie
    @DaveScottAggie 3 роки тому

    I think I flipped back and forth while listening to you talk about the 2 ways of thinking. I think both ways have merit, but I believe that I lean towards Frequentist.

    • @kozyrkov
      @kozyrkov  3 роки тому +1

      Then the last answer in the description is for you, David! :)

    • @DaveScottAggie
      @DaveScottAggie 3 роки тому

      Oh wow yes! I was watching on my phone. I found where my mobile UA-cam "hides" the descriptions. Thanks.

  • @SupremeChickenx
    @SupremeChickenx 3 роки тому

    damn i see why she's a leader at google now - great storytelling skills