Hope you enjoyed this video! It's part of a series we're developing for Answer in Progress where we dive a little deeper into specific learning issues we face while researching for our videos. If you want more deep dives and looks behind the scenes with us, make sure to sign up for our newsletter: answerinprogress.com/newsletter *Do you have a favourite kind of graph?* I know this is a nerdy question but if you're watching this video, you're probably a nerd. Personally, I think violin plots are the perfect mixture of hilarious and beautiful (with the right colour palette).
Honestly there aren't a lot of feelings as great as playing around with a dataset and randomly stumbling upon a scatter plot that reveals a correlation you'd have never thought of, and it gets you thinking about what kind of factors can possibly cause those 2 elements to correlate, so yeah that's definitely a big favorite for me, with a good old 100% stacked bar chart coming in second.
May I ask what did you major in in college? With the two machine learning videos and now this one, it seems like you’ll be quite interested in Data Science.
@@Minecraftrok999 I didn’t mean to imply that, I just thought it was a funny joke. I’m a high school math teacher now so I definitely got a lot of use out of my degree! Don’t get discouraged.
@@Minecraftrok999 "Economics is just astrology with uglier graphs." - Sabrina Cruz (...and, wow, I want to share that quote with at least one of my college economics professors; he'd have gotten a kick out of it.)
READ THE AXIS PEOPLE!!! The amount of times I see a biased article with a graph showing how vastly different to things are, the y axis will have a range of like 2 percent, meaning the difference is insignificant in most cases.
The number of times I've had to tell my colleagues to LABEL THEIR AXES... *facepalm* It annoys me to no end that MS Excel doesn't have axis labels built into charts as a default.
@@wavyduck1273 Yeah if you present global temperature changes, it's best to compare it next to something that is directly affected by global warming, like number of major storms (of course, that only works if you clearly define "major")
While doing my thesis I got so sensitive to y axis... Like it's about fluctuations in terms of milligrams or even micrograms and I had to triple check I marked them correctly...
I thought the same thing, but it's important to remember that it's a lot easier when you start off knowing that something about it is misleading. Any of us might have fallen for that in real life.
Nothing is wrong with the graph, but the observer on the other hand. The graph is very useful for knowing how many movies there are to watch, on the “topic/genre” of horror at different points in time.
@@davidjohansson1416 True, although I personally think there's something to be said for the design of a graph making what it means (that, as opposed to more horror movies by percentage) very clear
I wish I knew the source for this but I learned this when I was working on my bachelors degree in biology 🧬: “If you torture the data they will confess to anything.”
"if you torture the data long enough, it will confess to anything" Google proposes at least 4 different sources, I remember reading it in "The complete Murphy's law" by Arthur Bloch.
Am disappointed with the lack of clowns... Joking aside, I always think of how often people maliciously skew the Y axis to force narratives or leave out pieces of the puzzle to drive their views. But on a less intentional or malicious route, I still end up making bad graphs at work from time to time, especially if I'm going in there with no idea of what I am trying to ask of the data. Graphs in a way tell stories and we have to be very careful with how to tell that story in a clear & concise way that also remains honest and true.
There was a graph I remember being given in, I believe my first quarter of Biology in High School, and we were told to explain what the graph told us about the data, and it was a drastic curve. Obviously the answer the teacher wanted was that over time the amount of that trait had increased dramatically. Except, I checked the Y axis, and each point up on the Y axis, the distance of time increased. So it went 1400-1410-1450-1500-1550-1600-1700-1850-2000 It wasn't that the trait was appearing exponentially more often, it was that whoever made the graph had malicious intent I remember that so vividly because it was the first time I realized just how easy it is to, futz about with the numbers and make a graph completely inaccurate
My guess is that yes, there are likely more movies being made, but it's also selection effect exaggerating it. Big blockbusters from 2020 or 1950 are both definitely going to have an IMDB page, but there aren't that many of them, so it's the lower tier movies that make up the bulk of the film's listed by volume. A local indie film from the 50's might be lost to history or just have no one that cares enough to make a IMDB page for it, but if the same indie film is made today, it is much more likely to end up on IMBD as there will be a trailer in UA-cam, a website, and the director and crew will want their credits etc.
This was my first thought, as soon as she said IMDB. That more films are being documented. Because there's no way movie making truly exploded THAT much in the 2000s.
I would be willing to bet that foreign films are much more likely to be added to IMDB (and categorised correctly) if they have been released recently than if they were released in the past. The majority of IMDB users seem to be English speakers.
@@fergochan There's also a likability that those English speakers are second English speakers, lest we forget, and thus have some films in their mother tongue that they'd like to see being added in IMDb.
I'm doing my PhD in a quantitative field. I often feel like I'm getting a PhD in creating/reading graphs. It's difficult for everyone, especially because so many graphs are poorly done.
so true! I interned at a university lab last year and my supervisor genuinely told me to graph my results in photoshop, when excel/R exists??????? and he said that this is how he usually makes graphs for submitting to scientific papers.. mad
@@YukikoOdair That’s crazy! I use R for everything (the tidyverse makes my life much better), and rarely pop it into Adobe Illustrator for some additional work.
As soon as you put up that graph, I immediately jumped to, "Well, of course. We're making multiple times the amount of movies we used to." Statistics, probability, and data visualization should be mandatory courses.
I didn't know we had a spike in total movie production, so I'm very proud of my brain's first thought basically being "you have subcategory, look at whole category"
I'm realizing all my time spent on r/dataisbeautiful actually helped me develop a valuable life skill. The first thing I thought when seeing the halloween move graph was "probably they just started making a ton of movies during that period. This graph should be normalized in relation to movies released per year". But possibly me thinking that this quickly also had to do with the context this information was provided in, yet I feel like I did learn something good on reddit for once.
My thought process was that around the time digital cameras & digital movie pipelines started being a thing; more people able to create movies. Thus more movies are made.
I feel like some world leaders/governments/national broadcasters need to watch this video... both for their own education and to remember that the graph literacy of their audience isn't a given.
With how high quality and well-made your videos are I'm surprised how few views this has for the time it's been up... I'd think a lot more people would want to come and watch these when they come out. Thanks for this - somehow you make this kind of complex intricacy of the mind a simple easy to understand video and I'm all for it :D
Confirmation bias gets everyone Even smart ones It’s a normal thing human mind does all the time Just be self aware enough to notice it and you’ll be fine
I really don't want to come off as sounding rude, but I'm feeling such a strong sense of pride that I read the graph correctly the first time. I went "oh the 2000s? didn't we just start making a lot more movies around then?" and I got really hyped at the end when that was actually true! Anyway, does anyone want to buddy read How Charts Lie with me?
the year 2000 is when the 1ghz CPU was first available, pretty much all media content exploded from that point onwards, due much more powerful content creation tools
Hello! I just wanted to say how much I love your videos! I am a fellow Asian woman in STEM and it's really refreshing to see people like me do what I love. You also really show how cool girls can be with all your hard work and intelligence. You are never afraid to admit when you're wrong or how long you've been working on something with no avail. You make those beautiful graphics and animations which requires such an artistic eye and creativity. I honestly know nothing about programming, but I loved seeing you try to make pasta with pasta with pasta with pasta. You're just so authentic and I really love your videos and always learn something new. Thank you for creating the content you do! :)
Really good video, as always. Also, thank you for captioning all of your videos, it's really useful for people like me who's mother tongue is not english and also people with hearing loss! I really appreciate that you use your platform to make everyone more critic and informed, thank you so much
Great video! As someone working in the numbers industry, I will recommend this to all my colleagues. Also, regarding the movies, do note that your source is IMDB and it’s also possible that their records for older years may not be as accurate. Over time, not only do their records become more accurate (as they existed during those years) but their records would eventually span “all movies made anywhere” which would also skew the results.
I appreciate you pointing out your inaccuracies with reading data in general and in previous videos. That is something a lot of our “thought leaders” and news media could take notes on.
This is the first video I see from this channel and that's exactly what I've been wanting to see more of on my feed! The part about checking the sources of a graph really spoke to me. I'm a grad student in American civilisation so checking my sources is like breathing at this point, but I wish this was something we were taught way before doing research. Imagine what the world would be like if people questioned information and news every time, the amount of crazies we would avoid! Also the way you can always twist information to your liking hit where it hurts. On off days it's hard to focus on the readings and not make them fit what I want to say. But research is about highlighting something, not making stuff up and sort of justifying it convincingly. Anyways- subscribing!!
I feel this video. In a public health major, data and graphs are extremely important because most in this field use them to make vital information accessible and comprehensible for a wider audience. Kinda sucks how most of my classmates and colleagues have the belief of "numbers don't lie" which applies to graphs and blindly go about things before checking if their assumptions are valid.
Actually my first thought when you showed the graph was what is the trend for all movies. But the issue really has nothing to do with graphs it has to do with realizing that there may be more to a set of data than you realize. Another thing I thought of was maybe the data is based on what is in imdb and does NOT reflect how many movies were made but how many movies are in imdb. Maybe for example they started including foreign language movies at some point. In general even if data is not presented in graph form and someone just quotes a statistic at you, you need to ask a bit more before jumping to conclusions or agreeing with the conclusion presented as 'fact'.
Nice video, Sabrina! Graphs have a great capacity to ease understanding, but also to mislead. To explore your reading metaphor more fully, we could say that reading a sentence involves three things: 1) identifying letters & words, 2) understanding how the words interact to create meaning, and (optionally) 3) deriving implications from (or using information outside the sentence to explain) the content of the sentence. If we treat reading a graph like reading prose, we can break it down as follows: 1 = identifying x/y axes and graph elements (points, lines, etc) 2 = understanding how the elements interact to create meaning 3 = deriving implications from (or using information outside the graph to explain) the content of the graph It's clear that you have no issues with 1 and 2 (as you correctly understood the meaning of the horror movie graph, i.e., horror movie releases increased nearly exponentially after 2000) and it is the 3rd part that is tripping you up (and, indeed, myself and many others). I would classify this 3rd part as "interpreting" rather than reading, but they do tend to happen together.
Ayyyy former stats major before I switched to art. Glad to see i still retained the stuff I learned cuz my first guess was "what if they just made more movies overall vs specifically horror" and it was right :D Obviously a lot easier to recognize when Sabrina literally starts off by saying "hey you might be reading this graph wrong" but hey I'll take it
Most of these we fortunately learned in school, many teachers at my school really encourage critical thinking and checking the sources etc. One of those things you learn in school, but are actually pretty useful
I love graphs and charts of any form. My graph fanfic for this video is mentally plotting out a new chart - bar graph or line graph - with “horror movies as the percentage of all movies” on the y axis and year along the x axis. I’ve only just discovered your channel this week, and it is doing some serious damage to my TBR list.
Nice video! I’ve definitely seen this in action, one recent example I remember vividly is that for the longest time, studies were showing happier people were living longer than sad people, so the medical world was convinced that being happy extended your lifespan (or being sad shortened it). But when they conducted the experiment again and this time excluded people with preexisting medical conditions, they found the results were almost 50/50 with no major difference in lifespan tied to attitude. It turns out that a lot of people tend to be unhappy because they’re in poor health, imagine that. Correlation doesn’t equal causation and all that
Ooh I know this one! So for the transitions themselves, it's drawn frame by frame using a cel animation program (adobe animate, rough animator, etc.). It's usually animating a transition from a fully white screen to a fully black screen. Then, to do transitions as seen in this video, apply a luma matte on the explainer animation with the transition animation.
@@answerinprogress Quick question about this, do you use the same frame by frame method on all your animations? Is that why the frame rate is as low as it is or is that a stylistic choice?
@@kuro13wolf You can accomplish that effect by either creating a low frame rate animation (lets say you draw 15 frames a second) or you could create a completely fluid animation and use something called the "Posturize Time" effect available in After Effects. Either way it gives the stutter look that you are referring to, but hand animating something with 24 frames a second and then reducing that animation in software is really inefficient. Personally I use shape layers in after effects and add the posturize time effect because its the quickest way to accomplish this goal!
Nobody is perfectly a fact based person. Everyone is a mix of facts, opinion and bias... We are all mixed with correct and incorrect ideas... And honestly, for me, when you mentioned that there were more horror movies in the 2000's, my first thought was "oh, because the tech to make movies is now easier and cheaper than before, maybe there were more movies in general".
My mom is an accountant. Growing up, she'd tell me that if you have data, you can make it say whatever you want it to, and that’s where ethics comes in. It’s especially true with statistics. You don’t have to lie to lead people to draw certain conclusions.
Great vid! As a fellow scientists, the lack of science knowledge in the general public (world-wide) is really sad. Every child starts out as a scientist and an artist, but somehow in secondary school we discourage both.
I'm glad that you charted the number of all movie releases vs the number of horror movie releases, because when you showed the horror movie graph, that was my first question. LOL And it's surprisingly reassuring. I'd have been even happier there also been a follow-up graph charting the percentage of movies released being horror. But then, I'm used to peeking behind the curtain. The first two thoughts that I have during any presentation are: "There are three kinds of lies: lies, damned lies, and statistics," and, "Correlation is not causation." Only if a presentation can hold up to those do I even give it consideration. But then I'm a jaded old crumpet. LOL
I saw that graph and it just made sense to me, because around the start of the 2000s a lot more people were getting access to technology that allowed for access to movies and digital media in general and based off that and the knowledge that all those things became popular at the same time that the sharp increase in horror movies just makes sense because of more people having access to those things.
5:46 the sound when you said that, like the despair of realization when you're wrong and know the true cause is.... 🤣🤣🤣 I would have the same expression like you if i mistakenly think about something hahaha
As someone who is studying my first year of graphic design, I find this highly interesting because it is, well, graphic design meant to communicate numbers and data - and design is such an important language of communication (combined with science / facts / studies) in this case, and how graphs are presented through design and readability are such an important part of communication, especially nowadays when they've become the way to simplify complex information so you get this whole thing where us as graphic designers and communicators get a responsibility to aptly present data in ways that are realistic, and when you are aiming for an mass-audience and a understanding, the design easily becomes skewed for anyone to percieve.
5:15 - I thought immediately about the Digital Camera development and the gradual increase of its use in the movie industry, lowering costs and increasing production. Then the second time you said that I remembered and finally understood where the bias was coming.
Whenever I look at a graph I try and ask myself "What is the easiest way this graph could be lying to me?", and it's definitely helped me spot bad data. Just that one question will get you to check the axis and to think about what the graph is actually saying vs what the data actually means vs what the author is saying it all means. When I saw that first graph I asked myself this question and my immediate thought was that it could also be showing that more movies were being made in general, which was exactly the right answer.
There is a video called "This is how easy it is to lie with statistics" by Zach Star that outlines this pretty well. Basically, statistics help, but you gotta understand how to read them.
For anyone interested in this I can recommend "How to Lie With Statistics" by Darrell Huff written way back in 1954. It's short sweet and enlightening.
5 years of working on statistics in my office, I am glad I knew immediately what Sabrina's issue was, and anticipated the reveal! The issue here isn't the numbers, (Sabrinas comment about four years studying numbers) but as pointed out, that graphs are ways of presenting numbers. Strictly speaking, the numbers themselves are entirely accurate (assuming valid source data) but the gap between what the numbers *actually* say and what people choose to have them say is based on critical thinking rather than mathematical skills. There was nothing untrue about the huge leap in horror movies from 2000 on... But all the graph said is "there are many more horror movies after 2000." Everything else taken from that is speculation. The numbers are true, but they only tell you "there are more horror movies" and don't tell you why, how, percentages, other genres, anything at all about *anything* other than "there are more horror movies."
Well I think its not the graphs problem, its what you interpret out of it. The graph only states that there are more horror movies made. That overall more movies were made is another topic...
A professor once told his audience: "It's much easier to prove a bad hypothesis wrong than to prove a good hypothesis right." And I think that's not only a wise advice for students deciding on their research subjects, but also in general a sound approach to the scientific method. It's often harder to define what something is than it is to define what it's not, and by process of elimination you get a more solid approach to the truth.
As an information scientist, I think your facts-vs-data argument is more correctly expressed as a data-vs-information argument. Also, the correct left axis on those graphs is "releases _in IMDB_" because I have multiple reasons to wonder if their records become more expansive and complete in later years (e.g., after they become an Amazon subsidiary in 1998 and the internet starts taking off).
I try to always remember that a fallible human made the graph, and think of whatever conclusion I draw from it as a statement from said human. Always look for the assumption (i.e. that the number of movies of any genre made has remained stable since pre-2000) or the ulterior motive that the person making the graph has, the same way you should for any statement of "fact" you are told.
That's why reading scientific papers and articles is hard! Honestly, thank you for highlighting how we can make mistakes even if we don't mean to do so.
I think most of the time the problem is not the graphic, but the context. So: you cannot rely only on the graphic, you need to explain the data with context. I hate those papers which tells "see the chart, it tells all about it". Nop, most of the time it doesn't. You need to explain why there are an increase of movies on that time... maybe it is an efect of a "trend": one famous horror movie incentivates more horror movies. Or maybe it's something different. That's why I think is a lie the sentence "a picture is worth a thousand words": words are necessary.
I think you would love the website of Spurious Correlations! They basically show how the data of two complete random events can have a similar graph and therefore make you believe they are correlated. For example, if you cannot read a graph properly you may think that the number of people drowning in a pool is related to the number of films Nicholas Cage appeared in
I think its about understanding data in general, not just graphs. If the horror movie releases per year was presented as a spreadsheet, or communicated with words like "In 1995 there were only 150 horror movies released, by 2015 there were nearly 1500" , it would be just as misleading. No matter how it's communicated, the "horror movies per year data" also needs to be accompanied by the "how many movies per year".
Even experts are susceptible to bias such as confirmation bias which is why the scientific method is important but it by itself doesn't solve the problem. This is why peer-reviewed and double-blind studies are so important. This is a nice reminder that verifying the source of the data matters, you shouldn't just look at a chart and assume it's reality.
Thanks for another great video! I may use this video in the future to explain to some students about graph literacy along with science and math literacy.
It's called confirmation bias. We see what we are looking for. I had a sneaking suspicion that more movies was the cause. Lol Great video. Thank you Edit to correct confusing typo
Hope you enjoyed this video! It's part of a series we're developing for Answer in Progress where we dive a little deeper into specific learning issues we face while researching for our videos. If you want more deep dives and looks behind the scenes with us, make sure to sign up for our newsletter: answerinprogress.com/newsletter
*Do you have a favourite kind of graph?* I know this is a nerdy question but if you're watching this video, you're probably a nerd. Personally, I think violin plots are the perfect mixture of hilarious and beautiful (with the right colour palette).
Honestly there aren't a lot of feelings as great as playing around with a dataset and randomly stumbling upon a scatter plot that reveals a correlation you'd have never thought of, and it gets you thinking about what kind of factors can possibly cause those 2 elements to correlate, so yeah that's definitely a big favorite for me, with a good old 100% stacked bar chart coming in second.
May I ask what did you major in in college? With the two machine learning videos and now this one, it seems like you’ll be quite interested in Data Science.
I like the classic weighted histogram with a nice touch of good sources. Also, I need help making better graphs.
I love a classic pie graph nice simple and delicious
My fav kind of graph is a bar graph lol
MISSED OPPORTUNITY TO REFFRENCE THE "LOOK AT THIS GRAPH" VINE SABRINAAAAAAAAAAA
YAS ikr
"If you torture the data long enough, it'll confess to anything"
If you torture anything enough, it will confess to anything.
@@awhahoo
is that a threat
@@thatoneguy9582 yes.
@@thatoneguy9582 *yes*
@@thatoneguy9582 yes
"Four years and an expensive piece of paper saying, 'I studied numbers.'" I also majored in math in college and I felt this SO HARD.
Feel a knowing pat on the shoulder from a collegue about to finish his PhD.
Exactly!
I'm in last semester of math and economics and it feels so terrible to know that you haven't actually learned much of anything useful :(
@@Minecraftrok999 I didn’t mean to imply that, I just thought it was a funny joke. I’m a high school math teacher now so I definitely got a lot of use out of my degree! Don’t get discouraged.
@@Minecraftrok999 "Economics is just astrology with uglier graphs." - Sabrina Cruz (...and, wow, I want to share that quote with at least one of my college economics professors; he'd have gotten a kick out of it.)
@@WyvernYT hahahahahahaha I'm gonna steal that
READ THE AXIS PEOPLE!!! The amount of times I see a biased article with a graph showing how vastly different to things are, the y axis will have a range of like 2 percent, meaning the difference is insignificant in most cases.
The number of times I've had to tell my colleagues to LABEL THEIR AXES... *facepalm* It annoys me to no end that MS Excel doesn't have axis labels built into charts as a default.
and context matters too! if the context is global temperatures, a small increase can have a HUGE impact on the ecosystem.
Negative increment enters the chat
@@wavyduck1273 Yeah if you present global temperature changes, it's best to compare it next to something that is directly affected by global warming, like number of major storms (of course, that only works if you clearly define "major")
While doing my thesis I got so sensitive to y axis... Like it's about fluctuations in terms of milligrams or even micrograms and I had to triple check I marked them correctly...
It made me ridiculously happy that I immediately knew what was wrong with the graph. Forth year of doing my PhD... Yay for me...
Me too! 😄
I thought the same thing, but it's important to remember that it's a lot easier when you start off knowing that something about it is misleading. Any of us might have fallen for that in real life.
@@isaacchen3857 good point!
Nothing is wrong with the graph, but the observer on the other hand.
The graph is very useful for knowing how many movies there are to watch, on the “topic/genre” of horror at different points in time.
@@davidjohansson1416 True, although I personally think there's something to be said for the design of a graph making what it means (that, as opposed to more horror movies by percentage) very clear
I mean if graphs are literature then XKCD's probably the closest thing we have to fan fiction
I love xkcd...
There is a relevant XKCD for this, I'm sure
Wait, what is XKCD?
@@Somefool669 You're over of today's lucky 10,000.
@@Somefool669 a nerdy webcomic that often covers graphs
I wish I knew the source for this but I learned this when I was working on my bachelors degree in biology 🧬: “If you torture the data they will confess to anything.”
Sir, I want this on a tshirt.
So happy I could give the 42nd like
"if you torture the data long enough, it will confess to anything"
Google proposes at least 4 different sources, I remember reading it in "The complete Murphy's law" by Arthur Bloch.
Am disappointed with the lack of clowns...
Joking aside, I always think of how often people maliciously skew the Y axis to force narratives or leave out pieces of the puzzle to drive their views. But on a less intentional or malicious route, I still end up making bad graphs at work from time to time, especially if I'm going in there with no idea of what I am trying to ask of the data. Graphs in a way tell stories and we have to be very careful with how to tell that story in a clear & concise way that also remains honest and true.
The y axis is the most abused thing in popular media
There was a graph I remember being given in, I believe my first quarter of Biology in High School, and we were told to explain what the graph told us about the data, and it was a drastic curve. Obviously the answer the teacher wanted was that over time the amount of that trait had increased dramatically. Except, I checked the Y axis, and each point up on the Y axis, the distance of time increased. So it went 1400-1410-1450-1500-1550-1600-1700-1850-2000
It wasn't that the trait was appearing exponentially more often, it was that whoever made the graph had malicious intent
I remember that so vividly because it was the first time I realized just how easy it is to, futz about with the numbers and make a graph completely inaccurate
My guess is that yes, there are likely more movies being made, but it's also selection effect exaggerating it. Big blockbusters from 2020 or 1950 are both definitely going to have an IMDB page, but there aren't that many of them, so it's the lower tier movies that make up the bulk of the film's listed by volume. A local indie film from the 50's might be lost to history or just have no one that cares enough to make a IMDB page for it, but if the same indie film is made today, it is much more likely to end up on IMBD as there will be a trailer in UA-cam, a website, and the director and crew will want their credits etc.
This was my first thought, as soon as she said IMDB. That more films are being documented. Because there's no way movie making truly exploded THAT much in the 2000s.
I would be willing to bet that foreign films are much more likely to be added to IMDB (and categorised correctly) if they have been released recently than if they were released in the past. The majority of IMDB users seem to be English speakers.
@@fergochan There's also a likability that those English speakers are second English speakers, lest we forget, and thus have some films in their mother tongue that they'd like to see being added in IMDb.
I'm doing my PhD in a quantitative field. I often feel like I'm getting a PhD in creating/reading graphs. It's difficult for everyone, especially because so many graphs are poorly done.
so true! I interned at a university lab last year and my supervisor genuinely told me to graph my results in photoshop, when excel/R exists??????? and he said that this is how he usually makes graphs for submitting to scientific papers.. mad
@@YukikoOdair That’s crazy! I use R for everything (the tidyverse makes my life much better), and rarely pop it into Adobe Illustrator for some additional work.
I put the simp in asymptote.
Absolutely obsessed with this comment.
Lol
How do I favorite a comment? Lmao
I put the stan in standard deviation ;)
A simp tote? Sure lemme grab my bag of flowers
"Can you make graph fanfiction?" Well I've seen Fanfiction made about pieces of Tetris so.... yeah. It's probably out there
+
Rule No. ??
If it exists, there is fanfiction about it.
@@lonestarr1490 one moment as I go on that one rule to see if tetris is there
Edit: sigh
@@lonestarr1490 Rule No. 43
@@lonestarr1490 34
i'm reading Calling Bullshit: The Art of Skepticism in a Data-Driven World currently, this vid came in on time
As soon as you put up that graph, I immediately jumped to, "Well, of course. We're making multiple times the amount of movies we used to."
Statistics, probability, and data visualization should be mandatory courses.
@jocaguz18
Not universally.
me too, i felt so proud! I didn't have a data visualization class but i did write my bachelors thesis in that field
I didn't know we had a spike in total movie production, so I'm very proud of my brain's first thought basically being "you have subcategory, look at whole category"
6:09 "There's a metaphor in there. That's probably not even a metaphor"
Well, you DID say you studied numbers, not words!
I'm realizing all my time spent on r/dataisbeautiful actually helped me develop a valuable life skill. The first thing I thought when seeing the halloween move graph was "probably they just started making a ton of movies during that period. This graph should be normalized in relation to movies released per year". But possibly me thinking that this quickly also had to do with the context this information was provided in, yet I feel like I did learn something good on reddit for once.
My thought process was that around the time digital cameras & digital movie pipelines started being a thing; more people able to create movies. Thus more movies are made.
I kinda want some graph fanfics tho 👀
XD
what about all the "pie chart memes" do those count as graph fan fics?
Just go to qAnon and anti masks facebook pages lol
I wanna see someone pull off a Harry Potter fanfiction entirely in graph form
but wouldn't it end up being to graphic? 😏
I feel like some world leaders/governments/national broadcasters need to watch this video... both for their own education and to remember that the graph literacy of their audience isn't a given.
With how high quality and well-made your videos are I'm surprised how few views this has for the time it's been up... I'd think a lot more people would want to come and watch these when they come out. Thanks for this - somehow you make this kind of complex intricacy of the mind a simple easy to understand video and I'm all for it :D
Confirmation bias gets everyone
Even smart ones
It’s a normal thing human mind does all the time
Just be self aware enough to notice it and you’ll be fine
Imagine making a graph with malicious intent...that’s like a bad comic supervillain. “The Greedy Grapher”
That is absolutely amazing
that was basically my job when i did consulting!
Misleading headlines and malicious graphs are the core of journalism. The little text that nobody reads is there only for plausible deniability.
The movie thing made me think of how in the end, most demographic statistical data sorted by region is really just a population map.
"Oh unreadable graph."
"Oh you DECEPTIVE graph!"
"I love your trend lines."
There. Your graph fan fic.
Learning to write was a mistake
Today is the day I am finally happy to not be Jarred, 19
petition for all college professors to teach with a Sabrina-level of one liners and jokes (and also clarity, passion and awesomeness)
I really don't want to come off as sounding rude, but I'm feeling such a strong sense of pride that I read the graph correctly the first time. I went "oh the 2000s? didn't we just start making a lot more movies around then?" and I got really hyped at the end when that was actually true!
Anyway, does anyone want to buddy read How Charts Lie with me?
Sure I'll read it with you \(•~•)/ I mean why not?
@@derpyderp2627 Awesome! This'll be so fun. Do you have an insta or something similar we could chat on?
the year 2000 is when the 1ghz CPU was first available, pretty much all media content exploded from that point onwards, due much more powerful content creation tools
Sabrina! I have my Data Science course exam right around the corner and this video drops. God bless.
This is so incredibly timely. I just want to thank you for making this video just for me specifically. You're the best.
Hello! I just wanted to say how much I love your videos! I am a fellow Asian woman in STEM and it's really refreshing to see people like me do what I love. You also really show how cool girls can be with all your hard work and intelligence. You are never afraid to admit when you're wrong or how long you've been working on something with no avail. You make those beautiful graphics and animations which requires such an artistic eye and creativity. I honestly know nothing about programming, but I loved seeing you try to make pasta with pasta with pasta with pasta. You're just so authentic and I really love your videos and always learn something new. Thank you for creating the content you do! :)
so this is you explaining how we've all been clowned by graphs. now the emojis make sense.
Really good video, as always. Also, thank you for captioning all of your videos, it's really useful for people like me who's mother tongue is not english and also people with hearing loss! I really appreciate that you use your platform to make everyone more critic and informed, thank you so much
I agree! Captions could really reach a broader audience, and help those who need it :)
The satisfaction of guessing that there were just more movies overall by myself and then realising I was right
Great video! As someone working in the numbers industry, I will recommend this to all my colleagues.
Also, regarding the movies, do note that your source is IMDB and it’s also possible that their records for older years may not be as accurate. Over time, not only do their records become more accurate (as they existed during those years) but their records would eventually span “all movies made anywhere” which would also skew the results.
For some reason I haven’t been getting notifications for your channel lol, thankfully I was stalking my subscriptions page
lmao same
Sabrina! Your conclusion is so important and so well put and I wish I could shout it from the mountaintops! Well done video!
The fact that you are humble enough to correct yourself without anybody pointing out is a huge reason for why I love your videos ❤
I love that you include a status bar for the ad read
I for sure couldn't really get the graphs Apple used yesterday :D
this made me ridiculously happy. amazing animation, as always
I appreciate you pointing out your inaccuracies with reading data in general and in previous videos.
That is something a lot of our “thought leaders” and news media could take notes on.
I wasn't expecting the plot to be so good
This is the first video I see from this channel and that's exactly what I've been wanting to see more of on my feed! The part about checking the sources of a graph really spoke to me. I'm a grad student in American civilisation so checking my sources is like breathing at this point, but I wish this was something we were taught way before doing research. Imagine what the world would be like if people questioned information and news every time, the amount of crazies we would avoid! Also the way you can always twist information to your liking hit where it hurts. On off days it's hard to focus on the readings and not make them fit what I want to say. But research is about highlighting something, not making stuff up and sort of justifying it convincingly. Anyways- subscribing!!
I feel this video. In a public health major, data and graphs are extremely important because most in this field use them to make vital information accessible and comprehensible for a wider audience.
Kinda sucks how most of my classmates and colleagues have the belief of "numbers don't lie" which applies to graphs and blindly go about things before checking if their assumptions are valid.
:c wow, I've never thought how the misuse of graphs could affect people in such a way. That must be so frustrating to deal with
I met your channel some days ago and I just fallen in love with your content, congratulations on your work :)
I can't stop thinking about how the graphs in Apple's presentation yesterday do ALL of these mistakes
"mistakes"
Actually my first thought when you showed the graph was what is the trend for all movies. But the issue really has nothing to do with graphs it has to do with realizing that there may be more to a set of data than you realize. Another thing I thought of was maybe the data is based on what is in imdb and does NOT reflect how many movies were made but how many movies are in imdb. Maybe for example they started including foreign language movies at some point. In general even if data is not presented in graph form and someone just quotes a statistic at you, you need to ask a bit more before jumping to conclusions or agreeing with the conclusion presented as 'fact'.
Really love these videos. Your humour is great, and the gimmicks aren't cheesy. Look forward to the next one!
my graph fanfic:
number of times harry potter thinks about hermione compared to ginny
percentage of having a crush for hermione compared to ginny
etc.
Harmony fans are totally gonna cherry pick statistics for that graph
Nice video, Sabrina! Graphs have a great capacity to ease understanding, but also to mislead. To explore your reading metaphor more fully, we could say that reading a sentence involves three things: 1) identifying letters & words, 2) understanding how the words interact to create meaning, and (optionally) 3) deriving implications from (or using information outside the sentence to explain) the content of the sentence.
If we treat reading a graph like reading prose, we can break it down as follows:
1 = identifying x/y axes and graph elements (points, lines, etc)
2 = understanding how the elements interact to create meaning
3 = deriving implications from (or using information outside the graph to explain) the content of the graph
It's clear that you have no issues with 1 and 2 (as you correctly understood the meaning of the horror movie graph, i.e., horror movie releases increased nearly exponentially after 2000) and it is the 3rd part that is tripping you up (and, indeed, myself and many others). I would classify this 3rd part as "interpreting" rather than reading, but they do tend to happen together.
Commenting so that UA-cam shows this to more people
WOW
AMAZING
I LOVE THIS
I mean there's 137 AO3 results for graphs, so...
👀 pardon me
@@answerinprogress AO3 is a fanfiction site. It stands for archive of everything.
@@gaming__god I’m pretty sure it’s archive of our own. Hence the O3; there are 3 o’s.
FINALLYYYY! Someone is talking about this! Can finally send this video to my friends instead of ranting at them about graphs haha thank you!
Ayyyy former stats major before I switched to art. Glad to see i still retained the stuff I learned cuz my first guess was "what if they just made more movies overall vs specifically horror" and it was right :D
Obviously a lot easier to recognize when Sabrina literally starts off by saying "hey you might be reading this graph wrong" but hey I'll take it
This video is very important! Context is eeeeverything! Thank you for making it!!
5:30 for those who don't know her reference she's talking a bout the thing in new york in September in early 2000s
I love your hair in this video!
SO glad I found this channel!
Most of these we fortunately learned in school, many teachers at my school really encourage critical thinking and checking the sources etc.
One of those things you learn in school, but are actually pretty useful
As an engineer, I think this is one of the best videos on the topic! Making this required watching for my team!
I love graphs and charts of any form. My graph fanfic for this video is mentally plotting out a new chart - bar graph or line graph - with “horror movies as the percentage of all movies” on the y axis and year along the x axis.
I’ve only just discovered your channel this week, and it is doing some serious damage to my TBR list.
It made me way to happy that I did guess one of the reasons why the graph was misleading correctly.
Nice video!
I’ve definitely seen this in action, one recent example I remember vividly is that for the longest time, studies were showing happier people were living longer than sad people, so the medical world was convinced that being happy extended your lifespan (or being sad shortened it). But when they conducted the experiment again and this time excluded people with preexisting medical conditions, they found the results were almost 50/50 with no major difference in lifespan tied to attitude. It turns out that a lot of people tend to be unhappy because they’re in poor health, imagine that. Correlation doesn’t equal causation and all that
Does anyone know what software she does to create those transitions like the ripping etc.
+
Ooh I know this one! So for the transitions themselves, it's drawn frame by frame using a cel animation program (adobe animate, rough animator, etc.). It's usually animating a transition from a fully white screen to a fully black screen. Then, to do transitions as seen in this video, apply a luma matte on the explainer animation with the transition animation.
@@answerinprogress Quick question about this, do you use the same frame by frame method on all your animations? Is that why the frame rate is as low as it is or is that a stylistic choice?
@@kuro13wolf You can accomplish that effect by either creating a low frame rate animation (lets say you draw 15 frames a second) or you could create a completely fluid animation and use something called the "Posturize Time" effect available in After Effects. Either way it gives the stutter look that you are referring to, but hand animating something with 24 frames a second and then reducing that animation in software is really inefficient. Personally I use shape layers in after effects and add the posturize time effect because its the quickest way to accomplish this goal!
@@JoeTalks I'm personally not a fan of that low a frame rate but if she's doing it frame by frame it's completely reasonable.
Nobody is perfectly a fact based person. Everyone is a mix of facts, opinion and bias...
We are all mixed with correct and incorrect ideas...
And honestly, for me, when you mentioned that there were more horror movies in the 2000's, my first thought was "oh, because the tech to make movies is now easier and cheaper than before, maybe there were more movies in general".
YES! As someone who is studying to become a scientist I feel like making and reading graphs correctly is so important!
this is the best channel woah
My mom is an accountant. Growing up, she'd tell me that if you have data, you can make it say whatever you want it to, and that’s where ethics comes in. It’s especially true with statistics. You don’t have to lie to lead people to draw certain conclusions.
Great vid! As a fellow scientists, the lack of science knowledge in the general public (world-wide) is really sad. Every child starts out as a scientist and an artist, but somehow in secondary school we discourage both.
I'm glad that you charted the number of all movie releases vs the number of horror movie releases, because when you showed the horror movie graph, that was my first question. LOL And it's surprisingly reassuring. I'd have been even happier there also been a follow-up graph charting the percentage of movies released being horror. But then, I'm used to peeking behind the curtain. The first two thoughts that I have during any presentation are: "There are three kinds of lies: lies, damned lies, and statistics," and, "Correlation is not causation." Only if a presentation can hold up to those do I even give it consideration. But then I'm a jaded old crumpet. LOL
I saw that graph and it just made sense to me, because around the start of the 2000s a lot more people were getting access to technology that allowed for access to movies and digital media in general and based off that and the knowledge that all those things became popular at the same time that the sharp increase in horror movies just makes sense because of more people having access to those things.
5:46 the sound when you said that, like the despair of realization when you're wrong and know the true cause is.... 🤣🤣🤣
I would have the same expression like you if i mistakenly think about something hahaha
As someone who is studying my first year of graphic design, I find this highly interesting because it is, well, graphic design meant to communicate numbers and data - and design is such an important language of communication (combined with science / facts / studies) in this case, and how graphs are presented through design and readability are such an important part of communication, especially nowadays when they've become the way to simplify complex information so you get this whole thing where us as graphic designers and communicators get a responsibility to aptly present data in ways that are realistic, and when you are aiming for an mass-audience and a understanding, the design easily becomes skewed for anyone to percieve.
5:15 - I thought immediately about the Digital Camera development and the gradual increase of its use in the movie industry, lowering costs and increasing production. Then the second time you said that I remembered and finally understood where the bias was coming.
The fact that I fought that it has to be because there were more movies just boosted my self confidence plus 99999999999999999999999999
Have a lovely day Sabrina ♡
Whenever I look at a graph I try and ask myself "What is the easiest way this graph could be lying to me?", and it's definitely helped me spot bad data. Just that one question will get you to check the axis and to think about what the graph is actually saying vs what the data actually means vs what the author is saying it all means. When I saw that first graph I asked myself this question and my immediate thought was that it could also be showing that more movies were being made in general, which was exactly the right answer.
As always, you're amazing. I love this.
There is a video called "This is how easy it is to lie with statistics" by Zach Star that outlines this pretty well. Basically, statistics help, but you gotta understand how to read them.
For anyone interested in this I can recommend "How to Lie With Statistics" by Darrell Huff written way back in 1954. It's short sweet and enlightening.
5 years of working on statistics in my office, I am glad I knew immediately what Sabrina's issue was, and anticipated the reveal!
The issue here isn't the numbers, (Sabrinas comment about four years studying numbers) but as pointed out, that graphs are ways of presenting numbers.
Strictly speaking, the numbers themselves are entirely accurate (assuming valid source data) but the gap between what the numbers *actually* say and what people choose to have them say is based on critical thinking rather than mathematical skills.
There was nothing untrue about the huge leap in horror movies from 2000 on... But all the graph said is "there are many more horror movies after 2000." Everything else taken from that is speculation. The numbers are true, but they only tell you "there are more horror movies" and don't tell you why, how, percentages, other genres, anything at all about *anything* other than "there are more horror movies."
Well I think its not the graphs problem, its what you interpret out of it. The graph only states that there are more horror movies made. That overall more movies were made is another topic...
I love your videos! Interesting, hilarious, and great storytelling. Keep it up!
No worries sabrina we wouldn't be human if we didn't mess up.(love your content have watched for years)
You make such excellent videos. Go you, you're amazing, keep doing the great stuff!
I don't know if graph fanfiction is a thing but now I'm intrigued.
A professor once told his audience: "It's much easier to prove a bad hypothesis wrong than to prove a good hypothesis right." And I think that's not only a wise advice for students deciding on their research subjects, but also in general a sound approach to the scientific method. It's often harder to define what something is than it is to define what it's not, and by process of elimination you get a more solid approach to the truth.
I've seen graphs in TED Talks where people didn't label axis at all, but this is on a whole 'nother level.
As an information scientist, I think your facts-vs-data argument is more correctly expressed as a data-vs-information argument.
Also, the correct left axis on those graphs is "releases _in IMDB_" because I have multiple reasons to wonder if their records become more expansive and complete in later years (e.g., after they become an Amazon subsidiary in 1998 and the internet starts taking off).
I try to always remember that a fallible human made the graph, and think of whatever conclusion I draw from it as a statement from said human. Always look for the assumption (i.e. that the number of movies of any genre made has remained stable since pre-2000) or the ulterior motive that the person making the graph has, the same way you should for any statement of "fact" you are told.
Imagining the conclusions of a graph coming from a person is a really good way to approach this! I'll be stealing that, thank you very much :)
That's why reading scientific papers and articles is hard!
Honestly, thank you for highlighting how we can make mistakes even if we don't mean to do so.
My film degree finally came in handy when I immediately knew what she was missing.
Thank you! from now on ill be more aware 😌
I think most of the time the problem is not the graphic, but the context. So: you cannot rely only on the graphic, you need to explain the data with context. I hate those papers which tells "see the chart, it tells all about it". Nop, most of the time it doesn't. You need to explain why there are an increase of movies on that time... maybe it is an efect of a "trend": one famous horror movie incentivates more horror movies. Or maybe it's something different. That's why I think is a lie the sentence "a picture is worth a thousand words": words are necessary.
I think you would love the website of Spurious Correlations! They basically show how the data of two complete random events can have a similar graph and therefore make you believe they are correlated. For example, if you cannot read a graph properly you may think that the number of people drowning in a pool is related to the number of films Nicholas Cage appeared in
I think its about understanding data in general, not just graphs. If the horror movie releases per year was presented as a spreadsheet, or communicated with words like "In 1995 there were only 150 horror movies released, by 2015 there were nearly 1500" , it would be just as misleading. No matter how it's communicated, the "horror movies per year data" also needs to be accompanied by the "how many movies per year".
Even experts are susceptible to bias such as confirmation bias which is why the scientific method is important but it by itself doesn't solve the problem. This is why peer-reviewed and double-blind studies are so important. This is a nice reminder that verifying the source of the data matters, you shouldn't just look at a chart and assume it's reality.
Thanks for another great video! I may use this video in the future to explain to some students about graph literacy along with science and math literacy.
I KNEW IT! I thought that increase coincided with the increase in total movies made when I first saw that graph.
I’m glad this was the first thing I thought when I saw the graph
It's called confirmation bias. We see what we are looking for.
I had a sneaking suspicion that more movies was the cause. Lol
Great video. Thank you
Edit to correct confusing typo
Moore movies?
@@IsomerMashups hmm. No idea. Auto correct but from what...
@@MiscMitz Moore=more. More movies [being produced overall] was the cause.
@@averageguy7932 yep. That makes sense. Thank you
@@MiscMitz My pleasure! Nice to see comments that are intelligent and people are freindly. Nice change!