- 44
- 270 232
The Data Digest
Germany
Приєднався 4 чер 2018
Welcome to the data digest, a channel dedicated to data analysis with the R programming language.
Join me in the journey to master the various aspect of data analysis:
* Visualizations
* Programming
* Exploratory Data Analysis
* Statistics and Modelling
* Communication of Results
Join me in the journey to master the various aspect of data analysis:
* Visualizations
* Programming
* Exploratory Data Analysis
* Statistics and Modelling
* Communication of Results
Web scraping in R with ChatGPT (4 Examples) no HTML knowledge needed
In this video I show you how to extract online information from a website with the rvest package and a little help from ChatGPT.
⌚ TOC:
0:00 - Intro
0:47 - datapaste shortcut
2:13 - easy html table
5:22 - loop through urls
8:52 - chatGPT for nodes
datapaste Tutorials:
ua-cam.com/users/results?search_query=R+datapasta
skool community:
www.skool.com/data-analysis-with-r-6607/about
⌚ TOC:
0:00 - Intro
0:47 - datapaste shortcut
2:13 - easy html table
5:22 - loop through urls
8:52 - chatGPT for nodes
datapaste Tutorials:
ua-cam.com/users/results?search_query=R+datapasta
skool community:
www.skool.com/data-analysis-with-r-6607/about
Переглядів: 778
Відео
Analyzing the Top 1000 Skool Communities (8 August 2024)
Переглядів 5474 місяці тому
In this video I analyze the top 1000 communities on skool.com (8.8.2024). I show you how many are free or paid, public or private. In which languages their descriptions are written in and how a word cloud of their community names can tell you what the most engaging topics are right now on this platform. Visit my free skool community here: www.skool.com/data-analysis-with-r-6607/about Most of it...
EURO 2024: Analyzing the group phase matches by market value
Переглядів 9945 місяців тому
In this video, I analyze the group phase matches of Euro 2024 by market value. Did the more valuable team always beat the team of lower market value. Which team surprisingly continued to the knock-out phase? Link to flourish interactive chart: flourish-user-preview.com/17991450/TYJ5Ze021DQxj-2EhIiqbN1PWJDICBHYhIOHgQahahPRlmCBmHb24TqzUabav0fW/
I finished the "Productive R Workflow" course. Here is my review!
Переглядів 3276 місяців тому
In this video I want to share with you my experience with the Productive R Workflow course that was created by Yan Holtz. www.productive-r-workflow.com/ DISCLAIMER: This video is not payed, sponsored by the creator of the course. It is my honest and unbiased opinion. I am also not affiliated with him or his work but I know the creator from his other websites and follow him on twitter: r-graph-g...
ALL Titled Tuesday Chess Tournament WINNERS (2014-2024)
Переглядів 5039 місяців тому
There have been almost 400 Titled Tuesday Blitz Chess Tournaments. And in this animation I show all the winners. The first tournament was won on December 1st 2014 by Daniel Naroditsky. Data source: www.chess.com/tournament/live/titled-tuesdays Animation: flourish.studio/
US Edition of Titled Tuesday 2023 Analysis
Переглядів 1469 місяців тому
Watch the US Edition of my 2023 Titled Tuesday Blitz Chess Tournament Analysis. I focus on the most common match-ups of the top US players and their results and investigate correlations between their ratings, scores and games played on average. ⏱ Time Stamps ⌚ 0:00 - Intro 0:19 - Hikaru's results vs most common opponents 1:12 - Table of content 1:55 - US participation in Titled Tuesday Tourname...
Analyzing all Titled Tuesday Chess Tournaments from 2023
Переглядів 3,7 тис.9 місяців тому
I often watch Chess tournaments on UA-cam, so I was curious to analyze a whole year of blitz games played in the Titled Tuesday Tournaments, sponsored by @chess.com, where some of the worlds best chess players participate. ⏱ Time Stamps ⌚ 0:00 - Intro 1:45 - Data import and setup steps 2:38 - Data structure and variables 4:31 - What was the missing tournament 6:06 - Number of players participat...
ALL 53 ggplot2 GEOMS shown in R
Переглядів 2,9 тис.Рік тому
Did you know that there are 50 different "geoms" included in the ggplot2 package? How many can you name before watching? You can download the R code from this video here: www.skool.com/data-analysis-with-r-6607/classroom/daa88316?md=57ce545b62ca4ea1bf836c052ba5f7e9 I hope you enjoy watching all of them in this one video. ⏱ Time Stamps ⌚ 0:00 - intro 1:00 - point, jitter 2:10 - boxplot, violin, ...
How to Create Pie Charts in R (6 easy ways)
Переглядів 8 тис.Рік тому
In this video, I will show you how to create pie charts in R with different functions that often come from special packages. You can download the R code from this video here: www.skool.com/data-analysis-with-r-6607/classroom/daa88316?md=d9007aa78f5744498326ed8a8d8c203c ⏱ Time Stamps ⌚ 0:00 - Intro 1:01 - graphics::pie 4:57 - ggplot::geom_col coord_polar 9:29 - ggpattern 11:55 - ggpubr::ggpie 13...
How to create Multi-Panel plots in R with facet_wrap() and facet_grid()
Переглядів 6 тис.Рік тому
In this video, I will show you how to use facet_wrap or facet_grid to create multi-panel plots in R and ggplot. You can download the R code from this video here: www.skool.com/data-analysis-with-r-6607/classroom/daa88316?md=fafca7ecf1984ef78c9eda2c945fc07c Faceting plots can be very helpful to compare your data over different categories. It can also help you to get a quick overview of your data...
4 Examples of Using R Functions for Exploratory Data Analysis (EDA)
Переглядів 6 тис.Рік тому
In this video, I will show you four examples of Exploratory data analysis (EDA) using R. EDA is a critical data analysis technique that can help you identify important insights in your data. I will explain the most important functions, that will equip you to identify important patterns in your data and make better decisions based on it. ⏱ Time Stamps ⌚ 0:00 - Intro 1:28 - mtcars 10:47 - gapmind...
Three Important Lessons You can Learn from Anscombe's Datasets
Переглядів 710Рік тому
In this video I demonstrate three important lessons that the Anscombe's Quartet can teach you in R. I will show you different ways to calculate summary statistics. From basic indexing and function calls to apply and for loops and useful dplyr functions like pivot_longer, group_by and summarize. Visualizing datasets is crucial to spot outliers or detect the real pattern and relation ship of vari...
Ultimate Guide to Colors in R
Переглядів 3 тис.Рік тому
In this video I want to show you how you can change colors in R. I start with the basic functions and then give some advanced examples. You can download the R code from this video here: www.skool.com/data-analysis-with-r-6607/classroom/daa88316?md=a489a81dee934eddbb904455c39d88dd ⏱ Time Stamps ⌚ 0:00 - Intro 0:45 - base::plot 7:37 - mapping colors with ggplot() 13:45 - color based on conditiona...
R Beginner? Start Here and Learn over 100 basic R functions!
Переглядів 4,3 тис.2 роки тому
In this video I want to show you over 100 basic but extremely useful R functions that every R user should know. It should be essential for beginners to have at least heard of them but also experienced R users might find some extra tips in this video. If you want to download the code to these functions you can find it in my free skool community: www.skool.com/data-analysis-with-r-6607/classroom/...
Powerful R Functions Every Data Analyst Should Know
Переглядів 2,4 тис.2 роки тому
Powerful R Functions Every Data Analyst Should Know
How to Create Parallel Plots in R with geom_line() and ggparcoord()
Переглядів 3,9 тис.2 роки тому
How to Create Parallel Plots in R with geom_line() and ggparcoord()
How to use the 4 different norm() functions in R
Переглядів 15 тис.2 роки тому
How to use the 4 different norm() functions in R
Analyzing Monkeypox Cases in R for Beginners
Переглядів 1,6 тис.2 роки тому
Analyzing Monkeypox Cases in R for Beginners
How to add multiple pictures to ggplot in R with image_read and patchwork
Переглядів 1,7 тис.2 роки тому
How to add multiple pictures to ggplot in R with image_read and patchwork
How to Create Bubble Charts in R with geom_point() and scale_size()
Переглядів 7 тис.2 роки тому
How to Create Bubble Charts in R with geom_point() and scale_size()
How to Create Correlation Plots in R
Переглядів 47 тис.2 роки тому
How to Create Correlation Plots in R
How to Create Heatmaps in R with the geom_tile() and heatmap() functions.
Переглядів 4,6 тис.2 роки тому
How to Create Heatmaps in R with the geom_tile() and heatmap() functions.
Animating the Datasaurus Dozen Dataset in R
Переглядів 1,3 тис.2 роки тому
Animating the Datasaurus Dozen Dataset in R
Line charts and Connected Scatterplots in R with geom_line() and geom_path()
Переглядів 3,1 тис.2 роки тому
Line charts and Connected Scatterplots in R with geom_line() and geom_path()
Scatterplots in R with geom_point() and geom_text/label()
Переглядів 13 тис.2 роки тому
Scatterplots in R with geom_point() and geom_text/label()
Contour plots in R with geom_density_2d/filled() and geom_bin2d() [R- Graph Gallery Tutorial]
Переглядів 5 тис.3 роки тому
Contour plots in R with geom_density_2d/filled() and geom_bin2d() [R- Graph Gallery Tutorial]
Ridgeline plots in R with geom_ridgeline() and geom_density_ridges() [R- Graph Gallery Tutorial]
Переглядів 6 тис.3 роки тому
Ridgeline plots in R with geom_ridgeline() and geom_density_ridges() [R- Graph Gallery Tutorial]
From which Leagues do the Players of the EURO 2020 come from? Chord Diagram Visualization in R
Переглядів 8973 роки тому
From which Leagues do the Players of the EURO 2020 come from? Chord Diagram Visualization in R
Boxplots in R with ggplot and geom_boxplot() [R- Graph Gallery Tutorial]
Переглядів 24 тис.3 роки тому
Boxplots in R with ggplot and geom_boxplot() [R- Graph Gallery Tutorial]
How to reorder factors in R (the easy way)
Переглядів 8 тис.3 роки тому
How to reorder factors in R (the easy way)
thank you
I would love to see data on those you use skools native payment processor vs those who use 3rd party for their member subscription payments.
Thank you~ it is very helpful
great video thanks
Amazing video. Thank you ❤
Thanks for leaving such a nice comment :) glad you liked it.
This is great analysis. 👍👍
beautiful! thank you :)
Dear sir, Thankyou so much, your videos are very helpful to learn data visualization in R. NEED HELP: I want to make a graph in which I want to show, percent of income spent and saved which totals to hundred percent for males and females by country. I've tried several ways but am not able to do that. Kindly help. For example; suppose there are five countries. In each country males and females spend some percent of their income and save the remaining. I want to show what percentage of income is spent and what is saved for males and females for each country. So, as per my requirement, the countries will be on the X axis and each country will have two stacked bars; one for male and other for females. Please help me how we can do that in R software. Kindly make a video and upload it. I've searched many videos on UA-cam but didn't find any.
Dear sir, Thankyou so much, your videos are very helpful to learn data visualization in R. NEED HELP: I want to make a graph in which I want to show, percent of income spent and saved which totals to hundred percent for males and females by country. I've tried several ways but am not able to do that. Kindly help. For example; suppose there are five countries. In each country males and females spend some percent of their income and save the remaining. I want to show what percentage of income is spent and what is saved for males and females for each country. So, as per my requirement, the countries will be on the X axis and each country will have two stacked bars; one for male and other for females. Please help me how we can do that in R software. Kindly make a video and upload it. I've searched many videos on UA-cam but didn't find any.
Can you send me an email with the data as an attachment and maybe add an image with a similar looking chart (question@thedatadigest.email). You can also join my free skool community (www.skool.com/data-analysis-with-r-6607/about) where you can download my r-scripts and post your requests.
@@TheDataDigest Thankyou so much for prompt reply.
hikaru guy seems good
He looks a bit over powered. But Magnus actually is equally good if he competes in the tournament.
Thank you
You can download the R code from this video here in my free skool community: www.skool.com/data-analysis-with-r-6607/classroom/daa88316?md=fafca7ecf1984ef78c9eda2c945fc07c
You can download the R code from this video here in my free skool community: www.skool.com/data-analysis-with-r-6607/classroom/daa88316?md=57ce545b62ca4ea1bf836c052ba5f7e9
You can download the R code from this video here in my free skool community: www.skool.com/data-analysis-with-r-6607/classroom/daa88316?md=d9007aa78f5744498326ed8a8d8c203c
You can download the R code from this video here in my free skool community: www.skool.com/data-analysis-with-r-6607/classroom/daa88316?md=a489a81dee934eddbb904455c39d88dd
www.skool.com/data-analysis-with-r-6607/classroom/daa88316?md=ed11645dd3354f3382e2e1cc246f31c8
You can download the R code from this video here in my free skool community: www.skool.com/data-analysis-with-r-6607/classroom/daa88316?md=76038c9d080c4e67980b1be82150f578
You can download the R code from this video here in my free skool community: www.skool.com/data-analysis-with-r-6607/classroom/daa88316?md=6766c76a86594ff39751a3b618acf00b
You can download the R code from this video here in my free skool community: www.skool.com/data-analysis-with-r-6607/classroom/daa88316?md=ee80e25b6cc04dd5b54212441d7b28a9
You can download the R code from this video here in my free skool community: www.skool.com/data-analysis-with-r-6607/classroom/daa88316?md=12b8c611cb734142af09e4c3f68ac7e4
You can download the R code from this video here in my free skool community: www.skool.com/data-analysis-with-r-6607/classroom/daa88316?md=a92c428d727f47baaa9cd092532d5585
If you want to download the R code from this video you can do this here in my free skool community: www.skool.com/data-analysis-with-r-6607/classroom/daa88316?md=959f19346b794a0d8d5f22de14cd93f7
If you want to download the R code from this video you can do this here in my free skool community: www.skool.com/data-analysis-with-r-6607/classroom/daa88316?md=1213bcd67e104eb88b1a58073b5445cb
If you want to download the R code from this video you can do this here in my free skool community: www.skool.com/data-analysis-with-r-6607/classroom/daa88316?md=7a4fa79b07fe4e6696c1ca3b366b1c77
If you want to download the R code from this video you can do this here in my free skool community: www.skool.com/data-analysis-with-r-6607/classroom/daa88316?md=7ced1d323a514f27b4aa64b78bf60f62
If you want to download the R code from this video you can do this here in my free skool community: www.skool.com/data-analysis-with-r-6607/classroom/daa88316?md=50931fec4d254a4bb51f944c2f8893f1
If you want to download the R code from this video you can do this here in my free skool community: www.skool.com/data-analysis-with-r-6607/classroom/daa88316?md=ec775c430e6644c39bb567e32a6ae7b8
If you want to download the R code from this video you can do this here in my free skool community: www.skool.com/data-analysis-with-r-6607/classroom/daa88316?md=c7e012525e3a4598b90544f50a1e3732
If you want to download the R code from this video you can do this here in my free skool community: www.skool.com/data-analysis-with-r-6607/classroom/daa88316?md=f2cc035c179445a781e5af5c6e27573b
If you want to download the R code of this video you can do this here in my free skool community: www.skool.com/data-analysis-with-r-6607/classroom/daa88316?md=737422c47e9542fd936fdbedc31b4c3d
If you want to download the R code of this video you can do this here in my free skool community: www.skool.com/data-analysis-with-r-6607/classroom/daa88316?md=ab72ef36e9044d4e92d73961557bb7c1
If you want to download the R code of this video you can do this here in my free skool community: You can download the R-code to the video here: www.skool.com/data-analysis-with-r-6607/classroom/daa88316?md=4e962b006ca749978494f223aed14f99
If you want to download the R-code to this video you can do this here in my free skool community: www.skool.com/data-analysis-with-r-6607/classroom/daa88316?md=e32411294ee7464d90d07527746fb9dc
If you want to download the code to these functions you can find it in my free skool community: www.skool.com/data-analysis-with-r-6607/classroom/891d9c01?md=b433f484e5334d08937e6ce12bdda091
Thank you so much for your efforts ❤
My pleasure. Thanks for watching the video and taking the time to comment is such a nice way. If you want to download the code to these functions you can find it in my free skool community: www.skool.com/data-analysis-with-r-6607/classroom/891d9c01?md=b433f484e5334d08937e6ce12bdda091
Very well described
Wow, a single video = hours of online courses. This UA-cam channel should have millions of subscribers. Greetings from Egypt. ❤❤❤❤❤. Please, keep up the great work.
Thank you for a wonderful tutorial!! Do you think I can use this package to create an actogram, vertically stacked bar plot?
That should be possible. If you google "actogram in R" you even find an "actogrammr" package that someone build in 2022. You can email me the image/chart you want to create and we can work on it together. Maybe it is enough to make a barchart and ridgeline plot separately and just join them with patchwork.
Sir pls explain anscombe quartet in any video
Hi Shuchi, what do you mean? I thought the video above explained the Anscome quartet?
Well done. No way around LLMs if you are in scripting. I would have expected chatGPT to get this right from just example values but in general it is very helpful to specify what approach you'd follow yourself when solving this or even just to point out potential tripwires to it.
I first tried to copy the entire html code from the body into chatGPT, but that were too many lines of text. Is there a way to extract the grid or structure info from F12? Or could the online version chatGPT 4.0 access the website and investigate the structure by itself?
@@TheDataDigest it claims it can ("I can certainly help with summarizing or describing the structure of a webpage. For example, I can outline the general HTML structure of a page, explain how its components work, or describe the layout based on what I can access.") but I can't waste any 4o prompts right now :D What you can try is to save the webpage as html and then supply that file to chatGPT, context windows are pretty large by now
This is informative. Usually getting and cleaning the data is the hardest part of most projects
Very true (sadly). There is a project called TidyTuesday, where a clean dataset is created every week, ready for analysis. But this is often an exception especially with new data. But here chatGPT was quite helpful with the separate() function and the conversion based on "k" or no-"k".
Excellent. Very helpful.
Hi, in wich package can I get ""ggExtra"" and ""gcookbook""
Danke für deine tolle Analyse, auch deine Erklärungen sind sehr gut nachvollziehbar. Dein Englisch ist ausgezeichnet. Großartig. Freue mich auf deine eigene Community!
Danke für das Lob und den lieben Kommentar. Ich hatte Glück, dass mein erster Chef Kanadier war und auf der Arbeit fast nur English gesprochen wurde. Also die Community gibt es schon (siehe Link unten), also wenn du joinen möchtest oder sie jemanden empfehlen kannst wäre ich dir sehr dankbar.
This is brilliant! Good job 👍
Thank you. I will post it in the two communities you mentioned with some good screenshots.
Don't know what Skool is and was I was a bit hesitant in clicking this. Still not interested but clicked for your analysis and it didn't disappoint. I ENJOED your chain of thought, EXCELLENT explanation. and GREAT video overall. GLAD I clicked.
Thank you so much Hamed, I spent 10h yesterday for this 10min video but I really wanted to explore the current landscape of the platform. I am glad I found some interesting highlights that you liked. Thanks for giving the video a chance and leaving such an encouraging comment.
Hi Hamed, do you mind if I ask you what the reason is of you not signing up to the skool platform? Are you learning and using R yourself but prefer to study it in a different way? You can be totally honest, I just want to understand what potential barriers people have to joining my group. Also would you know someone that might be interested in learning R in a small group and would join me on skool?
@@TheDataDigest Hey Torsten, I am not using R at all, and that is the only reason. I primarily use Python and SQL. I follow your channel because of your thought process and analysis where it's both intersting and have transformable skills where R is only a tool and I am mostly interested in the results and final findings. And to be fully honest I would say your videos target very niche number of people. for example I found your channel after I got recommended your video about Title Tuesday which I know and follow as a chess player but the majority of people does not. also with this video you are targeting people who know and use skool which is a platform i never herd of, general people will skip these as they don't understand what the video is about. Not to mention that you already targeting a niche community who are interested in Data analysis. Maybe I would have considered it, if it was more general such as "Data Analysis" rather than focussing on R.
@@hamedrajhi Wow! Thanks for sharing your thoughts with me in such a detailed way. It is really helpful. Firstly, Python and SQL is bad ass. It means you manage a lot of data and analyze it in a very solid way, respect! I appreciate why you watch my videos and take it as a compliment :). And everything you mentioned about my niche is definitely food for thought. I will consider making videos that might be more general about analysis frame works regardless of the actual programming language/tools. There might be an entirely new market I could add value to. But also, my most viewed video has >40k views and ~6k people visit my videos per month. So I hope there are at least 100-200 people that want to join my skool community to improve their R skills with me. But again, thanks for making me think about how to better attract them. Have a great weekend!
@@hamedrajhi The next video will be about web-scraping in general but I will use skool again as the target of the data gathering. So it should be interesting to people that want to learn web-scraping regardless of the target url. But I will explain again, what skool is used for and raise awareness.
Спасибо!
пожалуйста (hoping google translate got this right)
Life saver. Thank you sir..
You are welcome. Let me know if I can help you with anything else. For what data are you using the correlation plots if I may ask?
Would be interesting to do an analysis adjusted for age. It's accessible to look up the current values, but since market values are about what a player could potentially offer you in the future, I wonder how it would change if we put in a factor based on age to model the squad quality at the moment.
Absolutely. For example the German Goalkeepers are quite similar in skill but ter Stegen age 32y is worth €28mio vs Neuer age 38y €4m. I am planning to do a bigger analysis with all 622 players where I also show the R code. There I will consider age, games played and other factors. Also, Mbappe worth €180m moved from Paris to Madrid this year without that payment because his contract ended.
@@TheDataDigest cool 👍🏻