Study: GPT-4 outperforms Data Analysts

Поділитися
Вставка
  • Опубліковано 14 тра 2024
  • 📈 My SQL Course 👉 • SQL for Data Analytics...
    Courses for Data Nerds
    ==================================
    📜 Google Data Analytics Certificate 👉🏼 lukeb.co/GoogleCert
    🐍 Python for Everybody 👉🏼 lukeb.co/PythonForEverybody
    💿 SQL for Data Science 👉🏼 lukeb.co/SQLdataScience
    🧾 Excel Skills for Business 👉🏼 lukeb.co/ExcelBusinessAnalyst
    📈 PowerBI for Data Viz 👉🏼 lukeb.co/PowerBI
    📊 Tableau for Data Viz 👉🏼 lukeb.co/Tableau_UCDavis
    🏴‍☠️ Data Science: Foundations using R 👉🏼 lukeb.co/RforDataScienceJH
    ➕ Coursera Plus Subscription (7-day free trial) 👉🏼 lukeb.co/CourseraPlus
    👨🏼‍🏫 All courses 👉🏼 kit.co/lukebarousse/data-anal...
    Books for Data Nerds
    ==================================
    📚 Books I’ve read 👉🏼 kit.co/lukebarousse/book-reco...
    📗 Data Analyst Must Read 👉🏼 geni.us/StorytellingWithData
    Tech for Data Nerds
    ==================================
    ⚙️ Tech I use 👉🏼 kit.co/lukebarousse/computer-...
    🪟Windows Virtual Machine for Mac (Parallels) 👉🏼 lukeb.co/ParallelsFreeTrial
    Social Media / Contact Me
    ======================
    📫Newsletter: www.lukebarousse.com/
    👨🏼‍💼 Linkedin: / luke-b
    🅧 X/Twitter: / lukebarousse
    🌄 Instagram: / lukebarousse
    ⏰ TikTok: / lukebarousse
    As an Amazon, Coursera, and Parallels Affiliate Programs member, I earn a commission from qualifying purchases on the links above. It costs you nothing but helps me with content creation.
    #datanerd #dataanalyst #datascience
  • Наука та технологія

КОМЕНТАРІ • 214

  • @MCPeeBoy
    @MCPeeBoy Місяць тому +94

    My dreams of living in a sunny coastal town working from home for 4 hours during the day and sipping fruity cocktails by night while still living a decent life are slowly but surely withering away

    • @jgonsalk
      @jgonsalk 26 днів тому +13

      Nah, just work 40 hours once and create a script that analyses data with an LLM and then work 4 minutes a day.
      But don't forget to write a script that searches the internet for people doing the same thing and automatically solicits hit men on the dark web because if everyone does this it won't be viable.

    • @WoWUndad
      @WoWUndad 22 дні тому +1

      instead of sorting numbers maybe you should try building something

    • @edzehoo
      @edzehoo 17 днів тому

      @@jgonsalk lmao

  • @richardtvtv
    @richardtvtv Місяць тому +186

    Time to start watching some farming videos

    • @LukeBarousse
      @LukeBarousse  Місяць тому +14

      😂

    • @RunOs3
      @RunOs3 Місяць тому +5

      They have enough water for farming where you live?

    • @NutsAboutData
      @NutsAboutData Місяць тому +8

      I´ve just enrolled to welding classes

    • @RunOs3
      @RunOs3 Місяць тому +5

      @@NutsAboutData That's going to be some hard 12 hour days.

    • @MoneyballTV
      @MoneyballTV 24 дні тому +1

      AI-embodied robots are coming for labor jobs too

  • @davidmiller-td1sl
    @davidmiller-td1sl Місяць тому +69

    I trained an LLM on your SQL course, saved myself 4 hours

    • @elijahsokoni7997
      @elijahsokoni7997 Місяць тому +5

      😂😂😂😂

    • @LukeBarousse
      @LukeBarousse  Місяць тому +22

      Dangit Dave! You weren’t supposed to tell people this!

    • @jameslow7680
      @jameslow7680 Місяць тому +3

      May I know how to do that? @@

    • @maruf7956
      @maruf7956 Місяць тому +2

      What is LLM

    • @Ohr45
      @Ohr45 24 дні тому +1

      Hahaha

  • @ALEX86ZILBER
    @ALEX86ZILBER Місяць тому +64

    thanks, just finished my Data Analyst course....hope the machine will not replace me soon )

  • @afterhours4890
    @afterhours4890 Місяць тому +49

    My two cents is the bottleneck for replacing DAs with AI is the stakeholder communication and the speed of which companies will adopt this technology. Would the stakeholders who are communicating with AI feel confident enough in themselves that they queried the AI correctly to retrieve valid results. I love AI. It helps me out at my job everyday but I don’t see it replacing DAs soon. Keep studying data analytics everyone and use AI to learn more about it! It’s a great field to join! Hope you all break in.

    • @carlosr7804
      @carlosr7804 8 годин тому

      The big difference is speed as much as accuracy, a machine never forgets, does not marry and have kids, do not get sick days, neither respects working hours, always available, no attitude problems, will never unionize.... works on weekends, are dirty cheap to use, you can use more than one to contrast results, you can get a standardized industry model and will never quit. If you are as accurate as that machine, there you go, you have a chance.

  • @wrcz
    @wrcz 24 дні тому +19

    "The purpose of this work is not to replace the data analyst role or to create anxiety. Instead, we would like to explore the potential of GPT-4 to aid human data analysts in more efficient working."
    Well, the corporations don't give a shit what you would like. If it's cheaper and more efficient to replace analysts, they will.

  • @AndyCotgreave
    @AndyCotgreave Місяць тому +36

    Fascinating stuff! One thing not mentioned is that in order to make the prompts work you need to be a.... data analyst. So, at best, ChatGPT is going to make data analysts more productive. Give these tasks to a non-data analyst, and they wouldn't be able to create this stuff in GPT.
    (Yet: I guess that could change some time)

    • @guy821
      @guy821 Місяць тому

      100%

    • @elOtorongo96
      @elOtorongo96 Місяць тому +7

      how about 1 data analyst for prompts doing the work of 10, instead of 10 analysts 🤯

    • @DroisKargva
      @DroisKargva 15 днів тому

      @@elOtorongo96aint no one is working their ass off that much. we are not robots.

    • @DroisKargva
      @DroisKargva 15 днів тому +4

      @@elOtorongo96 Also you need to evaluate these reports. No one is trusting AI blindly. Normal human cant properly evaluate 10 reports a day.
      also One big issue with the study is that the data was OPEN SOURCE. it’s not evaluated for proprietary internal company data.
      I seen how GPT 4 performance in data that is not publicly disclosed or one that is not trained yet and its laughable 😅

    • @rodo2220
      @rodo2220 5 днів тому

      Exactly. The stakeholders aren’t going to know what to ask lol

  • @secretnobody6460
    @secretnobody6460 Місяць тому +169

    Bruh, 31 yo and just started a new bachelor related to data science. Still in my 1st year and now i see this?! I'm dead. Like, what else am i supposed to do now? Im a guy, so no onlyfans option. Lol

    • @elijahsokoni7997
      @elijahsokoni7997 Місяць тому +37

      Well, you can still do ML, NLP, data engineering and business intelligence and AI so it's not that bad.

    • @T.M._Forum
      @T.M._Forum Місяць тому +5

      😂

    • @M1and5M
      @M1and5M Місяць тому +14

      You are in Data Science not Data Analytics, right?

    • @victorn1802
      @victorn1802 Місяць тому +17

      Plenty of guys make money on only fans, lots of gays pay money for that

    • @Qibbles
      @Qibbles Місяць тому +3

      start selling the shovel

  • @basedgod8636
    @basedgod8636 Місяць тому +93

    Bruh they want us all to be fast food workers and janitors

    • @sidharthmandal9957
      @sidharthmandal9957 Місяць тому +4

      😂😂 true. Bartender , body guards, cab driver etc etc

    • @MainEditor0
      @MainEditor0 Місяць тому +5

      Fast food workers will be replaced by androids (it's far future but still fact). Nvidia, Microsoft, Amazon, Google investing trillions in robotics and AI 😅

    • @userkm2
      @userkm2 Місяць тому

      Skill trades is the only way forward.

    • @Cussmem07
      @Cussmem07 Місяць тому +7

      @@MainEditor0 Actually, there are almost no cashiers in the europe for Mcdonalds

    • @teslacybertruck8769
      @teslacybertruck8769 Місяць тому +1

      @@sidharthmandal9957Cab driver will be replaced by autonomous driver

  • @renansk8flip
    @renansk8flip Місяць тому +14

    As data analyst ive never been paid to code or to just make graphs and say what they mean, im paid mostly to understand business and use the data to deliver better products, if i cant understand which information are relevant to the business, theres no work done, its something that llm cant do.
    Of course you can do a list of questions to be answered but the model are unable to understand which one is important to be presented and that is a issue that i cant see being solved quickly specially because those needs are super dynamic.
    But
    People who are the kind of analyst who just plot graphs with same simple evaluations in mind, they should be aware

    • @nav4688
      @nav4688 12 днів тому

      what do u mean by they should be aware

  • @mubashirahmedsiddiqui9243
    @mubashirahmedsiddiqui9243 23 дні тому +4

    Using 'Study' in the title is a smart choice, avoiding using people's worries just to get views. Nowadays, it's hard to find creators who care more about making good content than getting clicks. You deserve a subscribe!

  • @tybaltmercutio
    @tybaltmercutio Місяць тому +12

    How could that non-sensical paper even pass peer-review in such a high impact journal?
    Given the tiny sample size and the fact that only standardized benchmarks have been used, neither the title, the abstract nor the conclusions make any sense:
    It is quite obvious that even GPT 3 would outperform most humans on benchmarks, which are probably part of its training data given the timestamps in the github repository they cite.
    Also the term „correctness“ seems ambiguous in the context of data analysis/science (and many other fields) where your answer most of the time can only be an approximation to the „correct/exact answer“ if that one singular correct answer even exists. How messy was the dataset, how was it cleaned, was there some complicated imputation necessary, what metrics were used and what assumptions/approximations were necessary to do the statistics?
    If any of those questions arise in your analysis, your answer cannot be „correct“ but only an approximation to that. But they seem to have treated correctness as a boolean, which either implies that those data were trivial to analyze or that they actually have no clue about basic science.
    The fact that they compared the costs of humans to a machine makes it quite clear to me that they had a strong bias (maybe even OpenAI sponsored/backed?) as the comparison of cost/hour is quite meaningless in that context. If that metric was meaningful without further considerations no business would even consider switching to the Cloud.
    I guess, if the paper was published without that AI hype, it would have been rejected from each and every reputable journal. I mean the paper reads as if it was written by some bachelor students who are tasked to gain some scientific experience by writing some report about an internship and it was published in a journal with a significant impact factor of > 9.
    I am really more astonished by this than by their „findings“.

  • @omarhassoun4785
    @omarhassoun4785 Місяць тому +1

    a high quality content and a great video as always, thanks a lot Luke 💙
    you're my role model in data analytics. 🙏

  • @saminyead1233
    @saminyead1233 Місяць тому +23

    Man, from what the study shows, I think Data Analysts have a lot to be happy about here. This essentially means, that aspects of data analysis that could not be automated before, can be automated now. The study shows that GPT-4, if given some very specific instructions in natural language, can provide some very valuable outcomes. But this does not replace the need for human data analysts, because it's the humans who can take the fuzzy questions (e.g. hey Luke, why the heck is our sales low this year?) and figure out the best way to approach the problem. So, in this example, Luke can find out what metrics he should be looking at to find the answer to the question.
    As a result, in the end, you still need your human senior data analyst like Luke, he is the one who can bring order to chaos. Once he's done that, he can apply some unprecedented levels of automation thanks to GPT-4. So, it is in the hands of your experienced analysts that LLM's like GPT-4 are such powerful tools.

    • @georgejetson9801
      @georgejetson9801 Місяць тому +8

      Agree. This was a very carefully staged experiment on a clean dataset with a specific set of questions. Datasets are never that organized and ready to go.

    • @adrianmizen5070
      @adrianmizen5070 16 днів тому +5

      Which means the company can fire all of Luke's coworkers and make him do all the work for less pay, since most of his skill set is now obsolete. He's just cleaning inputs and prompt engineering. In a few years, he can be replaced by someone even cheaper with a skill set focused on those areas rather than data science in general. BTW, If the paper authors didn't intend this to threaten data analyst jobs, why did they include a cost comparison?

    • @saminyead1233
      @saminyead1233 16 днів тому +1

      @@adrianmizen5070 It's not as simple as that. Prompt engineering is easy when you have instructions as clear as school homework. Any time you have a fuzzy question - the AI is as lost as a five year old in the woods. But yes, you're right, Luke's 'co-workers' who are doing the more "mundane" parts of the jobs, are likely to be replaced by AI.

    • @oo--7714
      @oo--7714 День тому +1

      ​@@saminyead1233this sounds like cope tbh, when companies want to cheapen out they will

  • @datagus
    @datagus Місяць тому +44

    Of course companies will give tons of confidential data to ChatGPT to perform the analysis.

    • @okplld
      @okplld Місяць тому +3

      Is that what you really think will protect jobs? Lots of companies use apps like chrome and do confidential, sensitive work on such apps(saying this from my own experience).
      These companies will easily find way around concerns for privacy and confidentiality.
      I mean seriously every company use 3rd party tool for different types of work. Just because it is AI it's gonna change much.

    • @datagus
      @datagus Місяць тому +1

      @@okplld I did't say anything about protecting job. However, AI applications have opened a new horizon to data scientist: "AI Engineering". Companies will need AI Engineeris who can build their own custom AI application for their specific purposes. Even Microsoft Copilot will replace basic exploratory analysis and the only input that it will need is a spreadsheet.
      Staying only in the area of data analysis is dangerous.

    • @Gipkykerpich
      @Gipkykerpich Місяць тому

      😮​@@okplld

    • @RoganClipVaultYT
      @RoganClipVaultYT 18 днів тому

      Well for one, gpt enterprise exists, which is completely private, but if it didnt i bet there would still be companies willing to do it to save money

  • @TimWallace1978
    @TimWallace1978 Місяць тому +1

    Great video Luke! I am encouraging my team to use GPT4 to accelerate workflow. One thing I'd be interested to see you cover is how well these tools perform with raw qualitative data. My early tests have shown some promising results, but my concern is they are hallucinations that just sound thematically plausible.

  • @nessim.liamani
    @nessim.liamani 17 днів тому +2

    ChatGPT summary :
    The video transcript discusses a research paper evaluating whether GPT-4, a large language model, can effectively serve as a data analyst. The study compares the model's performance against human data analysts in terms of speed and cost-effectiveness. GPT-4 was found to be faster and significantly cheaper than human analysts, particularly senior ones. The study focuses on three major job scopes of a data analyst: data collection, data visualization, and analysis. GPT-4's performance was evaluated based on its ability to execute Python code to extract data, create visualizations, and generate insights. The model's accuracy and validity were assessed against human analysts, with varying results across different tasks. While GPT-4 outperformed intern and junior data analysts, its performance was comparable to senior analysts in some cases. However, the study acknowledges limitations in the specificity of the questions posed to GPT-4 and the small number of human analysts evaluated. Further research is needed to determine the extent to which GPT-4 can replace human data analysts. Overall, the study aims to explore how AI models like GPT-4 can aid human data analysts in improving efficiency.

  • @Flamechr
    @Flamechr 7 днів тому

    Hello Luke 😀 hope your all well. Hmm is there a way to check the version on dataset you put up on kaggle on the datajobs via the Kaggle API ?. I just want to make sure that I don't start downloading a dataset if I already got it 😀

  • @derpycyclistjr.1943
    @derpycyclistjr.1943 Місяць тому +10

    It's going to be the same story as with SQL. SQL was built for people that have no computer experience so they can deal with data without help of programmers. It didn't happen though.
    It's going to be the same for AIs - there will be 'AI programmers' that will write correct prompts.

    • @AcctistaZ
      @AcctistaZ 22 дні тому +1

      Nuh. SQL is hard for non technical people. Natural language is way easier

    • @derpycyclistjr.1943
      @derpycyclistjr.1943 22 дні тому +1

      @@AcctistaZFrom my experience working with neural networks in order to get what you want from them you should at least be able to write technical tasks and formulate exactly what it should do.
      It's not natural language per se.

    • @adrianmizen5070
      @adrianmizen5070 16 днів тому

      unlike SQL, prompt engineering a completely different skill/talent from programming. If you're writing something in Python, SQL, assembly, whatever, you know exactly what the program will do in response to what you write. Whereas, there is no ChatGPT language spec, you have to get to know its tendencies and experiment a lot to see how it reacts to prompts.

    • @sentryion3106
      @sentryion3106 3 години тому

      @@derpycyclistjr.1943I say it’s still many times easier than mastering sql.

  • @salonisharma1506
    @salonisharma1506 5 днів тому

    Hi, so i am done with my studies, and my tableau license that i got through my college is expiring soon. PowerBI is not available on Mac natively, I do use my windows machine from time to time, is there any other software that you can suggest for me please
    Thank you :)

  • @adnanebekkaoui9480
    @adnanebekkaoui9480 Місяць тому +2

    Statistically speaking their sample of Data analyst is too small cannot conclude on the performance result, however given many small to mid business struggle also with budget to recruit they may be appealed by this, however the quality of analysis repose on domain knowledge. Also comparing annual salary against the instance is not really enough, when performing these tasks give the number of tokens needed and monetize them. Finally a data analyst year salary will not be funneled solely toward a single analysis.
    I think GPT4 do great job collecting data and bring some initial insight that said, it is a matter of expertise, accuracy and cost. People tend to believe AI is cheap but it is not.
    Also side not: before adding AI solutions to your business, a need of a strong data governance strategy to be implementing because it will scale and scale fast. Question: how about your data quality...?
    Prompt engineering is key here. Basically look for a career to become an AI manager :)

  • @MDsiyamAliwd
    @MDsiyamAliwd 10 днів тому

    Hey Luke please give a video for top course to become a advanced data analyst

  • @pepperpeterpiperpickled9805
    @pepperpeterpiperpickled9805 Місяць тому +2

    I loved your videos and wanted to get into Data science, but im glad i never got into data analytics now.

    • @userkm2
      @userkm2 Місяць тому

      I was actually going into this field I am glad I left it early.

    • @Gipkykerpich
      @Gipkykerpich Місяць тому

      Me 2😢

    • @Tradex420
      @Tradex420 28 днів тому

      Lol

    • @Tradex420
      @Tradex420 28 днів тому

      ​@@userkm2what you doin now

  • @gammalgris2497
    @gammalgris2497 16 днів тому

    They have a limited sample and control group. The data is also already prepared for GPT4

  • @saipraneeth8502
    @saipraneeth8502 22 дні тому

    Hey Luke,
    Could you please make a new video about which operating system is most preferred by data analysts and data scientists? I've seen your old videos where you stated that Windows was the winner, but I believe times change. I want to hear your updated perspective, especially considering the new laptops available in 2024.

  • @knw-seeker6836
    @knw-seeker6836 Місяць тому +1

    The thing for me is what happens when it gets hacked etc
    There are so many things to do
    On the other hand better to understand and learn it now then later

  • @userkm2
    @userkm2 Місяць тому

    6:57 to 7:00 sums up what will happen in the near future. I am glad I left this field before I became depressed.

  • @marcelukeje3510
    @marcelukeje3510 Місяць тому

    Do you have a newsletter sir?

  • @marcellogomitoni1632
    @marcellogomitoni1632 Місяць тому +2

    Who created the framework you show at 0:45? Humans.
    How long did it take? Probably hours or days.
    How flexible is it considering the need to get data from other tables/files from other data sources (perhaps with columns with nonsense names, compromised data etc)? Probably very little.
    What if you go beyond "atomic" requests but require long-range analysis that leads to the generation of a presentation?
    I think they have taken a very specific setup here comparable to that of a machine on an assembly line, yet we see that men are still employed to do labor work.

  • @nclsduran
    @nclsduran Місяць тому

    I think that in cost they didnt take into account the time that took for they to develop the notebook, and the database used like the schemas and all that information because some neef to build it in order for the ai to function. Just using the cost off tha appi calls is just one small part.

  • @simaitools
    @simaitools 21 день тому

    There will always be value in people who can ask the right questions.

  • @bshelley0
    @bshelley0 Місяць тому +1

    Automation tools don’t/can’t know the weird stuff that needs to be captured when working with real, somewhat messy data

  • @bakirnolastname3940
    @bakirnolastname3940 17 днів тому +2

    I would like to see how GPT works when a non data analyst asks the questions and gives the promts. The main part of any tech worker is to interpert what the non tech guy wants

  • @hmghareib
    @hmghareib Місяць тому

    can you Lucke mention the link of the paper

  • @financialtrader3435
    @financialtrader3435 15 днів тому

    I'm facing a problem with gpt4 analyst.
    Every time I ask it to do the analysis, it's failing to execute fully. Gets stuck in the middle saying error 😢
    Any solution??

  • @yemunnsoe8450
    @yemunnsoe8450 Місяць тому +4

    Hey Luke, cool video! I gotta say, when I see these GPT-4 analyses, it feels like they're just spitting out what the chart says.
    You know, the real magic comes from understanding the bigger picture and weaving a story around the data. That's where the human touch makes all the difference (maybe GenAI can do better in near future).

  • @mischapeters5204
    @mischapeters5204 Місяць тому +3

    Can you provide i link to this reserach paper?

  • @darkquaesar2460
    @darkquaesar2460 21 день тому

    does it tho or does it just look that way to people who don't know data analytics?

  • @ThatOneDude6009
    @ThatOneDude6009 Місяць тому +1

    GPT will always have issues analyzing larger data sets and the understanding of the industry. Worse case scenario, I can see a demand for data analysts going down but an increase in business analysts.

  • @user-md8sk6em7h
    @user-md8sk6em7h Місяць тому

    Please add a link to the research paper or add the full title of the paper (and journal name, author,...)

  • @micbab-vg2mu
    @micbab-vg2mu Місяць тому

    great video:)

  • @yourube4367
    @yourube4367 16 днів тому +1

    The thing is, you need to follow the line of reasoning regarding AI use to it's logical conclusion. Nevermind replacing data analysts, the real money savings will be in getting rid of the decision makers that use the analyses.

  • @rishisaraf5404
    @rishisaraf5404 Місяць тому +16

    don't worry gpt5 is just right around the corner😭

    • @userkm2
      @userkm2 Місяць тому +1

      Ignorant data analyst and software engineers will find flaws in gpt5 and say don't worry your jobs are safe. And when it fix the flaws and come up with gpt6 these people will say the same. It is sad they are putting people in dangerous situation where they are jobless.

    • @sharmas7586
      @sharmas7586 21 день тому

      Absolutely right ​@@userkm2

    • @orange6562
      @orange6562 17 днів тому

      @@userkm2 software engineers are very safe, AI code is most of the time garbage and it just messes the application depth and integration, roles like analysts, accountants, lawyers which are non-engineering jobs are in real trouble.

    • @andrewtate5252
      @andrewtate5252 13 днів тому

      ​​@@orange6562engineers will be gone way before lawyers, actually lawyers will be one of the last to go, but whatever keep telling urself engineers are safe until u get kicked to the curb one day while being told we got a software to replace your mechanical work.

  • @zzz181085
    @zzz181085 Місяць тому +6

    By the time most people learn about this study, the results will get outdated. The speed of progression for the generative AI outpaces the speed of information.
    We can't keep up. 😢

  • @brianWreaves
    @brianWreaves Місяць тому +6

    AI is only at the dial-up stage, but it won't take 20 yrs for the majority of people to have access to broadband.
    What I'm unclear about, is the level of experience the human, using ChatGPT in this study, had in the DA profession? Then in the real world outside of this study, If the user is inexperienced, how would they if the results are bias, hallucinations, or spot on?

  • @Dee-zy2xv
    @Dee-zy2xv Місяць тому +2

    Carry on folks..DAs arent gonna be replaced any time soon LoL...do ya thing .

  • @JB12JB
    @JB12JB Місяць тому

    I just started learning data analysis yesterday 😅. Now a machine will eventually take it away.

  • @Edg5mx
    @Edg5mx 15 днів тому

    in order to understand handle the information provided by gpt as data analyst, you have to be an actual data analyst, otherwise other people like me won't be able to handle the prompts and determine if the information is accurate.

  • @Major_Data
    @Major_Data Місяць тому +12

    Dey terk errr jeerrrrbs! 😢

    • @RunOs3
      @RunOs3 Місяць тому

      They tuk ur jurb!

  • @ZzZzZiggy
    @ZzZzZiggy Місяць тому +2

    "Spend more time touching grass", you say? That is very... utopian of you. ^^ Wouldn't bosses everywhere just pile up more work on us cause "Hey, you can do it X times faster now that you have ChatGPT to help you!" ?

  • @drajatdiky
    @drajatdiky 24 дні тому

    The title of the article says "Is GPT-4 a Good Data Analyst?" (let's assume it's a topic, a general borderline covering several brief explanation around "Good Data Analyst") yet it sneak an unrelated cost-benefit analysis because of cheeky, unscientific assumption about "AI is considered as a good data analyst if we (as academics and researchers) are able to cut the corners" 😂
    If the author(s) enrolls as an undergraduate in my uni. with this unrevised off-the topic part in hand, the board of professors wouldn't accept his/her research proposal in the compulsory bachelor thesis writing in our university 😮

  • @SeattleDataGuy
    @SeattleDataGuy Місяць тому +2

    Is there a data engineering version of this 🤣

    • @LukeBarousse
      @LukeBarousse  Місяць тому +2

      I’m actually curious about this, as I haven’t found any. There needs to be more research on other data science disciplines as well; not just analytics

  • @RedJoker9000
    @RedJoker9000 Місяць тому +7

    I'm data analyst. Hope this doesn't end me. Especially since I'm disabled.

    • @ss-dax
      @ss-dax Місяць тому +2

      Don't worry as they sell AI courses they advertise like that ,more so If you could learn Analysis by self learning using AI for it would be piece of cake for you .:).

  • @lecturesfromleeds614
    @lecturesfromleeds614 Місяць тому +2

    chatGPT makes loads of mistakes when it comes to computational applied mathematics!

  • @anonymous-yf6ur
    @anonymous-yf6ur Годину тому +1

    If people don't have jobs as a result of AI taking over almost all jobs, people will not have money. If people don't have money, they will not spend on anything. Then what data will the companies analyse if nobody is buying their products?

  • @stupid.thoughts
    @stupid.thoughts Місяць тому +3

    We need a video on *Pyramid Analytics*

  • @gicoss4170
    @gicoss4170 Місяць тому +18

    The end is here

    • @PorkBoy69
      @PorkBoy69 Місяць тому +5

      *not. As a MS student in computer science, believe me I've asked ChatGPT to help on my homework. It sucks at even basic logic. It's great at doing generic tasks that it was trained on some blog post to do.

    • @Zane_Zaminsky
      @Zane_Zaminsky Місяць тому +2

      @@PorkBoy69No

    • @gicoss4170
      @gicoss4170 Місяць тому +5

      Yes is bad for now ,but they are going to improve and then being cheaper we are gone

    • @PorkBoy69
      @PorkBoy69 Місяць тому +1

      ​@@Zane_Zaminsky Didn't ask you

    • @PorkBoy69
      @PorkBoy69 Місяць тому

      @@gicoss4170 Yes future iterations might be a lot better.
      Currently, if you ask it to do anything vaguely innovative, it falls flat on its face. What seems like magic to many users is the same information you could've googled for. I've asked it questions before where it used the exact peculiar (non-technical) wording in some obscure reference I had open in another tab. I would have been impressed if I didn't happen to be reading the exact source it was trained to regurgitate back to me.
      Current version is glorified information retrieval with some glimmers of emergent properties. GPT architecture is in fact a form of probabilistic information retrieval. The only intelligence can occur via emergent properties.
      It has limited problem solving ability or creativity; if scaling increases those abilities rather than just the information available to retrieve than THAT would be a threat. We will see.
      If current version or peers to it is a threat to you as an engineer, either A: the efficiency improvements given to workers allows them to use some modest fraction less workers or B: you are terrible. To be clear, I am concerned about this making labor worth less in general and am not just trying to say "git gud".

  • @DrJack-xn1rn
    @DrJack-xn1rn Місяць тому

    @lukeBarousse. I'm taking courses in Business Analytics and Data Science at a University. Should I continue taking these courses in your expert opinion? Seems rather ummm not so great at this point.

    • @LukeBarousse
      @LukeBarousse  Місяць тому +3

      I'm still very optimistic about the field of Data Analytics; I think it'll involve the use of AI tools (like LLM agents) more in the future but will still ultimately need a human-in-the-loop to make sure things are going right.

    • @SomeStatus
      @SomeStatus Місяць тому +1

      @@LukeBarousse will there be a new roadmap? I've been studying for the last year to become a data analyst, but have been working full time just as an Aldi worker so I have no domain knowledge nor a degree. Extremely discouraging and daunting for someone like me to hear that GPT-4 is on PAR with the SERNIOR ANALYST and above the intern :/ . Feels extremely hopeless whenever I have my study sessions now because it feels like a waste of time. Very lost.

    • @shanekylerfoxx5978
      @shanekylerfoxx5978 22 дні тому +1

      ⁠@@SomeStatus For over a year now, I've been hearing about AI replacing data analyst jobs, and it seems there's only been an increase in data analyst jobs.Don’t feel hopeless

  • @laverdadbuscador
    @laverdadbuscador 17 днів тому

    Idk...Ai scares me like anyone else. The idea that all the desirable jobs will be replaced by Ai leaving us with only back breaking hard labor jobs makes me wanna vommit.
    Only thing that kinda brings me peace of mind is knowing that there should eventually be diminishing returns. By this i mean, the cost required to invest in the tech is too high where it doesnt make financial sense.
    Example. We still have human cashiers. We still have truckers. We still have bank tellers. We still have tax people. We still have travel agents. We still have normal vacuums. List goes on and on.
    There are many examples of where there are already viable robot alternatives....yet they're not all mainstream. Humans will be bias towards prefering humans. Sometimes i dont want the drama of people, but i think sometimes humans are just better at certain things.....i mean heck companies wont even invest in WFH half the time because they believe face-to-face is "needed".
    Idk i think the idea that all of our problems are suddenly over and Ai is going to do all the innovation now doesnt seem right.
    I think what we're really going to see if job requirements get dramatically higher AND entry level jobs basically disappear.

  • @Tango8787
    @Tango8787 Місяць тому

    Hahaha! GPT has not seen the back end of my company! Good fucking luck! So analysts will end up spending their entire workday explaining to GPT what each field in SQL actually means. I'm sure it performs well with cleaned data with field names like date_of_referral but it'll be completely lost when the fields are named cmod_temp_range_txt
    I'd like to add that I'm not trying to crap on gpt, I love gpt and use it daily at work. I just don't see it taking over my position anytime soon. Eventually but not now.

    • @adrianmizen5070
      @adrianmizen5070 16 днів тому

      What happens when people who specialize in prompt engineering and data cleaning (as opposed to general data science) start coming out of college? Totally different, and more common, skill set and talents compared to what is needed for general data science, and they will be much much cheaper.

  • @tesoulx
    @tesoulx 21 день тому

    Yes, give your data to open ai… what a good idea

  • @HughAnthonyEdward
    @HughAnthonyEdward 25 днів тому

    Bruh i just graduated. Im cooked

  • @alanbalsan
    @alanbalsan 20 днів тому

    I don't mean to be rude towards data analysts but doesn't your job was kinda repetitive in nature? Most of what I learnt in the master was using Pandas to generate charts and preprocess data with a few commands.

  • @syedhammad1962
    @syedhammad1962 Місяць тому +2

    Bro i just enrolled myself into GOOGLE DATA ANALYTICS Cert with coursera based off on last video....
    Luke should have asked me to wait 😭

    • @elijahsokoni7997
      @elijahsokoni7997 Місяць тому +3

      Do it. It's pretty basic. After that, do the advanced one.

    • @lordmetron4519
      @lordmetron4519 Місяць тому +1

      Do the Ibm

    • @georgejetson9801
      @georgejetson9801 Місяць тому +1

      Just do it. I've been waiting for computing to end for 40 plus years now.

  • @it2603
    @it2603 Місяць тому +3

    Time to get into plumbing

    • @userkm2
      @userkm2 Місяць тому

      Seriously that will secure your future.

    • @aminebarnat6528
      @aminebarnat6528 27 днів тому +1

      @@userkm2 It won't, when most white-collar workers will flock to blue-collar jobs, it will drastically bring the pay down, by increasing competition. The right answers to this AI disruption is taxation of profits made by AI to allow Universal Basic Income (UBI).

    • @wrcz
      @wrcz 24 дні тому

      @@aminebarnat6528 The only way to "secure your future" (not really) is to "make it" ASAP by investing into whatever is related to AI. Tech companies, GPU manufacturers etc. You have to get on board and stay there. The stock will keep rising. It's the last chance to leave the upcoming slave class. But even this might not be enough. The economy is gonna explode and if you're poor when that happens, you're gonna be poor forever. The ladder is being pulled.

  • @derekeano
    @derekeano 13 днів тому

    YOOOMAN Data Analyst

  • @followyourideas
    @followyourideas Місяць тому

    I'm a data analyst and even though I use chatgpt and it's very useful it couldn't do my job.

    • @Gipkykerpich
      @Gipkykerpich Місяць тому

      Can you explain more 😢

    • @followyourideas
      @followyourideas Місяць тому

      @@Gipkykerpich for example it's useful to detect spelling, or logical mistakes or to remind me of functions but it can't tell me what tables from my company database I should use and how to retrieve information because it doesn't know what information is inside the system and what it is or mean.

    • @userkm2
      @userkm2 Місяць тому

      @@followyourideas Aww what a sweet a naive thing to say. I said the same at my cashier job ooops self checkout kicked me in the ballz

    • @followyourideas
      @followyourideas Місяць тому

      @@userkm2 You can't compare a mechanical job like cashier with a data analyst.

    • @mithras666
      @mithras666 20 днів тому

      You can give it access to ALL this information. ​@@followyourideas

  • @sue6091
    @sue6091 18 днів тому

    Where's the damn government?

  • @yoverale
    @yoverale 19 днів тому

    Intern is using GPT anyway 😂

  • @PowerGurhl
    @PowerGurhl 18 днів тому

    All these videos and ChatGPT doing this and that is a bunch of hype. Some of the videos like Devin the software developer have been debunked.

  • @mikkosilakka
    @mikkosilakka Місяць тому +2

    its over bro

    • @andrewtate5252
      @andrewtate5252 13 днів тому

      Mass unemployment and mass starvation in 10 years.

  • @billykotsos4642
    @billykotsos4642 27 днів тому

    Don’t worry it has no idea what it’s doing… lol

  • @blaisemomin1106
    @blaisemomin1106 Місяць тому

    Bruh I haven't even started😭
    Time to pivot to music

    • @Xaviallin1
      @Xaviallin1 24 дні тому

      Music can be made with AI too bro

  • @iggy_sativa
    @iggy_sativa Місяць тому

    Please video about touching grass

  • @guy821
    @guy821 Місяць тому +2

    Gpt5 will be better than any data analyst

  • @sanjaybhatikar
    @sanjaybhatikar 22 дні тому +1

    Bro, you are really quite gullible.

  • @lordsneed9418
    @lordsneed9418 19 днів тому

    hehehe

  • @anangelsdiaries
    @anangelsdiaries 21 день тому

    Well...shit.

  • @Major_Data
    @Major_Data Місяць тому +3

    First!

  • @MystifulHD
    @MystifulHD 4 дні тому

    pray for communism

  • @erwerwewerwer4575
    @erwerwewerwer4575 Місяць тому +8

    in summary: the study is B.S lol

    • @kamipls6790
      @kamipls6790 Місяць тому +3

      Good luck in the near future.
      Your workspace is digital, highly relying on mathematics, data collection and logic.
      Pretty much every field this technology thrives on.

    • @Helixur
      @Helixur Місяць тому

      In summary you're unable to evolve, unable to understand/ playing with things that's beyond your intelect or will left behind like fossil pick your poison

    • @vips078
      @vips078 Місяць тому +1

      Every high paying field depends on logic, knowledge and experience. Do you want to go the manual labour route, too bad you can't compete with South Asians here too.

    • @erwerwewerwer4575
      @erwerwewerwer4575 Місяць тому +2

      @@vips078 lol if you believe in this study with a small sample size and dodgy methodology I think you should consider the local KFC as your future job.

    • @andrewtate5252
      @andrewtate5252 13 днів тому

      ​@@vips078i can do the job of 4 south asians easily, malnourished, skinny and short south asians against a 6'4", i do not think so.

  • @codygoldade3984
    @codygoldade3984 Місяць тому +1

    Brotha Luke you never responded back to me on the course 😢