Day in the Life of a Data Analyst - SurveyMonkey Data Transformation
Вставка
- Опубліковано 6 лют 2021
- NEWEST Day in the Life of a Data Analyst: • Making Money (as a dat...
Patreon: / shashankkalanithi
R Version is LIVE: • Day in the Life of a D...
Excel Version is LIVE (Courtesy of Василь Салик): • How to transform data ...
This is a tutorial of a project I did for a client where I transformed data using Excel and Python. I explain and walk you through the entire process to do this yourself and provide the files and code at this GitHub link.
Github: github.com/kshashank03/Survey...
Files: drive.google.com/drive/folder...
LG 35in Curved Monitor: amzn.to/39pPzR3
Twitter: / kalamari95
LinkedIn: / shashankkalanithi
Want to become a Data Analyst like me? Check out my FULL ROADMAP to Data Analytics: ua-cam.com/video/-AbAm4t4FYQ/v-deo.html
Hi Shashank please make more, its been a year now and we want more videos of data cleaning and transformation in this series
Please increase the font size in the videos you make from now on
Can you please share the link of the excel file for this data if possible?
Bro do you have any course ?
15:10
I dont understand what u did there
Finally, actual real work and not just "i go get food! now im drinking coffee."
I’m glad you like it Yui! I hope you like my other videos too
Lol!!
Absolutely right... I was about to say that..
Hahahahaa
Exactly!
Just stumbled upon your vid, and THIS is what I am looking for in a "Day in the Life of", not a food tour and fancy office spaces. Thank you very much, you've got yourself a sub. Please keep up content of this nature, it will be very well received!
Of course laalaa! That’s exactly what I was going for . New video coming out at Sunday 12 MDT.
@@ShashankData You're doing it real well my friend. Ill check it out asap!
@Duncan Marshall Yeah man. A day in the life of a X should entail the actual work. Really bugs me that there is so scarce material on actual work tasks in the DA/DS fields. Of course I know it might be hard to share specific use cases. But come on, its like they only wanna flex their company perks... something real eager learners gives 0 shits about.
@Duncan Marshall Yeah who knows why... but i appreciate people such as Shashank working against that!
Thanks for the support guys! In addition to these videos I’m also putting out a series on my journey to learn machine learning along with snippets and code I make through the process. A true day in the life of a Data Analyst!
You have my respect, finally someone who showed the real thing. This helps people understand that a vlog with a cafe and a cute keyboard is something for those who are crazy to become a youtuber and can't stand all the good and bad of the profession. Go with everything, congratulations, hugs from Brazil!
Wi
Or, 8 minute videos are just 8 minute videos showing a very tiny part of the process (and even the creators put a lot of real work behind cameras just for 8 mins).
Your the first person I’ve seen that actually shows the process of your day instead of your lunch breaks! We thank you!
I work as a Data Scientist at one of the big banks and this popped up in my feed and had some time to kill on a Friday and man this video is on point. Great work, we need more people like you!!
Thanks Dave! Just checked out your UA-cam channel and subbed!
@@ShashankData mutual. Great stuff man, looking forward to more.
Maybe you guys should collab on a data engineering + data analysis tutorial :0
lol same killing time on Friday
What does a data engineer do
fantastic video Everybody wants to be financially independent and live a better life. With savvy investing, an inexpensive lifestyle, and diligent budgeting, this is not difficult to do. I'm glad I realised early on that achieving financial freedom requires hard work.
@@marcelrobert9569 Would you mind recommending a specialist with a variety of investment options? This is extremely rare, and I eagerly await your response.
Reporting all of y'all
It makes me incredibly happy to see what you ACTUALLY do in the job versus a "I'm a data analysis and this is everything that I do, except the actual data analysis" video. I have questioned myself over if I'm capable of joining this career field, but seeing what it really is gives me allot of reassurance that I'm not in way over my head. Sincerely, thank you
Im in the middle of my "mid-life crisis" and thinking of switching to data analyst career. you have made it so much easier to understand the job and what you are doing on a daily basis! Please continue making more of such series so we can learn more from you!
Just an heads up, this is far from being the bulk of what data analysts do. There are, imo, 5 main things data analysts need to do:
1 - identify data they need to study for a given problem
2 - collect this data, through polls, for instance
3 - clean the data
4 - analyze it (i.e. take the "raw" results and produce statistics)
5 - interpret it to get to any useful conclusion (or else they're just numbers)
In this video he pretty much focused on point 2 (excluding the actual form) and 3, while barely scratching point 4, and did nothing for points 1 and 5.
Most data analysts spend their fair share of time in points 4 and 5, perhaps point 1.
I think this "job" was more of a side hustle than an actual job at a company or something.
@@carlosmspk thanks for the breakdown. I was thinking of switching my career as well. Any suggestions. I’m also watching Cisco and Simplilearn vid and free courses.
@@vonnpowell3844 I'll watch these and come back to you!
@@carlosmspk What's your recommendation? I'm thinking about switching my career as well to Data Analyst to a company. Which industry do you recommend?
Nice I had a mini one in my mid 30's now I am Research Analyst but I work with Data Analyst and this is what they do.
I loved the troubleshooting process through this. It's so refreshing seeing somebody who's talented actually work through issues that might arise like the n/a issue. Rather than seeing a scripted tutorial that just blasts through every problem that comes up.
Thank you! I try my best to show you the real process I go through in solving these issues.
im not even a data analyst but this video was insanely fascinating and informative. you're doing great work, excited for all the future data analysts you guide and inspire with such quality content
THANK YOU!
I’ve been self learning data analysis skills such as Python, but I felt like I was lacking an understanding of real world implementation; how real data analysts apply these skills in the real world. This video has reignited my motivation to continue pursuing this career.
You explain things the same way I think, so you held my interest throughout the video. I will subscribe and watch all of your other data analysis videos.
Thank you so much Samantha! I have a ton of free tutorials in everything from Python to SQL to my newest one in Excel. I hope you find them useful!
I'm on the same journey as yours 🙏 keep learning
@@debanjandutta2235 thanks, you too! I actually did it! I’m 3 weeks into a data analyst job and I love it!
Hey samanth, im into journey of pursuing a data analayst job. Currently working as a data associate in amazon. Can u share what sort of certification or projects helped u to get into ur job?
@@aruljoseph5162 I really started simple and got lucky with a company that saw my potential in place of a lot of established experience. I studied CS in college 10 years ago so I have programming knowledge, but in terms of other certifications I’ve only done the advanced Excel certification on LinkedIn. On my resume and cover letter I emphasized my skills in SQL and my thought process. They gave me a company-specific project to do and present to them a week later. At my job I use SQL and Tableau the most. I’m new to Tableau but picking it up really fast and I like it. I’ll probably get a Tableau certification next. I’d advise you to decide which tools and types of analytics you like to do most, get really good at them, and look for jobs that specifically need those skills.
As a DA myself, knowing most of it, I am 32 minutes in and still watching because you are so good at explaining. Fun to watch!
💯 I like how he carries you along as he works...
I'm getting to see DA in action. Pretty cool
i know nothing i watched 28min straight
waste of time
District attorney!
This is unreal that you presented everything in a tremendous way without fluff. I was totally expecting a cell phone alarm going off and you waking up and drinking coffee.
Great video and your time to do this is much appreciated.
every tech career should make “one day of...” like him.
I'll give you "Day in the life of cybersecurity", which is me trying desperately not to kill myself before the clock hits 5pm or so.
@@mxbx307 Would you mind going into a little more detail? I was thinking of getting into cybersecurity, but I've heard others echo your same sentiment. What's so bad about it? I thought it would be fun to learn tech and help catch bad guys.
This is what I was looking for, end to end real live analysis. I really liked the way you explained each and every minute detail without any assumption. Looking forward to more such videos. Kudos to you Shashank!
You'd make a great mentor dawg. Thorough explanation without sounding condescending or overly technical. More likes deserved for this video.
I watch his video and I feel like I'm getting a apprenticeship and being mentored.
Learning the transpose paste option in the first 15 minutes of the video has already blown my mind. Thank you so much for doing this.
right? like that part alone just changed my life lol
I never thought in my life that I would enjoy a video like this so much. You're great at explaining your process in a way that I can see and understand. Thank you!!!
I just randomly watching this video at 1 A.M eventhough having zero idea how I would use this skill, but stick till the end because I was fascinated with how detailed and easy to undertand your explanation was. Loved the video
This is amazing content, Shashank! I love how practical and realistic it is. Really helps aspiring DAs understand what the work is truly like. Gonna be sharing this widely - tons of folks in my community are looking for this exact thing!
Thanks so much Varun! Anything to help and inform people who might be looking!
This is great! I actually spent my Saturday evening watching this. Thoroughly enjoyed the video.
same here, worth investing time on such videos
i like how you include your mistakes or told how some of the things you don't know. Loved how real the video was. Total worth watching this rather than just tutorials.
Out of the tons of tutorials I've watched, I'd say this is one of the most instructive. Great job! Thanks!!
Facts ,
Pup?
That was a great tutorial, teaching seems to come naturally to you. Keep up the good work!
There is positive light in see in your tutorials. Amazing Shashank, really want to see more videos like this. Thanks
This is real, easy to follow and such a gem amongst all other "9AM-its-coffee-time" video. Please continue making them you're such a great teacher too.
This is exactly what I want to see. I'm changing career into D.A and videos like this helps a bunch. Thank you!
Glad it was helpful! I'll continue to make videos like this!
I agree, this allows me to see how to get or manage data in tables. I’ve waited a ton of videos on feature engineering but I’m still unsure how to even do it in real life.
What was your before carreer..?
@@ShashankData sir,I am from arts background.I want to become a data analyst.Can u plese tel me from where should I begin with
Hello there! I am changing career path too; started Google Data Analysis certificate three weeks ago! I still feel so unprepared though... keep it up! Good luck
wait.. why did I just watched every minute of this instead of working on my school projects? Wow man you are so good! I didnt even blink.
Hey man, just wanted to say thank you for the great content! This is exactly what I needed to see, day to day work tasks and an honest picture of what the job could be like.
By far the best tutorial for data analysts. I now work as a data analyst and this framework is essentially what I do everyday for cleaning datasets, just with some minor tweaks. Honestly props to Shashank for creating such a great tutorial that encapsulates what a Data Analyst does.
Hey Shashank, I just wanted to take the time to thank you for this amazing tutorial. I’m currently working on doing some analysis for a a Survey Monkey export myself and although I’m a pretty advanced Excel user and a beginner with Python and Pandas, I must appreciate the detail and explanation you provided with respect to transforming the data in Excel. Your tips and guidance towards a step-by-step methodical approach to prepare the data before importing it into pandas and taking the time how you show how to transpose the headers and merge them, how to preserve the source data by making copies before editing, pitfalls to avoid, and everything else you showed is priceless and truly appreciated by someone whose going through the same/similar process. Hats off to you, sir for putting this out there. This tutorial is just friggin’ awesome. Keep up the great work and I look forward to all your other tutorials.
Hi Shashank, I really appreciate you for creating something so meaningful! I have searched for a lot of day in the Life of a Data Analyst videos but have never got a chance to find something like yours. It really gave me a lot of insights. I'm looking forward to much more of different kinds of analysis and viz tips from you!
Thank you Chandhana! Comments like this inspire me to keep posting
@@ShashankData Thanks lot for the video! Can you do the analysis part of this data set as well. this is more of data cleaning I believe..!
@@ShashankData Hi Shashank, its great to see videos like this where a beginner like me knows how to approach work and be skilled rather than entering with no clue. Thank you. Please post more videos like this.
Now I have the confidence that I can do something well though its a long way! Eagerly waiting for your next video
I love this! I'm a post-doc researcher and have been looking at data science/data analyst jobs, this is such a good insight 😀
Yes!! I love how i literally see how all I'm learning in my data analytics course is being applied. Thank you so much for this video. 🙏🙏🙏
Thank you. I learned those codes with absolutely no clues on how it would be use in real life projects. Now it makes so much sense. Keep on great work!
Thank you so much Thu! Feel free to check out my other videos too :)
In the early transformation of your raw data in excel around the 11min mark, you could select the range holding blank cells you want to do the filling, use the “go to special” and select blanks, excel will highlight all the blanks cell, while it’s being selected you just have to type in “=“ then choose the cell above and press “ctrl + enter”, excel will auto fill the column. The steps above can be done with excel power query as well
power query can aplly fill-down!
Love this!! Exactly what i was looking for - please go over more of your projects!!
This was super helpful and great to watch; an ACTUAL "Day in the life" video. Thanks man!
This video is amazing. I hope you can post more. It's very practical and I picked up a lot just by watching a snapshot of what you do in real life. Thank you for sharing.
Thanks T Socks that means a lot. I'm trying to get another one out on a geospatial analysis that I did.
Great video, I enjoyed how you took a moment to describe literally everything you did. As miniscule as telling the viewer how can they understand different columns from the python output. Most developers, programmers and data analyst would perhaps forget to mention it, but you are pretty resiliant at making sure the viewing experience is easily digestible, no matter what background the viewer might belong to. Great job, can't wait to watch more of your videos 👍👍👍
This was amazing, keep on uploading in this format. Comes across very easy to follow and natural. Thank you.
Starting out my data science journey and this is the content I need! This is so good.
Keep reppin' the community!
Hey guys. If you're looking for an Excel version of this tutorial then check out Василь Салик's channel here: ua-cam.com/video/Z3Ifa37tXak/v-deo.html
He does this entire transformation using PowerQuery. Thank you so much Василь! This is the type of supportive analytics community we want to build!
Hey Shashank if you could start a series of Pandas tutorials, that would be very helpful. Considering all the tutorials out on UA-cam they just happen to each the basic steps. I know it's a big ask, but it would certainly be very helpful.
I was going to say the same thing, not real much coding is needed for power query and you can do what you did even quicker.
good job bro!
For the transpose formula thing around 15 minutes in, just go into the paste special dialogue, tick values and transpose :)
Very cool to see this done with code! I was thinking most of this could be taken care of in excel, but the melt method you used in Pandas came in clutch.
this is amazing bro, I've learned more from here about actually working with data than all the fancy tutorials i've been watching. Thanks man.
Found you on tiktok and your day in the life is actually amazing, I feel like tech jobs and their companies are over glamorized and there’s a lot of content that shows someone living in luxury, grabbing a cup of of coffee casually and then going home, when in reality that’s not at all the truth. The fancy offices and stuff comes with it but they never really show their actual job and what they actually get done and this is refreshing, so thank you!
- a future data analyst
What a wonderful presentation. Very methodical and real. Extremely helpful! Hope you continue to produce content like this in the furture.
This is perfect, make more tutorials like this on different projects really helpful
Will do!
This is genuinely some quality content. As a data analyst myself, who is just starting out in the industry, it's really helpful to learn the best practices and tips that you shared as a part of this video. Looking forward to more of this. Cheers!!
Thank you Ankit! You should share some of your insights as well. We're all learning here :)
Do you have any tips for getting into data analyst industry? I'm looking for data analyst internships :)
@@danielgarrison7463 learn python and start with basic projects that you can find online. Pyhton is a must, sql in later stages is an add on.
It is really good learning to watch you do project like this. I really like that you show when you do something wrong, you think and try out things. And best of all , you explain everything in a very good way! Thanks for helping me learn from you
Great video. As someone starting out in Data analysis it’s cool to see someone work through a problem.
Keep it up man.
This is one of the greatest tutorial videos I've ever seen. It was awesome watching another data analyst work, as I don't really see myself as a data analyst despite doing very similar things as this on the daily (sans python). I've been kind of siloed in my current position and haven't really had a barometer to compare my work to. I learned so much watching this video and now I want to dive into coding.
You sir are a fine human being. This perspective is great for someone who is learning individual tools but doesn't have experience using them collectively. Thank you for this channel.
Thank you Luis! I'm glad you liked it
sir
Thanks for the video, you do an excellent job explaining your thought process through out it, can't wait to see more.
That was a good watch, I didn't even realise it was an hour long clip!
Fantastic video sir! I am just starting out in the field of data analysis, still working primarily in spreadsheets. It was enlightening to sit over your shoulder, watch how you manipulate data, while listening to you explain what you are doing and why. I'm at least 100 steps away from being at this level, but this really helped open my eyes to what a future job in the industry could look like. Thank you for taking the time to create helpful content.
sir
Well stumbled upon this video out of nowhere and to say it’s a blessing for an aspiring analyst to know what I am getting into . Keep up the good work buddy subbed.
This was extremely useful ... It felt simple and structured... Not overwhelming at all... Glad you tool the time to share this on UA-cam ✌🏼✌🏼
Hi Shashank,
I'm almost a fresh graduate in Data Analysis, so great to see someone who can really show what it is actually like to be one! I really appreciate this and also I've subscribed. Can't wait for more videos. :)
This is really awesome! The algorithm suggested a video on the google data analysis course to me a few weeks ago so I be been researching whether for not I should take it and I’ve been confused as to what the job actually entails but watching your video gives me clarity and honestly this is really satisfying work and I’m very motivated to start the course and start doing projects!!!
Hope to see more of this kind of video. I really enjoy the video and buddy, great work!!!
Great video, this is what exactly I was looking for! Please do more like this. Thank you.
As someone who is considering going back to school for an MBA in Data Analytics, this is super super super super super helpful to see what the day to day could look like and to learn a bit more. Thank you so much for going through everything, showing some common mistakes, working through it, and highlighting your reasoning for doing certain things. Thank you for doing this!
Currently in a Masters program for Marketing Analytics and it helps SO much to see what I've learned being applied in a real world setting. It gets difficult to understand the purpose and what things do when it's all in a textbook setting. Thank you for sharing!! This excites me even more to become a Data Analyst!
I absolutely loved your video! This is exactly what I was looking for. Actual work as an analyst. Will be looking for more of your vids.
Good content. You are excellent at explaining not only what you are doing in the moment, but how and why. Subbed
I kinda don't want this to blow up so the competition doesn't see it. Good job dude.
Hahahaha thanks Flexporter. I’ll keep pumping out the content.
@@ShashankData I think a video on general organization and other ideas you mentioned in the video would be great. I'm just starting out on this, so I don't knkw much and your info helps a lot. Thanks :)
He showed nothing special here. Just basic stuff
@@WilliamEllison You got it! I'm trying to show people how easy it can be to break into the world of analytics. Although not sexy, Data Cleansing is the most time intensive and arguably most important part of the modeling process. If you have a more advanced topic you'd like to cover please let me know! :)
@@ShashankData ill let you know. thank you
As someone who already took a data analytics boot camp and is now a learning assistant, and who is already familiar with most of what was shown in this video, this was a great tutorial and showcase of what an actual data analysis job would look like. Thank you.
Yes i was searching from a month , today i got to know how this works
Hey man! Thanks so much for the video. I love the way you explain what you're doing at each step to make sure that we're following along. I'm a Computer Science graduate and I'm trying to teach myself Data Engineering and your video just gave me a window into what an actual job might look like. Thank you again and please continue to make videos like these.
Two years later and this is the best video about data analysis that I have come across. Shout out to you stranger for inspiring me!
FINALLY! someone who showed the "ACTUAL" work🥰
Currently in a DA bootcamp and it's dope seeing this from a real life perspective. Awesome content with great play by play explanations.
Thank you Josafath!
Its super helpful just to hear the thought process behind your work, thanks for making this!
Wow, thank you soo much for walking through this. You showed me how it is done and your commentarty was fantastic.
Thank you sir. I am an aspiring DA. And wanted to get started. Been looking and training for a lot time and have almost lost hope. But you have made me realize it is really fun and interesting to deal with data ❤️
I'm a medicine student and I love this things. I like to get along with numbers, statistics and Phyton and I think my future would be in epidemiology or some kind of specialization with a data analysis.
Thanks for keeping alive that dream for sharing your day!
Amazing video! This makes it so much easier to picture what DA tools are actually used to in a real world scenario. Thank you
Dude !!!!!! You are amazing for this format. It's such a huge disclosure for us transitioning into Data Analysis but in very initial phase like the ones you know going through courses on courseera. Much love, connecting you on linkedin too.
A cool way to do paste special values is to add Paste Values to your Quick Access Toolbar at the very top. The commands there can be accessed via ALT + {position of the command in the QAT}. So, if your paste special values is in the second position, you'd copy the data with the formulas, then press ALT+2 and your data is now pasted as values.
If you just know how python works you can turn excel into a monster. You really don't even have to know how to code. Great times we live in. This is great for me because I have turn excel and logic into a budding career. Cheers to Shashank for a great vid!
Would you recommend any specific set of tutorials?
@@buak809 yeah i'm intrested too
Very interested! Do you have any courses you recommend, perhaps on Udemy?
just saying python is free but not excel
@@username42 anything is free when you sail the seas
Dude - I am 27 minutes into this vid and it's absolutely great, the way you explain every single line, is like the best way to learn this stuff, instead of like a broad explanation, you go into basic details! keep it up
one of the best tutorial on data analysis I have come across. Amazing work man! THUMBS UP:)
searching what are two vertical dots called would be the most programmer thing ever, liked.
Your video just popped up today, 11 months after you released it. Great video where you explained a few things I wasn't aware of in Python. I am a data analyst and spend my days manipulating all sorts of data sets so it was good to see you working in the trenches. I have seen many people say Excel is irrelevant for data analytics but I am not sure what world they live in. In your video I thought you made things a bit hard for yourself by not eliminating the columns you didn't need in Excel before calling the file into Python. Even creating a third sheet and trimming the columns in there so you didn't have to code them out in Python later. Another thing I would have done (I know there are many ways to approach these projects) is to shorten the column titles and especially order the Question numbers so that there were in numerical order - eg: Q01, Q02... Q17 etc. This could easily been done in Excel as prep work. The Questions appeared as text in Python so Question 2 appeared after Question 19. Good video though, will check out the other you have made.
This is so brilliantly helpful. Thank you! You have a great voice too, very clear! 😀
What a Brilliant video! I am in the process of changing my career to a Data analyst and THIS is precisely what I was looking for! I have subbed and looking forward to more of such content. Thank You!!
Honestly the work seems super boring to me 😭😂 But thanks for the realistic video
Very informative and fruitful project video
Thank you so much, I've watched countless videos. This is the first showing the actual work.
Thanks for putting together such a great tutorial. I am an entry-level data analyst looking to broaden my skill set and I found your video to be very insightful. In addition, your screen presence is awesome. Keep up the great work! 🔔
I just graduated with a degree in computer science and am still trying to find my specialty. I really enjoyed this. I know it may be a bit of work, but adding chapters with timestamps for long videos like this would be extremely helpful. It would allow us to find important parts like the melting or certain excel functions quickly.
Totally agree. And it increase the views too as they know there are variety of interesting parts. A channel I subcribed to got x2.4 views after putting timestamps on his 2-hour long video
Computer science = webdev
Computer systems = computer science
Computer architecture = computer systems
I've had someone show me how to do this in this detail at a BootCamp, but never have been able to find an actual video online that went through it this well. They always make assumptions that you know all the ins and outs of python for data analysis and rarely take time to explain why something is right and why something is wrong. This video may be an hour long, but it saves people tons of additional time they would have had to spend figuring things out after watching a 15 to 30 minute video on the same thing. It is better than videos I have used on LinkedIn Learning, and Udemy. Splendid work man! It's clear you are one of the few I've seen who actually wants people to break into the industry, instead of providing cryptic hints all the time.
Really appreciated this video; thanks for taking the time to share this.
REALLY solid explanations. The way you "think out loud" and explain things is really helpful. Keep up the good work.
I started a Google Analaytics Ceritifiate and this video give a persperctive of what I'll work on. Keep doing videos you explain ery good. Thanks
Hey I’m taking the google analytics also, came here looking what im i getting into.
Same!
Same, and watching this videos honestly makes me more excited about it!!
Awesome guys. Did you all completed foundations data?
@@vemmannar7043 I’m starting the 2nd course today, finished the foundations last Saturday.
the other way to achieve what he was trying to do at 9:07 is to highlight Column A then do ctrl+g -> click special -> click blanks -> click ok -> without moving click = then move the cursor upwards (press up arrow key) -> ctrl +enter and voila, you have filled the blank cells with values above it
Wow! Just did it! Thanks
The video is amazing. Exactly what I was searching for. Absolutely worth it. Make more videos like this one.
You've earned my sub. That was like shadowing someone at a new job who wasn't socially inept and I watched the whole thing in one sitting.
Woww I'm an asian DA learner. It's absolutely helpful for me. Really appreciate this. Thank you, Shashank Kalanithi.
Thanks for watching Cao!
You are from Vietnam. Aren't you
@@Jack-rr9nh His last name sounds like Tamil
Very well explained, please do more of these😅