Crack Metric/Business Case/Product Sense Problems for Data Scientists | Data Science Interviews
Вставка
- Опубліковано 27 чер 2024
- In this video, I'll share three frameworks that I used to answer product sense/business case/metrics questions that help me get job offers from Airbnb, Lyft and Twitter.
3 Categories of Questions & Frameworks:
- Diagnose a problem
- Measure success
- Launch or not
🔗 Slides www.emmading.com/blog/the-ult...
🟢Get all my free data science interview resources
www.emmading.com/resources
🟡 Product Case Interview Cheatsheet www.emmading.com/product-case...
🟠 Statistics Interview Cheatsheet www.emmading.com/statistics-i...
🟣 Behavioral Interview Cheatsheet www.emmading.com/behavioral-i...
🔵 Data Science Resume Checklist www.emmading.com/data-science...
✅ We work with Experienced Data Scientists to help them land their next dream jobs. Apply now: www.emmading.com/coaching
Lyft/Uber Metric Interview Question and Answer
• Lyft/Uber Metric Inter...
Facebook Metric Interview Question and Answer
• Cracking Facebook (Met...
LinkedIn Metric Interview Question and Answer
• LinkedIn Metric Interv...
// Comment
Got any questions? Something to add?
Write a comment below to chat.
// Let's connect on LinkedIn:
/ emmading001
====================
Contents of this video:
====================
0:00 Intro
1:22 What are product sense problems
2:54 When you don't have any experience
3:28 What are companies looking for
4:17 Diagnose a problem
8:01 Measure success
10:52 Launch or not
13:42 Tips to ace the interview
15:08 Outro - Наука та технологія
If you prefer to read rather than watch this video, check out the blog post I wrote on this, and other, topics here ➡ www.emmading.com/resources
I just wanted to say your videos have really helped me pass my Data Engineer interview at Facebook recently. Thank you for all the great content!
Congrats! Best of luck with your new job!!
@@emma_ding Facebook now actually recommends this video to Data Engineer candidates. Really great video!
underrated channel. most of the candidates do excellent in the technical round and statistics round but fail miserably in the case study/product round. These videos are spot on and fill that gap perfectly.
Hey guys, I'm so sorry for the typos in the slides, below are the corrections.
In section "Measure success": calcification (clarification), sutable (suitable), Cancelation (Cancellation)
Hey Emma, ty for the content. The video is so helpful that these small mistakes don't matter!
This is the best video I have ever watched for the product & metric interview preparation! Thank you so much!
First ever video that motivates me to play again and again while making notes carefully. Thank you so much Emma!
Wow! This video has really helped me. I was preparing for an IBM data science interview. Thank you a lot. I also do appreciate that you used real-world questions, which were asked by big names. Other people usually just make up their own. Thanks a lot.
Amazingly helpful video and content! I was able to easily move onto the onsite round because of the great content you’ve provided on this channel!
I’ve watched almost all of your videos and I learned sooo much. Thanks for sharing this information for free! You are very talented at describing complex problems with very few words and give the exact right examples. You could be the most popular instructor at any universities.
Thank you for your kind words! I'm glad that you're learning a lot from my videos! :)
Amazing Job! You are helping so many ppl landing their dream job! Thank you for your work!!
Great content. I'm only on video two but I love the breadth and depth or the content with specific examples and real interview questions. I appreciate all the hard work you went through to provide a simple, easy to follow, concise video but I am sure it took hours of reading and note taking. Found you through KD nuggets.
非常有用，解开了我之前面试时候遇到的好多困惑，期待更多！
To say that this has been helpful is an understatement. Thanks!
Best video ever on product sense, saved ton of time to go through other articles/ videos...
Video content is structured, comprehensive, and practical.
Comprehensive and well-structured way to answer product sense questions. Emma you deserve a big thumb up!
Glad you find it helpful, thanks so much for watching!
A flawless framework and extremely applicable
每期都质量很高，学到了很多，非常感谢！
I've been looking everywhere for metric and product sense DS questions. Thank you! Hopefully these will help for the LinkedIn DS interview
Thanks for the hidden gems Emma!
Loved the breakdown...very simple and comprehensible.
This is super helpful, thank you Emma!
Subscribed within 5 minutes in the video. Very helpful
Really like the structure and tips in this video and I'll try using these framework to prepare for my next interview. Thank you!
This is underrated channel, so many awesome videos!
Much better than most DS interview videos. You deserve more subscribers!!
Wow, thanks!
This was very informative, thanks!
Amazing content as always!
Excellent job. Greatly appreciated. Right now I am doing the University of Texas Certificate in Artificial Intelligence and Machine Learning. Hopefully, this will prepare me for interviews after I have completed it. Thanks again.
This is the most helpful framework I have seen regarding product sense questions. Thanks a lot. Please do more of these
More to come!
谢谢emma老师！快面试了祝我成功～
This is one of the best product sense videos
Honestly, this video is really helpful for me! Thanks (again) for sharing this, Emma. A step-by-step video on how to solve a business problem using data science with real industry case would be intresting
Will do!
This is pure gold.
This was such a great video, thank you very much!
Giving reference to those interviews questions is really helpful. Also learned some new keywords. Thanks 👍
Great to hear!
Thank you for posting this very useful video! Cheers
Simply amazing explanation.
Thank you a lot! This is an awesome outline
Well explained !! Loved the framework. Thanks
You are welcome!
It's really awesome video! Thank you so much!
Thanks for making this video. Very helpful to me.
This is amazing!!! Thanks a lot!
Awesome video, thanks!
best channel of DS
This video helped me to pass the DS interview at TikTok! Thank you so much emma :)
Great news Bookerer! Wish you every success at TikTok! Please feel welcome to email me to share more details! This kind of news really makes my day!
@@emma_ding The problem they gave during the interview fell exactly into the "Diagnose a problem" category and they were quite impressed with my response even though I was merely following your framework :) understanding how commonly-used metrics can lead to success was also really important!
I am taking notes for all your videos.
This is so helpful thank you!!!
Emma thank you so much for this video. It helped me answer the Product question during a DS interview and I managed to secure the job.
Glad my videos are helpful. Congrats!
Love the content. I think a case walk-through video would be even more helpful. Keep up the good work!
Yes! Please and thank you kindly.
Stay tuned. More to come :)
well organized information, thank you
I just get asked the "how to measure success" question in my interview! This is very helpful, thank you for creating the amazing content!
You're so welcome! :D
感谢分享，最近正在准备Product sense的面试
谢谢观看 😄
This will help in future data science interview. Thanks
感谢分享！最近在准备面试，很有帮助～
Heyy! Really helpful, as these topics aren't covered by anyone properly. Thanks! And Keep making such videos ;)
Thank you for sharing amazing content.
Excellent video
Hello! Thank you for such a helpful video. Made a lot of sense to me. I was wondering where I can learn more about the different types of business metrics? Like conversion rate, etc.
I come from a Statistics background and I am pretty unfamiliar with these metrics. Would help me a ton if you could suggest some resources to me. Thanks!
I hope in the future you could release some walk-through videos targeting at real product sense questions, and discuss the possible answers using the framework. But this is already great content and very helpful! Thanks Emma
Totally agree! More walk-through videos please!
Stay tuned! More to come!
Great Video!
Great video!
Thanks a looot for this video! Got the job thanks to it :D I was struggling with business case studies especially in consulting firms interviews but this video made me so, so much better at it.
This is awesome to hear, Moutaouakkil! Congratulations on securing your new role! Feel free to share some more details with me if you'd like; what's the position and company?! So excited for you, and happy to have been a small part of your journey. 🥳
This is the best video regarding data science. Thanks Emma mam. I'm following you right from towardsdatascience article.
Most welcome 😊
Awesome!
I would tweak the framework for "Diagnose a Problem" a little bit.
I believe decomposing the metric is very important, specially when it is a ratio. It helps to identify if the numerator went down or if the denominator went up.
The framework I like to follow is -
1. Clarify
2. Time
3. Decompose the metric
4. Segment
5. New features
6. External influence
7. Summarize
great video, thanks.
Thank you!
Best video ever!! Thanks, Emma. Could you please make an example of the "measure success" problem following your framework?
Check this one out ua-cam.com/video/JjA6hvmaK7/v-deo.html where I share how to measure success for a LinkedIn interview question. Let me know if it helps :)
Thanks it's useful :)
This is an awesome video! I also like cracking DS case series a lot! I have a question. When I had onsite interview with some tech company, sometimes the interviewer will ask, "how will you collect the data to measure this?" or "What data will use to investigate some issue/measure the impact" all of these applied data questions. How should I ace these types of questions?
Very helpful!
So glad!
Thanks a lot for the wonderful content. The framework is really well structured and I am sure it will help me prepare for my interview. But I was curious to know, what sort of questions should I start practicing. Since I am pretty sure most of us will be applying for different roles/industries, so it can seem a bit overwhelming and hard to decide from where we should start and what kind of questions should we focus upon.
You can check out this video for requirements of different roles. ua-cam.com/video/l93hVZZ7qm0/v-deo.html
Excellent content - just subscribed. You mentioned you went through a bunch of materials yourself - is there any content in particular you would recommend? Such as certain books, websites, videos etc
Thanks again for putting this out! Looking forward to your future content
There are a lot of materials I benefited from and I listed them in my blog post towardsdatascience.com/how-i-got-4-data-science-offers-and-doubled-my-income-2-months-after-being-laid-off-b3b6d2de6938. Hope it helps!
I absolutely love your videos (thank you for making them!), but in case you were not already told, your slide at 8:38 says "calcification" , I think you meant "clarification", hope this helps!
Thank you for sharing the framework. I wonder if there's an option for incorperating experimentation testing into the second "measure success" question? And when we don't want to incorporate experiment testing into the second part if it's an option?
you are the best
很清楚 能让我边学边记笔记的视频不多啊哈哈
感谢观看 😄
on the spot
Hey Emma! First of all, thank you for this video! It's very clear and well explained, so helpful!
-- Change to Chinese mode --
感谢视频，最近在准备产品题，反复观看您的视频，觉得很有收获。但是因为没有任何case study实战经验，也真的特别期待您出一期例题实战回答或者mock interview+点评，（e.g. diagnose problem，why engagement is down）。我也看过一期不错的PM mock interview，也是类似的问题。但是非常好奇，一个DS回答此题的角度，跟PM应该有何不同呢？DS是否应该更侧重metric本身？更用数据说话？我看PM回答问题的framework也是clarify - time - segmentation等等。那期mock interview最后的solution就是发现其他team launch experiment/feature影响到了engagement,于是跟其他team讨论要不要继续。好奇从DS的角度，要如何侧重给一个solution呢？
请问你可以分享下你看到的PM mock interview的视频吗？关于DS是否跟PM的答案一样 - 这个要看具体的问题了。PM跟DS都应该重视metric都应该用数据说话，这个好像不是区分的关键，而且我个人的经验是很多这一轮面试就是PM来面的。能从PM的角度回答问题也是充分说明一个DS的产品知识很扎实啊。但是有些公司的面试会把产品跟experimentation结合起来，一些问题会问到A/B testing的细节，这个就是DS的专长了。
@@emma_ding 谢谢回答，原来如此。ua-cam.com/video/ID8YTF100A0/v-deo.html 这是我之前看到的视频，也是回答dignaose类型的。另外我也确实看到一些资料或者公司面试题要求从产品框架延伸到experimentation，这部分的mock interview见到的不多，感觉有些难度。我自己到定义metric之后，就答不出了。
Hi Emma, I've watched all your videos related to product sense problems including the videos of the real interview questions. They are all so helpful! There seems no sample question for Launch or Not problems though. Could you please also make a video on this type of question and give a sample answer? Like the LinkedIn, Lyft and Facebook ones. Thank you so much!
For sure! It's on my list but I did not have time to make it yet, stay tuned!
Hi Emma, thank you so much for the video! I have some questions about some of the steps you mentioned:
1. I was wondering what was the website in the video that has those sample case questions?
2. For the first category of questions which is diagnose a problem, the second step was analyzing the internal and external cause based on if the change happened suddenly or progressively. I feel like the examples for internal and external causes would lead to sudden change. What would be some external and internal reason that would lead to progressive changes?
3. What are the differences between the second category and the third category, which are measure success and launch or not? I feel like for launch or not type of question, we do need to measure the success first and then decide to launch it or not. So my understanding is that launch or not has the extra final step then measure success.Please correct me if my understanding is wrong.
Thanks Emma!
Hi Emma - First of you all THANK YOU for the amazing content. I do have a question for you. How to answer questions like what should be the UA-cam daily view time? How to answer such questions?
Hi Emma, I love your video so much and it's really helpful. I have a quick question to ask: For the launch or not questions, I'm wondering if the engineering team has already finished developing the feature for you to do the experiment, why not just launch the feature on the product directly? Also, if I have a question like "I have 2 features in the backlog, can you help me decide which one should go first", how to think about a question like this? Thank you so much!
1. There are many factors influencing whether a feature should be launched or even rolled back after being launched. In fact, "launching" is a complicated process. This is a great question to ask the interviewer at the end of the interview.
2. This is similar to the "measure success" problem. You can refer to this video ua-cam.com/video/JjA6hvmaK7I/v-deo.html
总结的很好，谢谢分享
谢谢观看 😄
This video is very helpful! Thanks, Emma! When we look at other features launched at the same company, is there any way to narrow down the features we need to look into? Since for big companies like Facebook, it might have hundreds of features changed within one month.
The interview time is short, you can give 1 or 2 examples of features and have good reasons to justify why they would affect the current product. You will be evaluated on the thought process and structure of your answers instead of knowing the exhaustive list or some particular features.
Thanks for this post! So are you focused on analytical type of ds positions? Since you have listed different kinds of data positions, how did you decide to focus on any one of them? Have you also interviewed for ML focused roles?
I'm working on covering more aspects of DS interviews. Stay tuned!
Would you consider to go through a real interview question and answers for "Launch or not" category? The videos for diagnose a problem, measure success, and improve a product are very helpful!!
If the interviewer is a Data Scientist, should we emphasize more or lead/expand the answers to AB test or ML modeling? How to do it? It seems like most categories can be expand to AB testing, but less to ML modeling.
Thank you for your clarifying videos! I never could understand where to even begin, but now I have some structure. Can you suggest any books or resources for specific questions that I can use for practice?
Check out my latest masterclass here.
www.datainterviewpro.com/services
Excellent video. Just sharing the next video idea(1): Several videos of... you are using/modifying your frameworks to answer the actual interview questions? (2) mock interviews video.
Because while product sense questions can be found easily, those sample *good* answers are hard to see!
Thanks for the suggestions! You may find this playlist helpful ua-cam.com/play/PLY1Fi4XflWSvtu963rZpfH6WeX54vSrDW.html. It contains answers to real interview questions.
Hi Emma, can you please help talk some products questions related to Opportunity sizing and Enter new market or not
Love this idea! Will consider it in future videos!
Great video. One minor correction. You wrote “calcification” when you meant “clarification” on the Measure Success slide.
Thank you for catching the typos. I made some comments under the video.
Need some more insights on launch or not framework. Any good articles or books on it would be helpful.
How can we test the efficiency of the new feature before launching it? Once we launch we could use success and guardrail metric as you suggested.
Typically, A/B testing is used to measure the effectiveness of a new feature. You may want to check out this video ua-cam.com/video/X8u6kr4fxXc/v-deo.html. I recommend two resources at the end of the video.
Thank you for the amazing framework! I think there is a typo in the slide Framework(launch or not), 3. recommendation based on experiments result. I think it is "conversion rate" instead of "conversation rate".
You are absolutely right! Thanks for the feedback, and I'm glad you enjoyed the video!
Hi Emma~ Thank you so so so much for providing these free high-quality content for us! And I want to know what's the website you used to find the interview questions shown in the video! Thank you in advance.
Hello~ i love your videos so much~ i'm wondering what is the website that you got these interview questions?
Those are from glassdoor.
Hi Emma, I had an interview ask if a feature can improve retention of their product. I followed the framework to ask interviwer to clarify the senario, but the interviewer was very impatient to clarify and couldn't wait to ask me how to use history data. I don't have chance to define the metrics (or follow other steps in the framework). I was very confused.
I don't know if it's too late but I read this book called "Lean Analytics". It categorizes different business models (E-commerce, two-sided market, SaaS) and what metrics to use at each stage of the business
Good job👍Thank you so much. Can you suggest some helpful tutorials for learning this? Am a beginner with an eye on this field.
Thanks for the suggestion. I'm working hard on more contents! Stay tuned!
Hi Emma, really like your videos! I have a question about your last slide, in which you mentioned 'write down thought process with bullet points'. I am wondering how can I do that? should I propose to the interviewer that 'can I share one doc with you to write down my thought process ?' Thanks a lot, I believe it would be really helpful for my interview with FB next week.
That pullet point is for (pre-COVID) onsite interviews that you can use the white board in the room. For possibility of sharing a doc or other ways of presenting, I would recommend communicating with the FB recruiter. If it's not possible to share any docs, the best way is to verbally communicate your framework or thought process, say "This problem we have 3 things to consider. First.. Second.. Third...". Good luck to your interview!
@@emma_ding Thanks so much for replying to me! That's a good strategy.
小姐姐，想问一个关于measure success 的问题。1）launch 之后就不能做ab test 了吧？
2） 如果不能做ab test, define 的metrics 要和谁比呢？ 整个ecosystem 的metrics 比如DAU 什么的可能还有baseline，像feature specific metrics, 比如新feature 的time spent, adoption rate 以什么为baseline 呢？还是只用整个ecosystem 的metrics 就可以了？