You are so right that most of what people claim to be insights are mainly observations. I think one of the reasons is that there is this belief that you don’t need domain knowledge or subject matter expertise to come up with insights. Thank you for this video because by breaking down the prerequisites for insights into those three components, we can see that knowledge component is critical and that only comes from Frontline experience with the phenomenon being studied. Again thank you for the great video because we need to dispel this myth.
Yes, data analyst really need to understand how the business and the sector work if they want to deliver insights, otherwise they are just providing commentary on the data. Glad you found the video useful, please keep watching.
My previous boss actually pointed out this out. Most of the time when working with research I was only describing the data e.g 46% of customers said they prefer product A over product B at that was it. No insight or explanation as to why they prefer that product or what should the client do to motivate customer to go for product B. This is great and very much informative.
Coming from a work environment where specialists are slowly being replaced by data scientists/analysts, this explains so much of my annoyance at the change. They're trying to look at trends without further context...
Absolutely love this. Thank you so much. Am a media analyst , trying to switch into consumer behaviour insights. This has definitely been helpful. You’ve made so much sense
Great to hear it helped. Good luck with the switch to consumer behaviour insights. The best question you can always ask yourself when in that role is Why? Why did they do that?
Thank you for this video, really helpful. I worked as a credit analyst and am now a business intelligence analyst. Would really like to do some freelance work as a side hustle. Thanks for the content.
Good luck with the side hustle. Doing data analysis as a side hustle is a good choice and easy to do. Check out my other videos where I give advice on how to do data analytics as a side hustle.
Hey 👋 Thanks a lot for more detailed clarification on 3 pillars of Insights. 1. Data observation 2. Context 3. Human insights with domain knowledge As I have been working on/off as a web analyst, realized that most of the time I have provided my observations on Data, nothing else. I do understand that, I never claim that I have provided Insights but get rejection in interviews as I don’t have much technical skills nor insights side :( I am so devastated but when you work with Google Analytics partner firms or digital agencies, most of the time you need to do is implementation and reporting with data observations, not so much of insights are needed. We do have multiple clients so domain knowledge doesn’t come from within in Insights. What to do in that case? How should I tell recruiter that I have enough work experience but I am having imposter syndrome as I don’t have developer level technical implementation skills or insights skills? I feel like my skills and knowledge isn’t enough. Could you please help me out ??
Hi Imposter syndrome is quite common when working in a field that straddles multiple expertise. What I would suggest you do is the following. A. Decide what you enjoy doing and are also good at. Is it building dashboards, is it running analysis, is it providing commentary. What ever it is, position yourself to recruiters and being good at that core skill set and emphasise you know the other components. B. Write your CV in a way that highlights all the different work experience you have. Instead of just saying you were a digital analyst for 2 years at company X, you should write the different things you did as a Web analyst for company X. For example, if you helped define what metrics or data should go in a report, then state that you worked on the KPI framework and defined the tracking specification. If you then built reports or dashboards in GA or Datastudio then state you gathered requirement from clients and built the relevant data visualisation. The aim here is to breakdown all the things you do as digital analyst, which to you are not different things, but to a recruiter and hiring manager are, and highlight them in your work experience. C. Even though you might get a job title from a company, when you are applying for a role, you should pick the job title that best matches your skill set. That way when you apply for a role you like, the recruiter is not focused on what your job title was before, but what you can do now. I once hired someone who had senior a analyst in his job title, but most of his role was managing a team and they were the skills I was looking for. He didn't write he did management role, so I would have not interviewed him, but I saw in his CV he did some management so that's why I interviewed him. So choose the job title you want, and highlight the skills in your CV that show you already have experience on that area. D. For insights, my recommendation is that you start to think about what do these numbers mean for the business. So let's say sales are going down and you notice that visitors and conversions on one part of the website has also gone down. Don't just state this as commentary, but ask your self why does this matter. If I ran this company, why would this data matter to me, does it tell me anything that I can do to get my sales back up. Even if I can't, does it tell me why my sales are going down and what I might need to do good or bad. You should always be thinking is my commentary going beyond just observing what I am seeing and connecting information from other areas. So sales is going down, do a quick search to see how the economy is doing, if anyone has written anything about sales going down in your sector, anything around consumer confidence, etc. Once you start bringing all this other information into your commentary you are moving away from just observations to insights, and then finally, what does all that information mean for the business. If there is anything you want me to explain more of, just let me know and I might make a video about it.
@@Shorful this was so detailed and help. The last bit on turning commentary into insights could be a whole video on its own. Do you think you could make one? Maybe showing us how to do it? Practically. I feel like I’ve stumbled upon a WHOLE new skill to learn altogether. A video on this would be highly appreciated
When I get time, I will try and do a video on this. In terms of university subject's that's a bit difficult as I've hired people from various backgrounds and those that excel at insights are those who have done a degree where they've had to conduct primary research, social science subject's are good as is economics. Maths and Computer Science not so much.
I will see what I can do when I get some time. It's interesting the journey I've taken turning commentary into insights. It mainly started when I had to report to senior managers early in my career and when doing some analysis, was told they don't want to know what the numbers are, they want to know what the numbers mean to them. As I had a research background, having done a PhD this came natural to me, but I'll try and pick put what skills are needed to turn commentary into insights and do a video
I love the sound of being an Insights Analyst, I genuinely know I would be good at it, as I often have a good sense of consumer behaviour and why people consume certain products and not others, for example. I also just generally find diving deeper into data and understanding consumer behaviour interesting. I currently have a background in business partnering/management accounting, but also a technical understanding of data tools such as Excel and SQL. Do you have any tips on how I should go about making the transistion from a Finance Business Partner/Management Accountant to Insights analytics? Many Thanks
This is a difficult one, as you don't have a related background that would let you move neatly into an insights analyst role. My suggestion would be to either 1. Apply for a data analyst role, your background is related and if you can demonstrate your skills in data analytics then you should be able to get a data analyst role. Once in that role, you can exhibit your insight abilities and then do more insights and less analysis, until you've positioned yourself as an insight analyst. 2. The other route is to look for roles within the research or consulting field. From there you can start to develop your insights skills and combined with your data analysis skills you should be able to position yourself as an insight analyst.
Hi and thank you for very insightsful video! I currently work as a data analyst for a big FMCG company. The role is completely new so I need to shape it myself which is quite challenging. What action would you suggest to avoid bringing just observations to the table? The role is only E-Commerce, do you have any key metrics you think I should focus on?
Every company has different KPIs so best for you to find out what is important to your organisation, I can't advise if I don't know your company and not having interviewed your stakeholders. To avoid just bringing just observation, after every piece of analysis ask yourself 'So what does this mean?' If you can't answer that then it's probably just an observation
Hi, I am new to data analytics and trying to build my data insight knowledge since I am a student and I have no prior experience.. how do I develop my data insight knowledge most dashboards I see with data insight give a summary of the data
To be more insightful with your analysis you need build knowledge about the domain area. Let's say you are looking at retail data, to generate insights you need to consider things like - how is the retailer performing now - how did it perform in the past - what are targets for the future - how are other retailers performing - how did other retailers perform in the past - are there new competitors and how are they performing and is that impacting your company - how is economy performing, is this impacting your company - what is consumer confidence like and are buying trends changing, and how is this impacting your company - are there any micro or macro trends, like new technologies, government policies, etc., which are impacting your company Taking into a broader set of data and knowledge and then connecting all the data points is where insights come from.
Hi I'd love to do more mentoring but I'm extremely busy. Feel free to ask questions on here and I will either answer or might even make a video about it.
Hi Adnan I've never thought about how you would train your brain to deliver insights. I guess my recommendation would be that every time you run a piece of analysis you ask yourself what does it mean for the business. To deliver insights, you need to think about how the business will use the information you give them. Your analysis can't just be interesting, it has to have some purpose. If the analysis can't be used by business to do something, then its probably not an insight. So next time you write up a piece of analysis, ask yourself what can the business do with my analysis, have I provided the context and business expertise which means that the business can now take what I have written/said and make a decision. Even if they don't make the decision, your insight should have the potential for the business to make a decision or take a direction.
That's a good point Sometimes there are no insights, but you can always draw some conclusions from beyond the data you see, like contextual information. This is to some extent insights, but may be limited in providing a wow moment. For example, you might notice that your sales is going down by x% and there is some external data which also shows that sales in your sector is going down by y%. You can conclude that the decline you observe is consistent with your sector and is higher/lower.
Hello Ejaz I've actually made a video on this. Have a look and let me know if it answers your question. If not let me know what else you want to know and I will do a video on it. Link to the video-> ua-cam.com/video/w4tK9kDj890/v-deo.html
I'm sorry to hear that. Please feel free to email me your CV and what type of roles you have been applying for and I can review your CV and give you my feedback.
Indeed, we have found a gem... Hey Dr. Shorful, thanks for all these videos! It is wisdom that one needs, in order to land great insights...and emotional intelligence; thats' why it is so difficult to discover talents. Good luck!
"I apologize, but I'm finding it difficult to grasp the content of this video. It seems overly complex and challenging to follow. Could simpler explanations be provided? Thank you."
There is no need to apologise. I think you failing to understand is what I'm trying to get across in the video. Analysts don't generate insights and one of the main reasons is that they don't understand what insights are. I'll try and do a simpler version when I get a chance
Thank you Dr Shortful, that was very useful. It reminded me of the DIKW model - en.wikipedia.org/wiki/DIKW_pyramid . If you ever decided to cover this model in relation to Analytics, I'd be very interested.
Hi Reza Interestingly, I just used this model in a workshop with a client, I talk about how at an organisational level, if you don't build institutional wisdom, then anything that is learnt from data, gets forgotten when people leave, and you need to build processes to ensure that knowledge is retained within an organisation, by building institutional wisdom. I will plan a video on this topic, keep an eye out for it
You are so right that most of what people claim to be insights are mainly observations. I think one of the reasons is that there is this belief that you don’t need domain knowledge or subject matter expertise to come up with insights. Thank you for this video because by breaking down the prerequisites for insights into those three components, we can see that knowledge component is critical and that only comes from Frontline experience with the phenomenon being studied. Again thank you for the great video because we need to dispel this myth.
Yes, data analyst really need to understand how the business and the sector work if they want to deliver insights, otherwise they are just providing commentary on the data.
Glad you found the video useful, please keep watching.
My previous boss actually pointed out this out. Most of the time when working with research I was only describing the data e.g 46% of customers said they prefer product A over product B at that was it. No insight or explanation as to why they prefer that product or what should the client do to motivate customer to go for product B.
This is great and very much informative.
Glad you found it useful
Coming from a work environment where specialists are slowly being replaced by data scientists/analysts, this explains so much of my annoyance at the change. They're trying to look at trends without further context...
Yes and many of them think they do insights because people refer to observation as insights.
Absolutely love this. Thank you so much. Am a media analyst , trying to switch into consumer behaviour insights. This has definitely been helpful. You’ve made so much sense
Great to hear it helped. Good luck with the switch to consumer behaviour insights.
The best question you can always ask yourself when in that role is
Why? Why did they do that?
@@Shorful I will. Thank you Shorful
Thank you for this video, really helpful. I worked as a credit analyst and am now a business intelligence analyst. Would really like to do some freelance work as a side hustle. Thanks for the content.
Good luck with the side hustle.
Doing data analysis as a side hustle is a good choice and easy to do.
Check out my other videos where I give advice on how to do data analytics as a side hustle.
Thank you for this. I always knew i was doing more of observation and commenting.
Thank you for this.
Glad you found this useful
a genuinely insightful program. Thanks for upload.
Thanks for watching
Perfectly clear and super helpful! Thank you so much!!! 👏👏👏
Thanks, glad you found it helpful. Please do keep watching. Thanks.
Brilliant and clear explanation!
Thank you
Hey 👋
Thanks a lot for more detailed clarification on 3 pillars of Insights.
1. Data observation 2. Context 3. Human insights with domain knowledge
As I have been working on/off as a web analyst, realized that most of the time I have provided my observations on Data, nothing else. I do understand that, I never claim that I have provided Insights but get rejection in interviews as I don’t have much technical skills nor insights side :(
I am so devastated but when you work with Google Analytics partner firms or digital agencies, most of the time you need to do is implementation and reporting with data observations, not so much of insights are needed.
We do have multiple clients so domain knowledge doesn’t come from within in Insights. What to do in that case?
How should I tell recruiter that I have enough work experience but I am having imposter syndrome as I don’t have developer level technical implementation skills or insights skills? I feel like my skills and knowledge isn’t enough.
Could you please help me out ??
Hi
Imposter syndrome is quite common when working in a field that straddles multiple expertise.
What I would suggest you do is the following.
A. Decide what you enjoy doing and are also good at. Is it building dashboards, is it running analysis, is it providing commentary. What ever it is, position yourself to recruiters and being good at that core skill set and emphasise you know the other components.
B. Write your CV in a way that highlights all the different work experience you have. Instead of just saying you were a digital analyst for 2 years at company X, you should write the different things you did as a Web analyst for company X. For example, if you helped define what metrics or data should go in a report, then state that you worked on the KPI framework and defined the tracking specification. If you then built reports or dashboards in GA or Datastudio then state you gathered requirement from clients and built the relevant data visualisation. The aim here is to breakdown all the things you do as digital analyst, which to you are not different things, but to a recruiter and hiring manager are, and highlight them in your work experience.
C. Even though you might get a job title from a company, when you are applying for a role, you should pick the job title that best matches your skill set. That way when you apply for a role you like, the recruiter is not focused on what your job title was before, but what you can do now. I once hired someone who had senior a analyst in his job title, but most of his role was managing a team and they were the skills I was looking for. He didn't write he did management role, so I would have not interviewed him, but I saw in his CV he did some management so that's why I interviewed him. So choose the job title you want, and highlight the skills in your CV that show you already have experience on that area.
D. For insights, my recommendation is that you start to think about what do these numbers mean for the business. So let's say sales are going down and you notice that visitors and conversions on one part of the website has also gone down. Don't just state this as commentary, but ask your self why does this matter. If I ran this company, why would this data matter to me, does it tell me anything that I can do to get my sales back up. Even if I can't, does it tell me why my sales are going down and what I might need to do good or bad. You should always be thinking is my commentary going beyond just observing what I am seeing and connecting information from other areas. So sales is going down, do a quick search to see how the economy is doing, if anyone has written anything about sales going down in your sector, anything around consumer confidence, etc. Once you start bringing all this other information into your commentary you are moving away from just observations to insights, and then finally, what does all that information mean for the business.
If there is anything you want me to explain more of, just let me know and I might make a video about it.
A more indepth video on the last bit would be interesting and what combination of university subjects would be optimal in getting one to improve on it
@@Shorful this was so detailed and help. The last bit on turning commentary into insights could be a whole video on its own. Do you think you could make one? Maybe showing us how to do it? Practically. I feel like I’ve stumbled upon a WHOLE new skill to learn altogether. A video on this would be highly appreciated
When I get time, I will try and do a video on this.
In terms of university subject's that's a bit difficult as I've hired people from various backgrounds and those that excel at insights are those who have done a degree where they've had to conduct primary research, social science subject's are good as is economics. Maths and Computer Science not so much.
I will see what I can do when I get some time.
It's interesting the journey I've taken turning commentary into insights. It mainly started when I had to report to senior managers early in my career and when doing some analysis, was told they don't want to know what the numbers are, they want to know what the numbers mean to them.
As I had a research background, having done a PhD this came natural to me, but I'll try and pick put what skills are needed to turn commentary into insights and do a video
I love the sound of being an Insights Analyst, I genuinely know I would be good at it, as I often have a good sense of consumer behaviour and why people consume certain products and not others, for example. I also just generally find diving deeper into data and understanding consumer behaviour interesting. I currently have a background in business partnering/management accounting, but also a technical understanding of data tools such as Excel and SQL.
Do you have any tips on how I should go about making the transistion from a Finance Business Partner/Management Accountant to Insights analytics?
Many Thanks
This is a difficult one, as you don't have a related background that would let you move neatly into an insights analyst role.
My suggestion would be to either
1. Apply for a data analyst role, your background is related and if you can demonstrate your skills in data analytics then you should be able to get a data analyst role. Once in that role, you can exhibit your insight abilities and then do more insights and less analysis, until you've positioned yourself as an insight analyst.
2. The other route is to look for roles within the research or consulting field. From there you can start to develop your insights skills and combined with your data analysis skills you should be able to position yourself as an insight analyst.
That means we need to understand the external factors thar are directly or indirectly effecting the regular behaviour of our trend. Am I right?
Yes, nothing operates in isolation and so data analyst need to consider all external factors, both direct and indirect.
Hi and thank you for very insightsful video! I currently work as a data analyst for a big FMCG company. The role is completely new so I need to shape it myself which is quite challenging. What action would you suggest to avoid bringing just observations to the table? The role is only E-Commerce, do you have any key metrics you think I should focus on?
Every company has different KPIs so best for you to find out what is important to your organisation, I can't advise if I don't know your company and not having interviewed your stakeholders.
To avoid just bringing just observation, after every piece of analysis ask yourself 'So what does this mean?'
If you can't answer that then it's probably just an observation
You and I in the same boat.
Hi, I am new to data analytics and trying to build my data insight knowledge since I am a student and I have no prior experience.. how do I develop my data insight knowledge most dashboards I see with data insight give a summary of the data
To be more insightful with your analysis you need build knowledge about the domain area.
Let's say you are looking at retail data, to generate insights you need to consider things like
- how is the retailer performing now
- how did it perform in the past
- what are targets for the future
- how are other retailers performing
- how did other retailers perform in the past
- are there new competitors and how are they performing and is that impacting your company
- how is economy performing, is this impacting your company
- what is consumer confidence like and are buying trends changing, and how is this impacting your company
- are there any micro or macro trends, like new technologies, government policies, etc., which are impacting your company
Taking into a broader set of data and knowledge and then connecting all the data points is where insights come from.
That's why six sigma methodology is still important because you also have to get to the root cause as well but now it's called insights.
Hello Sir, my pleasure to meet you.
Sir I just concluded data analyst course on coursera I want you to mentor me on the field.
Hi
I'd love to do more mentoring but I'm extremely busy.
Feel free to ask questions on here and I will either answer or might even make a video about it.
Amazing 👏
Thanks
Hey Shorful
What would you recommend, to train this side of your thinking?
Hi Adnan
I've never thought about how you would train your brain to deliver insights.
I guess my recommendation would be that every time you run a piece of analysis you ask yourself what does it mean for the business.
To deliver insights, you need to think about how the business will use the information you give them. Your analysis can't just be interesting, it has to have some purpose.
If the analysis can't be used by business to do something, then its probably not an insight.
So next time you write up a piece of analysis, ask yourself what can the business do with my analysis, have I provided the context and business expertise which means that the business can now take what I have written/said and make a decision. Even if they don't make the decision, your insight should have the potential for the business to make a decision or take a direction.
Thank you Shorful! That's a very good way to put things
Will there always be insights available to mine? What if there are none when you are asked to find insights?
That's a good point
Sometimes there are no insights, but you can always draw some conclusions from beyond the data you see, like contextual information.
This is to some extent insights, but may be limited in providing a wow moment.
For example, you might notice that your sales is going down by x% and there is some external data which also shows that sales in your sector is going down by y%. You can conclude that the decline you observe is consistent with your sector and is higher/lower.
@@Shorful Thank you.
Class!
Thanks
Sir
I want to start a Data Science Startup
Any 4 or 5 points plan on that
Plz advice
Hello Ejaz
I've actually made a video on this.
Have a look and let me know if it answers your question.
If not let me know what else you want to know and I will do a video on it.
Link to the video-> ua-cam.com/video/w4tK9kDj890/v-deo.html
You might also want to check out this video
--> ua-cam.com/video/0jWGPUiKugs/v-deo.html
@@Shorful Thanks 🙏
Do you think domain knowledge is the primary factor in giving insights
It's not the case it's a primary factor but it is an essential factor. If you don't have domain knowledge, how do you know what your data means.
The problem is that most of you hiring managers overlook people like me who is capable but "doesn't look good on paper".
I'm sorry to hear that. Please feel free to email me your CV and what type of roles you have been applying for and I can review your CV and give you my feedback.
@@Shorful Thank you for your kindness. I will send it to your email.
First here
Keep looking out for my other videos
Indeed, we have found a gem... Hey Dr. Shorful, thanks for all these videos!
It is wisdom that one needs, in order to land great insights...and emotional intelligence; thats' why it is so difficult to discover talents. Good luck!
"I apologize, but I'm finding it difficult to grasp the content of this video. It seems overly complex and challenging to follow. Could simpler explanations be provided? Thank you."
There is no need to apologise.
I think you failing to understand is what I'm trying to get across in the video. Analysts don't generate insights and one of the main reasons is that they don't understand what insights are.
I'll try and do a simpler version when I get a chance
Thank you Dr Shortful, that was very useful. It reminded me of the DIKW model - en.wikipedia.org/wiki/DIKW_pyramid . If you ever decided to cover this model in relation to Analytics, I'd be very interested.
Hi Reza
Interestingly, I just used this model in a workshop with a client, I talk about how at an organisational level, if you don't build institutional wisdom, then anything that is learnt from data, gets forgotten when people leave, and you need to build processes to ensure that knowledge is retained within an organisation, by building institutional wisdom.
I will plan a video on this topic, keep an eye out for it