DE to AI engineer. Is it really the future? I am at the age of just having kids. So I want to keep up with the future market at least 15 years. Confused af right now
You don't necessarily need to change your role to AI engineer. But you do need to understand how to implement Gen AI features in an existing data pipelines or products, since most of the products plan to use it. So yes, upskilling in AI and ML is absolutely key.
Can you please provide some tips for the 2 points 1. Work life balance 2. Soft skills improvement. I am currently working as an sde but wish to move toward the data Engineer role. Currently feeling over worked. Have been in the industry for 1.5 years. Truly appreciate your content. It's very insightful unlike other surface level explanations of other youtubers.
Hey @jayantbhowmick558, Work life balance & Soft skills improvement are really key to grow in your career. I struggled with work life balance a lot during my initial days of Data Engineering. I’ve worked as a Senior SDE for a long time before transitioning into a Data Engineering role, and the first point Jash mentioned really resonated with me. Learning to say ‘No’ is crucial, especially when switching from a different role. At first, you might feel incompetent or doubt your abilities because DE work is different from SDE tasks. But don’t let those doubts hold you back-you can absolutely become great at it with time. Be patient with yourself. It’s okay to admit when you don’t know something. Explain why something might take longer and ask for extra time to assess project timelines. Managing scope creep is essential, and if you’re someone who finds it hard to say ‘No,’ this role will challenge you and help you grow in that area. Remember, the adverse effect of not saying 'No' is a disruption in your work-life balance. Data Engineering taught me so many valuable lessons. Communicating with non-technical people can be tough, especially if you’ve been coding in isolation for years. But trust that you’ll improve-it’s worth pushing through the challenges. Stay positive, keep learning, and believe in your ability to grow. You've got this!
Great video! I've been following you since I was in my 2nd year of engineering. Your roadmap of DE was great, I got in TCS as a ninja role. Although, I'm not sure if I'll get any project related to data in it, what do you say? How much time should I be in TCS for experience? When to switch and how to prepare during my time in TCS? You have been my role model and because of you I get to know much about Data engineering.
Thanks for following! My advice is, don't go to a company thinking about how much time you will spend there even before you reach. Just focus on learning as much as possible early in your career. Don't get jealous if your friend gets 12 LPA and if you got 6 LPA for example. That difference of 6 LPA is nothing, trust me. If you learn and grow, you'll be making that much in a month within 5 years. Think about leaving a company only if you feel your learning has stopped or if you think you deserve more compensation. But forget about those thoughts in the beginning since you will have a lot to learn as a fresher no matter where you go. All the best!
Hi @JashRadia - I want to understand your mindset on how you view DE & SWE, why did you make that transition ? Is this temporary ? Please share your thoughts how you kept lean mindset when made that transition so lot of people who make the switch can make it easier for them as well, specially these 2 roles.
I have been working as an ETL developer for nearly 4 years and all I can get are these ETL tool opportunities. I want break this and become a proper data engineer. Give me a suggestion on how to proceed forward please
The range is quite wide in India. I believe 1 YOE in data engineering can range from 5 lakhs to 15-16 lakhs depending on the company. There are outliers though for example, companies like Google will pay about 32-35 lakhs.
I like both of them equally. (Way more than Azure) both have ups and downs. If you're interested in AI, then GCP has a slight edge. But in general, AWS is more robust.
nice video ! I have been following your roadmap for data engineering .. i am onto learning spark now , but since in am a 3rd year grad with no work ex i was thinking to devote 1-2 months to learn data analytics to land an intern .. will it help ? or should i focus only on de also please make a vid about how you first started as a de .. your journey to google and more :)
Don't make a decision in college. Wait until you get your first job (in dev or DE) and then see for yourself which one do you enjoy more. College courses are often far away from reality.
Hi Jash your content is really helpful. My question is how i can switch from a data analyst profile to data engineer + Analyst kind of job role while working full time. And what will be the exact simple roadmap(skillset) for that. Currently working in a service based MNC. Thanks
Thanks for watching! The role you can aim for is analytics engineer. You ideally want a mix of sql, data modeling, etl and data visualization with a little bit of python knowledge sprikled on top. For this kind of role, i wouldn't worry about leaening spark like frameworks.
Wanted a suggestion, Being a DE if we are more interested towards business related things not much in Spark databricks etl piplines, should we spend time in DE or move to Business intelligence roles.. Acc to you..
I would suggest move to data analyst or business analyst roles. Or even analytics engineering roles. You don't need to stay in DE if the tech doesn't interest you. Ultimately, you'll grow most where you enjoy.
Waiting for onboarding since a year I am working on pega domain I am a fresher I wanted to switch towards data domain I am unable to choose between Data analytics data engineer and data science... What to do sir... Plz reply
Hope these tips I learned along my career helps! Thanks for watching :) Check out OdinSchool here: hubs.la/Q02Mr-BQ0 😃
so much truth in your words! I find it very difficult to improve in soft skills but they are fundamental
Yes, it takes the longest to learn soft skills. That's what makes them invaluable 🤝
Currently working as devops engineer in a service based company but dream want to work as data engineer in a product based company.
All the best! Hope you get it 🫡
It's Great Dear.
Spread Knowledge everywhere you go.. 👍🏻👍🏻
Thank you 😁
Jash y dont u create 0 to hero complete play list content on DE. Pls contribute which will obsolutely appreciated
DE to AI engineer. Is it really the future? I am at the age of just having kids. So I want to keep up with the future market at least 15 years. Confused af right now
You don't necessarily need to change your role to AI engineer. But you do need to understand how to implement Gen AI features in an existing data pipelines or products, since most of the products plan to use it. So yes, upskilling in AI and ML is absolutely key.
@@JashRadiacan you please create video on a roadmap from DE to AI? It would really help.
@JashRadia this would be helpful
@@JashRadia but jash in your new company you again joined similar to data engineer role
Well explained! 😎
Thank you 😁
Great Content ✌🏻👏🏼 Really Helpful 👌🏻
Thank you 😁
Thaanks Josh! always a pleasure watching your videos!
Thank you! But it's Jash 😁
Can you please provide some tips for the 2 points 1. Work life balance 2. Soft skills improvement.
I am currently working as an sde but wish to move toward the data Engineer role. Currently feeling over worked. Have been in the industry for 1.5 years.
Truly appreciate your content. It's very insightful unlike other surface level explanations of other youtubers.
Hey @jayantbhowmick558, Work life balance & Soft skills improvement are really key to grow in your career. I struggled with work life balance a lot during my initial days of Data Engineering.
I’ve worked as a Senior SDE for a long time before transitioning into a Data Engineering role, and the first point Jash mentioned really resonated with me. Learning to say ‘No’ is crucial, especially when switching from a different role. At first, you might feel incompetent or doubt your abilities because DE work is different from SDE tasks. But don’t let those doubts hold you back-you can absolutely become great at it with time.
Be patient with yourself. It’s okay to admit when you don’t know something. Explain why something might take longer and ask for extra time to assess project timelines. Managing scope creep is essential, and if you’re someone who finds it hard to say ‘No,’ this role will challenge you and help you grow in that area. Remember, the adverse effect of not saying 'No' is a disruption in your work-life balance.
Data Engineering taught me so many valuable lessons. Communicating with non-technical people can be tough, especially if you’ve been coding in isolation for years. But trust that you’ll improve-it’s worth pushing through the challenges. Stay positive, keep learning, and believe in your ability to grow. You've got this!
Great video!
I've been following you since I was in my 2nd year of engineering.
Your roadmap of DE was great, I got in TCS as a ninja role. Although, I'm not sure if I'll get any project related to data in it, what do you say? How much time should I be in TCS for experience? When to switch and how to prepare during my time in TCS?
You have been my role model and because of you I get to know much about Data engineering.
Thanks for following! My advice is, don't go to a company thinking about how much time you will spend there even before you reach. Just focus on learning as much as possible early in your career. Don't get jealous if your friend gets 12 LPA and if you got 6 LPA for example. That difference of 6 LPA is nothing, trust me. If you learn and grow, you'll be making that much in a month within 5 years.
Think about leaving a company only if you feel your learning has stopped or if you think you deserve more compensation. But forget about those thoughts in the beginning since you will have a lot to learn as a fresher no matter where you go. All the best!
@@JashRadia Much thanks Bhai! Will learn as much as I can
@AltafKhan-ka1zer hey brother ! I am currently in my 2 year too , can you pls guide me through DE , i tried webdev but i am not enjoying it
Hi @JashRadia - I want to understand your mindset on how you view DE & SWE, why did you make that transition ? Is this temporary ? Please share your thoughts how you kept lean mindset when made that transition so lot of people who make the switch can make it easier for them as well, specially these 2 roles.
Real engineer❤
please share your experience of DOORDASH and by the way big fan of your work
Sure, I plan to do that soon. Thank you!
plz suggest some hands-on course on snowflake
Udemy snowflake zero to hero course
I have been working as an ETL developer for nearly 4 years and all I can get are these ETL tool opportunities. I want break this and become a proper data engineer. Give me a suggestion on how to proceed forward please
how much salary can i expect as 1 year experience in tech industry but fresher to data engineer
The range is quite wide in India. I believe 1 YOE in data engineering can range from 5 lakhs to 15-16 lakhs depending on the company.
There are outliers though for example, companies like Google will pay about 32-35 lakhs.
@@JashRadia thank you
Great Video!
Which cloud platform would you choose between AWS and GCP for Data Engineering?
I like both of them equally. (Way more than Azure) both have ups and downs. If you're interested in AI, then GCP has a slight edge. But in general, AWS is more robust.
@@JashRadia Thank youu!
What are your recommendations for free data engner course playlists?
what type of AI skills related to or close to DE can be useful for future
what programs do you for recording and editing ?
DaVinci resolve
Bro Big data vs Data engineering & tools to stay updated for future tech tool of data engineering
Learn LLMs. Especially langchain as a tool. Another super important one is Kafka nowadays. Also snowflake.
Can u make a detail roadmap on it for freshers who are willing to go into DE like me based on recent industry updates
Apart from LLMs rest is exactly same tbh. I will create a video on that topic
Sir will you please make a video for fresher
Like what to do
What skills to learn for diff data profile
What should be the sequence of skills
Please see my data engineering roadmap video. That applies to freshers as well
Ok sir thank you😊
nice video !
I have been following your roadmap for data engineering .. i am onto learning spark now , but since in am a 3rd year grad with no work ex i was thinking to devote 1-2 months to learn data analytics to land an intern .. will it help ? or should i focus only on de
also please make a vid about how you first started as a de .. your journey to google and more :)
Thank you! And yes. Any kind of internship in a data driven role will be super helpful even if you want to transition into DE.
@@JashRadia thanks ! , sent u linkedin req hope u accept it :)
@@Dev-tf2bx ur name dude?
@@Vincent45678 its dev
I am in my third year in tier-3 college, I am confused between Development and DE which one should I chose? And please specify the impact of AI in DE.
Don't make a decision in college. Wait until you get your first job (in dev or DE) and then see for yourself which one do you enjoy more. College courses are often far away from reality.
Hi Jash your content is really helpful.
My question is how i can switch from a data analyst profile to data engineer + Analyst kind of job role while working full time.
And what will be the exact simple roadmap(skillset) for that. Currently working in a service based MNC.
Thanks
Thanks for watching! The role you can aim for is analytics engineer. You ideally want a mix of sql, data modeling, etl and data visualization with a little bit of python knowledge sprikled on top. For this kind of role, i wouldn't worry about leaening spark like frameworks.
I have done internship in data engineering working with Scala spark kakfa what should I do now because in that organisation there is no hiring
Look for opportunities elsewhere. Ask for referrals, and use your internship experience well in resume.
Any suggestions on how an ETL developer can get Data Engineer jobs?
Just focus on upskilling on programmi g aspects like python, sql and spark and build 1-2 projects to show on your resume.
If we are working as data engg and not liking spark much. do we must need tableau knowledge for analytics engineer / BIE roles
Yes for data analysis and analytics engineer roles dashboarding tool is a must even if spark is not as good, which is okay.
Wanted a suggestion, Being a DE if we are more interested towards business related things not much in Spark databricks etl piplines, should we spend time in DE or move to Business intelligence roles.. Acc to you..
As initially we involve less with business more in tech stuff
I would suggest move to data analyst or business analyst roles. Or even analytics engineering roles. You don't need to stay in DE if the tech doesn't interest you. Ultimately, you'll grow most where you enjoy.
are there any plan for meet up in Pune?
Hey, I am not sure if I'll be doing something like this soon 😅
Waiting for onboarding since a year
I am working on pega domain
I am a fresher
I wanted to switch towards data domain
I am unable to choose between Data analytics data engineer and data science...
What to do sir...
Plz reply
Watch this video. It will clear some of your doubts ua-cam.com/video/TDrIBFgb6hE/v-deo.html
How to find data engineer job internship and please suggest me how to prepare for data engineer
Checkout my roadmap video for skills required
Bro why you left google ...is it for money or something else
Money is one thing, yes. But there are more factors to it. I'll probably create a video on this soon.