Very informative video once again!! Most organizations are not following these practices and just rely on static doc ( that doesn't explain much) and assumptions. This will take data pipelines to a whole new level and make it easy for the newcomers to understand. I'll try to push this idea to my organization.
Thank you, the best place to get started would be through documentation of some of these tools mentioned. I have added some document link and blogs etc in the description.
Thank you! I did find veey interesting video on this with a demo that can help you get started: ua-cam.com/video/rO3BPqUtWrI/v-deo.htmlsi=mO7czONV9_7tLiw4
Hello sir I'm in pre final year thinking of learning data engineering. Should I learn data engineering how is the future of de in future (in terms of jobs)?
Jash is there internships available for college students who dont know much about data engineering but are aspiring to be a data engineer so what will be your guidence on this
Hey Jash, as a full-stack developer, I have more than 5 years of experience. Now, I want to learn data engineering too. Is it possible to change domains now? Because my relevant experience might not be considered much when I try to find a data engineering job, isn't it? Please give me your suggestion. Thanks.
Heyy Jash! I recently got to know about data science technologies and concepts which directed me to your channel and I wanted to know that how one should approach to any professional positions like (ML engg, Data engg etc.) from their 3rd year of graduate. I am in my 3rd year of CSE and I would like to know your answer on this one.
Hi, first of all, for any data role (ML or data eng etc) prerequisites are data modeling, data warehousing, sql and programming (python) once you have that, upskill in the area of your choice. Be it ML or distributed compute etc. This should be enough for you to land a job in this field.
Hi Jash, I am Sanket currently working as Web designer and looking to take a path in Data Engineer. So is it okay to go with data Engineering? As I will be a fresher in data Engineering are companies hiring data engineer as fresher?
@@JashRadia As there are not entry-level internship for data engineers so can you give suggestion about it. I have found every where they ask for experience level only.plz reply ❤🙏🙏
Hey Jash Thanks for another amazing video. I’d like to knw ur views abt the future of Data Engineering. Some ppl are saying that DE can be automated in the near future bcz of AI/ML automation, while othrs believe tht DE will become more important due to AI needing quality data continuously for training. Which argument is correct? Ur reply would be very helpful for ppl like me who are trying to switch into DE. Thanks❤️
Both viewpoints about the future of Data Engineering have their merits. On one hand, advancements in AI and ML are making some tasks in Data Engineering more automated. Tools are being developed to handle repetitive tasks like data cleaning and integration more efficiently. On the other hand, as AI and ML become more advanced, the need for high-quality data is growing. Data Engineering will remain crucial because ensuring data is accurate, consistent, and well-structured is essential for training effective AI models. So, while some routine tasks in Data Engineering might get automated, the overall importance of the role will likely increase. For anyone looking to switch into Data Engineering, it’s a field with a lot of potential and evolving opportunities.
@@JashRadia Hey man, thanks alot for taking time to give an depth answer. I really appreciate that. Just one more follow-up question: You mentioned that data engineering will remain crucial and that's wht I believe too. I'm keen to know which tools or aspects of DE you think will remain crucial in future too. Additionally, what new and upcoming opportunities or tasks are emerging that data engineers can look forward to? Like in GenAi, Ai or Machine Learning. Sorry for the late response😅
@@husler7424 I'm following the roadmap that Jash provided-it's the best one available on the internet. I'm also working on some projects tht will help me transition into a DE.
Hi bro, Thanks for the vedio i have 3 yrs of experience in data engineering but really facing difficulty in switching job I apply most of job lyk for Walmart, Google how time will it take to get mails regarding the interview And also pls pls give some tips to get job soon
First thing is, make sure your resume is well suited for ATS screening for that job description. Then ask for a referral as much as possible. Hunting a job is a long game. Keep trying
Brother which language i should prefer for the dsa. I want to be a ml engineering and also want to go for app development... Your videos are really very helpful keep going 🎉🎉🎉🎉❤❤
Hi, I am a a fresher and will be joining as a Data Engineer. Though I have not studied much for data engineering placements and focused more on full stack. I would like to know what was your journey of transitioning from Data Engineer to AI Engineer, What all stuff is different? What did you need to learn.
AI engineering is 50% same as data engineering. Rest depends on what field of ML you go to. I was in LLMs so apart from basic ML, I had to upskill in LLM application integrations, fine tuning and parameters tuning
@@husler7424 Not as of now. First I will probably go through company training and then talk to seniors to understand exactly what to learn, from companies point of view also. Then I might take up a course
As there are not entry-level internship for data engineers so can you give suggestion about it. I have found every where they ask for experience level only.plz reply ❤🙏🙏
Thank you for watching ❤ let's talk here if you have thoughts or questions!
@jashradia Sir can u make a vedio of roadmap to become data engineer by defining the tools that are in hipe becuase there is too many tools available
@@white8254 I have a video on this: ua-cam.com/video/u2kBe9tbUsI/v-deo.html
That's why jash radha is best on youtube for data engineering thanks a lot
Very informative video once again!! Most organizations are not following these practices and just rely on static doc ( that doesn't explain much) and assumptions.
This will take data pipelines to a whole new level and make it easy for the newcomers to understand.
I'll try to push this idea to my organization.
Yess. Glad it was helpful
Thanks for sharing your insights, looking for more in upcoming days
By the way I'm using Apache Airflow and Redshift for my data engineering tasks.
That's good. Both of them have many tools to enable data lineage and Metadata!
Great Video for Data Engineers, thank you Jash 😊
Pleasure! 😁
Very Informative , Thanks for the video
Thanks for watching 😄
Great video...can you share more on this like blog, book suggestion or any practical guidance on this.
Thank you, the best place to get started would be through documentation of some of these tools mentioned. I have added some document link and blogs etc in the description.
Great Work ✌🏻 Very informative 👏🏼
Thank you 😁
Very interesting. Could you throw some more light on how the data pipelines are integrated with the data lineage workflows?
Thank you! I did find veey interesting video on this with a demo that can help you get started: ua-cam.com/video/rO3BPqUtWrI/v-deo.htmlsi=mO7czONV9_7tLiw4
@JashRadia thank you
Why did you resign from Google?
Hello sir
I'm in pre final year thinking of learning data engineering.
Should I learn data engineering how is the future of de in future (in terms of jobs)?
Definitely one of the most secure domains of tech! All the best 😊
Underrated content
Jash is there internships available for college students who dont know much about data engineering but are aspiring to be a data engineer so what will be your guidence on this
Yes. Just like any other SWE roles, data engineering roles also require and often have openings for freshers.
Very informative
Thank you!
Hey Jash, as a full-stack developer, I have more than 5 years of experience. Now, I want to learn data engineering too. Is it possible to change domains now? Because my relevant experience might not be considered much when I try to find a data engineering job, isn't it? Please give me your suggestion. Thanks.
Yes, data engineering is also a part of software engineering. You will find a lot of overlap for sure. All the best!
Thank you @JashRadia so much for answering my question! Your explanation was really helpful. Keep up the great work!🥰
Heyy Jash!
I recently got to know about data science technologies and concepts which directed me to your channel and I wanted to know that how one should approach to any professional positions like (ML engg, Data engg etc.) from their 3rd year of graduate. I am in my 3rd year of CSE and I would like to know your answer on this one.
Hi, first of all, for any data role (ML or data eng etc) prerequisites are data modeling, data warehousing, sql and programming (python) once you have that, upskill in the area of your choice. Be it ML or distributed compute etc. This should be enough for you to land a job in this field.
Hi Jash,
I am Sanket currently working as Web designer and looking to take a path in Data Engineer.
So is it okay to go with data Engineering?
As I will be a fresher in data Engineering are companies hiring data engineer as fresher?
Yes, data engineers also have freshers. They are ones who know more SQL along with normal programming
Hi bhaiya, i want to switch to DE and want to join a course for the same. Can you plz suggest me any course for it which covers basic to advance?
See my roadmap on this channel
@@JashRadia there are many. Can you plz share the link?
@@husler7424 there is only one. Roadmap.
@@JashRadia As there are not entry-level internship for data engineers so can you give suggestion about it. I have found every where they ask for experience level only.plz reply ❤🙏🙏
Hey Jash
Thanks for another amazing video.
I’d like to knw ur views abt the future of Data Engineering.
Some ppl are saying that DE can be automated in the near future bcz of AI/ML automation, while othrs believe tht DE will become more important due to AI needing quality data continuously for training.
Which argument is correct?
Ur reply would be very helpful for ppl like me who are trying to switch into DE.
Thanks❤️
Both viewpoints about the future of Data Engineering have their merits. On one hand, advancements in AI and ML are making some tasks in Data Engineering more automated. Tools are being developed to handle repetitive tasks like data cleaning and integration more efficiently.
On the other hand, as AI and ML become more advanced, the need for high-quality data is growing. Data Engineering will remain crucial because ensuring data is accurate, consistent, and well-structured is essential for training effective AI models.
So, while some routine tasks in Data Engineering might get automated, the overall importance of the role will likely increase. For anyone looking to switch into Data Engineering, it’s a field with a lot of potential and evolving opportunities.
@@JashRadia Hey man, thanks alot for taking time to give an depth answer. I really appreciate that.
Just one more follow-up question:
You mentioned that data engineering will remain crucial and that's wht I believe too.
I'm keen to know which tools or aspects of DE you think will remain crucial in future too.
Additionally, what new and upcoming opportunities or tasks are emerging that data engineers can look forward to?
Like in GenAi, Ai or Machine Learning.
Sorry for the late response😅
@@shubhamguptaherehi shubham, how are you going to switch into this DE field? Are you going to join any courses? I'm alike you.
@@husler7424 I'm following the roadmap that Jash provided-it's the best one available on the internet. I'm also working on some projects tht will help me transition into a DE.
@@JashRadia Hey Jash, could you please respond to my last question? I know you are very busy, but if you have a moment, I would really appreciate it🥺
Where I learn Datawhare housing and projects.if you answer it's helpful for me.
Checkout the book definitive guide to data modelling by kimball
@@JashRadia it's covers datawhare house right?
Hi bro, Thanks for the vedio i have 3 yrs of experience in data engineering but really facing difficulty in switching job
I apply most of job lyk for Walmart, Google how time will it take to get mails regarding the interview
And also pls pls give some tips to get job soon
First thing is, make sure your resume is well suited for ATS screening for that job description. Then ask for a referral as much as possible. Hunting a job is a long game. Keep trying
@@JashRadia thanks😀
Brother which language i should prefer for the dsa.
I want to be a ml engineering and also want to go for app development...
Your videos are really very helpful keep going 🎉🎉🎉🎉❤❤
A good insection between MLE and App development is hard to find. Python and Go can be good options. And thanks 😊
@@JashRadia thanks a lot brother, it means a lot
brother why not c++ or the java
@@JashRadiapls tell in a bit of detail. It's a request
@@hemadevi7106 c++ while is the fastest to execute, it isn't used in ML. Java is fairly complicated to learn compared to Python or Golang
Hi, I am a a fresher and will be joining as a Data Engineer. Though I have not studied much for data engineering placements and focused more on full stack. I would like to know what was your journey of transitioning from Data Engineer to AI Engineer, What all stuff is different? What did you need to learn.
AI engineering is 50% same as data engineering. Rest depends on what field of ML you go to. I was in LLMs so apart from basic ML, I had to upskill in LLM application integrations, fine tuning and parameters tuning
@@JashRadiaplz reply to my comment 🙏🙏
Hi Shlok, how are you planning to start DE? Are you joining any course?
@@husler7424 Not as of now. First I will probably go through company training and then talk to seniors to understand exactly what to learn, from companies point of view also. Then I might take up a course
But you can see Jash's Data Engineer Roadmap video, he provides a good resource there.
I/O
As there are not entry-level internship for data engineers so can you give suggestion about it. I have found every where they ask for experience level only.plz reply ❤🙏🙏
There are entry level internships. Just search for swe roles in data teams