Thank you for 10K subscribers! Publishing this video to answer a HOT FAQ everyone is asking 😄 Fill out this form to register for FREE Webinars and Masterclasses on all aspects of Data Engineering: form.typeform.com/to/KjIpcqS3 9 Month Post Graduation program in Data Engineering: bit.ly/3Hw9TQW Watch the entire video for special surprise and comment if you're interested down below! 😊
I think ChatGPT will take some Data Engineering jobs too. However, I believe that data engineers will still have plenty of work, such as securing or administering access to data warehouses and protecting them from being stolen by AI bots.
Keep growing...you are indeed providing quality content so 10K subscribers is just a stepping stone. I wish you Good Luck for your 100K subscribers by June2023. I will send my positive vibes to you so that you can see this count by June 2023.
I really appreciate your videos - I've been watching them all after your 'Harsh Reality' video! They're very clear and to the point, no time wasted while being very educational :) I'm sure the next 10k subs will come quick!
@@JashRadia How to get rid of Masturbation urges?? How can i get a entry level data or Automation testing job using python in less time or a Freelance niche skill to earn atleast 30000 rs so that i can get married soon and satisfy my sexual urges. I am 30 with 7 yrs career GAP with a graduation in Btech IT from a tier 3 college with no coding experience all due to no practice and that due to my masturbation addiction from childhood 😢 i know the only way out from this situation is marriage then i can focus on learning coding with Python or javascript to get a tech role at a company or just freelance so i right now i need that 20-30k rs to get married Sir its a completely irrelevant, sinful, weird, bizarre, crazy question to ask to a man of substance like you but right now I'm in Robot mode thinking in terms of precise calculated decision to uplift my life at 30 at this dire uncomfortable situation and just think about upskilling profoundly to then fulfill my dream of either cracking a company job or a remote job or hust freelance to finally be financially free. I think you may share your thoughts and opinion on this but i should not waste your time yet you're free to respond me extensively and briefly btw here it is, is it trying to get job roles like Python tester/Automation which requires programming skills or SAP or Scrum master or ETL roles or a standalone PowerBi or Tableau role without the need to learn Data analyst or Data engineering role, same as yours or Hustling harder than ever for a Frontend web dev role which is in the verge to dismantled by no code, Low code tools and specifically GPT and Gemini, or Devops which is complex or Call centre BPO jobs which requires to have a good command over English or any Non tech role, tell me please which one or any other worthy easy mentions to earn 20-30k per month so that i can marry so that bang someone satiating my urges and then take a Backend development bootcamp, learn Golang or Java or Typescript may be along with DSA and Leetcode and systems design questions to finally crack my SWE role or a Remote freelance role.... Help SIR😢😢😢🙏🙏🙏🙏
Hi Jash, Can you make a video on projects on data engineering on real-time batch processing, Like how to think, decide the topics and from where to take reference, That will a great help. Your video is really helping me out, Thank you.
Hey Jash, love your Data Engineering videos! I have ~5+ years of experience in one of the Big 4s. In recent years, I've been part of some great Data/Reporting related work, which rekindled the fire I had for all things Data. So much so, that I'm planning to steer my career towards it. Would love to connect with you, as I'm confident I have much to learn from you, and that you might be able to guide me further (Google Pune seems like a nice target for a Punekar like me😄). Apart from your knowledge, I find something about your videos/you very relatable as well. Do let me know if I'm lucky enough! Thanks!
Hi Jash Radia, I am From Nepal 🇳🇵. A 19 y/o boy having a curiosity to learn Data Science. Can you make a video on the courses that are available online for data science step-by-step. If you can !! It means a lot to us ❤
hello sir your content was very good for aspiring data engineers ......but i request you to make a video on road map to becoming data engineering and challenges they face in their journey, for those who is from non- IT + tier 3 college like me , in brief so that most of the students will be benefitted thank you
Jash if we direct learn cloud data engineering means if we become azure data engineer so in future will there be any problem because we didn't learn traditional data engineering like Hadoop hive etc and don't have experience on traditional data engineering so it will have in problem in future or we need traditional data engineering ?
Not at all. I am also weak in traditional concepts of Hadoop. Have never worked on real life Hadoop projects. Hive also I have only used as a metastore not as a compute layer. So you'll be just fine.
Thanks for making this video, Jash. As somebody looking to enter the DE profession in 2023, the impact of ChatGPT and its forthcoming iterations + competitors (Google/Azure) is obviously a matter for concern. Now, let's watch the video!!
@@JashRadia thanks, it was a really good video, Jash, loved it! The video has confirmed what I suspected; that ChatGPT is primarily (a pretty amazing!) tool to increase productivity. At this time, it in no way appears to be a threat to developers' jobs, i would agree. It definitely has its limitations.
Hi Sir, Congratulations 🎊 on 10k+ subscribers, Hope you reach 1 Million subscribers super soon. I'm currently working on DBT, Snowflake, Fivetran, Airflow. Could you please inform how's the scope/demand for this tech stack in the Data Engineering market. Could I get a good job based on these skills? Or Do I need to upskill myself with Spark and other technologies. Thank You! God Bless You!
Thank you! You can 100% get a job easily if you are good with tech stack you mentioned. However learning spark will give you that extra boost so I recommend it! All the best 😊
Data Engineering is the process of collecting data and making it available for analysis. In Data Engineering, data is stored in different formats and their storage locations are identified. This field also makes sure that the data is stored in a manner that is easy to access and retrieve. Data Management on the other hand is the process of organizing the data into a single format. So, it can be easily accessed by the users. It also ensures that the data is stored in a manner that allows for easier retrieval and handling of the data by users. A lot of times, data engineers also end up doing data management.
Companies hire round the clock throughout the year. There is no one hiring season. Make sure you create a job alert on LinkedIn rather than following a static list of companies. Just add your position and location preference there.
Congrats for 10k subscribers. Jash I am watching ur every single video I am highly passionate to become DE but I knoww the roadmap but still I am unable plz help me
I would like to connect with you regarding career choice and ways to boost up in Data engineering with my particular case. Looking forward to your response.. ✌️🤞
I can but that video will be too technical and involves a lot of work. Because I can't show exactly what I am working on so I have to create a big dummy project 😅 but thanks for suggestion. I'll give it a shot if I have bandwidth!
Hi Jash! Congratulations for 10k subscribers. Iam Suneel ,I graduated in civil engineering in 2018.I want to switch to software field as a fullstack developer. Did fullstack developers need any data engineering skills?
Yes and no. You do need SQL skills, system design concepts and cloud skills but not so much of distributed computing skills or data pipeline design. Docker, containers are also common for SWE and DE. So a lot of tech stack is same but a lot is different as well! You will also need more focus on APIs and connecting UI with backend.
Check out my roadmap video. It might help gain the skills. Apart from this focus on the business aspect no matter what domain you work in! Hope it helps 😊
Yes, it will replace most of data engineering section in near future. People who have their other specialty will obtain powerful performance ability instead by using AI technology.
Hi Jash i have one question i am trying to move to Data engineering after 5 year in testing, but i have worked in python and while searching for courses i came to know that Java and Scala have more scope , is it true??? Or can I continue with data engineering with python only . Can you please help
@@JashRadia Thank you, actually came across one course when i asked instructor if they have any python course he told me that Java and Scala have good scope compared to python. Thank you for your reply
We'll have to wait an see. But I wouldn't hold my breath 🤷♂️ As I said, real scale projects are wayyy complicated. Yes it will improve but will it replace actual engineers? Unlikely.. also ChatGPT is an AI. Remember that they also need Data Engineers and Data scientists to train ChatGPT. If we have too many such models, people will be engineering AI 😊
Hi @jashRadia, Thanks, for the video, clearly describes short comings of AI, which can't replace humans. I have also watched Video "data engineer certification", in which you have described right path for certification. I have filled out the form though the link provided in desc. To give brief about me, I have started my career as SQL DBA, I am support engineer and I have been learning Azure, Big data (Apache spark, spark SQL, Hadoop environment), IoT, coding in Java/Python/some Scala from last 4-5 years. However, I been accumulating knowledge with some paid course, and free stuff online. I feel it's not fulfilling. I work in small IT firm (start up )in Bangalore also, I am left back, struggling to become an data engineer. I think this because I need guide/guru, someone like to you, to help me to become proper Data engineer. Hope you consider me for one of lucky pick for learning. Thank you. Also, Thanks for providing right info through your videos.
Not by a long shot. These AIs are unable to replace simple customer call center support people after years. Forget about replacing way more complex and technical data engineering. It can only help us do our jobs better. You literally took the opposite message from what I wanted to give on the video 😅
Thank you for 10K subscribers! Publishing this video to answer a HOT FAQ everyone is asking 😄
Fill out this form to register for FREE Webinars and Masterclasses on all aspects of Data Engineering: form.typeform.com/to/KjIpcqS3
9 Month Post Graduation program in Data Engineering: bit.ly/3Hw9TQW
Watch the entire video for special surprise and comment if you're interested down below! 😊
Congratulations 🥳 🎉🎉
I think ChatGPT will take some Data Engineering jobs too. However, I believe that data engineers will still have plenty of work, such as securing or administering access to data warehouses and protecting them from being stolen by AI bots.
True
Keep growing...you are indeed providing quality content so 10K subscribers is just a stepping stone. I wish you Good Luck for your 100K subscribers by June2023. I will send my positive vibes to you so that you can see this count by June 2023.
Thank you so much! Really appreciate your support 🫡
Homie cracked a smile while reading the sponsored part 😂
"Happy life" 🤷♂️😅
I really appreciate your videos - I've been watching them all after your 'Harsh Reality' video! They're very clear and to the point, no time wasted while being very educational :) I'm sure the next 10k subs will come quick!
Thank you so much! 😁
Hey Jash, great video! Loving the Liverpool kit here from Liverpool,England
Thanks 😁 #YNWA! 2017-18 was one of my favourite seasons. Hence the kit!
Superb 🎉 Congratulations on 10K & tons of best wishes that your channel keeps on growing with your amazing content...✨️
Thank you 😊❤️
@@JashRadia How to get rid of Masturbation urges?? How can i get a entry level data or Automation testing job using python in less time or a Freelance niche skill to earn atleast 30000 rs so that i can get married soon and satisfy my sexual urges. I am 30 with 7 yrs career GAP with a graduation in Btech IT from a tier 3 college with no coding experience all due to no practice and that due to my masturbation addiction from childhood 😢 i know the only way out from this situation is marriage then i can focus on learning coding with Python or javascript to get a tech role at a company or just freelance so i right now i need that 20-30k rs to get married Sir its a completely irrelevant, sinful, weird, bizarre, crazy question to ask to a man of substance like you but right now I'm in Robot mode thinking in terms of precise calculated decision to uplift my life at 30 at this dire uncomfortable situation and just think about upskilling profoundly to then fulfill my dream of either cracking a company job or a remote job or hust freelance to finally be financially free.
I think you may share your thoughts and opinion on this but i should not waste your time yet you're free to respond me extensively and briefly btw here it is, is it trying to get job roles like Python tester/Automation which requires programming skills or SAP or Scrum master or ETL roles or a standalone PowerBi or Tableau role without the need to learn Data analyst or Data engineering role, same as yours or Hustling harder than ever for a Frontend web dev role which is in the verge to dismantled by no code, Low code tools and specifically GPT and Gemini, or Devops which is complex or Call centre BPO jobs which requires to have a good command over English or any Non tech role, tell me please which one or any other worthy easy mentions to earn 20-30k per month so that i can marry so that bang someone satiating my urges and then take a Backend development bootcamp, learn Golang or Java or Typescript may be along with DSA and Leetcode and systems design questions to finally crack my SWE role or a Remote freelance role.... Help SIR😢😢😢🙏🙏🙏🙏
Hi Jash, Can you make a video on projects on data engineering on real-time batch processing, Like how to think, decide the topics and from where to take reference, That will a great help. Your video is really helping me out, Thank you.
Thanks for the suggestion. I'll keep this in backlog 😊
@@JashRadia , Please that will help a lot.
Congratulations for 10k jash
Thank you! You guys made it all possible 😊
Hey Jash, love your Data Engineering videos! I have ~5+ years of experience in one of the Big 4s. In recent years, I've been part of some great Data/Reporting related work, which rekindled the fire I had for all things Data. So much so, that I'm planning to steer my career towards it.
Would love to connect with you, as I'm confident I have much to learn from you, and that you might be able to guide me further (Google Pune seems like a nice target for a Punekar like me😄). Apart from your knowledge, I find something about your videos/you very relatable as well.
Do let me know if I'm lucky enough! Thanks!
Sure I'll let you know! Thank you for supporting the channel 😊
Congratulations on 10k brother❤❤❤
Thank you Kunal bhai 😁❤️
Hi Jash Radia, I am From Nepal 🇳🇵. A 19 y/o boy having a curiosity to learn Data Science. Can you make a video on the courses that are available online for data science step-by-step. If you can !! It means a lot to us ❤
Congratulations on 10k🎉
Thank you! 😊
Thanks
hello sir your content was very good for aspiring data engineers ......but i request you to make a video on road map to becoming data engineering and challenges they face in their journey, for those who is from non- IT + tier 3 college like me , in brief so that most of the students will be benefitted thank you
The roadmap video is already there on the channel. Are you looking for something else?
Congratulations sir for 10k
Thank you!
Jash if we direct learn cloud data engineering means if we become azure data engineer so in future will there be any problem because we didn't learn traditional data engineering like Hadoop hive etc and don't have experience on traditional data engineering so it will have in problem in future or we need traditional data engineering ?
Not at all. I am also weak in traditional concepts of Hadoop. Have never worked on real life Hadoop projects. Hive also I have only used as a metastore not as a compute layer. So you'll be just fine.
Thanks for making this video, Jash. As somebody looking to enter the DE profession in 2023, the impact of ChatGPT and its forthcoming iterations + competitors (Google/Azure) is obviously a matter for concern. Now, let's watch the video!!
Definitely! Hope you like it! 😊
@@JashRadia thanks, it was a really good video, Jash, loved it! The video has confirmed what I suspected; that ChatGPT is primarily (a pretty amazing!) tool to increase productivity. At this time, it in no way appears to be a threat to developers' jobs, i would agree. It definitely has its limitations.
This makes the roadmap for beginners longer, as does the other advances in tech. Are CS courses going to become 5-6 year courses?
This will always be there in DE. More things to learn and evolve over time.
Hi Sir,
Congratulations 🎊 on 10k+ subscribers, Hope you reach 1 Million subscribers super soon.
I'm currently working on DBT, Snowflake, Fivetran, Airflow. Could you please inform how's the scope/demand for this tech stack in the Data Engineering market. Could I get a good job based on these skills? Or Do I need to upskill myself with Spark and other technologies.
Thank You!
God Bless You!
Thank you! You can 100% get a job easily if you are good with tech stack you mentioned. However learning spark will give you that extra boost so I recommend it! All the best 😊
@@JashRadia Okay Sir, Thank you so much for your kind help and response.
God Bless You!
Jash hello
Can you explain to what is the difference between Data Engineering and Data Management ?
Data Engineering is the process of collecting data and making it available for analysis. In Data Engineering, data is stored in different formats and their storage locations are identified. This field also makes sure that the data is stored in a manner that is easy to access and retrieve.
Data Management on the other hand is the process of organizing the data into a single format. So, it can be easily accessed by the users. It also ensures that the data is stored in a manner that allows for easier retrieval and handling of the data by users.
A lot of times, data engineers also end up doing data management.
Sir as a fresher data engineer, may u please tell which companies hires and when
Companies hire round the clock throughout the year. There is no one hiring season. Make sure you create a job alert on LinkedIn rather than following a static list of companies. Just add your position and location preference there.
@@JashRadia sir many companies don't hires freshers DE. What would u suggest regarding this !
@@shivendusrivastava3608 maybe apply for data analyst job postings first, get some experience and then progress on to DE?
Make a video on DE beginner to intermediate projects
Thanks for suggestion!
Very good suggestion, I want that too
Congrats for 10k subscribers. Jash I am watching ur every single video I am highly passionate to become DE but I knoww the roadmap but still I am unable plz help me
Hi Anushka, I'll try to connect with you 1:1 if possible. Will keep you updated! Thanks for supporting the channel
Surely ai will not replace data engineers but i think it has potential to reduce number of jobs opening in data engineering in future
Yep surely.
Congratulations sir🎉🎉
Thank you sir 😁
Big fan of you sir. 💐💐
You are awesome! Thanks for supporting the channel 😊
I would like to connect with you regarding career choice and ways to boost up in Data engineering with my particular case. Looking forward to your response.. ✌️🤞
Thanks for interest! Will let you know 😊
@@JashRadia sure, please let me know if you required my email ID 😄
Which glasses do you wear sir, any specs. And how do you take care of your eyes, please answer it in detail for the practices you follow.
Frame is Carrera and I have crizal lens. I don't really have a routine to take care of my eyes. That reminds me, I need one 😅
@@JashRadia The glasses have a tint, I am intrigued by the purpose of it.
@@su-pq9ts it's photochromatic. Turns kinda into sunglasses under the sun
Hello Jash, you have said that this a very small project. Can you give real case/problem in your real life as DE ? Thank you
I can but that video will be too technical and involves a lot of work. Because I can't show exactly what I am working on so I have to create a big dummy project 😅 but thanks for suggestion. I'll give it a shot if I have bandwidth!
Hi Jash!
Congratulations for 10k subscribers. Iam Suneel ,I graduated in civil engineering in 2018.I want to switch to software field as a fullstack developer.
Did fullstack developers need any data engineering skills?
Yes and no. You do need SQL skills, system design concepts and cloud skills but not so much of distributed computing skills or data pipeline design. Docker, containers are also common for SWE and DE. So a lot of tech stack is same but a lot is different as well! You will also need more focus on APIs and connecting UI with backend.
@@JashRadia thanks for the reply
Please suggest, how to good data engineer
Check out my roadmap video. It might help gain the skills. Apart from this focus on the business aspect no matter what domain you work in! Hope it helps 😊
Yes, it will replace most of data engineering section in near future. People who have their other specialty will obtain powerful performance ability instead by using AI technology.
Hi Jash i have one question i am trying to move to Data engineering after 5 year in testing, but i have worked in python and while searching for courses i came to know that Java and Scala have more scope , is it true??? Or can I continue with data engineering with python only . Can you please help
I personally think all are equally good. I myself am comfortable with Python. Not with Java or Scala.
@@JashRadia Thank you, actually came across one course when i asked instructor if they have any python course he told me that Java and Scala have good scope compared to python.
Thank you for your reply
But right now it is not able but in future it can be because ai learn through data so these questions are helping chat-gpt i think
We'll have to wait an see. But I wouldn't hold my breath 🤷♂️ As I said, real scale projects are wayyy complicated. Yes it will improve but will it replace actual engineers? Unlikely.. also ChatGPT is an AI. Remember that they also need Data Engineers and Data scientists to train ChatGPT. If we have too many such models, people will be engineering AI 😊
@@JashRadia engineering ai ? ,🤔
@@Nick-du9ss Humans created ChatGPT. So there was a team of DEs and DSs involved. For engineering these AI tools, you need engineers iykwim.
Okay it is confirmed here it is a #YNWA haha
Hi @jashRadia, Thanks, for the video, clearly describes short comings of AI, which can't replace humans. I have also watched Video "data engineer certification", in which you have described right path for certification. I have filled out the form though the link provided in desc. To give brief about me, I have started my career as SQL DBA, I am support engineer and I have been learning Azure, Big data (Apache spark, spark SQL, Hadoop environment), IoT, coding in Java/Python/some Scala from last 4-5 years. However, I been accumulating knowledge with some paid course, and free stuff online. I feel it's not fulfilling. I work in small IT firm (start up )in Bangalore also, I am left back, struggling to become an data engineer. I think this because I need guide/guru, someone like to you, to help me to become proper Data engineer. Hope you consider me for one of lucky pick for learning. Thank you. Also, Thanks for providing right info through your videos.
Thanks Ramesh for supporting the channel. I will soon let you know if you are selected for the mentoring session.
So in short, Data Engineering has it's days numbered
Not by a long shot. These AIs are unable to replace simple customer call center support people after years. Forget about replacing way more complex and technical data engineering. It can only help us do our jobs better. You literally took the opposite message from what I wanted to give on the video 😅
@@JashRadia lol that's what I got that in 20 years, when ChatGPT is no longer a baby. I mean ChatGPT is in diapers now, not even a toddler.
Then, Chat GPT can’t eat Data Engineers Job, I’m safe 😋
For the next 5 years. Definitely! Although not so sure about what happens after 10 years 😅🤷♂️