Top 5 FREE Resources to 10X Your Data Engineering Skills
Вставка
- Опубліковано 24 чер 2024
- Here is the FREE version of Data Engineering roadmap in which you will level up your data engineering skills by learning Cloud, Spark, System Design, Snowflake and more!
For 1:1 mentoring sessions: topmate.io/jash_radia
Follow me here:
LinkedIn: / jashradia
Instagram: / jash.radia
Resources mentioned in the video:
Cloud and Data Engineering: cloud.google.com/learn/traini...
System Design, Data Modeling, Spark: github.com/letthedataconfess/...
Projects: www.knowledgehut.com/blog/dat...
Additional Platforms (Databricks):
(original Databricks link is not somehow working in UA-cam description. Just search for customer-academy.databricks)
Additional Platforms (Snowflake): / driving-maximum-result...
Full Data Engineering Roadmap Video: • God Tier Data Engineer...
Happy Learning!
0:00 About the Resources
1:13 Cloud and Data Engineering
4:03 System Design, Data Modeling, Spark
5:37 Projects
9:13 Additional Platforms
Hope these free resources help you level up your Data Engineering game ❤ Let's discuss your thoughts or questions here!
@JashRadia brother Is GCP Data engineering learnign path course just a 30 day trail or can I finish in as many days as I want?
Excellent communication, useful resources, right to the point but not simplified. Top tier content right here!!🎉
Thank you 😁
Finally a video came out after a long wait. Please do a video once in a week. Thank you for the content
I am aiming for once in 2-3 weeks for now and then gradually improve the frequency. The issue is I rarely get time to do this, but thank you for supporting the channel! :D
Such talk's helps a lot in shaping the career, Thanks for the content.
Thank you for the advice and sources on this one.
Exactly what I was looking for, thank you so much!!
Great communication with Great content. Very useful video Jash. 👍🏽
Thank you! 😀
Sir keep such sort of videos coming waited so long for such quality content! Thankyou
Sure, thanks for watching! 😁
@@JashRadiaplease upload detailed tutorial for bigquery,dataproc,dataflow,gcs etc.
Precious information..
Thank you so much
Excellent content, thanks for posting it. Could you please make a video on how to build a data engineer resume for big companies like Google?
Started going through the GCP courses, it really helped me understand cloud concepts + data engineering in the cloud.
Awesome to know! All the best 🙂
From where you are learning GCP data engg?
If I will become a DE this year! This video must be the reason of that!
Enlightening 👏🏼👏🏼 Very well explained 👌🏻
Glad you liked it 😊
This is a great video about DE for beginners like me😜. I have been studying on DE for last 2 months. And I am curious about what type work we need to do in a company and how they will use our skill to their growth? If you have enough time Please make a video on that. Thank you in advance 🙏
Thanks for sharing the resources.
My pleasure!
Fantastic and to the point presentation. 😊
Thank you ❤️
Great resources for learning, thanks for sharing....
My pleasure!
Hello Jash!!
I hope you are doing well.
Can you please share on what Topics/ concept should we focused more from a freshers point of view.
Thank you
Great content from great man on youtube thanks a lot for sharing this 😊
Glad you enjoyed it thanks! 🙏
Very helpful , Thanks a lot Jash Bhaiyya🙌💯
You're welcome 😊
Very insightful video! Can’t wait to upskill myself using these 😀
You got this!
Just owo, excellent resources, thanks for sharing resources
No problem! Thanks for watching 🫡
Hello jash thanks a lot for valuable information I have 7 years of experience in big data as Hadoop admin also worked on azure cloud n aws cloud in my career. Could you please suggest which skill is helpful for me to grow in career data engineer or ML engineer or AI engineer. If I go with the ML/AI eng will it requires coding knowledge in depth. Kindly suggest. Thank you
That was accurate>>
Thank you very much❤
You're welcome 😊
Hello Jash..
I am targeting data engineer role. I have aws solutions architect associate certification. Lack good grasp over python and sql.
Shall I focus on python, sql first or go for aws data engineer associate and databricks cert?
@Jash, i have 10+ yrs of exp and wanted to carrier transition in Data engineering, advise me which one is best between Azure DE or Snowflake DE?
I want to be jr. DBA and how to get place i learnt sql and excel
Hi Jash, thanks for making this video. Can you please make a roadmap for AI Engineer and related field.
Thanks for the suggestion and support. I'll keep this in mind 😊
@@JashRadia also if possible create a roadmap for cracking data jobs at google, I am a data engineer too since 3 years 😀
@@kartikgarg5652 there is no separate roadmap for Google. If you're a good DE, you can get hired anywhere! 😃
Hi Jash, I have 1 year of devops experience and I wish to look adding more skills to it. I wonder whether going for ML engineer or Data Engineer would be better transition as I want better quality of life than Devops engineer who gets call anytime during night to fix things and want to utilise my knowledge of K8s, AWS etc as well. I am open to learning new stuff but I am confused what to go towards. Can you help me on this?
Devops usually have expertise in setting up infra. So I'd say data engineer is closer to devops than MLE. However, if you like the Ops part of devops, then MLOps is a great option, too!
hi ,
i am preparing for project trainee position in snowflake they are expecting me to be aware of snowpark to can you tell me which topics i shoud cover in snowpark as a project trainee
Snowpark is a relatively small topic if you already know spark, if you don't I suggest reading about PySpark, and then follow along the documentation about SnowPark in snowflake docs.
Can you recommend like most imp chapters for DDIA and Kimball’s Toolkit? Going through whole books might not be feasible for everyone.
That's a great question. For the data modelling book, go through the first 2 chapters and then 17+ chapters. Chapters in between have case studies for different industries. If you're applying for a company related to inventory management, then go through the inventory chapter for example.
For designing data intensive application, I can't discard any chapter since all of them are super important but it's a relatively quicker read. Hope this helps!
Thanks for the suggestion, this helps! :)
I'm gonna learn data engineering for a data science role ... I have completed Datascience now i just need hadoop,spark,pyspark, databricks & azure ... How many months could it take ... I spend at least 10 hours a day to learn & do projects without even attending college ... Can you give me a rough estimate
Wow 10 hours a day is a lot! I don't think you'd need more than 3 months to be really good at all the foundational skills required to be a DE. All the best!
Hey Jash, I'm a business analyst and I have learnt Hadoop,hive,pyspark,airflow,python, DSA and have done a project in which etl task is performed on the dataset from kaggle using airflow, can you please help me if I'm proceeding in the right direction to become a data engineer
Yes, all the skills you mentioned are data engineering specific. I wouldn't worry too much about Hadoop and hive but rest of the things are spot on! All the best.
Also add cloud platform knowledge
@@JashRadia Thank you Jash!!
Hello Jash, I have been following you for a while its really inspiring. I am quite curious about data engineering but from my research I got to know that companies mostly hires seniors for data engineering positions. After seeing your LinkedIn profile I came to know that you got into data engineering straight out of college so how did you do that ?, how did you prepared for data engineering positions ?, was the placement on campus or off campus asking this because generally on campus companies hire for software engineering positions. I would appreciate if you replied. Thank you.
The best place to get a data engineering job as a fresher is in consulting industry. Most of the tech roles you apply at companies like ZS, Deloitte, KPMG, Astria, etc are DE focused. They may have different names like technology associate, cloud engineer etc but all of them work mostly on DE related skills and that's a great place to get started.
There are also small companies like Nobroker, who allow freshers in the DE roles. Ultimately, not all data roles needs experience. Entry level roles needs SQL, python, data model knowledge over everything else.
@@JashRadia Thank you soo much for your insights into the industry
I am a beginner learning from scratch. I recently watched your video of road map to become a data engineer. I started with sql ,python and linux and then next to the level 2… and so on. Currently im in level 1. I am spending at least 8-10 hours a day. How much time it may take for me to get familiar with everything and be able to sit in a interview with good knowledge.
8-10 hours a day is a lot. With this much time consistently, I think 3 months are enough to gain all the foundational skills. (Not considering optional skills like docker, etc) that should be enough to give interviews. All the best!
@@JashRadia thank you soo much jash .keep posting videos and keep guiding.
Itna time spend upsc ke liye krta to ias bann jata secure job
@@tejas4054 if in UPSC i would have a chance to get end less opportunities and unlimited attempts like in IT, i might do that in first place.
@@sharikhirfaan9045 bhai 10 hour bol rha hai ye youtuber daily study ke liye tum itna upsc ke liye ya फिर तुम्हारे state गवर्नमेंट ke liye dete toh definitely bann jate bhai aacha hi hai na private ke gulaami se
hey bro can u please tell me is DSA required for Data engineering
Yes, it is. Most product companies have DSA round. You must be comfortable in solving leetcode medium.
give also list for paid resources sir! Thank you for your content.
It's in the link. You can check my data engineering roadmap video for it.. Glad you liked it! 😊
can you please tell me how to learn python for snowflake data engineering iam strugling learn the python
i appreciate if you provide any resource
Learnpython.org and leetcode
Is data engineering relevant with Advent of AI ?
Yes. Even more so now.
Sir, Apache Kafka and Apache Airflow are important for data engineers
This is not the entire roadmap. Check my roadmap video I mentioned for that. This only contains free resources for learning data engineering
Bhai suggest some best paid courses in india for data engineering ....example like some institues or BITS pilani online course
I won't be suggesting those because I only believe in recommending things I have personally experienced so I can back my recommendation. Hope it makes sense!
Please make a roadmap for ai with resources.
In gcp data engineer course for handson it is asking for credits.. any idea how can we bypass that
I recommend creating a free tier account that also gives you around 300 credits on GCP. And then do hands on there instead of directly in the lab.
@@JashRadia as per your suggestion tried creating free account but after payment it is giving unsuccessful prompt. I have tried with different payment modes on different google account but no luck. Could not able to start gcp free tier. please suggest some solution
Bro is masters required to get job in data engineering or date science
No for data engineering. For data science, yes it does help if you don't have any data experience. If you have data analytics or engineering experience, you don't need masters for DS then
Can we become all three: a data engineer, a data scientist, and a data analyst?
No. Even if we can, I don't recommend this. There's no point in being a unicorn. It's much better to develop deep expertise on a specialized area
@@JashRadia ok thank you sir
What's the difference between data engineering and database engineering
Data engineers focus on the big picture of data infrastructure, building and maintaining the systems that enable data-driven decision-making.
Database engineers focus on the details of specific databases, ensuring they are optimized for performance, security, and scalability...
First one needs Strong programming skills, experience with ETL tools, knowledge of distributed systems.
The latter one needs Deep knowledge of SQL, database design, administration, and performance tuning.
@@JashRadia thank you
The GCP learning path is not free it needs GCP credits to complete the labs hence it needs some sort of subscription
You can follow the lab in your own free tier GCP account. Code and everything else can be copied.
Apart from that, when you sign up, you get 350$ worth of credits
@@JashRadia oh right thanks !
I don't want to be jobless
What?
Are you gujju by any chance?
Yes 💯
Thank you for Content .
Thanks for watching 🫡