@thedatatech I too have a similar question as this guy. Is there a need to learn other tools that those are included in this video to be able to call myself a beginner in data engineering?
Hello Sir, Just a Question that is this course enough to start my carrer in Data Engineering if I have the basic knowledge of SQL and ETL. And if not please suggest me a course of yours or others so that I can Learn everything and Enter into Data Engineering field.
You are really a hero for data engineer aspirants. I being an ETL Tester, always had an overview about data engineering. Trust me!! all my bits and pieces of knowledge got a direction for which I was struggling from so many days. Hat's off to you generous work. Thankyou so much for sharing your insights and knowledge to such depth. 🙏😇
Amazing content for Data Engineers! It's packed with super useful stuff. Big thanks to the creator for making learning data engineering so much easier. Highly recommend it if you're into this field! 👍👍
On the story in mapReduce video at 3:38:10. Yes, Hadoop is not dead, but it is facing increasing competition from newer technologies. Hadoop is still a popular choice for big data processing, but it is not the only option anymore. HDFS is replaced with Cloud object storage like Aamazon S3, Azure Blob Storage, and Google Cloud Storage, Data lakehouses. Hive has better alternatices like spark, impala, presto, Athena, BigQuery. Oozie is replaced with Airflow, prefect. The base for all these new technologies is hadoop that's why learning about hadoop is important.
Goutham bro really hats offs to you bro ... because your teacher skill is far better than my big data College professor.....it's very easy to grasping the concept on your teaching way....big fan bro 💯
Geniuses still exist. You are one amazing teaching. Concepts well explained with real-life examples. I find it extremely easy to understand every bit of explanation you make. This is by far the best course to get started with. Thank you @The Data Tech
Thanks bro for this Video, I am a Tester with 7 years experience now looking for an upgrade in my career. I am following your course hoping for the right result, Thank you once again
Thank your very much for this big big course its amazing work. I have a question, I want to create a real time project for sentiment analysis and I want to use live stream data from different resources, the question is wich technologies will be good for this project such as I have knowledge in python.
Hi. Is there anyway to practice on multinode cluster for spark and hdfs. And do you think is it really necessary for practicing purpose. Any help is much appreciated. Please give reasons ss well. Thanks
Thank You so much for the detailed video. While installing hive when i started the hive server it is showing no current connection. I tried all usernames and passwords. Also after entering correct password it’s showing an impersonation error. Could you please help in this.
I am in testing (selenium with java) with 7 year of experience Thinking of switching to data engineer? I like to work on java basic of sql linux basic knowledge It will be a qood idea to move this way ?
bhaiya i have learnt devops and also made devops projects ,now i want to learn aws data enginnering ,so should i learn aws big data tools first or should i first start your playlist. i am in confusion .
Hi Gautham, Its very good and detail videos for Bigdata Hadoop. Thanks for all you efforts. can you upload the video for installing VM in windows 10. Thanks
Hey man, i followed this quick tutorial ua-cam.com/video/Q0Na0f1NtpA/v-deo.html to install the VM and then went back to Gowtham's hadoop single node tutorial. It worked pretty fine.
if zoopkeeper are following leader follower method.why spark master are not following that.If the master spark is following leader follower.There is no need of zoopkeeper right?
Big Data represents the huge quantity and variety of data and the problems faced to process the data or information to get the desired result. Whereas data engineering is a process or method or a way to solve the problem which we face due to this data. In simple terms, different ingredients in huge quantity for a dish is big data the process of cooking that dish to get the desired dish is data engineering.
Hi sir, thank you for uploading this valuable learning. I have a question sir. I have worked with the basic pyspark on databricks like joins or basic data modification and iam good with machine learning with python. I was interviewed by some company and they said that they can hold my position for 15 days and i should get a certification for Apache Spark. And luckily i saw your playlist. I have all time for 15 days. So will i be able to attend s certification exam if i complete your 2 parts on this?
Thanks Bro for an Amazing explanation that too free! I am referring your videos and preparing for transition from data analytics to data engineering. Having 2yrs experience in DA Can you please give me tips and suggestions for my transition. Also pls provide your LinkedIn :)
Can someone confirm if this course is suitable for data engineer beginner. I recently completed python and sql and was looking for spark playlist is it appropriate?
Resource Links has been added and updated
I am from a non tech background and working in support. Can I learn Data engineering from this alone or do I need to add something else also ?
@thedatatech I too have a similar question as this guy. Is there a need to learn other tools that those are included in this video to be able to call myself a beginner in data engineering?
Hello Sir, Just a Question that is this course enough to start my carrer in Data Engineering if I have the basic knowledge of SQL and ETL. And if not please suggest me a course of yours or others so that I can Learn everything and Enter into Data Engineering field.
hi bro can you make videos on databricks
You are really a hero for data engineer aspirants. I being an ETL Tester, always had an overview about data engineering. Trust me!! all my bits and pieces of knowledge got a direction for which I was struggling from so many days. Hat's off to you generous work. Thankyou so much for sharing your insights and knowledge to such depth. 🙏😇
Amazing content for Data Engineers! It's packed with super useful stuff. Big thanks to the creator for making learning data engineering so much easier. Highly recommend it if you're into this field! 👍👍
On the story in mapReduce video at 3:38:10. Yes, Hadoop is not dead, but it is facing increasing competition from newer technologies. Hadoop is still a popular choice for big data processing, but it is not the only option anymore. HDFS is replaced with Cloud object storage like Aamazon S3, Azure Blob Storage, and Google Cloud Storage, Data lakehouses. Hive has better alternatices like spark, impala, presto, Athena, BigQuery. Oozie is replaced with Airflow, prefect. The base for all these new technologies is hadoop that's why learning about hadoop is important.
Need end to end real time big data engineering projects involving all tech stack like AWS,python and no sql DB
definitely, soon will upload the videos
Goutham bro really hats offs to you bro ... because your teacher skill is far better than my big data College professor.....it's very easy to grasping the concept on your teaching way....big fan bro 💯
Geniuses still exist.
You are one amazing teaching.
Concepts well explained with real-life examples.
I find it extremely easy to understand every bit of explanation you make.
This is by far the best course to get started with. Thank you @The Data Tech
Thanks Gowtham brother for bringing up this video that is even free for the community ❤. This will be very helpful in my Bigdata career path.
From datadots till here, it's really nice to see good content on big data technologies..
Thank you a lot. I am at the beginning of my career and this full course is tremendously helpful.
Such a wonderful way of explaining things. I genuinely appreciate your content. Glad YT recommended such quality stuff.
Glad you enjoy it!
Great content, Unparalleled way of explanation.....thank you
Thk u so much brother. I learned big data through your videos only.please upload real time project. It will help us to crack the interview easily.
Thanks bro for this Video, I am a Tester with 7 years experience now looking for an upgrade in my career.
I am following your course hoping for the right result, Thank you once again
Did you complete this course? How effective it is ?
Thank you so much for your contribution. Helping me a lot.
This is really good stuff....😀 it will be really helpful for aspirants like me Thanks for enlightening us with the knowledge. Keep going 👏
It's my pleasure
Thanks a lot. Blessed to have you.
Thanks a lot brother,this will help a lot of people..👍👍
So nice of you
@@thedatatechbro plz make end to end projects to add in resume ❤ and guide more videos how to prepare for interviews
Thanks a lot Gowtham bro for this video, looking forward for sample DE project videos
I liked the content so far and still following your video. Could you please help with the resources links
Very nice video, please prepare videos on PySpark end to end project as well. Badly needed!!
What is the configuration required to setup single node hadoop setup?
Please help
Thanks. I am a senior java dev
The session and content on Hadoop are awesome! could you please share the installation steps that we have in notepad?
You are a champp man!. You are a hero man!. Thank you so so so so so much to you. Sending you lots of blessings. God bless you!
😊🙌❤️❤️❤️
Hi bro, all the videos regarding Bigdata are very clear and understandable. Can you make a lecture on "python required for Big Data Engineer"?
Hello, What projects do you suggest I add to my resume? For fresher?
Thanks bro for this amazing concept with detail and crystal clear
Thank your very much for this big big course its amazing work.
I have a question, I want to create a real time project for sentiment analysis and I want to use live stream data from different resources, the question is wich technologies will be good for this project such as I have knowledge in python.
Hi. Is there anyway to practice on multinode cluster for spark and hdfs. And do you think is it really necessary for practicing purpose. Any help is much appreciated. Please give reasons ss well. Thanks
excellent content...sir can you please teach kafka and flint with a complete project on it and make a industry level spark project pleasee
Thanks!
Thank you so much for this . But it would be more helpful if we have some practical hands on with theory
Bro, Your a lifesaver!
Looking forward to complete it!
Thank You so much for the detailed video. While installing hive when i started the hive server it is showing no current connection. I tried all usernames and passwords. Also after entering correct password it’s showing an impersonation error. Could you please help in this.
Amazing content sir. Thank you
Great boss,but you might split into 15 min clips.
I need to save this masterpiece for when i reach this part of my learning journey, cant lose this gem
Thank you ❤️ 😊
Will you add advance course or projects?
Thank you so much for the amazing content, subscribed and liked ✌✌🙌🙌👌👌👍👍👏👏👌👌
Very nice explanation bro ❤
Thank you very much for this course
well I am starting it today, wish me luck
How the hashing algorithm formula works for string datatype column can you please help me with the query
I am in testing (selenium with java) with 7 year of experience
Thinking of switching to data engineer?
I like to work on java basic of sql linux basic knowledge
It will be a qood idea to move this way ?
Grate video on UA-cam ❤
Dear Thambhi, ne vera level yaa!!!
bhaiya i have learnt devops and also made devops projects ,now i want to learn aws data enginnering ,so should i learn aws big data tools first or should i first start your playlist. i am in confusion .
I am just Msc mathematical candidate without IT background. Can I learn this successfully?
Do you have a full course for beginners??
Hey Gowtham, is Scoop and DBeaver have same usecase?
Is this helpful for data science course? Can i start .. and in this session .. spark lession ar also there ?
Thanks bro for bringing this amazing content 🎉🎉🎉
Great Content..!
Please upload the installation and configuration commands soon so that we can practice. Thank you!
pls find Code Link - codewithgowtham.blogspot.com/2023/09/spark-rdd-boot-camp.html
Thanks for the awesome content...but any update on resources?
shouldn't replication factor be greater than or equal to 1? In the video you mentioned that it could be 0 so just wanted to confirm
Hi Gautham, Its very good and detail videos for Bigdata Hadoop. Thanks for all you efforts. can you upload the video for installing VM in windows 10. Thanks
Hey man, i followed this quick tutorial ua-cam.com/video/Q0Na0f1NtpA/v-deo.html to install the VM and then went back to Gowtham's hadoop single node tutorial. It worked pretty fine.
if zoopkeeper are following leader follower method.why spark master are not following that.If the master spark is following leader follower.There is no need of zoopkeeper right?
Asa a fresher is it useful for me to learn this
Hi Gowtham can you share the document which you used setting up Hadoop at 2.50.00 timestamp.Thank you for the videos .They were really amazing.
What is the difference between data engineering and big data ????
Same question ❓
Big Data represents the huge quantity and variety of data and the problems faced to process the data or information to get the desired result. Whereas data engineering is a process or method or a way to solve the problem which we face due to this data. In simple terms, different ingredients in huge quantity for a dish is big data the process of cooking that dish to get the desired dish is data engineering.
+1
why 5 virtual machines do you want for hadoop?
Can u please do video on Index and views using hive??
Bro ,do you have have any paid course like end to end of big data course from start to end which follows particular circulam
For Big Data Engineer will they ask DSA ?
Great content. Thanks a lot.🙏
Is there any playlist or videos on datalakes??
Wow I’m glad I discovered this
Thank you all the efforts.
Our pleasure!
what are prerequisites of this course???
My PC configuration is not soo good it has 4GB Ram, 2.79GHz Processor, 320GB Harddisk, so is there any other way to practice practical stuff...
Hi sir, thank you for uploading this valuable learning.
I have a question sir. I have worked with the basic pyspark on databricks like joins or basic data modification and iam good with machine learning with python. I was interviewed by some company and they said that they can hold my position for 15 days and i should get a certification for Apache Spark. And luckily i saw your playlist. I have all time for 15 days. So will i be able to attend s certification exam if i complete your 2 parts on this?
Could you please extend this contact for data scientist job position?
Thanks Bro for an Amazing explanation that too free!
I am referring your videos and preparing for transition from data analytics to data engineering.
Having 2yrs experience in DA
Can you please give me tips and suggestions for my transition.
Also pls provide your LinkedIn :)
Sir which programing are you using in this course
Any prerequisites for this video?
hello sir I have 2yrs of exp in etl and 3yrs of gap want to start my career back with big data need your guidance
Can you suggest me How can I complete one project on bigdata
in which programming language do we have this course in ??
Python or scala???
Big fan of your work !!
Thank you so much 😀
Please Make a Video on Snowflake Dara Engineer.
From Source to destination With any ETL TOOL
Yes please ....... Looking forward
Where is the separate playlist for Hive & Sparks.
I am beginner in data engineer
I want to start from scratch how much will these two parts will help me
Part 1,Part 2
Yeah dude me too was a beginner and he is teaching from scratch
Hi..can you upload video on sqoop please.
Do you give personal training also
is data structure is important for data engineer
Thanks for sharing
Hi gowtham bro, can u share me notes, codes, technology tools which are used in company or for cv
Make videos on dad science for beginners to advanced
do we need to know etl as a Data engineer??
Just subscribed and Liked The Video after seeing 27:05-31:02
Great Boss..... keep upload videos.any training giving seperate please provide contact details i will contact you.
Great. thank you 👍
sir is hbase dependent n hdfs for storage of data in distributed fashion?
yes you are correct
bro god bless you and your family man , do you have paid classes also somewhere?? please reply if you see this msg.
Thank you so much and wish u the same , currently i don't have any paid course
please do bigdata videos on windows
Is this a course for big data analyst?
please start a real time project in spark and azure.
Can someone confirm if this course is suitable for data engineer beginner. I recently completed python and sql and was looking for spark playlist is it appropriate?
Yes