You might not need that always. But some times it is possible that you might need to consume a Rest API service from your spark or mapreduce or udf , and in that case it is advised to have a knowledge of Rest API too. We would be including it in our Scala session soon on how to work with the rest API.
Great videos. but don't you think Hadoop is outdated now and in upcoming years, I guess now we should learn and move towards modern data stack like: Cloud datawarehouse, Spark, cloud etl tools, airflow and many more. IMO make more videos on the real time issues and experiences, that you have handled in the projects, this will really help us all.
Hadoop has been the backbone of the technologies for many years. I Believe you still need to understand all these to master data engineering even if you are not going to implement it at your job. Real-time issues are something that cannot be generalized and they are varieties hence we do not make those.
[𝗩𝗶𝗱𝗲𝗼 𝗖𝗼𝗻𝘁𝗲𝗻𝘁]
00:00 Intro
00:17 MapReduce
13:22 Understanding MapReduce beyond code
26:37 Outro
thanks Great video.
Great
Hi sir IS Rest API knowledge and it's implementation also required for Data Engineering and if yes Then in your Course have you covered Rest API ❔
You might not need that always. But some times it is possible that you might need to consume a Rest API service from your spark or mapreduce or udf , and in that case it is advised to have a knowledge of Rest API too.
We would be including it in our Scala session soon on how to work with the rest API.
Great videos. but don't you think Hadoop is outdated now and in upcoming years, I guess now we should learn and move towards modern data stack like: Cloud datawarehouse, Spark, cloud etl tools, airflow and many more.
IMO make more videos on the real time issues and experiences, that you have handled in the projects, this will really help us all.
Hadoop has been the backbone of the technologies for many years.
I Believe you still need to understand all these to master data engineering even if you are not going to implement it at your job.
Real-time issues are something that cannot be generalized and they are varieties hence we do not make those.